awesome-repositories.com
Blog
MCP
awesome-repositories.com

Entdecke die besten Open-Source-Repositories mit KI-gestützter Suche.

EntdeckenKuratierte SuchenOpen-Source-AlternativenSelf-hosted SoftwareBlogSitemap
ProjektMCP-ServerÜber unsRanking-MethodikPresse
RechtlichesDatenschutzAGB
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

4 Repos

Awesome GitHub RepositoriesAsynchronous Model Execution

Support for non-blocking LLM requests to enable concurrent task processing and improved performance.

Distinguishing note: Focuses on the concurrency model of LLM interactions, distinct from general task orchestration.

Explore 4 awesome GitHub repositories matching artificial intelligence & ml · Asynchronous Model Execution. Refine with filters or upvote what's useful.

Awesome Asynchronous Model Execution GitHub Repositories

Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
  • crewaiinc/crewaiAvatar von crewAIInc

    crewAIInc/crewAI

    53,687Auf GitHub ansehen↗

    CrewAI is a multi-agent orchestration framework designed for building autonomous systems that execute complex, multi-step workflows. It provides a development platform where specialized agents are defined with specific roles, goals, and tool sets to perform tasks collaboratively. By leveraging a declarative workflow engine, the system manages task dependencies, state transitions, and execution logic, allowing for the creation of structured, stateful sequences of operations. The framework distinguishes itself through its hierarchical management capabilities, which utilize manager agents to coo

    CrewAI runs non-blocking requests to improve performance and concurrency when executing multiple operations in parallel.

    Pythonagentsaiai-agents
    Auf GitHub ansehen↗53,687
  • memorilabs/memoriAvatar von MemoriLabs

    MemoriLabs/Memori

    15,358Auf GitHub ansehen↗

    Memori is an AI agent memory middleware platform designed to provide persistent, context-aware recall for language models. It functions as a non-intrusive layer that intercepts outbound model requests to automatically capture interaction history and execution traces, ensuring that agents maintain continuity across sessions without requiring modifications to existing application logic. The platform distinguishes itself through a dual-model storage architecture that maintains information as both structured relational primitives for precise fact retrieval and rolling narrative summaries for situ

    Supports non-blocking LLM requests to enable concurrent task processing and memory persistence.

    Pythonagentaiaiagent
    Auf GitHub ansehen↗15,358
  • 567-labs/instructorAvatar von 567-labs

    567-labs/instructor

    13,176Auf GitHub ansehen↗

    Instructor is a framework designed for structured data extraction, validation, and language model integration. It functions as a library that transforms unstructured text into validated, type-safe objects by leveraging schema definitions and model-specific tool-calling capabilities. By acting as a validation middleware, the project ensures that language model outputs strictly conform to defined data structures. The library distinguishes itself through a robust validation-based retry loop that automatically re-submits failed responses with error feedback to iteratively correct schema complianc

    Provides non-blocking execution of extraction tasks to maintain high throughput and application responsiveness.

    Pythonopenaiopenai-function-calliopenai-functions
    Auf GitHub ansehen↗13,176
  • pipecat-ai/pipecatAvatar von pipecat-ai

    pipecat-ai/pipecat

    12,846Auf GitHub ansehen↗

    Pipecat is a framework and software development kit for building real-time multimodal AI agents and speech-to-speech systems. It utilizes a frame-based data pipeline to route audio, video, and text through a modular sequence of processors, enabling the orchestration of low-latency conversational AI. The project is distinguished by its ability to coordinate complex multimodal services, including speech-to-text, language models, and text-to-speech, within a single pipeline. It features semantic voice activity detection for natural turn-taking, state-machine conversation flows for dialogue manag

    Implements a non-blocking execution loop for handling model-initiated function calls and external tool execution.

    Pythonaichatbot-frameworkchatbots
    Auf GitHub ansehen↗12,846
  1. Home
  2. Artificial Intelligence & ML
  3. Asynchronous Model Execution

Unter-Tags erkunden

  • Hybrid Request HandlersComponents that support both blocking and non-blocking execution modes for model interactions. **Distinct from Asynchronous Model Execution:** Distinct from Asynchronous Model Execution: focuses on the dual-mode capability rather than purely asynchronous patterns.