18 个仓库
Automatic retry strategies for failed model inference tasks.
Distinguishing note: Focuses on retrying AI model tasks specifically.
Explore 18 awesome GitHub repositories matching artificial intelligence & ml · Model Task Retries. Refine with filters or upvote what's useful.
Conductor is a durable workflow engine designed to orchestrate complex, long-running business processes and autonomous agent loops. It functions as a stateful execution platform that persists the entire history of a process, ensuring that workflows remain reliable and recoverable across infrastructure failures, system restarts, and transient network errors. By managing task lifecycles, worker polling, and state transitions, it provides a centralized coordination layer for distributed systems. The platform distinguishes itself through its specialized support for AI agent orchestration, allowin
Retries failed model tasks automatically using configurable backoff strategies while preserving workflow state.
This project is a Python framework for building autonomous, event-driven agent systems. It provides a unified runtime for orchestrating multi-agent workflows, managing persistent conversation state, and executing code within secure, isolated sandbox environments. The framework is designed to handle complex task delegation, allowing agents to invoke other agents as tools while maintaining context across multi-turn interactions. The framework distinguishes itself through its deep integration with the Model Context Protocol, enabling agents to connect to external data sources and remote services
Implements retry strategies for failed model requests to improve reliability.
Claude Code is a command-line interface and multi-agent orchestration framework designed for autonomous software engineering. It enables AI agents to perform codebase modifications, debugging, and Git workflow management while coordinating multiple specialized agents to decompose and execute complex engineering tasks in parallel. The system distinguishes itself through a high degree of isolation and safety, utilizing Git worktrees to create independent working directories for concurrent agents and implementing a tiered permission system that combines user rules, project policies, and OS-level
Automatically switches to alternative AI providers when the primary model fails or reaches capacity.
LiveKit is a comprehensive framework for building and orchestrating real-time, multimodal AI agents that interact with users through voice, video, and text. It provides a centralized, event-driven architecture to manage the entire lifecycle of automated participants, from initialization and session state management to graceful shutdown. By utilizing a selective forwarding unit, the platform efficiently routes media streams between participants and agents, ensuring low-latency communication and secure, token-based authentication for all connections. The platform distinguishes itself through it
Defines a sequence of alternative speech or language models to automatically retry requests if the primary service fails or becomes unavailable.
PydanticAI is a Python framework designed for building production-grade autonomous agents. It provides a unified interface for interacting with diverse language models, enabling developers to construct agents that perform complex tasks through structured data validation, tool execution, and multi-turn conversation management. The library centers on type-safe schema enforcement, ensuring that model inputs and outputs remain consistent and reliable throughout the agent's lifecycle. The framework distinguishes itself through a robust architecture that emphasizes modularity and testability. It ut
The framework applies custom validation logic or context-aware checks to model responses, automatically requesting retries if the output fails to meet defined criteria.
Instructor is a schema enforcement and validation library designed to transform language model outputs into structured, type-safe data formats. It functions as a validation layer that uses Pydantic to ensure model responses conform to specific data models, acting as a tool for forcing large language models to return data in predefined schemas. The project differentiates itself through a recursive error-feedback loop that automatically retries requests when structural errors occur, passing validation failure messages back to the model to guide corrections. It also includes a streaming parser c
Automatically retries requests when model outputs fail to conform to the required structural schema.
Instructor is a framework designed for structured data extraction, validation, and language model integration. It functions as a library that transforms unstructured text into validated, type-safe objects by leveraging schema definitions and model-specific tool-calling capabilities. By acting as a validation middleware, the project ensures that language model outputs strictly conform to defined data structures. The library distinguishes itself through a robust validation-based retry loop that automatically re-submits failed responses with error feedback to iteratively correct schema complianc
Automatically re-attempts extraction requests when model outputs fail schema validation.
Eino is an AI agent development kit and LLM application framework designed for building autonomous agents and orchestrating complex language model workflows. It serves as a multi-agent orchestration engine and workflow orchestrator, providing a graph-based execution model to route data between models, tools, and retrievers. The framework distinguishes itself through a robust set of multi-agent coordination patterns, including supervisor-led management, sequential flows, and autonomous reasoning loops like ReAct. It features advanced agent execution controls such as active turn preemption, che
Implements automatic retry strategies and input modification for failed model inference tasks.
OmniRoute is a unified LLM API gateway that connects multiple AI providers to a single endpoint. Its primary purpose is to simplify the integration of various AI models into tools and agents by translating different provider formats into a standardized API. The project distinguishes itself through a multi-strategy request routing system that optimizes for cost, speed, and availability, including automatic model fallbacks and a circuit-breaker resilience model to isolate provider failures. It employs a local-first security posture, using AES-256-GCM encryption to store API keys and conversatio
Automatically switches to alternative AI models when the primary provider fails or hits rate limits.
本项目是一个全面的 Python 编程教育材料合集,包括教程、练习与精选代码示例。它作为一个学习课程与软件工程工具包,利用 Jupyter Notebooks 将可执行代码与描述性教育文本相结合。 该仓库提供了构建大语言模型应用的实践指南,例如检索增强生成(RAG)系统、有状态 AI 代理与机器学习工作流。它通过提供结构化的代理编码工作流脱颖而出,涵盖了上下文窗口蒸馏、与提供商无关的模型路由以及模式强制的结构化输出。 这些材料涵盖了广泛的软件工程能力,包括使用分布式任务队列的异步编程、使用 REST API 的 Web 应用开发以及数据分析工作流。它还包括用于掌握面向对象设计、实现 CI/CD 流水线以及应用专业 Linting 与格式化标准的资源。
Implements logic to automatically switch requests to alternative AI models if the primary provider fails.
Plano is an AI agent orchestrator and LLM gateway proxy that unifies access to multiple AI providers through a single interoperable interface. It functions as a model routing engine that decouples applications from specific vendors using semantic aliases, allowing traffic to be shifted between providers without modifying application code. The system distinguishes itself with intent-based agent routing, which directs prompts to specialized agents based on semantic analysis. It features an interceptor-based filter chain system that acts as guardrail middleware to enforce safety policies, rewrit
The product defines ordered pools of candidate models to allow automatic retries with alternative models upon failure.
Mods is a terminal-based AI client that sends prompts to large language models and streams responses back to the command line. It functions as a multi-provider AI gateway, routing queries to OpenAI, Cohere, Groq, Gemini, and local endpoints, and includes a conversation history manager that saves, caches, branches, and resumes text-based interactions. The tool also operates as a Model Context Protocol client, connecting to external MCP servers via stdio, SSE, or HTTP to extend model capabilities with specialized tools and data. The project distinguishes itself through a config-driven provider
Switch to a configured fallback model when the primary model is unavailable or returns a 404.
AIClient-2-API is an AI gateway and proxy server that translates diverse large language model interfaces into a single standardized API format. It functions as an OpenAI API compatible proxy and multi-provider orchestrator, allowing a single client to interact with multiple different model backends through a unified interface. The project distinguishes itself by acting as a load balancer that distributes requests across multiple provider accounts using health checks and polling to bypass quota limits. It includes a TLS fingerprint emulator to simulate browser characteristics and prevent API a
Automatically switches to alternative AI models or providers when the primary service is unhealthy or returns an error.
Koog is an LLM agent framework used to build autonomous entities that execute tool-based workflows. It utilizes a graph-based workflow engine to define agent behaviors and decision paths as a directed graph of nodes and edges. The framework distinguishes itself through a model provider orchestrator that enables dynamic switching, load balancing, and automatic fallbacks between different AI backends. It implements the Model Context Protocol to connect agents to remote tool servers and features a RAG memory system using vector embeddings to maintain long-term conversation context. The project
Automatically redirects requests to a secondary AI provider when the primary client is unavailable.
Geist is an open-source font family and typography collection designed for high legibility in technical interfaces. It consists of a series of web-optimized typefaces, including geometric sans-serif, monospaced, and pixel styles. The collection functions as a variable font library, utilizing coordinate interpolation to allow precise control over weight and style within a single font file. These fonts are built as OpenType typefaces, incorporating standardized layout tables to define advanced typographic behaviors such as kerning and ligatures. The project provides specific implementations fo
Automatically redirects requests to a sequence of backup models if the primary model is unavailable.
ClawRouter is an AI model router and API gateway designed to classify query complexity and assign prompts to the most efficient model tier. It operates as a multi-model AI proxy that orchestrates traffic between various large language models and AI media generators through a unified interface. The project distinguishes itself by integrating a non-custodial micropayment processor using the x402 protocol. This allows for per-request API access and USDC settlement on Base and Solana chains, replacing static API keys with wallet-based authentication and real-time budget enforcement. The system c
Provides a prioritized chain of alternative models to maintain availability when primary providers return errors.
This Python SDK provides a comprehensive toolkit for synthetic audio generation, voice cloning, and the development of conversational AI agents. It enables the creation of lifelike spoken audio from text, the replication of human voices through custom cloning, and the deployment of real-time voice agents capable of interacting with external large language models. The library distinguishes itself through deep integration of conversational AI capabilities, including the design of agent personas and the execution of real-time actions via APIs. It supports professional-grade audio production thro
Implements mechanisms for automatically switching to alternative AI models when the primary provider fails.
该工具作为模型上下文协议(Model Context Protocol)服务器,连接人工智能模型与本地开发环境。它使 AI 助手能够执行代码库分析、运行命令行工具,并直接对本地项目文件应用自动化代码修改。通过与 Gemini API 集成,该系统促进了外部模型与本地系统资源之间的深度交互。 该项目通过为自动化开发工作流设计的稳健安全和可靠性框架脱颖而出。它强制执行严格的基于路径的访问控制以保护敏感文件,并利用隔离的沙箱环境执行生成的代码。为确保持续运行,该工具实现了动态模型回退路由,在达到使用限制时自动切换模型层级,并采用二级模型判断来验证生成输出的质量。 该系统支持广泛的技术操作,包括从终端输出中提取结构化数据、管理对话历史以及配置长时间运行任务的执行参数。它提供了扫描项目目录、生成技术洞察以及管理上下文窗口以处理大量文档和代码库信息的全面能力。
Maintains service continuity by automatically switching between different artificial intelligence backends when primary model usage limits are exceeded.