3 repository-uri
Implementing failure isolation patterns for external AI model and embedding API calls.
Distinct from Circuit Breaking States: Distinct from Circuit Breaking States: applies the pattern specifically to external AI provider connectivity and exponential backoff.
Explore 3 awesome GitHub repositories matching software engineering & architecture · Provider Circuit Breakers. Refine with filters or upvote what's useful.
OmniRoute is a unified LLM API gateway that connects multiple AI providers to a single endpoint. Its primary purpose is to simplify the integration of various AI models into tools and agents by translating different provider formats into a standardized API. The project distinguishes itself through a multi-strategy request routing system that optimizes for cost, speed, and availability, including automatic model fallbacks and a circuit-breaker resilience model to isolate provider failures. It employs a local-first security posture, using AES-256-GCM encryption to store API keys and conversatio
Implements failure isolation for external AI provider calls using circuit breakers to allow for service recovery.
OpenViking is a multi-tenant context server and knowledge base administration system designed to provide AI agents with persistent long-term memory. It enables the indexing of diverse documents and codebases to support retrieval-augmented generation, allowing agents to recall past interactions, user preferences, and learned experiences across sessions. The project is distinguished by its use of a URI-based virtual filesystem to organize memories, resources, and skills. It implements a tiered context loading system that balances retrieval precision with token budgets by structuring data into a
Prevents system failure by pausing provider calls during consecutive errors and employing exponential backoff.
This platform is a self-hosted knowledge management system designed for interacting with documents through natural language. It functions as a retrieval-augmented generation engine, allowing users to upload files and query them using large language models. The system provides a unified interface for document-based chat, ensuring that responses are grounded in the source material through specific citations. The platform distinguishes itself through a multi-tenant architecture that enforces strict data isolation between users and organizations. It features a flexible AI gateway that standardize
Implements failure isolation and automatic retries for external AI API calls to maintain system reliability.