How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
This is a written reference for designing, building and operating production AI systems, aimed at engineers who work with large language models. It is organized as chapters, worked case studies and interview-preparation material rather than as installable software. The central topics are tool-using LLM agents, retrieval-augmented generation, cost and model selection, evaluation and observability, and security and compliance, with explicit trade-offs among latency, cost, accuracy and safety. The agent material covers control loops such as ReAct and plan-and-execute, graph-based orchestration,
Switchyard is a Rust library for routing large language model requests. For each request it chooses which model and provider should respond, balancing answer quality, cost, and response time rather than relying on one fixed model. It is aimed at coding assistants and agent harnesses, where it picks the best available model for each step and can show the chosen model in a tool's status line. Routing decisions come from composable strategies. A language model can judge whether a cheaper, more efficient model can handle a task, and that verdict selects the model tier. Execution signals, such as
OpenSquilla is an LLM agent orchestration framework designed to coordinate multi-step AI workflows and tool execution using directed acyclic graphs. It functions as a centralized system for managing specialized skill packages and executing complex reasoning sequences. The project distinguishes itself through a routing gateway that directs tasks to different AI providers based on complexity, cost, and performance. It utilizes a multi-tier AI memory system that organizes working, episodic, and semantic knowledge using local embeddings and SQLite, alongside a secure execution sandbox that isolat
Mission Control is a self-hosted web dashboard that acts as a control plane for autonomous AI coding agents. It lets operators register and monitor a fleet of agents across runtimes, dispatch tasks to them, review their runs, and track token spend, all from one interface backed by role-based access and an audit log. Work reaches agents through priority queues, direct assignment, cron-driven recurring templates, and multi-step pipelines that chain one agent's output into the next. Agents claim the highest-priority task atomically, and completed work can be routed through a quality-review gate
Cascadeflow is a runtime for AI agents that cuts language model spend by trying an inexpensive drafter model first, validating the answer, and escalating to a stronger verifier only when quality falls short. It also works as a budget and policy enforcement layer inside the agent loop, applying spending caps, compliance rules, and allow, switch-model, deny-tool, or stop actions at each step, with an audit trail of the decisions taken. Each call reports the model used, its…
The main features of lemony-ai/cascadeflow are: Model Cascades, Agent Authorization and Budget Controls, Agent Budget Enforcement, Drop-In Gateway Proxies, Cost-Aware Model Routers, Tiered Model Cascades, LLM Operational Cost Optimization, Cost-Quality Model Routing.
Projects with overlapping indexed features include: ombharatiya/ai-system-design-guide — This is a written reference for designing, building and operating production AI systems, aimed at engineers who work… nvidia-nemo/switchyard — Switchyard is a Rust library for routing large language model requests. For each request it chooses which model and… opensquilla/opensquilla — OpenSquilla is an LLM agent orchestration framework designed to coordinate multi-step AI workflows and tool execution… builderz-labs/mission-control — Mission Control is a self-hosted web dashboard that acts as a control plane for autonomous AI coding agents. It lets… copilotkit/openbot — OpenBot is a self-hosted workspace where teams run AI bots as coworkers. Each bot gets its own isolated computer with… maiot-io/zenml — ZenML is an extensible machine learning orchestration framework designed to manage the end-to-end lifecycle of data…