How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
This is a written reference for designing, building and operating production AI systems, aimed at engineers who work with large language models. It is organized as chapters, worked case studies and interview-preparation material rather than as installable software. The central topics are tool-using LLM agents, retrieval-augmented generation, cost and model selection, evaluation and observability, and security and compliance, with explicit trade-offs among latency, cost, accuracy and safety. The agent material covers control loops such as ReAct and plan-and-execute, graph-based orchestration,
This project is a command-line utility designed to monitor and analyze token consumption and financial expenditure for AI coding assistants. By parsing local session logs directly on the user's machine, it provides a privacy-focused way to track development activity without transmitting sensitive data to external servers. The tool distinguishes itself through its ability to aggregate disparate log formats from multiple coding assistants into a unified, schema-agnostic representation. It features a decoupled pricing engine that allows users to apply custom model-specific cost multipliers, over
ruby_llm is an LLM integration framework and AI agent orchestrator designed to connect applications to multiple large language model providers through a unified interface. It serves as a toolkit for building autonomous assistants with custom personas, managing structured output via JSON schemas, and implementing vector embedding engines for semantic search. The project distinguishes itself as an observability suite and multimodal toolkit. It provides specialized capabilities for tracking token usage, calculating model costs, and tracing workflows via OpenTelemetry, while supporting the proces
OmniRoute is a unified LLM API gateway that connects multiple AI providers to a single endpoint. Its primary purpose is to simplify the integration of various AI models into tools and agents by translating different provider formats into a standardized API. The project distinguishes itself through a multi-strategy request routing system that optimizes for cost, speed, and availability, including automatic model fallbacks and a circuit-breaker resilience model to isolate provider failures. It employs a local-first security posture, using AES-256-GCM encryption to store API keys and conversatio
models.dev is a directory and intelligence system for large language models that provides a standardized catalog of technical specifications, provider mappings, and pricing data. It serves as a central index for model metadata, including context windows, output limits, and release dates.
The main features of anomalyco/models.dev are: LLM Model Catalogs, Capability Indices, Unified Model Catalogs, Provider Mappings, Language Model Directories, LLM Capability Indices, LLM Cost Management, Provider Directories.
Projects with overlapping indexed features include: ombharatiya/ai-system-design-guide — This is a written reference for designing, building and operating production AI systems, aimed at engineers who work… ryoppippi/ccusage — This project is a command-line utility designed to monitor and analyze token consumption and financial expenditure for… crmne/ruby_llm — ruby_llm is an LLM integration framework and AI agent orchestrator designed to connect applications to multiple large… diegosouzapw/omniroute — OmniRoute is a unified LLM API gateway that connects multiple AI providers to a single endpoint. Its primary purpose… cheahjs/free-llm-api-resources — This project is a community-driven repository that serves as a directory for artificial intelligence providers… pheralb/svgl.