Awesome GitHub RepositoriesLLM Token Compression

OmniRoute is a unified LLM API gateway that connects multiple AI providers to a single endpoint. Its primary purpose is to simplify the integration of various AI models into tools and agents by translating different provider formats into a standardized API. The project distinguishes itself through a multi-strategy request routing system that optimizes for cost, speed, and availability, including automatic model fallbacks and a circuit-breaker resilience model to isolate provider failures. It employs a local-first security posture, using AES-256-GCM encryption to store API keys and conversatio

ClawRouter is an AI model router and API gateway designed to classify query complexity and assign prompts to the most efficient model tier. It operates as a multi-model AI proxy that orchestrates traffic between various large language models and AI media generators through a unified interface. The project distinguishes itself by integrating a non-custodial micropayment processor using the x402 protocol. This allows for per-request API access and USDC settlement on Base and Solana chains, replacing static API keys with wallet-based authentication and real-time budget enforcement. The system c

SimpleMem is a persistent memory system for AI assistants designed to maintain context across different user chat sessions. It functions as a memory server and multimodal vector database that stores and retrieves information from text, images, audio, and video. The project features a context compression engine that distills interaction histories into compact units to reduce token consumption. It utilizes a distributed memory orchestrator and worker-thread parallel processing to reduce latency when querying large-scale dialogue datasets. The system implements a hybrid indexing approach combin