Awesome GitHub RepositoriesAI Query Routing

localGPT is a private AI knowledge base and retrieval-augmented generation application. It provides a local document indexer, a hybrid search engine, and an inference interface to enable chatting with private documents and managing a self-hosted information repository without sending data to external servers. The system distinguishes itself through a dual-pass verification pipeline that ensures generated answers are grounded in retrieved sources, accompanied by explicit source attribution. It employs a hybrid retrieval approach combining semantic vector search with keyword matching and rerank

Redis is a high-performance in-memory key-value store that functions as a distributed cache, message broker, and NoSQL database. It provides sub-millisecond read and write access to data stored in RAM and can operate as a vector database for indexing high-dimensional embeddings. The system supports a wide range of data storage and synchronization primitives, including the management of strings, hashes, lists, sets, and JSON documents. It enables real-time data operations through atomic transactions, hybrid persistence using snapshots and append-only logs, and high-availability configurations

Manifest is a language model provider unification system that standardizes access to multiple AI backends through a single interface. It functions as a centralized management layer for integrating various cloud-based and local model providers to simplify how applications request completions. The system provides intelligent model routing and high availability infrastructure by directing queries based on complexity and automatically triggering model fallbacks when a primary provider fails. It distinguishes itself through multi-tenant AI management, organizing agents into isolated groups with de

Promptbase este un framework de prompt engineering conceput pentru proiectarea, testarea și optimizarea prompt-urilor pentru modele de limbaj mari. Oferă un sistem pentru măsurarea acurateței și performanței modelului printr-un toolkit de evaluare care compară output-urile cu seturi de date de referință (ground-truth). Proiectul include, de asemenea, un pipeline de orchestrare pentru automatizarea sarcinilor de machine learning multi-component pe endpoint-uri bazate pe cloud și un utilitar pentru pregătirea seturilor de date de tip retrieval-augmented generation. Framework-ul se distinge prin optimizarea avansată a calității răspunsului, utilizând generatoare de tip „chain-of-thought” pentru a produce pași de raționament intermediari și preluarea dinamică a exemplelor „few-shot” folosind căutarea semantică bazată pe embedding. Implementează metode de ansamblu pentru a crește acuratețea predictivă, folosind rutarea interogărilor bazată pe complexitate și agregarea prin vot majoritar a mai multor variații de modele. Sistemul acoperă capabilități mai largi în gestionarea datelor și automatizare, inclusiv formatarea datelor externe în fișiere structurate pentru antrenare și orchestrarea pipeline-urilor de execuție a modelelor prin utilitare de linie de comandă.

how2 is a terminal-based tool that translates plain-English questions into shell commands using AI and StackOverflow data. It functions as a command-line interface where users describe what they want to do in natural language, and the tool returns the appropriate Unix shell or PowerShell command, with support for generating multi-line Bash scripts from natural language prompts. The tool distinguishes itself through its interactive answer browsing mode, which lets users select and copy from multiple StackOverflow answers directly in the terminal. It includes a fallback search mechanism that qu