Awesome GitHub RepositoriesChat Model Interfaces

LangChain is an orchestration framework designed for building, managing, and deploying applications powered by large language models. It provides a unified integration layer that normalizes disparate model provider APIs into a consistent set of primitives, enabling developers to build complex, multi-step AI workflows that manage state, memory, and tool execution. The project distinguishes itself through a durable execution runtime that maintains persistent state across long-running processes by checkpointing progress to external storage. It models agent workflows as directed graphs, allowing

Ktransformers is a comprehensive framework designed for the operation, fine-tuning, and serving of large language models. It functions as a heterogeneous inference engine and quantized execution runtime, enabling the deployment of massive models by distributing computational workloads across both CPU and GPU resources. This architecture allows users to bypass local memory constraints, making it possible to run and train models that exceed the capacity of a single device. The project distinguishes itself through specialized support for sparse architectures, particularly mixture-of-experts mode

Mistral Inference is a library for running Mistral large language models on a GPU, generating text from prompts with token streaming. It loads pretrained model weights from local disk or a remote registry into GPU memory, then produces output tokens one by one for real-time display in interactive applications. The library supports multimodal prompts that accept image URLs alongside text, enabling visual description and reasoning. It includes content safety guardrails that scan generated text against predefined policies to block or flag policy violations. For structured interactions, it provid

MiniCPM is a collection of small language models designed for local, on-device deployment in resource-constrained environments. The project focuses on running dense Transformer models on consumer hardware, including GPUs, CPUs, and Apple Silicon, without requiring custom code forks. The project distinguishes itself through heavy optimization for edge hardware, utilizing quantized weight compression in GGUF and MLX formats to reduce memory overhead. It implements advanced inference techniques such as speculative sampling and radix-tree prefix caching to accelerate generation speed and throughp

CopilotForXcode is an AI-powered coding assistant integrated directly into Xcode as a source editor extension. It functions as an agent that can automate multi-step project tasks, such as editing files, running terminal commands, and searching across the entire codebase, all while understanding the full context of the current Xcode project. The assistant provides a context-aware chat interface that answers coding questions based on open files, symbols, and recent edits. It also offers diff-based code review, analyzing changes to provide feedback on code quality and potential issues before mer

CodeCompanion is a Neovim plugin that brings large language model capabilities directly into the editor, enabling turn-based conversations with AI models in a dedicated chat buffer. It provides a comprehensive interface for interacting with LLMs, supporting multiple providers through a flexible adapter system that can route requests to various hosted or local language model services. The plugin distinguishes itself through its extensive context-sharing capabilities, allowing users to send buffer contents, visual selections, git diffs, LSP diagnostics, terminal output, quickfix lists, and view

freegpt-webui est une interface web auto-hébergée pour interagir avec des grands modèles de langage. Il fournit un frontend basé sur le chat conçu pour communiquer avec les modèles GPT 3.5 et GPT 4. L'application permet un chat sans clé API, permettant aux utilisateurs d'accéder à l'IA conversationnelle pour la génération de texte et la récupération d'informations sans fournir ou gérer de clés d'authentification personnelles. Le système gère l'intégration des modèles via une passerelle de proxy inverse et prend en charge le traitement de flux asynchrone pour la génération de texte en temps réel. Les préférences utilisateur et l'historique des conversations sont persistés via le stockage de session côté client.

AIOS is an LLM agent operating system and orchestration kernel designed to manage memory, resource scheduling, and tool execution for multiple autonomous AI agents. It serves as a comprehensive framework for developing and deploying agents, featuring a dedicated resource manager that coordinates model backends, GPU memory, and isolated kernel instances. The system distinguishes itself through a semantic memory engine that uses vector search and autonomous clustering for long-term knowledge management, and a semantic file system that allows users to control computer files and system operations

AICommand est un contrôleur d'éditeur et un outil d'automatisation propulsé par LLM conçu pour l'éditeur Unity. Il intègre des modèles de langage étendus pour traduire des invites en langage naturel en commandes exécutables, permettant aux utilisateurs de manipuler les paramètres et objets de l'environnement de développement via des instructions textuelles. Le système utilise un pipeline texte-vers-action qui emploie un mappage de commandes basé sur LLM et une découverte d'API basée sur la réflexion pour résoudre les entrées en langage naturel en fonctions d'éditeur spécifiques. Ce processus permet l'exécution de fonctions de l'éditeur Unity en résolvant des identifiants de chaîne en handles de code au moment de l'exécution. L'outil fournit une interface de chat intégrée au sein de l'environnement de développement pour capturer les invites de l'utilisateur. Il se concentre sur l'automatisation des tâches répétitives de configuration et sur la rationalisation des flux de travail du moteur de jeu en remplaçant la navigation manuelle dans les menus par un contrôle en langage naturel.

ChatGPT.nvim is an OpenAI LLM Neovim plugin that serves as an AI-powered code assistant for refactoring, completing, and fixing code snippets. It functions as a custom prompt automation tool and a markdown renderer, allowing users to interact with language models directly within the editor. The project distinguishes itself through a framework for defining reusable AI personas and automated text processing tasks using system prompts and templates. It includes a specialized rendering system that transforms responses into styled markdown with foldable code blocks. The plugin covers interactive

Claudian is a framework that combines AI coding agents, knowledge base integration, and a multi-provider orchestrator for managed interactions with large language models. It functions as a browser extension that connects users to AI services through a sidebar and inline editing interface, providing a system for integrating agents into local directories to perform file operations, bash commands, and workspace searches. The project distinguishes itself with a multi-provider orchestrator that allows switching between different AI backends while maintaining separate conversation states and config