Multimodal prompt library

Ell is a Python library that treats prompts as callable functions, transforming a Python function into a language model program where the docstring defines the system message and the return value defines the user message. It provides a framework for writing language model programs that can accept and return images, audio, and text natively within message objects, and supports chaining multiple model calls into a single function for multi-step reasoning or test-time compute. The library decouples model selection from client instantiation through a registry that supports multiple provider backe

This project is a LangChain-based framework for building retrieval-augmented generation systems, autonomous agents, and multimodal chatbots. It functions as an open-source orchestrator that connects local inference engines and online APIs to manage various large language model deployments. The system distinguishes itself by providing specialized interfaces for local knowledge bases, allowing the loading and vectorization of private documents to create context-aware assistants. It also supports multimodal capabilities, enabling the processing of both text and image inputs through vision-capabl

This project is an API proxy that provides free and paid access to ChatGPT models through an OpenAI-compatible endpoint. It acts as a reverse proxy, routing requests to ChatGPT while maintaining full compatibility with OpenAI's SDK interface, allowing any application or tool that supports a custom base URL and API key to connect. The service offers a free tier that provides access to ChatGPT models for chat, image generation, and voice dialogue without requiring an official subscription, along with a paid tier that unlocks over 130 OpenAI models including GPT-4 with lower latency and reduced

CodexMonitor is an AI agent orchestration interface designed for monitoring agentic workflows and managing remote daemon connections. It provides a web-based dashboard for coordinating AI agents across local workspaces and managing the execution of large language model tasks. The system distinguishes itself by integrating AI agents directly into git-based development workflows, synchronizing GitHub issues and pull requests with conversation threads. It uses branch worktree isolation to run tasks in separate physical directory copies, preventing state leakage between concurrent agent activitie

AIClient-2-API is an AI gateway and proxy server that translates diverse large language model interfaces into a single standardized API format. It functions as an OpenAI API compatible proxy and multi-provider orchestrator, allowing a single client to interact with multiple different model backends through a unified interface. The project distinguishes itself by acting as a load balancer that distributes requests across multiple provider accounts using health checks and polling to bypass quota limits. It includes a TLS fingerprint emulator to simulate browser characteristics and prevent API a

CoAI is an enterprise-grade, self-hostable AI gateway platform that unifies access to over 200 AI models from more than 35 providers through a single OpenAI-compatible API endpoint. It functions as a multi-tenant gateway, routing requests across providers with load balancing, automatic failover, and priority-based routing, while exposing standard OpenAI API endpoints for chat, image generation, model listing, and billing to enable seamless integration with existing tools and clients. The platform distinguishes itself through a comprehensive set of operational capabilities built around the gat

This project is a vision language model framework and vision-to-text pipeline designed for deploying and optimizing models that process both images and text. It provides an on-device inference engine and a vision language model framework to run quantized models locally on mobile and desktop hardware accelerators. The framework features a model quantization toolkit to reduce weight precision for lower memory footprints and increased execution speed on specialized silicon. It also includes an efficient vision encoder utilizing a hybrid encoding system to compress image tokens, which reduces pro

Mistral Inference is a library for running Mistral large language models on a GPU, generating text from prompts with token streaming. It loads pretrained model weights from local disk or a remote registry into GPU memory, then produces output tokens one by one for real-time display in interactive applications. The library supports multimodal prompts that accept image URLs alongside text, enabling visual description and reasoning. It includes content safety guardrails that scan generated text against predefined policies to block or flag policy violations. For structured interactions, it provid

Enchanted is a privacy-focused, cross-platform chat frontend for interacting with self-hosted large language models on iOS and macOS. It serves as a native client for communicating with private model servers, specifically providing integration for the Ollama API. The application supports multimodal interactions, allowing users to combine text, image attachments, and voice prompts. It provides tools for local AI model management, including the ability to define persistent system prompts and switch between different models for specific tasks. The interface includes capabilities for rendering m

llama-cpp-python provides a Python interface for the llama.cpp library, enabling the execution of large language models with hardware acceleration. It functions as a GGUF model loader and a structured text generator capable of running inference servers and multimodal runtimes for processing both text and image inputs. The project distinguishes itself through a local inference server that exposes model capabilities via an OpenAI-compatible web API. It supports advanced execution techniques including speculative decoding, weight quantization, and layer-based GPU offloading to manage memory acro

BAML is a prompt engineering framework and LLM client generator that defines AI prompts as type-safe functions. It serves as a structured data extraction tool and workflow orchestrator, transforming unstructured model responses into strongly typed objects using a custom schema language and alignment algorithms. The project distinguishes itself by using a compiler to generate language-specific boilerplate code for API communication and output parsing. It features a dedicated environment for designing complex prompt templates with conditional logic and reusable snippets, and employs genetic alg