Projects sharing features with Gemini Web2api

OmniRoute is a self-hosted AI gateway that puts one OpenAI-compatible endpoint and key in front of many chat, media, search, and local-model providers. It translates each request into the chosen provider's native format and maps the reply back. It is built to serve coding assistants and command-line agents, and it can configure them to send their model traffic through the gateway. It also catalogs free and keyless model tiers and uses them before falling back to paid capacity. Routing and failover are central. Models can be chained into ordered combos with strategies such as priority, round-r

workbuddy2api-hub is a self-hosted gateway that pools several AI coding-assistant accounts, including international, China and Huawei CodeArts editions, behind a single OpenAI-compatible base URL and gateway-issued API keys. Existing OpenAI-style clients and command-line tools can call the pooled accounts through chat completions and Responses endpoints, with streaming and reasoning-chain backfill. Experimental support for Anthropic-style message requests is available as an opt-in option. Accounts are imported through browser sign-in, and the pool rotates quota and fails over automatically wh

Shimmy is a local large language model inference engine and server that loads and serves GGUF formatted weights. It is distributed as a single binary runtime written in Rust, providing a standalone environment for running models without external runtime dependencies. The project utilizes WebGPU for hardware acceleration, allowing model compute kernels to execute across diverse graphics hardware through a standardized interface. It features a local server that implements an OpenAI-compatible API layer, enabling applications to interface with local models via standardized REST endpoints. Memor

RouteLLM is a routing framework and traffic manager designed to direct prompts between high-capability and low-cost large language models. It functions as an API gateway that mimics the OpenAI specification to route requests across different model providers. The system optimizes operational costs by splitting traffic between model tiers based on predicted win rates and prompt complexity. It includes a calibration tool to analyze sample queries and determine the optimal cost-quality tradeoff for traffic distribution. The framework provides a tool for measuring the accuracy and cost efficiency

FastDeploy is a high-performance deployment framework for large language models, vision models, and multimodal models. It provides the infrastructure to launch model services that process combined image, video, and text inputs, exposing these capabilities through a standardized, OpenAI-compatible API for chat and text completions. The project distinguishes itself through advanced inference pipeline engineering and GPU optimization. It employs speculative decoding, tensor parallelism, and a disaggregated execution model that separates prefill and decode phases across different hardware resourc

freellmapi is a self-hosted gateway that combines the free tiers of many language model providers behind one local, OpenAI-compatible endpoint. Applications talk to a single address with a single bearer token, while the router chooses a provider and model for each request and retries on another when one errors or hits its limit. Provider keys are stored encrypted in a local database, and per-key rate limits are tracked against per-minute and per-day ceilings. Beyond the OpenAI-style format for chat, completion, embedding, image, video, and speech requests, the router also accepts Anthropic, G

Bard-API is an asynchronous Python wrapper and client for interacting with Google Gemini. It functions as a stateful conversation manager and multimodal interface, allowing users to send text and image prompts to a language model and retrieve responses. The library utilizes a cookie-based authentication system that extracts session tokens from local browser storage to authorize requests. To manage access and connectivity, it includes proxy-based request routing to bypass regional restrictions and avoid IP blocks. The project covers capabilities for multimodal AI analysis and the maintenance

Describe Anything is a multimodal vision-language framework designed for localized visual analysis and automated dataset annotation. It utilizes a vision-language model to generate detailed, context-aware text descriptions for specific regions within images and videos, triggered by user-defined inputs such as points, boxes, or masks. The system distinguishes itself through its ability to maintain object context across video frames via temporal mask propagation and its support for regional question answering without requiring additional model fine-tuning. It provides an OpenAI-compatible API t

Strata is a native engine for running large language models directly on a personal Windows, Linux, or Mac computer, so chat and coding work happen offline without sending data to a cloud service. It loads compressed GGUF model files at several quantization levels, letting users trade memory use, speed, and answer quality against the hardware they have. Strata runs on NVIDIA, AMD, Intel Arc, and Apple Silicon graphics hardware, with a dedicated backend for each and support for multi-GPU and unified-memory systems. Models too large for available memory can be read from the SSD during inference,

mini-sglang is a collection of tools for large language model inference, serving as an OpenAI-compatible inference server, a memory-efficient prefill engine, and a tensor parallelism runtime. It also functions as a local batch processing engine for offline benchmarking and ablation studies. The project focuses on acceleration and memory management through a KV cache manager that reuses precomputed caches for shared request prefixes. It handles large model workloads by distributing tasks across multiple GPUs and manages peak memory consumption by splitting long input sequences into smaller chu

CTranslate2 is a C++ inference engine and runtime for Transformer models, designed to execute models on both CPU and GPU with optimizations for speed and memory efficiency. It functions as a model format converter, quantization tool, and REST API server, enabling deployment of neural machine translation, automatic speech recognition, and text generation models. The engine distinguishes itself through a suite of runtime optimizations including layer fusion, weight-matrix quantization, batch-by-length grouping, and a caching allocator that reuses GPU memory. It supports tensor-parallel model di

Experiential is an open-source LLM gateway and router. It exposes OpenAI-compatible and Anthropic-compatible APIs in front of hosted models, models reached with your own provider keys, and local models, all under one base URL and one bearer key. Existing OpenAI and Anthropic SDK clients, as well as coding agents, can be pointed at it by changing only the endpoint. The project states that usage carries zero markup. What sets it apart is that routing is learned from your own traffic. It captures traces from desktop coding agents and imports past activity from supported monitoring tools, databas

Fauxpilot is a self-hosted AI coding assistant and local inference server. It functions as a proxy and API gateway that redirects traffic from IDE plugins to a local large language model, allowing for AI-assisted programming without external cloud dependencies. The project provides a specialized API emulation layer that mimics coding assistant protocols and a standardized OpenAI-compatible interface. This enables supported code editors to use local models for completions and suggestions by overriding default proxy URLs. The system includes capabilities for downloading and deploying local mod

This project is an API proxy that provides free and paid access to ChatGPT models through an OpenAI-compatible endpoint. It acts as a reverse proxy, routing requests to ChatGPT while maintaining full compatibility with OpenAI's SDK interface, allowing any application or tool that supports a custom base URL and API key to connect. The service offers a free tier that provides access to ChatGPT models for chat, image generation, and voice dialogue without requiring an official subscription, along with a paid tier that unlocks over 130 OpenAI models including GPT-4 with lower latency and reduced

This project provides a unified server environment and gateway for hosting and executing open-source large language models on private infrastructure. It functions as a standardized interface that exposes locally deployed models through widely-adopted API protocols, allowing existing applications to interact with them without requiring code modifications. The platform distinguishes itself by acting as a compatibility layer that translates standard REST requests into model-specific execution calls. It supports advanced interaction patterns including real-time token streaming, function calling f

gpt4free-ts is a TypeScript-based LLM API proxy and gateway that provides a unified interface for accessing large language models without paid subscriptions or official API keys. It functions as a containerized AI bridge that routes requests to various free third-party providers to retrieve chat completions. The project acts as an OpenAI API wrapper, translating requests and responses into the standard OpenAI chat completions format to ensure compatibility with existing AI tools. It utilizes a provider-based routing system to distribute request loads across available endpoints. The gateway s

KoboldAI-Client is a web-based interface and toolkit for interacting with large language models. It functions as a local AI text generator for storytelling and conversational AI, providing a front end for models hosted either on local hardware or within cloud-provisioned environments. The system includes a persona manager that uses external modules and soft-prompting to guide AI responses toward specific characters and writing styles. It also provides an API wrapper that exposes a standardized, OpenAI-compatible REST API, allowing external applications to communicate with the hosted models.

This project is a Discord bot API gateway that converts bot interfaces into standard RESTful endpoints. It functions as a protocol-translation gateway, allowing programmatic access to language models and tools through an industry-compatible API. The system manages LLM rate limits by distributing incoming requests across a pool of multiple bot accounts to bypass platform throttling and increase overall throughput. It ensures session privacy through multi-user session isolation, mapping individual conversations to dedicated threads to prevent context leakage. The gateway includes capabilities

BAML is a prompt engineering framework and LLM client generator that defines AI prompts as type-safe functions. It serves as a structured data extraction tool and workflow orchestrator, transforming unstructured model responses into strongly typed objects using a custom schema language and alignment algorithms. The project distinguishes itself by using a compiler to generate language-specific boilerplate code for API communication and output parsing. It features a dedicated environment for designing complex prompt templates with conditional logic and reusable snippets, and employs genetic alg

This project is a framework for developing multimodal AI agents that function as programmable participants in real-time communication rooms. It enables the construction of agents that can see, hear, and speak by integrating speech-to-text, large language models, and text-to-speech pipelines to facilitate low-latency, natural conversations. The system is distinguished by its advanced orchestration of real-time media and conversational flow, including support for full-duplex speech, preemptive response generation, and sophisticated interruption management. It further differentiates itself throu

Langroid is a multi-agent orchestration framework and tool integration suite designed for building complex AI applications. It serves as a multi-modal integration layer that connects diverse local and remote language models with an agentic retrieval-augmented generation system. The project distinguishes itself through a collaborative message-exchange paradigm, allowing specialized agents to delegate tasks hierarchically and coordinate via structured communication. It features an advanced state management system for conversational AI, including the ability to rewind and prune conversation hist

Lux is a command line video downloader written in Go designed for extracting and saving video and audio from various websites. It functions as a concurrent media downloader that increases transfer speeds by splitting files into fragments and downloading them using multiple threads. The tool serves as a playlist download manager capable of retrieving entire video collections or specific ranges of items. It also operates as a proxy-enabled media client, supporting HTTP and SOCKS5 proxies and session cookies to access region-locked, private, or age-gated content. Additional capabilities include

OmniRoute is a unified LLM API gateway that connects multiple AI providers to a single endpoint. Its primary purpose is to simplify the integration of various AI models into tools and agents by translating different provider formats into a standardized API. The project distinguishes itself through a multi-strategy request routing system that optimizes for cost, speed, and availability, including automatic model fallbacks and a circuit-breaker resilience model to isolate provider failures. It employs a local-first security posture, using AES-256-GCM encryption to store API keys and conversatio

Genkit is an open-source framework for building AI-powered applications. It provides a unified interface for connecting to hundreds of generative AI models from multiple providers, enabling text, image, audio, and video generation through a single API. The framework structures multi-step AI interactions—including chat, retrieval-augmented generation, tool use, and agentic workflows—as composable, traceable flows with built-in streaming and state management. The framework distinguishes itself through a comprehensive developer toolkit that includes a command-line interface and a local developer

This project is a terminal-based command line interface client and agent orchestrator for interacting with multiple large language model providers. It functions as an OpenAI API client and a local API gateway that exposes chat completions and embeddings through an HTTP server. The system distinguishes itself by providing a retrieval-augmented generation tool for indexing local files and URLs into a vector database to provide custom document context. It allows for the creation of specialized AI agents that combine custom system prompts with tool calling and external function execution. The to