1 repo
Local servers that implement the OpenAI API specification for broad compatibility.
Distinguishing note: Focuses on the specific API compatibility standard rather than general API server functionality.
Explore 1 awesome GitHub repository matching web development · OpenAI-Compatible Servers. Refine with filters or upvote what's useful.
Jan is a desktop application that functions as a local artificial intelligence model runtime and an open-standard API server. It enables the execution of large language models directly on local hardware, ensuring that data remains private and accessible offline while providing a unified interface for managing model weights and inference runtimes. The platform distinguishes itself by offering a modular inference backend that allows users to swap execution engines based on hardware compatibility and performance needs. It acts as a cross-platform orchestrator, providing the ability to switch bet
Exposes model capabilities through standard HTTP endpoints for integration with external applications.