1 repo
Middleware for routing and unifying requests between local and remote AI model providers.
Distinguishing note: Focuses on proxying and unifying model sources rather than direct model execution.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Model Provider Proxies. Refine with filters or upvote what's useful.
Jan is a desktop application that functions as a local artificial intelligence model runtime and an open-standard API server. It enables the execution of large language models directly on local hardware, ensuring that data remains private and accessible offline while providing a unified interface for managing model weights and inference runtimes. The platform distinguishes itself by offering a modular inference backend that allows users to swap execution engines based on hardware compatibility and performance needs. It acts as a cross-platform orchestrator, providing the ability to switch bet
Routes requests to external cloud-based AI services through a unified interface.