1 repo
Systems that manage both local and cloud-based AI model execution.
Distinguishing note: Focuses on the hybrid nature of model execution rather than purely local or remote.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Hybrid AI Orchestrators. Refine with filters or upvote what's useful.
Jan is a desktop application that functions as a local artificial intelligence model runtime and an open-standard API server. It enables the execution of large language models directly on local hardware, ensuring that data remains private and accessible offline while providing a unified interface for managing model weights and inference runtimes. The platform distinguishes itself by offering a modular inference backend that allows users to swap execution engines based on hardware compatibility and performance needs. It acts as a cross-platform orchestrator, providing the ability to switch bet
Executes large language models directly on hardware or connects to cloud services.