1 repo
Awesome GitHub RepositoriesResource Orchestrators
Systems for managing and scheduling computational resources.
Distinguishing note: Focuses on the orchestration of model loading and unloading.
Explore 1 awesome GitHub repository matching devops & infrastructure · Resource Orchestrators. Refine with filters or upvote what's useful.
Awesome Resource Orchestrators GitHub Repositories
Find the best repos with AI.We'll search the best matching repositories with AI.
- mudler/LocalAI
mudler/LocalAI
42,910View on GitHubLocalAI is a self-hosted inference server that enables the execution of machine learning models directly on local hardware. By providing a unified interface for text, image, and audio processing, it allows users to maintain full control over data privacy and infrastructure costs while eliminating dependencies on external network services. The platform functions as an API gateway that mimics standard cloud-based artificial intelligence interfaces, allowing existing applications to integrate local models as drop-in replacements. It utilizes a container-based architecture to package runtimes and
Manages a backend layer that dynamically loads and unloads computational models to optimize hardware utilization.
Goaiapiaudio-generation
