2 repos
Network services that provide standardized API endpoints for hosting and connecting to local or remote AI models.
Explore 2 awesome GitHub repositories matching artificial intelligence & ml · API Servers. Refine with filters or upvote what's useful.
GPT4All is a cross-platform runtime environment designed to execute large language models directly on local consumer hardware. By leveraging an optimized C++ inference backend, it enables private, offline AI interactions without requiring an internet connection or external cloud services. The project provides a compreh
Unsloth is a high-performance training and inference platform designed to optimize the lifecycle of large language and multimodal models. It provides a comprehensive engine for fine-tuning, executing, and managing models locally, with a focus on reducing memory consumption and increasing compute speed on consumer-grade