1 repo
Awesome GitHub RepositoriesModel Serving APIs
Interfaces for exposing local machine learning models as network-accessible services for external application integration.
Distinguishing note: Focuses on the infrastructure layer of serving models via standard APIs, distinct from model training or inference libraries.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Model Serving APIs. Refine with filters or upvote what's useful.
Awesome Model Serving APIs GitHub Repositories
Find the best repos with AI.We'll search the best matching repositories with AI.
- oobabooga/text-generation-webui
oobabooga/text-generation-webui
46,070View on GitHubThis project is a comprehensive platform for hosting and interacting with large language models directly on local hardware. It provides a web-based graphical interface that allows users to manage model loading, configure generation parameters, and execute text or chat interactions entirely offline. By running models locally, the software ensures complete data privacy and eliminates reliance on external cloud services for generative tasks. Beyond basic inference, the platform functions as a versatile workbench for generative AI development. It includes an integrated pipeline for fine-tuning mo
Expose local language models through a standard API interface to integrate text generation capabilities into your own custom software applications and external development workflows.
Python
