1 dépôt
Awesome GitHub RepositoriesPredictive Model Backends
Fallback serving runtimes for predictive tasks like text classification when generative backends are unavailable.
Distinct from Model Serving: Distinct from Model Serving: focuses on fallback to standard Hugging Face backends for predictive tasks, not general serving optimizations.
Explore 1 awesome GitHub repository matching devops & infrastructure · Predictive Model Backends. Refine with filters or upvote what's useful.
Awesome Predictive Model Backends GitHub Repositories
Trouvez les meilleurs dépôts grâce à l'IA.Nous recherchons les dépôts les plus pertinents grâce à l'IA.
- kserve/kserve
kserve/kserve
5,576Voir sur GitHubKServe is a Kubernetes-native platform for deploying and serving machine learning models as scalable inference services. It supports both generative AI models, including large language models, and traditional predictive models from frameworks such as TensorFlow, PyTorch, Scikit-Learn, XGBoost, and ONNX. The platform manages the full lifecycle of model deployments, including revision tracking, canary rollouts, A/B testing, and automatic rollbacks, and provides serverless scale-to-zero capabilities for cost-efficient resource management. KServe distinguishes itself through a standardized infere
Provides a fallback Hugging Face backend for predictive tasks when vLLM is not supported.
Go
