1 مستودع
Deploying models directly from the Hugging Face Hub with minimal configuration.
Distinct from Hugging Face: Distinct from Hugging Face: focuses on deployment from the Hub, not model conversion.
Explore 1 awesome GitHub repository matching devops & infrastructure · Hub Deployments. Refine with filters or upvote what's useful.
KServe is an open platform for deploying and serving generative and predictive AI models on Kubernetes. It defines inference services as custom resources with declarative YAML specifications, enabling a Kubernetes-native approach to model deployment and lifecycle management. The platform leverages Knative-based serverless scaling for automatic scale-to-zero and revision management, and supports a pluggable serving runtime architecture that maps model formats to containerized execution environments. KServe distinguishes itself through model-aware autoscaling that scales replicas based on token
Deploys models directly from the Hugging Face Hub with minimal configuration.