awesome-repositories.com
© 2026 Bringes Technology SRL·VAT RO45896025·hello@bringes.io
MCPSitemapPrivacyTerms
Model Inference Deployment · Awesome GitHub Repositories

1 repo

Awesome GitHub RepositoriesModel Inference Deployment

Systems for deploying models to production or local environments.

Explore 1 awesome GitHub repository matching devops & infrastructure · Model Inference Deployment. Refine with filters or upvote what's useful.

  1. Home
  2. DevOps & Infrastructure
  3. Deployment Management and Strategies
  4. Deployment Management
  5. Model Inference Deployment

Awesome Model Inference Deployment GitHub Repositories

Describe the repository you're looking for…
We'll search the best matching repositories with AI.
  • unslothai/unsloth

    unslothai/unsloth

    52,461GitHubView on GitHub↗

    Unsloth is a high-performance training and inference platform designed to optimize the lifecycle of large language and multimodal models. It provides a comprehensive engine for fine-tuning, executing, and managing models locally, with a focus on reducing memory consumption and increasing compute speed on consumer-grade

    Pythonagentdeepseekdeepseek-r1

Explore sub-tags

  • Local Model ServingCapabilities for deploying and running machine learning models on local hardware with accessible API endpoints.
  • Model Inference ServersCommand-line tools that initialize servers to load machine learning models and expose them for inference.