1 repo

Awesome GitHub RepositoriesModel Inference Servers

Command-line tools that initialize servers to load machine learning models and expose them for inference.

Explore 1 awesome GitHub repository matching devops & infrastructure · Model Inference Servers. Refine with filters or upvote what's useful.

We'll search the best matching repositories with AI.

unslothai/unsloth
unslothai/unsloth
52,461GitHubView on GitHub
Unsloth is a high-performance training and inference platform designed to optimize the lifecycle of large language and multimodal models. It provides a comprehensive engine for fine-tuning, executing, and managing models locally, with a focus on reducing memory consumption and increasing compute speed on consumer-grade
Pythonagentdeepseekdeepseek-r1

1 repo

Command-line tools that initialize servers to load machine learning models and expose them for inference.

Explore 1 awesome GitHub repository matching devops & infrastructure · Model Inference Servers. Refine with filters or upvote what's useful.

We'll search the best matching repositories with AI.

unslothai/unsloth
unslothai/unsloth
52,461GitHubView on GitHub
Unsloth is a high-performance training and inference platform designed to optimize the lifecycle of large language and multimodal models. It provides a comprehensive engine for fine-tuning, executing, and managing models locally, with a focus on reducing memory consumption and increasing compute speed on consumer-grade
Pythonagentdeepseekdeepseek-r1

Awesome Model Inference Servers GitHub Repositories