3 repos
Awesome GitHub RepositoriesMachine Learning Runtimes
Execution environments that manage the loading and processing of machine learning models during inference.
Explore 3 awesome GitHub repositories matching artificial intelligence & ml · Machine Learning Runtimes. Refine with filters or upvote what's useful.
Awesome Machine Learning Runtimes GitHub Repositories
We'll search the best matching repositories with AI.
- vllm-project/vllm
vLLM is a high-throughput inference engine designed for the efficient serving and execution of large language models. It functions as a production-ready distributed model server, providing standard API protocols for online serving while also supporting offline batch processing. The system is built to maximize token gen
Pythonamdblackwellcuda - ultralytics/yolov5
YOLOv5 is a comprehensive computer vision framework designed for end-to-end deep learning, specializing in real-time object detection, image classification, and instance segmentation. It provides a unified toolkit that manages the entire lifecycle of a model, from initial dataset configuration and hyperparameter tuning
Pythoncoremldeep-learningios - karpathy/nanoGPT
nanoGPT is a lightweight engine for training and fine-tuning transformer-based language models from scratch. It provides a minimalist codebase designed for educational exploration and rapid experimentation with neural network architectures, utilizing self-attention and feed-forward layers to process sequences and predi
Python
Explore sub-tags
- Browser-based Inference EnginesTools and libraries that enable the execution of pre-trained machine learning models directly within web browsers.
- Custom Model Execution EnginesSystems that support the execution of user-defined or custom model architectures via optimized backends.
- Text Generation RuntimesCommand-line tools and engines for sampling sequences from neural networks with configurable generation parameters.