microsoft/DeepSpeed

Features

• Deep Learning Frameworks - Optimizes distributed training and inference for large models.
• Inference Frameworks - Scalable library for distributed training and high-throughput inference.
• LLM Training and Optimization - Library for optimized training and RLHF implementation.
• Model Quantization Tools - Comprehensive library for quantization and efficient inference.
• Model Training Frameworks - Optimization library for efficient distributed training and inference.