microsoft/LMOps

Features

• Distillation Algorithms - Provides a framework for knowledge distillation of large models.
• Model Distillation - Provides frameworks for knowledge distillation of large language models.
• Prompt Optimization - Automatic prompt optimization using gradient-like descent.