mit-han-lab/smoothquant

Features

• Model Quantization - Optimization technique to mitigate outliers for efficient 8-bit quantization.
• Model Quantization Tools - Accurate post-training quantization for large language models.