nbasyl/LLM-FP4

Features

• Model Quantization Tools - 4-bit floating-point quantization for transformer models.