# nbasyl/llm-fp4

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/nbasyl-llm-fp4).**

224 stars · 21 forks · Python · MIT

## Links

- GitHub: https://github.com/nbasyl/LLM-FP4
- awesome-repositories: https://awesome-repositories.com/repository/nbasyl-llm-fp4.md

## Description

The official implementation of the EMNLP 2023 paper LLM-FP4

## Tags

### Part of an Awesome List

- [Model Quantization Tools](https://awesome-repositories.com/f/awesome-lists/ai/model-quantization-tools.md) — 4-bit floating-point quantization for transformer models.