# casper-hansen/autoawq

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/casper-hansen-autoawq).**

2,342 stars · 304 forks · Python · MIT · archived

## Links

- GitHub: https://github.com/casper-hansen/AutoAWQ
- Homepage: https://casper-hansen.github.io/AutoAWQ/
- awesome-repositories: https://awesome-repositories.com/repository/casper-hansen-autoawq.md

## Description

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

## Tags

### Part of an Awesome List

- [Model Optimization](https://awesome-repositories.com/f/awesome-lists/devops/model-optimization.md) — Package for 4-bit quantization of language models.