# bytedance/abq-llm

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/bytedance-abq-llm).**

245 stars · 21 forks · C++ · Apache-2.0

## Links

- GitHub: https://github.com/bytedance/ABQ-LLM
- awesome-repositories: https://awesome-repositories.com/repository/bytedance-abq-llm.md

## Description

An acceleration library that supports arbitrary bit-width combinatorial quantization operations

## Tags

### Part of an Awesome List

- [Model Quantization Tools](https://awesome-repositories.com/f/awesome-lists/ai/model-quantization-tools.md) — Arbitrary-bit quantized inference acceleration.