# timdettmers/bitsandbytes

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/timdettmers-bitsandbytes).**

8,277 stars · 873 forks · Python · MIT

## Links

- GitHub: https://github.com/timdettmers/bitsandbytes
- Homepage: https://huggingface.co/docs/bitsandbytes/main/en/index
- awesome-repositories: https://awesome-repositories.com/repository/timdettmers-bitsandbytes.md

## Description

Accessible large language models via k-bit quantization for PyTorch.

## Tags

### Part of an Awesome List

- [Model Quantization Tools](https://awesome-repositories.com/f/awesome-lists/ai/model-quantization-tools.md) — Efficient 8-bit matrix multiplication for large-scale models.