# bitsandbytes-foundation/bitsandbytes

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/bitsandbytes-foundation-bitsandbytes).**

7,968 stars · 825 forks · Python · mit

## Links

- GitHub: https://github.com/bitsandbytes-foundation/bitsandbytes
- Homepage: https://huggingface.co/docs/bitsandbytes/main/en/index
- awesome-repositories: https://awesome-repositories.com/repository/bitsandbytes-foundation-bitsandbytes.md

## Topics

`llm` `machine-learning` `pytorch` `qlora` `quantization`

## Tags

### Part of an Awesome List

- [Performance Optimization](https://awesome-repositories.com/f/awesome-lists/ai/performance-optimization.md) — Library for k-bit quantization to optimize LLM memory usage.
- [Computation and Optimization](https://awesome-repositories.com/f/awesome-lists/devtools/computation-and-optimization.md) — Lightweight wrapper for 8-bit optimizers and CUDA functions.