# bigscience-workshop/petals

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/bigscience-workshop-petals).**

10,208 stars · 615 forks · Python · MIT

## Links

- GitHub: https://github.com/bigscience-workshop/petals
- Homepage: https://petals.dev
- awesome-repositories: https://awesome-repositories.com/repository/bigscience-workshop-petals.md

## Description

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

## Tags

### Part of an Awesome List

- [Chat Interfaces](https://awesome-repositories.com/f/awesome-lists/ai/chat-interfaces.md) — Distributed inference and fine-tuning using peer-to-peer resources.
- [Inference Frameworks](https://awesome-repositories.com/f/awesome-lists/ai/inference-frameworks.md) — Distributed inference and fine-tuning over internet-connected nodes.
- [Developer Tools and Infrastructure](https://awesome-repositories.com/f/awesome-lists/devtools/developer-tools-and-infrastructure.md) — Distributed platform for running large AI models.