# b4rtaz/distributed-llama

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/b4rtaz-distributed-llama).**

2,837 stars · 210 forks · C++ · mit

## Links

- GitHub: https://github.com/b4rtaz/distributed-llama
- awesome-repositories: https://awesome-repositories.com/repository/b4rtaz-distributed-llama.md

## Topics

`distributed-computing` `distributed-llm` `llama2` `llama3` `llm` `llm-inference` `llms` `neural-network` `open-llm`

## Tags

### Part of an Awesome List

- [Inference Engines](https://awesome-repositories.com/f/awesome-lists/ai/inference-engines.md) — Cluster-based inference acceleration using multiple home devices.
- [LLM Development Utilities](https://awesome-repositories.com/f/awesome-lists/ai/llm-development-utilities.md) — Cluster-based acceleration for local LLM inference.