# ericlbuehler/mistral.rs

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/ericlbuehler-mistral-rs).**

6,597 stars · 528 forks · Rust · mit

## Links

- GitHub: https://github.com/EricLBuehler/mistral.rs
- awesome-repositories: https://awesome-repositories.com/repository/ericlbuehler-mistral-rs.md

## Topics

`llm` `rust` `uqff`

## Tags

### Part of an Awesome List

- [Artificial Intelligence](https://awesome-repositories.com/f/awesome-lists/ai/artificial-intelligence.md) — Fast LLM inference engine supporting multimodal models and quantization.
- [Inference and Serving](https://awesome-repositories.com/f/awesome-lists/ai/inference-and-serving.md) — High-speed inference engine for language models.
- [Inference Engines](https://awesome-repositories.com/f/awesome-lists/ai/inference-engines.md) — Fast and flexible inference engine for various models.