# xorbitsai/inference

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/xorbitsai-inference).**

9,358 stars · 834 forks · Python · Apache-2.0

## Links

- GitHub: https://github.com/xorbitsai/inference
- Homepage: https://inference.readthedocs.io
- awesome-repositories: https://awesome-repositories.com/repository/xorbitsai-inference.md

## Description

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

## Tags

### Part of an Awesome List

- [Artificial Intelligence](https://awesome-repositories.com/f/awesome-lists/ai/artificial-intelligence.md) — Platform for running multimodal and LLM models with simple integration.
- [Serving Frameworks](https://awesome-repositories.com/f/awesome-lists/devtools/serving-frameworks.md) — Drop-in replacement for OpenAI API with multi-model support.