# tensorchord/openmodelz

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/tensorchord-openmodelz).**

283 stars · 26 forks · Go · Apache-2.0

## Links

- GitHub: https://github.com/tensorchord/openmodelz
- Homepage: https://docs.open.modelz.ai
- awesome-repositories: https://awesome-repositories.com/repository/tensorchord-openmodelz.md

## Description

Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)

## Tags

### Part of an Awesome List

- [MLOps Platforms](https://awesome-repositories.com/f/awesome-lists/ai/mlops-platforms.md) — Deploys machine learning models at scale on any cluster.