# hsword/spotserve

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/hsword-spotserve).**

134 stars · 15 forks · Apache-2.0

## Links

- GitHub: https://github.com/Hsword/SpotServe
- awesome-repositories: https://awesome-repositories.com/repository/hsword-spotserve.md

## Description

SpotServe: Serving Generative Large Language Models on Preemptible Instances

## Tags

### Part of an Awesome List

- [Inference Serving Engines](https://awesome-repositories.com/f/awesome-lists/ai/inference-serving-engines.md) — Serving generative models on preemptible cloud instances.