# michaelfeil/infinity

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/michaelfeil-infinity).**

2,838 stars · 193 forks · Python · MIT

## Links

- GitHub: https://github.com/michaelfeil/infinity
- Homepage: https://michaelfeil.github.io/infinity/
- awesome-repositories: https://awesome-repositories.com/repository/michaelfeil-infinity.md

## Description

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

## Tags

### Part of an Awesome List

- [Inference and Serving](https://awesome-repositories.com/f/awesome-lists/ai/inference-and-serving.md) — Python-based inference engine for text embeddings.
- [Model Serving & Deployment](https://awesome-repositories.com/f/awesome-lists/ai/model-serving-deployment.md) — Provides a high-throughput API for embeddings and reranking.
- [Model Serving Engines](https://awesome-repositories.com/f/awesome-lists/ai/model-serving-engines.md) — REST API server for serving text-embedding models.