michaelfeil/infinity

Features

• Inference and Serving - Python-based inference engine for text embeddings.
• Model Serving & Deployment - Provides a high-throughput API for embeddings and reranking.
• Model Serving Engines - REST API server for serving text-embedding models.