2 repositorios
Automated maintenance tasks that run asynchronously to preserve system performance.
Distinguishing note: Focuses on non-blocking index compaction and merging.
Explore 2 awesome GitHub repositories matching devops & infrastructure · Background Optimization Processes. Refine with filters or upvote what's useful.
Qdrant is a high-performance vector similarity database designed to store, index, and search high-dimensional vectors alongside structured metadata. It functions as a distributed search engine that manages large-scale data clusters, providing low-latency retrieval and complex filtering capabilities. The system is built to serve as a specialized middleware layer, connecting machine learning pipelines and AI agents to persistent storage for intelligent information retrieval and recommendation tasks. The platform distinguishes itself through advanced retrieval techniques, including support for h
Performs segment merging and index compaction in background threads to maintain query performance.
LanceDB is a vector database and columnar data store designed to function as a versioned dataset manager and vector search engine. It serves as a high-performance backend for indexing and retrieving high-dimensional embeddings, providing the foundation for machine learning data pipelines. The system distinguishes itself through a combination of cloud-native object storage and immutable version tracking, allowing for data time-travel and reproducible AI experiments. It integrates hybrid search capabilities, merging dense vector similarity with BM25 full-text search and SQL-like scalar filters
Runs file compaction and table optimization as asynchronous background tasks to maintain system performance.