14 repositorios
Specialized databases for storing and searching high-dimensional embedding vectors.
Explore 14 awesome GitHub repositories matching part of an awesome list · Vector Databases. Refine with filters or upvote what's useful.
Milvus is a specialized vector database engine designed for the indexing, management, and high-speed similarity retrieval of high-dimensional vector embeddings. It functions as a similarity search engine capable of identifying nearest neighbors within large-scale vector spaces, supporting the storage and retrieval of billions of data points while maintaining consistent performance. The system utilizes a distributed architecture that decouples storage, query, and coordination into independent services, allowing for horizontal scaling across clusters. It employs a global indexing mechanism that
Open-source vector database for AI-powered applications.
This project is a high-performance library designed for the similarity search and clustering of dense vectors across massive datasets. It functions as a vector similarity search engine, providing the necessary tools to organize complex numerical data into specialized structures that facilitate rapid retrieval and efficient querying of millions of records. The library distinguishes itself through a variety of advanced indexing and compression techniques, including hierarchical navigable small worlds for logarithmic time complexity and inverted file indexing to partition vector spaces into mana
Library for efficient similarity search and dense vector clustering.
SurrealDB is a multi-model database engine designed to store and query document, graph, relational, and vector data within a single ACID-compliant platform. It functions as an AI-native data store, integrating vector search, graph traversal, and machine learning model execution directly into its query layer. By providing a unified declarative query language, the platform eliminates the need for external middleware to synchronize data across different storage models. The platform distinguishes itself through its ability to manage agent memory and complex workflows natively. It allows developer
Scalable multi-model database optimized for time-series data.
Qdrant is a high-performance vector similarity database designed to store, index, and search high-dimensional vectors alongside structured metadata. It functions as a distributed search engine that manages large-scale data clusters, providing low-latency retrieval and complex filtering capabilities. The system is built to serve as a specialized middleware layer, connecting machine learning pipelines and AI agents to persistent storage for intelligent information retrieval and recommendation tasks. The platform distinguishes itself through advanced retrieval techniques, including support for h
Vector similarity search engine with extended filtering support.
Chroma is a specialized vector database designed to index and retrieve high-dimensional data representations for semantic similarity search. It functions as a comprehensive platform for information retrieval, enabling the storage and management of unstructured documents alongside structured metadata. By mapping data into numerical representations, the system facilitates rapid similarity lookups across large datasets. The platform distinguishes itself through a hybrid search infrastructure that combines dense vector embeddings with sparse keyword and regular expression matching to balance sema
AI-native open-source embedding database.
Vector similarity search extension for PostgreSQL.
PostgreSQL extension for vector similarity search.
Weaviate is a cloud-native vector database and distributed vector store designed to save high-dimensional vectors alongside structured data. It functions as a hybrid search engine that combines vector similarity, keyword matching, and structured metadata filtering within a single query. The system is optimized for retrieval-augmented generation, integrating vector search with generative AI and reranking to power question-and-answer workflows. It distinguishes itself through the ability to merge semantic search with traditional keyword queries and structured metadata filters to improve result
Vector search engine that uses machine learning for data storage.
Neo4j is a native graph database management system designed to store and query highly connected data using a property-graph model. It provides an ACID-compliant transaction engine that ensures data integrity, supported by a distributed cluster architecture that maintains causal consistency across nodes. Users interact with the system through a declarative query language, which allows for complex pattern matching and path traversal without requiring manual traversal logic. The platform distinguishes itself through its hybrid approach to data retrieval, combining traditional graph-based queries
Graph database management system with vector search capabilities.
Weaviate is an AI-native vector database designed to store and index high-dimensional vector embeddings alongside traditional data objects. It serves as a backend infrastructure for retrieval-augmented generation, enabling applications to ground language model responses in private, context-aware data. The platform distinguishes itself by combining vector similarity search with traditional keyword filtering through a hybrid storage architecture. It integrates directly with external machine learning models to automate the generation of embeddings and perform complex inference tasks during inges
Cloud-native open-source vector search engine.
Annoy is a C++ library designed for approximate nearest neighbor search in high-dimensional vector spaces. It functions as a vector similarity search engine that constructs static, disk-based data structures to facilitate fast lookups. By mapping identifiers to vector data and persisting these structures to disk, the library enables efficient, memory-mapped access to large datasets. The project distinguishes itself through the use of random projection trees and distance-metric-based partitioning, which organize data into hierarchical binary trees to balance search precision against computatio
Listed in the “Vector Databases” section of the Llm Course awesome list.
txtai is an artificial intelligence platform designed for building semantic search applications, managing vector storage, and orchestrating language model workflows. It functions as a comprehensive engine for processing unstructured data, enabling the development of autonomous agents and complex content automation pipelines. The platform distinguishes itself through a hybrid indexing architecture that combines dense vector embeddings with relational graph structures, allowing for multi-dimensional retrieval across both semantic meaning and entity relationships. It supports multimodal analysis
Framework for building semantic search applications.
sqlite-vec is a C-based vector library and SQLite extension that adds virtual tables for storing and querying high-dimensional embeddings. It functions as a database plugin for performing nearest neighbor searches using distance metrics such as L2, cosine, and Hamming distance. The project provides a portable embedding store that supports deployment across Android, iOS, desktop environments, and web browsers via WebAssembly. It distinguishes itself by converting numerical arrays into compact binary formats and utilizing quantization to reduce the memory footprint and storage size of vector in
Lightweight vector search extension for SQLite databases.
Infinity es una base de datos vectorial distribuida y un almacén vectorial multimodal diseñado para gestionar datasets a gran escala para recuperación y búsqueda por similitud. Sirve como backend para aplicaciones de modelos de lenguaje grandes y pipelines de generación aumentada por recuperación (RAG) almacenando y recuperando vectores densos, vectores dispersos y datos de texto completo. El sistema funciona como un motor de búsqueda híbrido, combinando embeddings vectoriales y búsqueda de texto completo con algoritmos de reranking para identificar los documentos más relevantes. Admite el almacenamiento de datos multimodal, permitiendo el mantenimiento de diversos tipos de datos, incluyendo tensores, cadenas y numéricos, dentro de un único entorno. La base de datos ofrece capacidades para gestionar esquemas y registros, incluyendo importación, exportación y consultas estructuradas. Incluye herramientas para la gestión de índices y optimización de almacenamiento, y ofrece recuperación de estado mediante snapshots del sistema o de tablas. La base de datos puede desplegarse como un binario único o mediante Docker, y es accesible a través de una API HTTP y un SDK de Python.
AI-native database for vector and full-text search.
The Pinecone Python SDK provides a client for the Pinecone vector database. Use it to create and manage indexes, upsert and query vectors, and run inference operations from Python.
Official client for managed vector search services.