75 Repos
Tools for creating and managing indexes optimized for high-dimensional vector data to support semantic search.
Distinguishing note: Specifically targets the management of vector-based indexes for semantic retrieval, distinct from general-purpose database indexing.
Explore 75 awesome GitHub repositories matching data & databases · Vector Indexing. Refine with filters or upvote what's useful.
Cursor is an AI-powered code editor and integrated development environment built as a fork of Visual Studio Code. It functions as an AI programming assistant that integrates large language models directly into the editing experience to write, refactor, and maintain source code. The editor utilizes a customized version of the VS Code interface to provide native artificial intelligence capabilities, including an environment for natural language code generation and codebase indexing. The platform covers a range of AI-assisted coding capabilities, such as intelligent code completion, automated c
Indexes local project files into a vector database to enable semantic retrieval for AI prompt grounding.
Cursor is an artificial intelligence-powered code editor built as a fork of the Visual Studio Code environment. It integrates machine learning models directly into the development workflow, allowing users to generate, refactor, and debug code through natural language prompts while maintaining full compatibility with existing editor extensions and themes. The editor distinguishes itself through a specialized codebase context engine that indexes local project structures and file relationships using vector-based embeddings. This system enables the editor to inject relevant file snippets and proj
Converts project files into high-dimensional embeddings to allow rapid semantic retrieval of relevant context for machine learning models.
Qdrant is a high-performance vector similarity database designed to store, index, and search high-dimensional vectors alongside structured metadata. It functions as a distributed search engine that manages large-scale data clusters, providing low-latency retrieval and complex filtering capabilities. The system is built to serve as a specialized middleware layer, connecting machine learning pipelines and AI agents to persistent storage for intelligent information retrieval and recommendation tasks. The platform distinguishes itself through advanced retrieval techniques, including support for h
Retrieves data quickly by indexing vectors using graph-based algorithms.
oh-my-codex is an AI coding workflow orchestrator and a retrieval augmented generation documentation assistant. It manages complex programming tasks through a structured sequence of planning, execution, and verification phases, while providing tools for querying and translating technical documentation. The project utilizes Git worktrees to isolate parallel coding sessions, ensuring that concurrent tasks remain independent. It integrates a vector-store knowledge base to index documents into embeddings, enabling semantic search and factual context retrieval across multiple languages. The syste
Implements vector indexing of text documents to enable semantic search and context retrieval.
This project is a distributed, document-oriented database system designed to store information in flexible, hierarchical structures. It supports horizontal scaling through automated sharding and maintains high availability across global clusters using a multi-node replication protocol. By executing multi-document operations as atomic units, the system ensures data integrity and consistency across distributed environments. The platform distinguishes itself by integrating advanced vector-based indexing, which enables semantic similarity searches alongside traditional geospatial and lexical quer
Manages high-dimensional vector indexes to enable semantic similarity searches alongside traditional queries.
Chroma is a specialized vector database designed to index and retrieve high-dimensional data representations for semantic similarity search. It functions as a comprehensive platform for information retrieval, enabling the storage and management of unstructured documents alongside structured metadata. By mapping data into numerical representations, the system facilitates rapid similarity lookups across large datasets. The platform distinguishes itself through a hybrid search infrastructure that combines dense vector embeddings with sparse keyword and regular expression matching to balance sema
Maps unstructured data into high-dimensional numerical representations to enable rapid semantic similarity lookups across large datasets.
Deepface is a comprehensive deep learning library for facial recognition and demographic analysis. It provides a modular pipeline that handles the entire lifecycle of facial processing, including detection, geometric alignment, and the transformation of facial images into high-dimensional numerical vector embeddings for identity verification and similarity comparison. The library distinguishes itself through a model ensemble approach, which combines predictions from multiple pre-trained neural networks to improve classification accuracy and reduce bias. It also integrates advanced security fe
Builds approximate nearest neighbor indexes on vector columns to enable high-speed similarity searches.
This project is a feature-rich Go client library designed for interacting with Redis. It serves as a comprehensive interface for managing remote data stores, enabling developers to execute standard database commands, handle complex data structures, and perform asynchronous operations within Go applications. The library distinguishes itself through its support for advanced Redis capabilities, including connection pooling, pipelining, and transactional integrity. It provides specialized primitives for managing distributed clusters, including automated topology updates and request routing to sha
Organizes high-dimensional vector embeddings using flat or graph structures to enable efficient similarity searching.
Vector similarity search extension for PostgreSQL.
Implements specialized indexing structures like HNSW and IVFFlat to accelerate nearest neighbor searches on large vector datasets.
Mastra is an orchestration framework designed for building, deploying, and managing autonomous AI agents and multi-agent systems. It provides a comprehensive suite of primitives for creating resilient AI applications, including durable workflow orchestration, event-driven agent loops, and semantic memory management. By integrating these core components, the platform enables developers to build complex, multi-step processes that can reason about goals and execute tasks without manual intervention. The framework distinguishes itself through its focus on observability and secure, isolated execut
Maintains synchronized vector search indexes by managing data entries.
FossFLOW is an open source metadata search engine and data platform designed to aggregate and normalize repository information from multiple code hosting services. It functions as a developer productivity utility, enabling users to discover software projects and analyze contributor networks through a unified, searchable index. The platform distinguishes itself by utilizing vector-based semantic search, which converts project descriptions and code metadata into numerical embeddings to facilitate discovery based on conceptual relevance. To maintain a consistent view of disparate data, the syste
Converts code metadata into numerical embeddings to facilitate conceptual discovery of projects and contributor networks.
Neo4j is a native graph database management system designed to store and query highly connected data using a property-graph model. It provides an ACID-compliant transaction engine that ensures data integrity, supported by a distributed cluster architecture that maintains causal consistency across nodes. Users interact with the system through a declarative query language, which allows for complex pattern matching and path traversal without requiring manual traversal logic. The platform distinguishes itself through its hybrid approach to data retrieval, combining traditional graph-based queries
Configures vector indexes to support efficient similarity lookups and filtering based on high-dimensional data.
Memvid is an embedded memory framework designed to provide persistent, versioned context for intelligent agents. It functions as a local vector database library that stores all data within a single binary file, removing the need for external database infrastructure or network dependencies. The system distinguishes itself by integrating in-process vector indexing with append-only versioning, allowing for high-speed semantic similarity searches alongside the ability to track and roll back state changes over time. It includes built-in transparent data encryption and masking to secure sensitive i
Performs high-speed semantic similarity searches directly within the application memory space.
Weaviate is an AI-native vector database designed to store and index high-dimensional vector embeddings alongside traditional data objects. It serves as a backend infrastructure for retrieval-augmented generation, enabling applications to ground language model responses in private, context-aware data. The platform distinguishes itself by combining vector similarity search with traditional keyword filtering through a hybrid storage architecture. It integrates directly with external machine learning models to automate the generation of embeddings and perform complex inference tasks during inges
Persists data objects alongside their vector representations to enable high-performance semantic search and retrieval-augmented generation.
Virgilio is an AI educational roadmap generator and learning path orchestrator designed to structure personalized study trajectories for data science and machine learning. It functions as an AI-driven mentor that organizes educational content into hierarchical levels of abstraction, ranging from high-level introductions to technical tutorials. The system automates curriculum design by mapping technical knowledge into organized levels to ensure a logical progression of study. It manages e-learning journeys by breaking down broad domains into smaller sub-modules, guiding users through necessary
Indexes data science documentation as numerical embeddings to enable conceptual semantic search.
This platform is an automated documentation and codebase analysis system designed to generate structured wikis, technical guides, and interactive diagrams from source code repositories. It functions as a retrieval-augmented generation framework that connects codebases to language models, enabling context-aware answers, deep research, and automated documentation updates through semantic vector search. The system distinguishes itself through a self-hosted, containerized architecture that supports both cloud-based and local AI model execution. It provides sophisticated model orchestration, allow
Offloads computationally intensive embedding tasks to remote worker clusters to accelerate the processing of large-scale codebase analysis.
Pipecat is a framework and software development kit for building real-time multimodal AI agents and speech-to-speech systems. It utilizes a frame-based data pipeline to route audio, video, and text through a modular sequence of processors, enabling the orchestration of low-latency conversational AI. The project is distinguished by its ability to coordinate complex multimodal services, including speech-to-text, language models, and text-to-speech, within a single pipeline. It features semantic voice activity detection for natural turn-taking, state-machine conversation flows for dialogue manag
Integrates vector-based indexing to enable semantic search and knowledge injection into model contexts.
This project serves as a comprehensive, curated directory of resources, tools, and platforms dedicated to the generative artificial intelligence ecosystem. It functions as a central hub for developers and researchers to discover the frameworks, models, and services necessary for building, deploying, and managing intelligent software applications. The directory distinguishes itself by providing a structured index of specialized tooling across several technical domains. It covers the full lifecycle of generative AI, including the development of autonomous agent systems, the implementation of re
Provides tools for creating and managing indexes optimized for high-dimensional vector data to support semantic search.
LEANN is a framework for local retrieval augmented generation and vector indexing. It functions as a system for building local knowledge bases and source code search engines that combine large language models with retrieved private data to generate context-aware responses. The project distinguishes itself through a vision-model based document layout extractor for parsing complex PDF figures and diagrams, and a source code search engine that employs structure-aware chunking to preserve function and class boundaries. It also implements the Model Context Protocol to integrate real-time data sour
Builds high-dimensional vector indices from text data to enable efficient semantic retrieval.
Garnet is a multi-threaded in-memory database and distributed key-value store. It functions as a high-performance remote cache store that implements the RESP wire protocol to maintain compatibility with existing Redis clients and libraries. The project is distinguished by a shared-memory architecture that enables parallel request processing across multiple cores for sub-millisecond latency. It features a tiered storage system that automatically offloads colder data from system memory to SSD or cloud storage layers, and includes a specialized vector search database for high-dimensional similar
Provides specialized approximate nearest neighbor indexing for high-dimensional vectors to enable fast semantic similarity search.