30 open-source projects similar to lucidrains/vector-quantize-pytorch, ranked by how many features they have in common. Compare stars, activity and what each one does to find the best Vector Quantize Pytorch alternative.
EnCodec is a neural audio codec and compression tool designed to transform raw audio waveforms into discrete codes and reconstruct them back into sound. It functions as a system for neural audio representation, converting continuous audio signals into sequences of integer indices for use in generative AI tasks. The project utilizes a residual vector quantizer, which employs multiple layers of codebooks to represent audio signals with high precision at low bitrates. This approach allows the system to compress audio to discrete codes and perform low bitrate audio coding for efficient transmissi
This project is a PyTorch implementation of a text-to-image transformer. It is a generative AI model designed to map discrete text tokens to image pixels using a transformer network to create visual content from textual descriptions. The system utilizes a discrete VAE image encoder to compress visual data into tokens for transformer processing. It supports classifier-free guidance to adjust the influence of text prompts during inference and includes capabilities for ranking generated images based on their similarity to text prompts. The architecture incorporates sparse attention mechanisms a
Edward is a probabilistic programming language and inference engine designed for building deep generative models and Bayesian neural networks. It utilizes the TensorFlow framework to represent probabilistic models as differentiable computational graphs. The library enables the construction of complex data distributions through Bayesian neural networks, mixture models, and Gaussian processes. It differentiates itself by providing an integrated toolkit for both supervised and unsupervised probabilistic modeling, including the implementation of generative adversarial networks and mixture density
dalle-mini is a text-to-image model and generative AI system designed to transform natural language descriptions into synthetic images. It functions as an image generation training toolkit and a generative model capable of creating visual representations from text prompts. The project provides a containerized deployment for consistent execution across different computing environments. It includes the necessary scripts and configuration files to train custom generative models from datasets. The system utilizes an autoregressive transformer architecture that treats visual data as discrete toke
sqlite-vec is a C-based vector library and SQLite extension that adds virtual tables for storing and querying high-dimensional embeddings. It functions as a database plugin for performing nearest neighbor searches using distance metrics such as L2, cosine, and Hamming distance. The project provides a portable embedding store that supports deployment across Android, iOS, desktop environments, and web browsers via WebAssembly. It distinguishes itself by converting numerical arrays into compact binary formats and utilizing quantization to reduce the memory footprint and storage size of vector in
This is a generative AI model library containing a collection of PyTorch and TensorFlow implementations for creating synthetic data and modeling complex probability distributions. It serves as a multi-framework repository of deep learning models designed for learning and replicating data patterns. The project provides specialized implementation suites for several generative architectures. This includes Generative Adversarial Networks using competing generator and discriminator models, Variational Autoencoder frameworks that map data to a latent space, and Restricted Boltzmann Machine and Deep
USearch is a high-performance vector similarity search engine and approximate nearest neighbor index designed for dense embeddings. It functions as a low-level vector database core and high-dimensional vector indexer, providing the primitives necessary to store and retrieve vectors across massive datasets. The engine distinguishes itself through hardware-level SIMD acceleration for distance kernels and a proximity-graph indexing system that enables fast retrieval across billions of vectors. It supports multi-precision vector quantization to balance memory usage and accuracy, and utilizes memo
Multimodal is a machine learning library built on PyTorch for training large-scale models that combine text, image, audio, and video data streams. It functions as a deep learning framework dedicated to generative diffusion models, multi-task training, and vision-language tasks. The library supplies modular building blocks, discrete latent codebook quantization, shared-space embeddings, and stackable adapter layers to handle diverse conditional inputs during training and inference. The framework supports specific architectures for diffusion models, text-to-video generation, image-text retrieva
TurboVec is a high-performance Rust vector database and quantized search index designed for storing and retrieving high-dimensional embeddings. It functions as a pluggable vector store for large language model orchestration frameworks, providing a memory-efficient alternative to standard in-memory storage. The project distinguishes itself through a high-dimensional vector compressor that utilizes random rotation and data-oblivious scalar quantization to reduce memory footprints. Retrieval is accelerated via SIMD kernels that process distance calculations and search operations for increased th
This project is a PyTorch implementation of a discrete variational autoencoder designed to compress high-resolution imagery into discrete latent representations. It functions as an image autoencoder that encodes visual data into discrete codes and decodes those codes back into reconstructed images. The system utilizes a latent space image compressor to convert images into a compressed, discrete format. This allows for generative image synthesis and the analysis of image compression by transitioning between raw pixels and discrete code sequences. The implementation covers latent space visuali
This project is a research framework and toolkit designed for training large-scale vision transformers and multimodal language models. It provides a comprehensive suite for vision-language pretraining, enabling the development of models that map images and text into shared latent spaces. The framework is distinguished by its capabilities in high-fidelity image generation and multimodal research, utilizing normalizing flows and variational autoencoders to produce images from text prompts or class labels. It supports the development of both generative and contrastive models, allowing for a wide
Lightly is a self-supervised learning framework and computer vision data curation tool designed to manage large image datasets and train models on unlabeled data. It functions as a PyTorch vision library and dataset management SDK, providing tools to convert raw images into high-dimensional vectors for similarity search, visualization, and feature extraction. The project implements a variety of self-supervised architectures, including MoCo, SimCLR, VICReg, Barlow Twins, and masked image modeling. It distinguishes itself by combining these learning frameworks with active learning capabilities,
This project is a neural network route optimizer and unsupervised learning tool designed to solve the traveling salesman problem. It functions as a self-organizing map solver that calculates near-optimal paths through a set of coordinates to determine the shortest possible tour. The system utilizes a Kohonen map implementation to organize high-dimensional data into a lower-dimensional representation. It employs competitive learning and topology preservation to approximate solutions for combinatorial optimization problems. The solver covers route optimization analysis and heuristic pathfindin
LanceDB is a vector database and columnar data store designed to function as a versioned dataset manager and vector search engine. It serves as a high-performance backend for indexing and retrieving high-dimensional embeddings, providing the foundation for machine learning data pipelines. The system distinguishes itself through a combination of cloud-native object storage and immutable version tracking, allowing for data time-travel and reproducible AI experiments. It integrates hybrid search capabilities, merging dense vector similarity with BM25 full-text search and SQL-like scalar filters
This project is a full text search engine and enterprise search infrastructure designed for indexing and retrieving large sets of documents. It provides a comprehensive framework for information discovery using ranked results and linguistic analysis. The system integrates high-dimensional vector similarity search for semantic retrieval alongside traditional full-text capabilities. It distinguishes itself through support for geospatial data retrieval, multilingual text processing, and a search suggestion workflow that includes typo-tolerant query completion and spellchecking. The platform cov
Weaviate is a cloud-native vector database and distributed vector store designed to save high-dimensional vectors alongside structured data. It functions as a hybrid search engine that combines vector similarity, keyword matching, and structured metadata filtering within a single query. The system is optimized for retrieval-augmented generation, integrating vector search with generative AI and reranking to power question-and-answer workflows. It distinguishes itself through the ability to merge semantic search with traditional keyword queries and structured metadata filters to improve result
pgvecto.rs is a database extension that integrates high-dimensional vector search capabilities directly into PostgreSQL. It functions as a specialized engine for storing and retrieving embeddings, allowing relational databases to perform similarity searches alongside traditional structured data queries. The extension distinguishes itself through hardware-aware execution strategies that maximize performance. It performs runtime analysis of the host machine to utilize specific processor instruction sets for accelerated mathematical operations. To manage memory efficiently, it employs quantizati
TensorFlow Probability is a library for probabilistic reasoning and statistical analysis integrated with the TensorFlow ecosystem. It serves as a Bayesian deep learning framework, a probabilistic programming interface, and a variational inference engine, providing a toolset for Markov chain Monte Carlo sampling and tensor-based probabilistic modeling. The project enables the construction of neural networks with probabilistic weights and the implementation of Bayesian neural networks to quantify prediction uncertainty. It provides specialized capabilities for hierarchical probabilistic modelin
This project is a framework for training and deploying transformer-based models that map text, images, audio, and video into dense or sparse vector representations. It functions as a multimodal embedding library and semantic search engine used to retrieve relevant documents by calculating vector similarity between meanings. The framework provides specialized tools for both cross-encoder reranking, which calculates precise similarity scores to refine search results, and vector quantization to compress embedding vectors for reduced memory usage and increased retrieval speed. The project covers
Bark is a generative audio engine and machine learning inference library designed to convert written text into high-fidelity speech and sound effects. It functions as a text-to-audio transformer, utilizing multi-stage neural network architectures to map semantic input tokens into detailed audio codebooks for synthesis. The system distinguishes itself through a hierarchical transformer stacking approach that separates semantic understanding from acoustic realization. By employing autoregressive token prediction and vector quantized codebook mapping, the engine bridges linguistic and sonic doma
PyTorch-GAN is a research-oriented framework providing a collection of modular implementations for generative adversarial network architectures. It serves as a toolkit for training and evaluating models that utilize adversarial minimax optimization to produce synthetic data, offering a structured environment for exploring complex generative tasks within the PyTorch ecosystem. The library distinguishes itself through a comprehensive suite of image synthesis and manipulation capabilities, including super-resolution, inpainting, and cross-domain style translation. It supports advanced training m
Qdrant is a high-performance vector similarity database designed to store, index, and search high-dimensional vectors alongside structured metadata. It functions as a distributed search engine that manages large-scale data clusters, providing low-latency retrieval and complex filtering capabilities. The system is built to serve as a specialized middleware layer, connecting machine learning pipelines and AI agents to persistent storage for intelligent information retrieval and recommendation tasks. The platform distinguishes itself through advanced retrieval techniques, including support for h
This is a library of generative model architectures built using the TensorFlow framework. It provides implementations for producing synthetic data and realistic images, specifically focusing on Variational Autoencoders and various Generative Adversarial Network variants. The collection includes specific GAN architectures such as WGAN-GP, LSGAN, InfoGAN, and EBGAN. It also features Variational Autoencoders designed to learn latent representations and synthesize new samples from learned distributions. The project covers image processing pipelines for normalizing and cropping data, as well as a
This project provides a comprehensive educational curriculum and research resource for deep learning, focusing on the theoretical and technical foundations of neural network implementation. It serves as a structured academic guide for building and training complex models from scratch, covering the essential mathematical primitives, computational graph construction, and automatic differentiation mechanisms required for modern machine learning. The repository distinguishes itself through its extensive coverage of generative modeling and specialized neural architectures. It includes practical im
This project is a machine learning library providing a collection of implementations for supervised and unsupervised learning algorithms. It serves as a deep learning framework, a statistical classifier collection, and a suite of tools for unsupervised learning and dimensionality reduction. The library enables the construction of neural networks, including multi-layer perceptrons and convolutional networks for pattern recognition. It also provides tools for performing principal component analysis and manifold learning to visualize high-dimensional datasets, alongside a suite of clustering alg
Fairseq is a PyTorch toolkit for sequence-to-sequence modeling, specializing in neural machine translation, automatic speech recognition, and large-scale language model training. It provides a framework for processing and aligning diverse data sources, including text, audio, and video, to support tasks such as speech-to-text conversion and multimodal sequence learning. The project is distinguished by its distributed training capabilities, which utilize parameter sharding, mixed-precision training, and CPU offloading to handle models that exceed single-device memory. It also includes specializ
This project is a PyTorch implementation of StyleGAN2, providing a library and research framework for training style-based generative adversarial networks. It serves as a toolkit for high-resolution image synthesis, utilizing competitive minimax optimization to create realistic synthetic visual content. The framework incorporates specialized architectural components such as style-based latent mapping, multi-scale feature modulation, and self-attention layers to improve structural coherence. It distinguishes itself with advanced training stability techniques, including exponential moving avera
LibSQL is a high-performance, distributed SQL database engine that extends SQLite to support remote network access, edge computing, and real-time synchronization. It functions as an embedded database library that integrates directly into application processes while providing the infrastructure to maintain consistency across multiple geographic regions. The platform distinguishes itself by enabling database interaction over standard HTTP protocols, allowing applications to query remote data sources in serverless and edge environments without requiring local filesystem access. It includes nativ