1 dépôt
Awesome GitHub RepositoriesEmbedding Generation Pipelines
Workflows for transforming raw text into high-dimensional vectors for storage in vector databases.
Distinct from Vector Similarity Search: Focuses on the preprocessing/generation of embeddings rather than the search/matching algorithms.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Embedding Generation Pipelines. Refine with filters or upvote what's useful.
Awesome Embedding Generation Pipelines GitHub Repositories
Trouvez les meilleurs dépôts grâce à l'IA.Nous recherchons les dépôts les plus pertinents grâce à l'IA.
- eventual-inc/daft
Eventual-Inc/Daft
5,225Voir sur GitHubDaft is a distributed dataframe library and multimodal data processor designed to handle large-scale structured and unstructured data. It functions as a vectorized execution engine that processes tables alongside images, audio, and video, utilizing a unified schema to manage diverse data types. The project distinguishes itself by combining distributed data engineering with large-scale AI inference. It provides an AI data pipeline for batch-optimizing model prompts and generating high-dimensional text embeddings, while utilizing zero-copy memory sharing to execute custom Python functions witho
Generates high-dimensional text embeddings and calculates vector similarity for storage in vector search engines.
Rustai-engineeringai-pipelinearrow
