1 Repo
Awesome GitHub RepositoriesHigh-Dimensional Data Loading
Specialized loading of high-dimensional temporal data for GPU-accelerated training.
Distinct from High-Performance Training Schedulers: Candidates focus on compression or scheduling; this is specifically about high-throughput data loading for GPUs
Explore 1 awesome GitHub repository matching artificial intelligence & ml · High-Dimensional Data Loading. Refine with filters or upvote what's useful.
Awesome High-Dimensional Data Loading GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- lancedb/lancedb
lancedb/lancedb
9,031Auf GitHub ansehenLanceDB is a vector database and columnar data store designed to function as a versioned dataset manager and vector search engine. It serves as a high-performance backend for indexing and retrieving high-dimensional embeddings, providing the foundation for machine learning data pipelines. The system distinguishes itself through a combination of cloud-native object storage and immutable version tracking, allowing for data time-travel and reproducible AI experiments. It integrates hybrid search capabilities, merging dense vector similarity with BM25 full-text search and SQL-like scalar filters
Retrieves temporal windows of high-dimensional data from storage to maximize GPU utilization during training.
HTMLapproximate-nearest-neighbor-searchimage-searchnearest-neighbor-search
