4 रिपॉजिटरी
Direct data movement between GPU memory and persistent storage to bypass CPU bottlenecks.
Distinct from Direct File Descriptor I/O: Distinct from general file I/O as it specifically involves GPU-to-storage direct paths.
Explore 4 awesome GitHub repositories matching data & databases · GPUDirect Storage. Refine with filters or upvote what's useful.
cuDF is a GPU-accelerated dataframe library and data processing engine designed for manipulating and analyzing large tabular datasets. It provides a high-level API for executing filtering, joining, and aggregating operations directly on GPU hardware. The project integrates the Apache Arrow memory format to enable zero-copy data transfers and includes a just-in-time compiler for executing custom user-defined functions on the GPU. The library features specialized acceleration for existing workflows by redirecting standard Pandas dataframe calls and Polars query plans to a GPU backend. It also p
Provides direct data streaming between GPU buffers and filesystems to eliminate CPU bottlenecks.
jetson-inference is a set of libraries and tools for executing optimized deep learning models on embedded GPU hardware. Its primary purpose is to enable real-time computer vision and AI inference at the edge with low latency and high throughput. The project distinguishes itself through high-performance streaming analytics and the ability to execute concurrent AI pipelines on auto-grade silicon. It provides specialized support for multi-sensor stream processing, utilizing zero-copy data transport to load camera frames directly into GPU memory. The codebase covers a broad surface of capabiliti
NVIDIA moves sensor data directly into GPU memory using high-speed capture cards to minimize ingestion latency.
Reads and writes data directly between GPU memory and storage devices, eliminating CPU bounce buffers.
NVIDIA DALI is a GPU-accelerated data loading and preprocessing library designed for deep learning workflows. It constructs high-performance data pipelines that offload decoding, augmentation, and normalization to the GPU, eliminating CPU bottlenecks in training and inference. The library reads data from multiple storage formats and streams it directly into GPU memory, with support for multi-GPU execution to scale throughput across large-scale workloads. DALI distinguishes itself by enabling data pipelines to be built once and executed across multiple deep learning frameworks without code cha
Streams data directly from storage into GPU memory bypassing the CPU and system memory for lower latency.