2 repository-uri
Awesome GitHub RepositoriesTensor Record Serialization
Specialized binary serialization formats used to stream large tensor datasets from disk.
Distinct from Disk-Serialized Collection Libraries: Existing candidates focus on cache persistence or filesystem formats, not ML-specific record serialization like TFRecords.
Explore 2 awesome GitHub repositories matching data & databases · Tensor Record Serialization. Refine with filters or upvote what's useful.
Awesome Tensor Record Serialization GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- tensorflow/rust
tensorflow/rust
5,480Vezi pe GitHubThis project provides Rust bindings for the TensorFlow C API, serving as a tensor computation interface and machine learning library. It enables the construction and execution of machine learning models and neural networks by bridging a systems language to high-performance backends. The framework supports GPU-accelerated computing to increase the speed of model training and inference by offloading mathematical operations to graphics processing units. It offers both graph-based computation for defining static network architectures and an eager execution mode for immediate operation calls durin
Uses a specialized binary format to efficiently stream large datasets from disk into memory.
Rust - kimiyoung/transformer-xl
kimiyoung/transformer-xl
3,703Vezi pe GitHubThis project is an implementation of the Transformer-XL language model, a neural network architecture designed for long-context language modeling. It provides frameworks for training and deploying models that capture long-term dependencies and relationships in text sequences that extend beyond a fixed context window. The implementation supports both PyTorch and TensorFlow, allowing for distributed training across multiple GPUs and host nodes. It employs a recurrent mechanism to maintain coherence in extended sequences, utilizing segment-level recurrence and state-based memory reuse. The code
Utilizes specialized binary serialization formats to stream large tensor datasets from disk for high-throughput training.
Python
