amznlabs/amazon-dsstneArchived
Amazon Dsstne
Amazon DSSTNE is a machine learning toolkit and sparse tensor network library designed for deep learning models with sparse inputs and outputs. It provides a model-parallel training framework and a GPU-accelerated sparse engine to support memory-intensive networks.
The framework is specifically designed for recommendation system training and large-scale sparse learning. It enables the distribution of large weight matrices and embedding tables across multiple GPU devices to handle models that exceed the memory capacity of a single processor.
The project covers a broad range of capabilities including distributed GPU computation, sparse dataset processing, and the construction of scalable sparse tensor networks. These utilities allow for the execution of high-performance machine learning operations and model scaling across GPU clusters.
Features
- Model Parallelism - Provides a model-parallel training framework to split large weight matrices across multiple GPUs.
- Distributed GPU Computing - Distributes training and prediction tasks across multiple GPUs to increase processing speed and memory capacity.
- Distributed GPU Training - Enables distributing neural network training and prediction workloads across multiple GPUs to increase memory and speed.
- Embedding Table Sharding - Supports partitioning massive embedding tables across distributed graphics processors to handle memory-intensive models.
- Recommendation Model Training - Designed for training deep learning recommendation models with weight matrices that exceed single-GPU memory.
- Model Training Frameworks - Provides a distributed training framework that scales large weight matrices across multiple GPUs for memory-intensive networks.
- Recommendation Models - Serves as a toolkit specifically for building deep learning recommendation models with sparse inputs and outputs.
- Sparse Computing Kernels - Implements specialized computational kernels to accelerate sparse neural network operations on GPU hardware.
- Sparse Tensor Network Libraries - Provides a library for building and training machine learning models using scalable sparse tensor networks.
- Sparse Computation Engines - Provides a GPU-accelerated sparse engine using custom kernels to process sparse datasets without zero-value expansion.
- Distributed Tensor Networks - Provides a distributed tensor network to organize large-scale model computations as a graph spread across a GPU cluster.
- Sparse Learning - Supports large-scale sparse learning by processing vast datasets with mostly zero values efficiently.
- Large-Scale Model Training - Supports building large-scale recommendation models using model-parallel scaling for weight matrices.
- Sparse Tensor Network Modeling - Enables constructing machine learning models using scalable sparse tensor networks to handle large-scale data.
- Sparse-to-Dense Embedding Tables - Provides embedding tables that map high-dimensional sparse inputs directly to dense vectors without matrix expansion.
- Sparse Data Processing - Executes computations on sparse datasets using custom GPU kernels to maintain performance without expanding zero entries.
- Deep Learning Frameworks - Library for building deep learning recommendation systems.
- General Machine Learning - Library for training and deploying deep neural networks at scale.
Star-Verlauf
