FlagGems is an operator library for large language models implemented in the Triton Language.
The main features of flagopen/flaggems are: Computation and Optimization.
Open-source alternatives to flagopen/flaggems include: arogozhnikov/einops — Einops is a tensor manipulation library that provides a framework-agnostic interface for reshaping, Einstein… bitsandbytes-foundation/bitsandbytes — bitsandbytes is a deep learning quantization tool and library designed to reduce the memory footprint of large… cupy/cupy — CuPy is a CUDA array computing library that implements a NumPy-compatible interface for executing array operations and… dask/dask — Dask is a parallel computing framework and distributed task scheduler designed to scale Python data science workflows… deap/deap. adapter-hub/adapters — A Unified Library for Parameter-Efficient and Modular Transfer Learning.
Einops is a tensor manipulation library that provides a framework-agnostic interface for reshaping, Einstein summation, and multi-dimensional array operations. It serves as an abstraction layer that works across NumPy, PyTorch, TensorFlow, and JAX, allowing for tensor transformations without changing the API. The library distinguishes itself through a declarative notation system that uses readable string patterns to describe tensor rearrangements and reductions. This approach includes an extended Einstein summation interface that supports multi-letter axis names and a named dimension mapping
bitsandbytes is a deep learning quantization tool and library designed to reduce the memory footprint of large language models. It serves as a GPU memory optimizer and quantization framework, compressing model weights and features to 8-bit and 4-bit precision to enable inference and training on hardware with limited memory. The project provides a framework for low-rank adaptation, allowing the fine-tuning of quantized models by combining 4-bit weights with small trainable matrices. It further distinguishes itself through memory paging, which moves optimizer states between CPU and GPU memory t
CuPy is a CUDA array computing library that implements a NumPy-compatible interface for executing array operations and numerical computing on NVIDIA GPUs. It serves as a GPU-accelerated numerical library and a CUDA-based SciPy implementation, offloading heavy calculations to graphics hardware to increase processing speed for scientific and engineering workloads. The library enables multi-framework tensor exchange, allowing data buffers to be shared between different deep learning frameworks using standardized memory layouts to avoid memory copies. It also supports custom GPU kernel integratio
A Unified Library for Parameter-Efficient and Modular Transfer Learning