Awesome GitHub RepositoriesData Wrangling

Albumentations is an image augmentation library and computer vision preprocessing tool designed to expand datasets for deep learning models. It provides a collection of transformations that modify pixel values and spatial geometry to increase the diversity of training samples and improve model generalization. The library supports both 2D image augmentation and 3D volumetric data augmentation. It handles a variety of labels alongside images, ensuring that bounding boxes, keypoints, and segmentation masks remain accurately aligned when spatial transformations are applied. The tool incorporates

imgaug is a Python library for machine learning data augmentation and computer vision dataset expansion. It provides tools to increase the volume and variety of training sets by applying random geometric, color, and noise transformations to images. The library ensures spatial consistency by synchronizing transformations across images and their associated annotations, such as bounding boxes, keypoints, and segmentation maps. It uses a compositional pipeline pattern to chain multiple augmentations into sequences and employs deterministic seed management to reproduce specific data samples. The

Augmentor 是一个 Python 图像增强库和框架，旨在扩展机器学习数据集。它既是一个生成合成图像变体以增加数据多样性的预处理工具，也是一个训练数据流处理器，可将增强后的图像和标签直接馈送到神经网络循环中，而无需中间磁盘存储。 该框架保持图像与其对应掩码之间的空间对齐，这是语义分割训练所必需的。它支持多种几何和像素级变换，包括弹性形变、通过倾斜和扭曲进行的透视变换、旋转、剪切以及随机区域擦除。 该系统包含针对类别处理的策略以解决数据不平衡问题，并使用多线程来加速增强数据集的并行生成。它还提供了在预处理阶段清理和标准化原始图像文件的实用程序。

AugLy 是一个多模态数据增强库和机器学习数据集增强器。它提供了一个系统，用于在音频、图像、文本和视频数据集上生成训练数据的合成变体，以增加样本多样性并提高模型鲁棒性。 该库作为一个多媒体噪声模拟器，专门设计用于通过在媒体上叠加社交媒体模板和互联网伪影来模拟真实世界的用户捕获。它包括一个数据来源跟踪器，用于记录应用于每条增强数据的特定转换和强度级别。 该工具涵盖了广泛的数据集扩展功能，包括文本的语言转换、视频的时间和视觉转换以及音频的声学转换。

Official cleanlab repo is at https://github.com/cleanlab/cleanlab