Awesome GitHub RepositoriesDataset Formats

Keras is a high-level deep learning API used to design, build, and train neural networks for tasks such as computer vision, natural language processing, and time series forecasting. It provides a framework for defining model architectures and optimizing weights through a structured interface. The project is defined by a backend-agnostic design that allows the same model code to run across different compute engines. This multi-backend execution enables users to swap underlying engines to optimize for specific hardware or performance requirements. The system supports distributed model training

GPT-SoVITS is a text-to-speech synthesis engine and voice cloning toolkit designed for generating natural-sounding human speech. It functions as a neural audio processing pipeline that maps input text to high-fidelity audio waveforms, utilizing conditional variational autoencoders and flow-based decoders to ensure expressive output. The platform distinguishes itself through its ability to perform few-shot voice cloning and cross-lingual speech generation, allowing users to maintain a specific speaker's vocal identity and emotional delivery across multiple languages. By employing cross-modal l

Supervision is a computer vision toolset for normalizing model outputs, managing datasets, and visualizing annotations. It provides a framework to convert predictions from various classification and detection models into a standardized data format to ensure interoperability across different computer vision pipelines. The library features a post-processor for filtering, counting, and tracking detected objects across image frames and video streams. It includes capabilities for large image tiling to improve the detection of small objects and tools for assigning persistent identities to objects t

Detectron2 is a PyTorch computer vision framework and visual recognition platform designed for training and deploying models for object detection, image segmentation, and visual recognition. It provides a research-oriented environment for training complex vision models with multi-GPU acceleration. The project includes a specialized object detection library for identifying and locating multiple objects via bounding boxes, as well as an image segmentation toolkit for creating pixel-level masks through instance, semantic, and panoptic segmentation. Additionally, it features a human pose estimati

Fairseq is a PyTorch toolkit for sequence-to-sequence modeling, specializing in neural machine translation, automatic speech recognition, and large-scale language model training. It provides a framework for processing and aligning diverse data sources, including text, audio, and video, to support tasks such as speech-to-text conversion and multimodal sequence learning. The project is distinguished by its distributed training capabilities, which utilize parameter sharding, mixed-precision training, and CPU offloading to handle models that exceed single-device memory. It also includes specializ

WeClone is an end-to-end framework designed for the creation, training, and deployment of personalized conversational AI digital twins. By fine-tuning large language models on individual chat history, the platform enables the replication of unique communication styles, speech patterns, and conversational habits. The system manages the entire lifecycle of these digital avatars, from initial data preparation to final integration into messaging platforms for real-time interaction. The platform distinguishes itself through a comprehensive suite of data processing utilities that prepare raw messag

Presto is a distributed SQL query engine designed for high-performance analytical processing across heterogeneous data sources. It functions as a data federation platform and massively parallel processing engine, allowing users to execute interactive queries against diverse storage systems without requiring data migration. By mapping remote metadata and structures to a unified relational namespace, it enables seamless cross-platform analysis through a standard SQL interface. The engine distinguishes itself through a pluggable connector architecture and a shared-nothing distributed processing

Labelme 是一个基于 Python 的图像标注工具，用于创建计算机视觉数据集。它作为语义分割的可视化编辑器，允许用户使用多边形、矩形、点和圆定义对象边界。该应用程序还可用作多光谱图像标注器，支持卫星和科学图像中使用的位深度较高的 TIFF 文件。 该工具集成了 AI 辅助标注功能，可自动创建掩码和多边形。这些功能允许通过文本提示或交互式点选择来生成形状，根据用户放置的正负点提出边界建议。 该软件涵盖了广泛的数据管理和标注任务，包括创建密集像素掩码、旋转边界框和视频帧序列。它包含一个将内部 JSON 状态持久化转换为 COCO 和 Pascal VOC 等标准数据集格式的管道。其他功能包括图像级分类标志、几何细化工具和批量图像导入。

PaddleDetection is an object detection framework designed for the end-to-end development, training, and deployment of computer vision models. It provides a comprehensive library of modular neural network architectures and pipelines that support object detection, instance segmentation, and multi-object tracking tasks. The project distinguishes itself through a configuration-driven approach that decouples model components like backbones and heads, allowing for the flexible assembly of custom vision workflows. It incorporates advanced techniques such as anchor-free detection logic, joint detecti

MMSegmentation is an open-source semantic segmentation toolbox built on PyTorch that provides a modular, configurable framework for building, training, evaluating, and deploying segmentation models. At its core, it offers a config-driven pipeline that assembles training, evaluation, and inference workflows by parsing hierarchical configuration files, with a modular component registry that enables plug-and-play composition of neural network modules, optimizers, datasets, and metrics. The framework supports the full model lifecycle through a unified runner interface that controls training, testi

X-AnyLabeling is an AI-assisted annotation platform and computer vision labeling tool. It provides an interface for annotating images and videos using polygons and rectangles to create training sets for machine learning models. The project distinguishes itself through the integration of external AI models via a plugin-based inference backend, allowing for automated generation of candidate labels and the execution of specialized tasks like pose estimation and object detection. It also functions as an optical character recognition tool for extracting text and layout information from document im

RF-DETR is a Python library for training and deploying object detection, instance segmentation, and keypoint detection models built on a vision transformer architecture. It provides a unified command-line interface and Python API for the full workflow, from fine-tuning pretrained checkpoints on custom datasets to running inference on images, video files, and live camera streams. The project supports training on datasets in COCO or YOLO format, with automatic format detection and configurable augmentation pipelines. Models can be exported to ONNX, TFLite, or TensorRT for deployment across edge

Muzic 是一个用于 AI 驱动的音乐分析、创作和合成的深度学习平台和框架。它作为一个音乐生成框架和分析工具，利用大型语言模型和自主智能体来编排符号音乐和音频音乐的创作与解读。 该项目以其跨模态能力而著称，将自然语言和符号音乐映射到共享的联合嵌入空间中，用于零样本分类和信息检索。它采用了多种专门的架构，包括用于音频合成的扩散框架、用于长序列结构一致性的双粒度注意力机制，以及结合音乐理论规则与神经网络的混合系统。 该平台涵盖了广泛的功能，包括从文本和歌词生成 MIDI 序列、神经歌声合成以及自动歌词转录。它还提供用于音乐结构建模、基于属性的符号生成以及通过自主智能体编排外部音乐工具的工具。 支持性实用程序包括用于大规模 MIDI 二进制化、数据集编码的数据工程流水线，以及用于旋律音符提取和语音到音素对齐的音频信号处理。

mmocr 是一个基于 PyTorch 的光学字符识别（OCR）框架，旨在训练和部署文本检测、识别和关键信息提取模型。它作为一个全面的场景文本检测和识别工具箱，提供用于定位文本区域并将视觉文本转换为机器编码字符串的专用库。 该项目的独特之处在于用于关键信息提取的研究框架和高级文本定位功能。这些包括使用 Transformer 的基于点的定位，以及使用参数化贝塞尔曲线来识别和转录任意形状的文本。 该框架涵盖了广泛的计算机视觉功能，包括用于增强和标准化多样化 OCR 数据集的流水线管理、具有分布式扩展的模型训练，以及使用标准 OCR 指标的性能评估。它还提供用于几何多边形操作和结果可视化的实用程序，以便根据真实标注审计预测。 该系统使用 Python 实现，并支持通过 Docker 环境打包进行安装。

该项目是 RetinaNet 架构的深度学习实现，用于图像中的对象检测和分类。它构建为 Keras 对象检测框架和 TensorFlow 计算机视觉工具，提供了基于 RetinaNet 论文的完整神经网络实现。 该框架包含特征金字塔网络（Feature Pyramid Network）和用于处理对象检测的焦点损失函数（focal loss function）等专用组件。它具有可配置的主干架构和基于锚点（anchor-based）的边界框，可预测不同尺度和长宽比下的对象位置。 该工具集涵盖了计算机视觉的端到端工作流，包括训练例程、性能评估和模型推理部署。它提供数据管理实用程序，用于从 CSV 和 Pascal VOC 格式导入和调试图像标注，以及将训练好的模型转换为不同格式以进行部署的工具。