Awesome GitHub RepositoriesHigh-Performance Inference Modes

PaddleOCR is a comprehensive optical character recognition framework designed for detecting and transcribing text from images and documents into structured, machine-readable formats. It provides a modular computer vision pipeline that decouples image preprocessing, text detection, and character recognition into independent, configurable stages. This architecture supports automated document digitization and multilingual text recognition, capable of identifying text in over one hundred languages across diverse environments ranging from scanned documents to industrial scenes. The framework disti

This project is a distributed training infrastructure designed for aligning large language models through reinforcement learning. It functions as an end-to-end engine for complex alignment tasks, including proximal policy optimization, direct preference optimization, and iterative self-play. By providing a unified framework for multi-turn interactions and tool-use scenarios, it enables the development of models capable of reasoning and external environment engagement. The framework distinguishes itself through a decoupled architecture that separates model training from sample generation. This

This project is a comprehensive toolkit designed for the full lifecycle management of large language and multimodal models. It functions as a unified orchestrator that handles the entire development process, ranging from dataset preparation and supervised fine-tuning to advanced reinforcement learning alignment and production-ready inference deployment. The platform distinguishes itself through a specialized reinforcement learning library that supports complex optimization algorithms, including group relative policy optimization and leave-one-out techniques, to improve model instruction-follo

PaddleX is a PaddlePaddle-based framework for building, deploying, and fine-tuning AI model pipelines, with pre-built support for computer vision, OCR, document analysis, and time series tasks. It offers a toolkit of ready-to-use pipelines for image classification, object detection, segmentation, and pose estimation, alongside an end-to-end OCR document analysis pipeline that extracts text, tables, formulas, and layout information. The platform also includes a dedicated time series forecasting pipeline for analyzing historical data to detect anomalies, classify patterns, and predict future val

MindSpore 是一个深度学习框架，旨在跨云、边缘和移动环境构建和训练神经网络。它作为分布式训练系统和硬件加速 AI 工具包，能够在 CPU、GPU 和专用 AI 处理器上执行工作负载。 该项目包括一个自动微分引擎，通过源代码转换和静态编译计算梯度。它通过使用数据和模型并行性在硬件之间拆分工作负载，从而实现分布式模型训练。 该框架涵盖跨平台 AI 部署和模型推理，利用高性能工具包加速执行和服务。它为 Ascend 硬件提供专门的加速，并支持异构设备后端的硬件无关算子映射。 该环境可以通过包管理器安装，也可以在 Linux 系统上从源代码编译，以用于标准或专用 AI 处理器环境。