Awesome GitHub RepositoriesDistributed Device Orchestration

PaddleOCR is a comprehensive optical character recognition framework designed for detecting and transcribing text from images and documents into structured, machine-readable formats. It provides a modular computer vision pipeline that decouples image preprocessing, text detection, and character recognition into independent, configurable stages. This architecture supports automated document digitization and multilingual text recognition, capable of identifying text in over one hundred languages across diverse environments ranging from scanned documents to industrial scenes. The framework disti

JAX is a hardware-accelerated array library and automatic differentiation system for numerical computing. It provides a framework compatible with NumPy that extends array operations with a just-in-time compiler to transform Python functions into optimized kernels for execution on GPU and TPU accelerators. The system differentiates itself through the use of an XLA-based compiler and a single program multiple data sharding model. These capabilities allow the library to distribute large-scale computations across multiple hardware accelerators using both automatic parallelization and manual shard

Paddle is a deep learning framework designed for building, training, and deploying neural networks. It provides a platform for constructing models using tensor-based computations and supports both dynamic and static execution graphs to facilitate research and production workflows. The platform functions as a distributed machine learning system, enabling the scaling of training workloads across multiple nodes and hardware clusters. It includes a comprehensive toolkit for model deployment and optimization, allowing users to convert external model formats, compress trained models for resource-co

OpenVINO is an AI inference engine and model serving platform designed to execute optimized deep learning models across CPUs, GPUs, and NPUs through a unified API. It includes a model optimization toolkit for converting, quantizing, and compressing models from various frameworks, alongside a specialized generative AI runtime for large language models. The project distinguishes itself through a plugin-based hardware acceleration layer that maps neural network operations to vendor-specific drivers. It features advanced execution mechanisms such as continuous batching, speculative decoding, and

UFO is a multi-device task orchestrator and LLM agent orchestration framework designed to decompose natural language requests into executable task graphs. It functions as a cross-platform UI automation tool capable of performing interactions on Windows and mobile devices while routing tasks to distributed agents based on their hardware and software capabilities. The system is distinguished by its RAG-enhanced agent architecture, which integrates external documentation and previous execution traces to improve decision-making. It employs a hybrid UI detection approach that combines computer vis

trlx es una biblioteca de aprendizaje por refuerzo y framework de entrenamiento diseñado para alinear modelos de lenguaje grandes utilizando retroalimentación humana. Sirve como un entrenador distribuido y orquestador de cómputo para escalar modelos de alto número de parámetros a través de múltiples GPUs y nodos. El proyecto proporciona herramientas para el aprendizaje por refuerzo a partir de retroalimentación humana y alineación de modelos. Implementa optimización basada en modelos de recompensa y optimización de política proximal para refinar el comportamiento del modelo basado en recompensas orientadas a objetivos o conjuntos de datos etiquetados por humanos. El framework cubre estrategias de entrenamiento distribuido, incluyendo paralelismo de modelos, fragmentación de parámetros y sincronización de gradientes entre múltiples nodos. También incorpora restricciones como la divergencia KL para gestionar la deriva del modelo durante el proceso de aprendizaje por refuerzo.