Awesome GitHub RepositoriesPipeline Execution Interfaces

PaddleX is a PaddlePaddle-based framework for building, deploying, and fine-tuning AI model pipelines, with pre-built support for computer vision, OCR, document analysis, and time series tasks. It offers a toolkit of ready-to-use pipelines for image classification, object detection, segmentation, and pose estimation, alongside an end-to-end OCR document analysis pipeline that extracts text, tables, formulas, and layout information. The platform also includes a dedicated time series forecasting pipeline for analyzing historical data to detect anomalies, classify patterns, and predict future val

Anomalib is a PyTorch-based library for visual anomaly detection, offering a modular framework, a comprehensive model zoo, and a benchmarking suite designed for industrial defect detection. It provides a wide range of algorithms—including generative, discriminative, teacher-student, and vision-language approaches—that support unsupervised, few-shot, and zero-shot settings. The library enables deployment through model export to ONNX and OpenVINO for edge devices, and includes a no-code web application for training and inference. It also features a command-line interface for orchestrating multi

ZenML is an extensible machine learning orchestration framework designed to manage the end-to-end lifecycle of data pipelines and AI agent workflows. It functions as a durable orchestrator that executes machine learning tasks as directed acyclic graphs, ensuring that every step is containerized for consistent performance across local, cloud, and hybrid infrastructure. By decoupling pipeline code from underlying compute and storage backends, the platform allows developers to define infrastructure-agnostic stacks that remain portable across diverse environments. The project distinguishes itself

ZenML is an orchestration platform designed for building, deploying, and monitoring reproducible machine learning pipelines and agentic workflows. It provides a unified framework that manages the entire lifecycle of machine learning assets, from data processing and model training to the deployment of persistent inference services. By decoupling pipeline logic from underlying compute and storage, the platform enables teams to transition workflows seamlessly from local development environments to production-grade cloud infrastructure. The platform distinguishes itself through a service-oriented

Este es un toolkit de procesamiento de lenguaje natural para chino que proporciona un conjunto de herramientas para segmentación de palabras, etiquetado gramatical (POS tagging) y reconocimiento de entidades nombradas. Incluye un parser de dependencia neuronal para analizar relaciones sintácticas y semánticas entre palabras y una suite de entrenamiento de machine learning para crear modelos lingüísticos personalizados utilizando datasets anotados. El toolkit se distingue por su flexibilidad de despliegue, ofreciendo un servidor dockerizado y una interfaz de servicio web que expone capacidades de procesamiento vía API. Soporta el uso de modelos preentrenados y permite la integración de léxicos externos y extensiones de diccionarios de palabras para mejorar la precisión del análisis. En términos generales, el proyecto cubre un pipeline completo de tareas lingüísticas, incluyendo segmentación de oraciones, mapeo de dependencia sintáctica y etiquetado de roles semánticos. Estas capacidades están disponibles a través de una interfaz de línea de comandos, módulos independientes o pipelines de análisis integrados. La lógica central está implementada en C++ con bindings oficiales para Python y Java.

Arroyo is a high-performance stream processing platform built in Rust. It executes continuous SQL queries on streaming data with event-time semantics, enabling accurate windowed aggregations, joins, and stateful computations on unbounded event streams. The platform uses native Rust execution for high throughput and low latency, with periodic checkpointing for exactly-once fault tolerance and horizontal scaling across distributed workers. The system integrates deeply with Kafka for reading and writing topics with exactly-once delivery and supports change data capture (CDC) from MySQL and Postg

Git stats is a command-line utility and reporting tool that analyzes project activity and generates statistical insights from source code version control data. It functions as a Git history analysis tool and repository analytics generator, processing historical commit logs and file modification patterns to track how codebases grow and change over time. The application operates through a command-line interface execution pipeline that parses raw repository logs and commit streams directly into structured data records. It includes an incremental activity aggregator that rolls up individual commi