Awesome GitHub RepositoriesPipeline Execution Interfaces

PaddleX is a PaddlePaddle-based framework for building, deploying, and fine-tuning AI model pipelines, with pre-built support for computer vision, OCR, document analysis, and time series tasks. It offers a toolkit of ready-to-use pipelines for image classification, object detection, segmentation, and pose estimation, alongside an end-to-end OCR document analysis pipeline that extracts text, tables, formulas, and layout information. The platform also includes a dedicated time series forecasting pipeline for analyzing historical data to detect anomalies, classify patterns, and predict future val

Anomalib is a PyTorch-based library for visual anomaly detection, offering a modular framework, a comprehensive model zoo, and a benchmarking suite designed for industrial defect detection. It provides a wide range of algorithms—including generative, discriminative, teacher-student, and vision-language approaches—that support unsupervised, few-shot, and zero-shot settings. The library enables deployment through model export to ONNX and OpenVINO for edge devices, and includes a no-code web application for training and inference. It also features a command-line interface for orchestrating multi

ZenML is an extensible machine learning orchestration framework designed to manage the end-to-end lifecycle of data pipelines and AI agent workflows. It functions as a durable orchestrator that executes machine learning tasks as directed acyclic graphs, ensuring that every step is containerized for consistent performance across local, cloud, and hybrid infrastructure. By decoupling pipeline code from underlying compute and storage backends, the platform allows developers to define infrastructure-agnostic stacks that remain portable across diverse environments. The project distinguishes itself

ZenML is an orchestration platform designed for building, deploying, and monitoring reproducible machine learning pipelines and agentic workflows. It provides a unified framework that manages the entire lifecycle of machine learning assets, from data processing and model training to the deployment of persistent inference services. By decoupling pipeline logic from underlying compute and storage, the platform enables teams to transition workflows seamlessly from local development environments to production-grade cloud infrastructure. The platform distinguishes itself through a service-oriented

Acesta este un toolkit de procesare a limbajului natural (NLP) pentru limba chineză, care oferă o suită de instrumente pentru segmentarea cuvintelor, etichetarea părților de vorbire și recunoașterea entităților numite. Include un parser de dependență neuronală pentru analizarea relațiilor sintactice și semantice dintre cuvinte și o suită de antrenare machine learning pentru crearea de modele lingvistice personalizate folosind seturi de date adnotate. Toolkit-ul se distinge prin flexibilitatea desfășurării, oferind un server dockerizat și o interfață de serviciu web care expune capabilitățile de procesare prin API. Suportă utilizarea modelelor pre-antrenate și permite integrarea lexicoanelor externe și a extensiilor de dicționar de cuvinte pentru a îmbunătăți acuratețea analizei. În linii mari, proiectul acoperă un pipeline complet de sarcini lingvistice, inclusiv segmentarea propozițiilor, maparea dependențelor sintactice și etichetarea rolurilor semantice. Aceste capabilități sunt disponibile printr-o interfață în linie de comandă, module standalone sau pipeline-uri de analiză integrate. Logica de bază este implementată în C++ cu binding-uri oficiale pentru Python și Java.

Arroyo is a high-performance stream processing platform built in Rust. It executes continuous SQL queries on streaming data with event-time semantics, enabling accurate windowed aggregations, joins, and stateful computations on unbounded event streams. The platform uses native Rust execution for high throughput and low latency, with periodic checkpointing for exactly-once fault tolerance and horizontal scaling across distributed workers. The system integrates deeply with Kafka for reading and writing topics with exactly-once delivery and supports change data capture (CDC) from MySQL and Postg

Git stats is a command-line utility and reporting tool that analyzes project activity and generates statistical insights from source code version control data. It functions as a Git history analysis tool and repository analytics generator, processing historical commit logs and file modification patterns to track how codebases grow and change over time. The application operates through a command-line interface execution pipeline that parses raw repository logs and commit streams directly into structured data records. It includes an incremental activity aggregator that rolls up individual commi