Awesome GitHub RepositoriesModel Deployment Management

InsightFace is a comprehensive deep learning framework designed for face recognition, biometric identity verification, and feature extraction. It provides a specialized engine for one-to-one verification and one-to-many identification tasks, utilizing convolutional neural networks to transform raw image pixels into high-dimensional vector embeddings. The project includes a complete toolkit for detecting, aligning, and processing facial data to ensure consistent identity discrimination. Beyond core recognition, the platform distinguishes itself through an extensive model management and optimiz

This project provides a framework for managing multi-agent systems, designed to automate complex software development, infrastructure, and business workflows. It functions as a multi-agent workflow orchestrator that routes tasks to domain-specific workers while maintaining state persistence and infrastructure automation. By leveraging large language models, the system decomposes high-level objectives into actionable plans, ensuring that complex operations are executed with consistency and reliability. The framework distinguishes itself through its hierarchical agent registry and policy-driven

This project is a development platform for managing the lifecycle of generative artificial intelligence models. It provides a unified environment for accessing, fine-tuning, and deploying large language models, serving as an orchestrator that handles the integration of diverse models into custom applications. The platform distinguishes itself by offering a managed infrastructure for hosting and scaling models, which removes the requirement for manual server maintenance or configuration. It includes integrated tools for supervised fine-tuning and vector embedding optimization, allowing for the

This project is a curated collection of technical reference materials and study guides designed for machine learning interview preparation. It provides comprehensive resources for candidates pursuing engineering roles, focusing on deep learning, production infrastructure, and large-scale system design. The repository distinguishes itself through an architecture that combines theoretical research with industrial case studies. It utilizes a pattern-based approach to system design, breaking down complex deployments—such as recommendation engines, search ranking, and ad click prediction—into reus

OpenLLM is a framework for deploying, managing, and scaling open-source large language models

h2oGPT is a self-hosted platform designed for running large language models and executing retrieval-augmented generation workflows locally. It provides a comprehensive web interface that allows users to index private document collections into searchable databases, enabling context-aware question answering and summarization without exposing sensitive data to external services. The platform distinguishes itself by offering a modular architecture that supports both local model execution and connections to external inference servers. It facilitates the development of autonomous agents capable of

PyCaret is a Python AutoML platform and MLOps lifecycle manager designed to automate machine learning workflows. It functions as a low-code environment that leverages a scikit-learn native engine to execute preprocessing, training, and evaluation for tabular data. The platform distinguishes itself as an LLM-powered ML copilot, using large language model agents to analyze datasets, design experiment configurations, and explain model results. It also serves as a Kubernetes ML orchestrator and model registry, enabling the versioning of trained pipelines and their promotion to production API endp

DevOpsGPT ist eine LLM-gesteuerte DevOps-Automatisierungsplattform und ein KI-Softwareentwicklungs-Agent. Er wandelt natürlichsprachliche Anforderungen in funktionalen Code und automatisierte Bereitstellungen um, indem er Codebasis-Analysen, Code-Generierung und Delivery-Pipelines koordiniert. Das System verfügt über eine automatisierte Code-Generierungs-Engine und eine aufgabenbasierte Zerlegungs-Engine, die Projektstrukturen analysieren, um kontextbewusste Code-Erweiterungen zu erstellen. Es nutzt ein steckbares Modell-Integrationssystem, um sich für domänenspezifische Entwicklungsaufgaben mit privaten oder professionellen Sprachmodell-Bereitstellungen zu verbinden. Die Plattform verwaltet den gesamten Software-Delivery-Lebenszyklus durch einen CI/CD-Pipeline-Orchestrator, der Codesynthese mit automatisierten Test- und Bereitstellungstools verknüpft. Dies umfasst Funktionen für Software-Version-Releases und die Integration mit verschiedenen externen DevOps-Plattformen.

KServe is a Kubernetes-native platform for deploying and serving machine learning models as scalable inference services. It supports both generative AI models, including large language models, and traditional predictive models from frameworks such as TensorFlow, PyTorch, Scikit-Learn, XGBoost, and ONNX. The platform manages the full lifecycle of model deployments, including revision tracking, canary rollouts, A/B testing, and automatic rollbacks, and provides serverless scale-to-zero capabilities for cost-efficient resource management. KServe distinguishes itself through a standardized infere

KServe is an open platform for deploying and serving generative and predictive AI models on Kubernetes. It defines inference services as custom resources with declarative YAML specifications, enabling a Kubernetes-native approach to model deployment and lifecycle management. The platform leverages Knative-based serverless scaling for automatic scale-to-zero and revision management, and supports a pluggable serving runtime architecture that maps model formats to containerized execution environments. KServe distinguishes itself through model-aware autoscaling that scales replicas based on token

RStudio is a specialized integrated development environment for the R programming language and statistical computing. It provides a workbench for writing, debugging, and executing R code, offering both a desktop application and a server-hosted collaborative platform for managing data science projects. The platform enables the creation of interactive data applications, AI-powered dashboards, and technical reports. It facilitates the sharing of analysis results through a centralized publishing platform and supports the rendering of notebooks and markdown into multiple file formats. The environ

VisualDL ist ein Deep-Learning-Visualisierungs-Toolkit und Experiment-Tracking-Dashboard. Es bietet ein Web-basiertes Interface zur Überwachung von Trainingsmetriken, zur Analyse hochdimensionaler Daten und zum Rendern von Modellarchitekturen mittels statischer und dynamischer Graphen. Das Toolkit dient als Performance-Profiler, um Ausführungsengpässe zu identifizieren und die Ressourcennutzung zu optimieren. Es fungiert zudem als Datenanalysator, der Projektionsalgorithmen verwendet, um Beziehungen zwischen Punkten in komplexen Datensätzen zu identifizieren. Zu den Funktionen gehören das Tracking von Trainingsmetriken mittels Skalaren und Histogrammen, der Vergleich mehrerer Experimente durch Multi-Directory-Log-Aggregation und die Evaluierung der Klassifizierungsleistung mit Precision-Recall- und ROC-Kurven. Das System unterstützt zudem die Visualisierung von Multimedia-Outputs, einschließlich Bildern, Text und Audio. Benutzer können einen Visualisierungsserver starten, um Logs zu durchsuchen und Modellgraphen über einen Webbrowser zu erkunden.

Seldon Core ist ein auf Kubernetes basierender Server für Machine-Learning-Modelle und ein MLOps-Inference-Framework. Es fungiert als Serving-Engine für mehrere Modelle und als Pipeline-Orchestrator, der Modelle als skalierbare Microservices verpackt, die über standardisierte REST- und gRPC-APIs bereitgestellt werden. Das Projekt zeichnet sich durch graphbasierte Inference-Pipelines aus, die Modelle und Datentransformatoren zu sequenziellen Workflows verketten. Es optimiert die Hardwareauslastung durch Shared-Serving für mehrere Modelle und Strategien für dynamisches Memory-Overcommit, während es gleichzeitig Produktionsexperimente durch gewichtetes Traffic-Routing, A/B-Tests und Shadow-Deployments unterstützt. Das Framework deckt ein breites Spektrum an MLOps-Funktionen ab, darunter bedarfsgesteuertes Autoscaling, asynchrone Request-Verarbeitung über Message-Busse sowie umfassendes Monitoring für Data Drift, Ausreißer und die Erklärbarkeit von Vorhersagen. Es bietet zudem Infrastrukturmanagement für die Konfiguration der Modell-Runtime und sichere Kommunikation mittels TLS-Verschlüsselung über Control- und Data-Planes hinweg.

Aigcpanel is a visual workflow automation tool and model lifecycle manager designed for generative AI media pipelines. It provides a unified interface to install, launch, and configure both local and remote AI model endpoints, acting as an orchestration platform for large language models and AI tools. The system features a drag-and-drop node editor for chaining AI models and scripts into automated processing pipelines. It distinguishes itself with a breakpoint-aware execution model that allows users to pause and resume long media tasks from specific points in the workflow. Additionally, it in