10 repositorios
Infrastructure for managing large-scale distributed computing networks.
Distinguishing note: Focuses on the operational infrastructure layer.
Explore 10 awesome GitHub repositories matching devops & infrastructure · Distributed Infrastructure. Refine with filters or upvote what's useful.
Umami is a self-hosted, privacy-focused web analytics platform designed to provide full control over infrastructure and user data. It captures website traffic and visitor behavior through anonymous tracking methods that avoid cookies, browser fingerprinting, and the storage of personally identifiable information. The platform distinguishes itself through a comprehensive suite of behavioral analysis tools, including session replays, heatmaps, and cohort-based retention reporting. It features a multi-tenant architecture that allows teams to manage multiple websites within a single, collaborativ
Supports distributed architecture by running the web server and database on separate machines.
NATS Server is a high-performance, lightweight messaging system designed for cloud-native applications, edge computing, and distributed microservices. It functions as a distributed publish-subscribe broker that routes messages using hierarchical, dot-separated subject strings, enabling decoupled communication between services without requiring centralized broker lookups. The system supports core messaging patterns including asynchronous publish-subscribe, request-reply, and load-balanced queue processing. The platform distinguishes itself through a decentralized architecture that eliminates t
Connects separate messaging environments across cloud and edge systems to create a unified communication fabric.
TiKV is a cloud-native distributed transactional key-value store and storage engine. It provides a distributed database designed for horizontal scalability and strong consistency across a cluster of physical nodes. The system uses a Raft-based consensus mechanism to maintain data availability and state synchronization. It ensures ACID compliance for distributed transactions through a two-phase commit workflow and manages data distribution via multi-Raft sharding. The engine handles massive datasets using automated range splitting and cluster load balancing to distribute data across different
Processes data directly on storage nodes using a coprocessor to reduce network traffic and lower system latency.
PeerTube is a decentralized, open-source video hosting platform that enables users to operate independent, interoperable servers. By utilizing the ActivityPub protocol, it connects these servers into a global, federated network where users can follow channels, discover content, and interact across different instances. The platform is designed to function as a self-hosted video content management system, providing a community-driven alternative to centralized media services. What distinguishes PeerTube is its hybrid approach to content delivery and infrastructure management. It integrates peer
Delegates resource-intensive tasks to external infrastructure to maintain platform performance as content volume grows.
Owncast is a self-hosted live streaming server that provides full control over broadcast infrastructure and audience data. It functions as an RTMP video streaming server, accepting incoming video feeds and distributing them to viewers through HLS-based segmented streaming. The platform includes a built-in, stateful web-based chat interface that enables real-time viewer engagement during broadcasts. The project distinguishes itself through deep integration with the decentralized Fediverse, allowing servers to automatically broadcast stream status updates and notify followers across distributed
Bypasses internal re-encoding to reduce hardware utilization or offloads segment distribution to third-party storage providers.
ART is a platform for agentic training, providing a reinforcement learning framework, training environment, and compute orchestrator. It enables the improvement of multi-step agent reasoning and tool usage through group relative policy optimization and a judge-based reward modeling system. The project features tools for model distillation to transfer capabilities from large teacher models to smaller architectures, as well as a system for capturing execution trajectories to generate synthetic training data. It supports specialized training workflows including supervised fine-tuning for baselin
Offloads the training process to managed hardware to remove the requirement for local GPU resources.
Performs operations like AllReduce directly on network switches to reduce CPU involvement and speed up multi-GPU training.
Orchestrates multiple Xray-core servers as nodes to distribute proxy traffic for redundancy and scalability.
caddy-docker-proxy es un proxy inverso HTTP dinámico y controlador de entrada (ingress) de red de Docker que genera automáticamente configuraciones de enrutamiento leyendo etiquetas de los contenedores de Docker. Sirve como herramienta de descubrimiento de servicios que detecta las direcciones IP de los contenedores en tiempo real para enrutar el tráfico web entrante a los destinos de backend correctos. El proyecto funciona como un orquestador de proxy distribuido, capaz de enviar configuraciones generadas desde un controlador central a múltiples instancias de servidor remotas para escalar el manejo de solicitudes. Automatiza la emisión y renovación de certificados de seguridad TLS para dominios proxy y coordina certificados compartidos entre réplicas de servidores. El sistema admite la generación de configuración basada en etiquetas, utilizando plantillas y secretos de Docker para inyectar metadatos y configuraciones globales en la configuración del servidor. Mantiene la sincronización escuchando los eventos del ciclo de vida del contenedor y utiliza un mecanismo de carga en proceso para actualizar el comportamiento del servidor. Las capacidades de gestión de tráfico incluyen la definición de reglas de enrutamiento de solicitudes, coincidencia de rutas y reescritura de URI para dirigir el tráfico a recursos contenedorizados.
Coordinates multiple proxy server instances from a central controller to scale request handling across a cluster.
Este proyecto es una plataforma de comunicación en tiempo real escalable diseñada para conferencias de video y audio de múltiples partes. Funciona como un servidor multimedia modular que orquesta sesiones en vivo, gestiona salas de reuniones virtuales y maneja la distribución de flujos multimedia a través de entornos informáticos distribuidos. La plataforma se distingue por su soporte para el puente de protocolos, permitiendo la traducción entre WebRTC, RTSP, SIP y HLS. Incorpora transcodificación acelerada por hardware para mantener el rendimiento en diversos dispositivos y utiliza una arquitectura basada en plugins para permitir el procesamiento multimedia personalizado, como análisis de contenido en tiempo real y detección de objetos. El sistema proporciona una infraestructura integral para gestionar tuberías (pipelines) multimedia, incluyendo grabación de sesiones, adaptación dinámica de red y la composición de diseños de video personalizados. También admite la integración de telefonía, permitiendo la conectividad entre salas de conferencias digitales y sistemas telefónicos tradicionales. Las funciones administrativas incluyen la gestión de servicios multi-inquilino y control de acceso basado en tokens para asegurar espacios virtuales. El software está empaquetado para el despliegue en contenedores, facilitando la ejecución y orquestación consistentes en clústeres de desarrollo y producción.
Manages virtual rooms and horizontal scaling of media workloads across distributed computing clusters.