23 个仓库
Tools and configurations for optimizing performance under high concurrent load.
Distinguishing note: Focuses on high-traffic web application scaling.
Explore 23 awesome GitHub repositories matching devops & infrastructure · Infrastructure Scaling. Refine with filters or upvote what's useful.
This project is a satirical software development framework and conceptual parody of modern DevOps. It functions as an empty-project generator and non-functional deployment tool designed to automate the total absence of code and infrastructure. The framework distinguishes itself by providing a zero-code application building process that removes the need for source code authoring. It includes a nowhere deployment capability, which distributes applications to non-existent environments to eliminate hosting requirements and technical liability. Additional capabilities include a build pipeline tha
Increases the capacity of non-existent deployments to handle any amount of traffic.
Remotion is a programmatic video framework that enables the creation of video content using component-based logic and standard web technologies. By leveraging a declarative animation engine, it allows developers to structure visual content as a hierarchy of reusable components, ensuring that animations and state updates remain consistent through deterministic frame execution. The framework distinguishes itself by utilizing a headless browser renderer that captures visual output frame-by-frame to generate high-quality video files. This architecture supports a cloud-native media pipeline, allow
Scales rendering workloads by offloading tasks to managed serverless cloud functions.
Mastodon is a self-hosted, decentralized social networking platform that functions as a microblogging application. It enables independent server instances to communicate and exchange social data through the standardized ActivityPub protocol, allowing users to participate in a global, interoperable network. The platform distinguishes itself through its federated architecture, which grants administrators full control over their community instances. This includes comprehensive tools for user moderation, account management, and the enforcement of community guidelines. The system is designed to ha
Optimizes database connections, background job queues, and worker processes for high-traffic stability.
Jitsi Meet 是一个用于实时音视频通信的开源平台。它提供了一个用于托管安全视频会议的完整基础设施,支持屏幕共享、消息传递和参与者投票等功能。该平台既可独立使用,也可集成到外部 Web 或移动应用程序中。 该系统利用选择性转发单元 (SFU) 架构在参与者之间路由媒体流,确保跨多个用户的有效通信。它依赖标准化的实时传输协议来管理数据传输,并包含用于绕过防火墙和网络地址转换的网络路径协商机制。安全性通过实施端到端加密和标准协议来维护,以保护通信会话的隐私。 该平台提供广泛的配置和部署选项,允许在私有服务器上进行自托管安装,或在云环境中进行可扩展部署。它支持通过容器化微服务和负载均衡进行基础设施管理,以在高负载期间保持性能。开发者可以通过编程接口(包括软件开发工具包和沙盒接口注入)扩展平台功能,以使通信体验符合特定的组织需求。
Supports dynamic scaling of server nodes in cloud environments to accommodate fluctuating participant counts and ensure consistent service availability.
Deepagents is an LLM agent orchestration platform and stateful application server designed for deploying and managing AI agents built with computational graphs. It provides a containerized runtime environment that handles agent execution, state persistence, and the versioning of AI assistants. The platform distinguishes itself through deep integration with the Model Context Protocol, allowing agents to function as servers that expose tools and capabilities to external clients. It features a sophisticated observability suite for capturing execution traces, performing LLM-based evaluations agai
Configures execution environments as either single host or distributed runtimes to match traffic needs.
Invidious is a privacy-focused, self-hosted alternative frontend for mainstream video platforms. It operates as a decentralized network of independent instances that provide a lightweight, ad-free interface for consuming media. By acting as a proxy between the user and the content provider, the platform prevents tracking and data collection while maintaining a familiar browsing experience. The project distinguishes itself through its robust suite of network-level traffic management and anonymization tools. It employs techniques such as IP rotation, reverse proxy stream routing, and integratio
Supports horizontal scaling of application containers behind load balancers to handle concurrent traffic.
LangChain.js is a framework for building, executing, and monitoring stateful agentic applications. It provides an orchestration engine that models workflows as directed graphs, allowing developers to connect language models, data sources, and external tools into modular, multi-step processes. The platform distinguishes itself through its focus on stateful execution and human-in-the-loop control. It manages agent lifecycles by persisting execution state across threads, enabling fault tolerance and the ability to pause workflows at designated breakpoints for manual review or modification. This
Adjusts active container counts based on CPU, memory, and task volume to maintain performance.
kops is a Kubernetes cluster provisioner and lifecycle manager designed to automate the creation, maintenance, and destruction of production-grade clusters on cloud infrastructure. It functions as a declarative infrastructure manager, synchronizing the live state of a cluster with versioned manifests stored in remote object storage to ensure idempotent operations. The project distinguishes itself by offering comprehensive automation for the entire cluster lifecycle, including high-availability control plane deployment, incremental rolling updates, and automated version upgrades. It also serve
Allows adjusting the capacity of specific instance groups by synchronizing cloud state with desired configuration.
PeerTube is a decentralized, open-source video hosting platform that enables users to operate independent, interoperable servers. By utilizing the ActivityPub protocol, it connects these servers into a global, federated network where users can follow channels, discover content, and interact across different instances. The platform is designed to function as a self-hosted video content management system, providing a community-driven alternative to centralized media services. What distinguishes PeerTube is its hybrid approach to content delivery and infrastructure management. It integrates peer
Optimizes resource allocation and infrastructure settings to support a large number of simultaneous viewers without performance degradation.
This project is a cloud-native identity and access management platform designed to centralize authentication, authorization, and identity lifecycle management. It functions as a standards-compliant OpenID Connect authorization server, providing secure session management and token issuance for web, mobile, and device-based applications. The platform is built to handle complex identity requirements through stateless token authentication and support for modern passwordless methods, including biometrics and hardware keys. What distinguishes this platform is its native support for multi-tenant env
Supports high availability and automatic scaling by running stateless application instances in parallel.
Nakama is a distributed server framework designed for real-time multiplayer games and social applications. It provides an authoritative runtime environment for executing game logic, ensuring consistent state and cheat-resistant gameplay across diverse client platforms. The system acts as a centralized backend, managing persistent player identities, social graphs, and real-time communication channels to support complex multiplayer interactions. The platform distinguishes itself through an integrated suite of LiveOps tools that allow developers to manage game economies, schedule time-bound even
Adjusts compute and storage capacity dynamically to handle fluctuating player traffic and ensure consistent performance for online titles.
Vue Storefront is a composable commerce platform designed to decouple the presentation layer from backend systems. By providing a headless frontend framework, it enables developers to build high-performance, mobile-first digital storefronts that remain independent of specific commerce engines, payment providers, or content management systems. The platform distinguishes itself through a modular architecture that uses standardized integration adapters to aggregate data from disparate services into a unified layer. This approach allows businesses to modernize legacy infrastructure or manage comp
Provides auto-scaling and global content delivery to maintain performance during high traffic.
KEDA is a Kubernetes event-driven autoscaler and cloud event scaling engine. It functions as a custom metrics provider that monitors external event sources—including message brokers, databases, and cloud metrics—to dynamically adjust the replica counts of containerized workloads. The project is distinguished by its scale-to-zero workflow, which reduces workloads to zero replicas during inactivity and automatically restarts them when new events are detected. It operates as a multi-cloud event trigger system, using a pluggable scaler interface to integrate with a wide array of third-party servi
Monitors message counts across various queues via API to adjust workload replicas.
AutoMQ is a cloud-native streaming platform and Kafka-compatible message broker. It implements the Kafka protocol to provide integration with existing clients and ecosystems while functioning as a message queue that persists data directly to cloud object storage. The system decouples compute from storage, allowing processing power and storage capacity to scale independently. It utilizes a shared-log architecture and object-storage-based persistence to remove dependencies on local disks, which reduces operational costs and eliminates manual disk management. The platform includes mechanisms fo
Automatically expands or shrinks compute resources and balances partitions to handle changing workload demands.
Gorse is a personalized recommendation engine server and machine learning pipeline designed to suggest items to users based on their behavior and preferences. It operates as a distributed system that separates training, candidate generation, and serving nodes to support high-throughput workloads. The system utilizes a multi-stage recommendation pipeline to refine results through retrieval, scoring, and reranking. It generates personalized suggestions using collaborative filtering, matrix factorization, and item-to-item similarity models, while also providing non-personalized and fallback reco
Distributes tasks across master, worker, and server nodes to separate heavy model training from real-time serving.
This project is a comprehensive educational resource and curriculum focused on site reliability engineering, distributed systems, and infrastructure operations. It provides technical guides, a systems engineering course, and instructional manuals designed to teach the principles of managing large-scale computing environments. The curriculum covers high-level architectural design for scalability and resilience, including fault-tolerant infrastructure, high-availability patterns, and microservices decomposition. It emphasizes the practical application of site reliability engineering through the
Covers strategies for optimizing infrastructure performance and scaling applications to handle high concurrent loads.
shapez.io is an open-source automation base building game and infinite sandbox factory simulation. Players extract and process geometric shapes through conveyor belts and industrial automation to meet delivery goals within an endless map. The project incorporates a logic circuit simulation environment, allowing for the creation of automated control systems using wiring and logic gates to optimize factory operations. It utilizes an entity-component game architecture to manage thousands of active elements across its simulation. Gameplay covers industrial automation and resource logistics, spec
Increases production capacity across the sandbox by duplicating complex building layouts.
how2 is a terminal-based tool that translates plain-English questions into shell commands using AI and StackOverflow data. It functions as a command-line interface where users describe what they want to do in natural language, and the tool returns the appropriate Unix shell or PowerShell command, with support for generating multi-line Bash scripts from natural language prompts. The tool distinguishes itself through its interactive answer browsing mode, which lets users select and copy from multiple StackOverflow answers directly in the terminal. It includes a fallback search mechanism that qu
Scales infrastructure and development capacity based on secured project funding.
Pigsty 是一个全面的数据库基础设施编排平台,旨在自动化高可用 PostgreSQL 集群的全生命周期。它作为一个基础设施即代码(IaC)框架,通过幂等 Playbook 管理集群协调、节点配置与服务发现。通过集成分布式共识机制,该平台确保了在包括裸机与虚拟化基础设施在内的多样化环境中,自动化故障转移与一致的状态强制执行。 该平台通过一套超越标准数据库管理的强大运营能力脱颖而出。它具备内置的观测流水线,将指标、日志与追踪聚合到集中式仪表盘中,用于实时性能监控与诊断分析。此外,它还提供了一个模拟专有线路协议与 SQL 语法的迁移框架,允许将遗留企业数据库工作负载集成到现代关系型环境中。 该系统涵盖了广泛的功能面,包括带有写时复制(CoW)克隆以实现快速部署的高级存储管理,以及协调关系型引擎与缓存及对象存储服务的多数据库编排。它还整合了安全加固、自动化备份与恢复,以及通过分层代理进行的流量路由,以将客户端连接与底层集群拓扑解耦。 该项目以自包含的包镜像模型分发,能够在安全或离线环境中实现一致的部署与依赖管理。
Adds new nodes and initializes additional high-availability clusters to expand managed infrastructure.
This project is a Terraform Kubernetes provisioner and K3s cluster deployer designed to automate the installation and configuration of lightweight container orchestration on Hetzner Cloud infrastructure. It functions as a Hetzner Cloud infrastructure module, using declarative configuration to manage the full lifecycle of virtual machines, private networks, and load balancers. The orchestrator focuses on high availability by deploying redundant control planes and worker nodes across multiple physical data centers to ensure service continuity. It incorporates a cloud network security manager to
Implements a scaling model where worker nodes are treated as replaceable resources based on demand.