Awesome GitHub RepositoriesObject Storage

यह प्रोजेक्ट निजी सर्वर वातावरण और होम लैब में डिप्लॉयमेंट के लिए डिज़ाइन किए गए ओपन-सोर्स सॉफ्टवेयर की एक समुदाय-क्यूरेटेड निर्देशिका है। यह मुख्यधारा की क्लाउड सेवाओं के स्वतंत्र, स्व-होस्ट किए गए विकल्पों को खोजने के लिए एक व्यापक संसाधन के रूप में कार्य करता है, जिससे उपयोगकर्ता अपने डिजिटल इंफ्रास्ट्रक्चर पर पूर्ण डेटा स्वामित्व और नियंत्रण बनाए रख सकते हैं। निर्देशिका को एक पदानुक्रमित वर्गीकरण के माध्यम से संरचित किया गया है जो अनुप्रयोगों के एक विशाल संग्रह को तार्किक श्रेणियों में व्यवस्थित करता है, जो मीडिया प्रबंधन और डेटा एनालिटिक्स से लेकर निजी संचार और टीम उत्पादकता टूल तक फैला हुआ है। यह एक सहयोगात्मक पीयर-रिव्यू प्रक्रिया के माध्यम से खुद को अलग करती है, जहाँ समुदाय के सदस्य निर्देशिका को सटीक और विश्वसनीय सुनिश्चित करने के लिए प्रत्येक सबमिशन की गुणवत्ता और प्रासंगिकता को मान्य करते हैं। प्रोजेक्ट इंफ्रास्ट्रक्चर ऑटोमेशन, कंटेनर-आधारित सर्विस डिप्लॉयमेंट और घोषणात्मक कॉन्फ़िगरेशन प्रबंधन सहित क्षमताओं के एक व्यापक क्षेत्र को कवर करता है। ये टूल उपयोगकर्ताओं को पुनरुत्पादनीय सर्वर वातावरण बनाए रखने और निजी हार्डवेयर पर जटिल सर्विस निर्भरताओं को प्रबंधित करने में सहायता करते हैं। निर्देशिका को एक वर्ज़न-कंट्रोल रिपॉजिटरी के रूप में बनाए रखा जाता है, यह सुनिश्चित करते हुए कि सभी अपडेट और समुदाय-संचालित परिवर्तन ट्रैक किए जाते हैं और पारदर्शी हैं।

SeaweedFS is a distributed object store and high-performance file system designed to manage massive volumes of unstructured data. It utilizes a decoupled architecture that separates metadata management from raw data storage, allowing for independent scalability and the efficient handling of billions of files. By providing a POSIX-compliant interface, it enables applications to interact with a unified namespace while maintaining the performance characteristics of a distributed object store. The system distinguishes itself through a multi-region data fabric that supports active-active replicati

This project serves as a comprehensive technical reference for the architecture and design of data-intensive applications. It provides a structured analysis of the fundamental principles required to build reliable, scalable, and maintainable software systems, covering the core trade-offs inherent in modern data infrastructure. The repository explores the mechanics of distributed data management, including strategies for replication, partitioning, and achieving consensus across multiple nodes. It details the design of storage engines, indexing techniques, and transaction management models, whi

This project is a feature-rich Go client library designed for interacting with Redis. It serves as a comprehensive interface for managing remote data stores, enabling developers to execute standard database commands, handle complex data structures, and perform asynchronous operations within Go applications. The library distinguishes itself through its support for advanced Redis capabilities, including connection pooling, pipelining, and transactional integrity. It provides specialized primitives for managing distributed clusters, including automated topology updates and request routing to sha

Prefect is a workflow orchestration platform designed to define, schedule, and monitor complex data pipelines as Python code. It functions as a container-native engine that wraps individual tasks in isolated environments, ensuring consistent dependencies and resource allocation across diverse infrastructure. By utilizing a state-machine-based orchestration model, the system tracks execution progress through discrete transitions and persistent event logs to maintain reliable and observable task processing. The platform distinguishes itself through a decoupled worker-API architecture, which sep

NATS Server is a high-performance, lightweight messaging system designed for cloud-native applications, edge computing, and distributed microservices. It functions as a distributed publish-subscribe broker that routes messages using hierarchical, dot-separated subject strings, enabling decoupled communication between services without requiring centralized broker lookups. The system supports core messaging patterns including asynchronous publish-subscribe, request-reply, and load-balanced queue processing. The platform distinguishes itself through a decentralized architecture that eliminates t

VictoriaMetrics is a high-performance, scalable time series database and observability platform designed for long-term storage and analysis of metric, log, and trace data. It functions as a unified backend for monitoring ecosystems, offering full compatibility with industry-standard protocols and query languages. The system is built to handle massive data volumes through a distributed architecture that supports horizontal scaling and efficient data lifecycle management. The platform distinguishes itself through a storage engine that utilizes consistent hashing for data sharding and log-struct

Ceph is a unified, software-defined storage platform designed to provide object, block, and file storage services from a single distributed cluster. By decoupling data management from physical hardware, it enables elastic scaling across commodity hardware, allowing organizations to build large-scale storage infrastructure without reliance on proprietary vendor equipment. The system distinguishes itself through a shared-nothing, distributed architecture that utilizes deterministic hashing for data placement. This approach eliminates centralized metadata bottlenecks, allowing the cluster to sca

CVAT एक ओपन-सोर्स कंप्यूटर विज़न एनोटेशन टूल और विज़ुअल डेटासेट प्रबंधन प्लेटफ़ॉर्म है। यह विज़न AI मॉडल के लिए डेटासेट बनाने के लिए छवियों, वीडियो और 3D डेटा को लेबल करने के लिए एक स्व-होस्टेड इंटरफ़ेस प्रदान करता है। प्लेटफ़ॉर्म में मास्क और बाउंडिंग बॉक्स के निर्माण को स्वचालित करने के लिए AI-सहायता प्राप्त डेटा लेबलिंग की सुविधा है, जो बाहरी मशीन लर्निंग मॉडल को जोड़ने के लिए प्लग-इन सिस्टम का उपयोग करता है। इसमें एक आम सहमति-आधारित गुणवत्ता आश्वासन प्रणाली शामिल है जो स्वतंत्र एनोटेशन की तुलना करके लेबल सटीकता को सत्यापित करती है। सिस्टम सहयोगी टीम प्रबंधन, कार्य अपघटन के माध्यम से प्रोजेक्ट संगठन, और रिमोट क्लाउड स्टोरेज एकीकरण को कवर करता है। यह प्रोग्रामेटिक वर्कफ़्लो नियंत्रण और उद्योग-मानक प्रारूपों में डेटा के आयात और निर्यात के लिए एक REST API भी प्रदान करता है।

Bolt is a single-file embedded key-value store for Go applications. It is an ACID transactional database that organizes data in B+trees on disk to provide efficient sorted key retrieval and range scans. The system uses a memory-mapped model to map the database file directly into the process address space for fast random-access reads. The project distinguishes itself through a multi-version concurrency control architecture that allows multiple simultaneous readers to access a consistent snapshot of data without blocking a writer. It employs a single-writer multi-reader locking model and uses a

PeerTube is a decentralized, open-source video hosting platform that enables users to operate independent, interoperable servers. By utilizing the ActivityPub protocol, it connects these servers into a global, federated network where users can follow channels, discover content, and interact across different instances. The platform is designed to function as a self-hosted video content management system, providing a community-driven alternative to centralized media services. What distinguishes PeerTube is its hybrid approach to content delivery and infrastructure management. It integrates peer

Floci is a local emulator for AWS services and cloud infrastructure designed for developing and testing applications without a live internet connection. It serves as a containerized cloud emulator and a serverless runtime emulator, allowing users to run high-fidelity replicas of cloud databases, queues, and compute services on a local machine. The project distinguishes itself by using real container images instead of simple mocks to ensure behavioral accuracy. It functions as a local API gateway simulator with proxy-based routing for REST and WebSocket APIs, and provides a serverless environm

JuiceFS is a distributed file system designed to mount object storage as a local, POSIX-compliant drive. It functions as a cloud-native persistent storage layer that decouples file metadata from raw data, storing metadata in a transactional database while keeping data blocks in object storage. This architecture enables multiple hosts across different regions to access the same storage simultaneously while maintaining strong consistency. The system distinguishes itself by performing data processing, including compression and encryption, directly on the client side before transmission. By split

The AWS Cloud Development Kit is an infrastructure-as-code framework that enables developers to define and provision cloud resources using familiar programming languages. By utilizing construct-based synthesis, it translates high-level, object-oriented code into declarative templates, allowing for the automated management of complex cloud environments through a centralized, code-driven control plane. The framework distinguishes itself through its ability to model infrastructure as a dependency-aware resource graph, ensuring that components are provisioned and updated in the correct order. It

InsForge is a backend-as-a-service platform that provides an integrated suite of tools for managing relational databases, identity provision, object storage, and serverless compute. It functions as an open-source identity provider and a PostgreSQL database manager featuring integrated vector storage and row-level security. The platform serves as an LLM orchestration gateway, offering a unified endpoint to route requests across various AI providers through an OpenAI-compatible interface. It enables AI-driven application generation and connects AI agents to backend resources using a standardize

Azure Docs is the official technical documentation repository for Microsoft Azure, the cloud computing platform. It provides comprehensive guidance on the full spectrum of Azure services, covering everything from core infrastructure components like virtual machines, Kubernetes clusters, and serverless computing to platform services for AI, machine learning, data analytics, and storage. The documentation details how to provision, manage, and govern cloud resources at scale, including policy enforcement, identity management, and cost optimization. The documentation distinguishes Azure through i

Owncast is a self-hosted live streaming server that provides full control over broadcast infrastructure and audience data. It functions as an RTMP video streaming server, accepting incoming video feeds and distributing them to viewers through HLS-based segmented streaming. The platform includes a built-in, stateful web-based chat interface that enables real-time viewer engagement during broadcasts. The project distinguishes itself through deep integration with the decentralized Fediverse, allowing servers to automatically broadcast stream status updates and notify followers across distributed

s3fs-fuse is a FUSE-based filesystem that mounts Amazon S3 buckets and S3-compatible object storage as local directories. It functions as a cloud object storage gateway, translating standard POSIX filesystem calls into RESTful API requests to allow remote objects to be accessed as if they were local files. The project enables the mapping of remote object stores to local paths on Linux, macOS, and FreeBSD. It supports integration with third-party S3-compatible providers through the use of custom service URLs and specialized request styles. The system includes capabilities for local data and m

Boto3 is the AWS SDK for Python, providing a programmatic interface for managing and automating AWS cloud infrastructure and services. It serves as a cloud management API client and resource manager for provisioning, configuring, and scaling virtual servers, databases, and storage. The library enables the implementation of infrastructure-as-code through declarative templates and scripts, allowing for the deployment of identical resource stacks across multiple accounts and geographic regions. It also provides a framework for coordinating distributed workflows, serverless functions, and contain

bbolt is an ACID-compliant embedded key-value store for Go applications. It persists all data in a single memory-mapped file on disk, organizing information using B+ trees to facilitate sorted key iteration and efficient range queries. The project distinguishes itself through a hierarchical data organization model, allowing buckets to be nested within other buckets to create a tree-like structure. It employs a single-writer, multi-reader locking mechanism and copy-on-write transactions to ensure serializable isolation and data integrity. The system includes comprehensive data management capa