Awesome GitHub RepositoriesData Catalogs

यह प्रोजेक्ट निजी सर्वर वातावरण और होम लैब में डिप्लॉयमेंट के लिए डिज़ाइन किए गए ओपन-सोर्स सॉफ्टवेयर की एक समुदाय-क्यूरेटेड निर्देशिका है। यह मुख्यधारा की क्लाउड सेवाओं के स्वतंत्र, स्व-होस्ट किए गए विकल्पों को खोजने के लिए एक व्यापक संसाधन के रूप में कार्य करता है, जिससे उपयोगकर्ता अपने डिजिटल इंफ्रास्ट्रक्चर पर पूर्ण डेटा स्वामित्व और नियंत्रण बनाए रख सकते हैं। निर्देशिका को एक पदानुक्रमित वर्गीकरण के माध्यम से संरचित किया गया है जो अनुप्रयोगों के एक विशाल संग्रह को तार्किक श्रेणियों में व्यवस्थित करता है, जो मीडिया प्रबंधन और डेटा एनालिटिक्स से लेकर निजी संचार और टीम उत्पादकता टूल तक फैला हुआ है। यह एक सहयोगात्मक पीयर-रिव्यू प्रक्रिया के माध्यम से खुद को अलग करती है, जहाँ समुदाय के सदस्य निर्देशिका को सटीक और विश्वसनीय सुनिश्चित करने के लिए प्रत्येक सबमिशन की गुणवत्ता और प्रासंगिकता को मान्य करते हैं। प्रोजेक्ट इंफ्रास्ट्रक्चर ऑटोमेशन, कंटेनर-आधारित सर्विस डिप्लॉयमेंट और घोषणात्मक कॉन्फ़िगरेशन प्रबंधन सहित क्षमताओं के एक व्यापक क्षेत्र को कवर करता है। ये टूल उपयोगकर्ताओं को पुनरुत्पादनीय सर्वर वातावरण बनाए रखने और निजी हार्डवेयर पर जटिल सर्विस निर्भरताओं को प्रबंधित करने में सहायता करते हैं। निर्देशिका को एक वर्ज़न-कंट्रोल रिपॉजिटरी के रूप में बनाए रखा जाता है, यह सुनिश्चित करते हुए कि सभी अपडेट और समुदाय-संचालित परिवर्तन ट्रैक किए जाते हैं और पारदर्शी हैं।

Dagster is a data orchestration platform designed to manage the entire lifecycle of data assets through declarative modeling and version-controlled code. It functions as a workflow engine that treats data assets as first-class primitives, allowing teams to define, schedule, and monitor complex pipelines while maintaining clear visibility into lineage, dependencies, and data quality. The platform distinguishes itself by using a code-as-configuration framework that enables standard software engineering practices, such as unit testing and local mocking, to be applied directly to data workflows.

The AWS Cloud Development Kit is an infrastructure-as-code framework that enables developers to define and provision cloud resources using familiar programming languages. By utilizing construct-based synthesis, it translates high-level, object-oriented code into declarative templates, allowing for the automated management of complex cloud environments through a centralized, code-driven control plane. The framework distinguishes itself through its ability to model infrastructure as a dependency-aware resource graph, ensuring that components are provisioned and updated in the correct order. It

DataHub is a metadata management platform designed to unify technical, operational, and business context across diverse data ecosystems. By utilizing a graph-based metadata model and an event-driven ingestion architecture, it creates a centralized source of truth that maps complex data relationships, lineage, and ownership. This foundational framework enables organizations to maintain a synchronized view of their data landscape, supporting both human-led discovery and automated data operations. The platform distinguishes itself through its focus on grounding artificial intelligence and autono

InsForge is a backend-as-a-service platform that provides an integrated suite of tools for managing relational databases, identity provision, object storage, and serverless compute. It functions as an open-source identity provider and a PostgreSQL database manager featuring integrated vector storage and row-level security. The platform serves as an LLM orchestration gateway, offering a unified endpoint to route requests across various AI providers through an OpenAI-compatible interface. It enables AI-driven application generation and connects AI agents to backend resources using a standardize

Clair is a container image vulnerability scanner and security analyzer. It performs static analysis of container images by matching package contents against vulnerability databases to identify security risks across different package formats and architectures. The project functions as both an image indexer and a vulnerability database manager. It processes container layers into intermediate representations to enable fast security lookups and synchronizes security metadata from multiple external sources to maintain a local registry. Capability areas include continuous security monitoring, whic

Delta is a lakehouse table format that brings ACID transactions and data warehouse consistency to large scale data lakes on cloud object storage. It serves as an ACID transaction manager, coordinating atomic commits and serializable isolation for concurrent reads and writes across distributed compute engines. The project provides a multi-engine interoperability layer that uses format translation to allow diverse SQL engines and processing frameworks to read and write the same tables. It functions as a data versioning system, utilizing a transaction log to enable time travel, historical snapsh

Higress is an AI API gateway and cloud-native traffic manager that functions as a Kubernetes ingress controller. It provides a centralized system for routing, securing, and optimizing traffic directed toward large language models, AI agents, and microservice architectures. The project distinguishes itself through deep AI orchestration, including the ability to host and manage Model Context Protocol servers that transform REST APIs into tools for AI agents. It features specialized AI infrastructure for model request proxying, protocol translation across multiple providers, and semantic-based c

CloudQuery is a cloud infrastructure ETL tool and multi-cloud data pipeline designed to collect, synchronize, and normalize resource metadata from various cloud providers and SaaS platforms. It functions as a centralized asset inventory manager and security posture manager, extracting configuration and state data into relational databases, data lakes, or data warehouses. The system distinguishes itself by transforming complex, nested cloud API responses into flat relational tables, enabling the use of standard SQL for asset querying and analysis. It employs a modular plugin system for data ex

NextFaster is a Next.js e-commerce storefront that uses artificial intelligence to generate a complete product catalog, including categories, descriptions, and images. Product images are stored in cloud object storage and served directly via CDN, offloading delivery from the origin server. Pages are delivered with pre-rendered shells from the edge, with dynamic content streamed in afterward for fast initial interactivity. All write operations—such as orders and catalog updates—are handled through server-side functions for data consistency and security. The project differentiates itself by com

BilibiliSponsorBlock is a content filtering system and API server designed to identify and remove sponsored segments and filler content from Bilibili video playback. It utilizes a crowdsourced segment database where users contribute and vote on timestamps to create a shared repository of skippable video sections. The project features a video metadata synchronizer that links equivalent videos across different platforms, allowing skip markers and timing data to be shared between mirrored content. It implements a reputation-based permission system to manage submissions and edits, alongside a pri

यह प्रोजेक्ट एक AWS pandas एकीकरण लाइब्रेरी और डेटा पाइपलाइन फ्रेमवर्क है जिसे स्थानीय मेमोरी और AWS स्टोरेज और एनालिटिक्स सेवाओं के बीच डेटा की आवाजाही और रूपांतरण को सरल बनाने के लिए डिज़ाइन किया गया है। यह एक क्लाउड डेटा लेक टूलकिट और स्टोरेज फाइल मैनेजर के रूप में कार्य करता है, जो उपयोगकर्ताओं को विभिन्न क्लाउड वातावरणों में संरचित डेटा को पढ़ने, लिखने और बदलने की अनुमति देता है। लाइब्रेरी एक डिस्ट्रीब्यूटेड कंप्यूट ऑर्केस्ट्रेटर के रूप में खुद को अलग करती है जो EMR जैसे वातावरण में क्लस्टर्स को प्रबंधित करने में सक्षम है ताकि उन डेटासेट्स को प्रोसेस किया जा सके जो एक मशीन की मेमोरी सीमा से अधिक हैं। यह वेक्टर इंडेक्स को प्रबंधित करने और क्लाउड स्टोरेज बकेट्स के भीतर समानता खोज (similarity searches) करने के लिए विशेष क्षमताएं भी प्रदान करती है। इसकी व्यापक क्षमता सतह DynamoDB, RDS और Timestream जैसी सेवाओं के लिए क्लाउड डेटाबेस ETL, और AWS Glue के माध्यम से क्लाउड डेटा कैटलॉग प्रबंधन को कवर करती है। यह Athena और Redshift के माध्यम से सर्वरलेस डेटा एनालिटिक्स का समर्थन करती है, और S3 ऑब्जेक्ट्स को प्रबंधित करने, OpenSearch में दस्तावेजों को इंडेक्स करने और CloudWatch लॉग्स का विश्लेषण करने के लिए यूटिलिटीज प्रदान करती है।

Wanderer is a self-hosted trail database and federated social network for storing GPS tracks and hiking routes. It functions as a GPX route manager and geographic route planner that allows users to catalog outdoor explorations in a private database. The system utilizes the ActivityPub protocol to enable decentralized federation, allowing users to follow others and share activities across independent server instances. This social layer includes collaborative route exchange, engagement management for likes and comments, and granular content visibility controls. The platform provides tools for

This project is a self-hosted media server for organizing, streaming, and tracking anime and manga collections. It functions as a BitTorrent streaming client that allows video content to be played directly from torrents and cloud storage, a manga reader and tracker, and a media processing system using hardware-accelerated transcoding to ensure browser compatibility. The system distinguishes itself through synchronized media viewing, enabling users to host watch parties by coordinating playback in real time across multiple devices. It also features an extensible framework with a JavaScript-bas

Gravitino is a federated metadata lake and unified data catalog designed to manage tables, files, and AI models across diverse data sources and cloud storage. It serves as a centralized interface for governing schemas, access controls, and tagging across relational databases, messaging queues, and object stores. The project distinguishes itself by unifying the management of AI assets, such as machine learning models and their version lineages, alongside traditional tabular data. It also implements the Iceberg REST specification to provide a standardized metadata server and proxy for lakehouse