Awesome GitHub RepositoriesData Catalogs

Ce projet est un répertoire de logiciels open source organisé par la communauté, conçu pour être déployé dans des environnements de serveurs privés et des laboratoires domestiques. Il sert de ressource complète pour découvrir des alternatives indépendantes et auto-hébergées aux services cloud grand public, permettant aux utilisateurs de conserver la pleine propriété des données et le contrôle de leur infrastructure numérique. Le répertoire est structuré par une taxonomie hiérarchique qui organise une vaste collection d'applications en catégories logiques, allant de la gestion multimédia et de l'analyse de données à la communication privée et aux outils de productivité d'équipe. Il se distingue par un processus de revue par les pairs collaboratif, où les membres de la communauté valident la qualité et la pertinence de chaque soumission pour garantir que le répertoire reste précis et fiable. Le projet couvre une large surface de capacités, notamment l'automatisation de l'infrastructure, le déploiement de services basés sur des conteneurs et la gestion de configuration déclarative. Ces outils aident les utilisateurs à maintenir des environnements de serveur reproductibles et à gérer des dépendances de services complexes sur du matériel privé. Le répertoire est maintenu en tant que dépôt contrôlé par version, garantissant que toutes les mises à jour et les changements pilotés par la communauté sont suivis et transparents.

Dagster is a data orchestration platform designed to manage the entire lifecycle of data assets through declarative modeling and version-controlled code. It functions as a workflow engine that treats data assets as first-class primitives, allowing teams to define, schedule, and monitor complex pipelines while maintaining clear visibility into lineage, dependencies, and data quality. The platform distinguishes itself by using a code-as-configuration framework that enables standard software engineering practices, such as unit testing and local mocking, to be applied directly to data workflows.

The AWS Cloud Development Kit is an infrastructure-as-code framework that enables developers to define and provision cloud resources using familiar programming languages. By utilizing construct-based synthesis, it translates high-level, object-oriented code into declarative templates, allowing for the automated management of complex cloud environments through a centralized, code-driven control plane. The framework distinguishes itself through its ability to model infrastructure as a dependency-aware resource graph, ensuring that components are provisioned and updated in the correct order. It

DataHub is a metadata management platform designed to unify technical, operational, and business context across diverse data ecosystems. By utilizing a graph-based metadata model and an event-driven ingestion architecture, it creates a centralized source of truth that maps complex data relationships, lineage, and ownership. This foundational framework enables organizations to maintain a synchronized view of their data landscape, supporting both human-led discovery and automated data operations. The platform distinguishes itself through its focus on grounding artificial intelligence and autono

InsForge is a backend-as-a-service platform that provides an integrated suite of tools for managing relational databases, identity provision, object storage, and serverless compute. It functions as an open-source identity provider and a PostgreSQL database manager featuring integrated vector storage and row-level security. The platform serves as an LLM orchestration gateway, offering a unified endpoint to route requests across various AI providers through an OpenAI-compatible interface. It enables AI-driven application generation and connects AI agents to backend resources using a standardize

Clair is a container image vulnerability scanner and security analyzer. It performs static analysis of container images by matching package contents against vulnerability databases to identify security risks across different package formats and architectures. The project functions as both an image indexer and a vulnerability database manager. It processes container layers into intermediate representations to enable fast security lookups and synchronizes security metadata from multiple external sources to maintain a local registry. Capability areas include continuous security monitoring, whic

Delta is a lakehouse table format that brings ACID transactions and data warehouse consistency to large scale data lakes on cloud object storage. It serves as an ACID transaction manager, coordinating atomic commits and serializable isolation for concurrent reads and writes across distributed compute engines. The project provides a multi-engine interoperability layer that uses format translation to allow diverse SQL engines and processing frameworks to read and write the same tables. It functions as a data versioning system, utilizing a transaction log to enable time travel, historical snapsh

Higress is an AI API gateway and cloud-native traffic manager that functions as a Kubernetes ingress controller. It provides a centralized system for routing, securing, and optimizing traffic directed toward large language models, AI agents, and microservice architectures. The project distinguishes itself through deep AI orchestration, including the ability to host and manage Model Context Protocol servers that transform REST APIs into tools for AI agents. It features specialized AI infrastructure for model request proxying, protocol translation across multiple providers, and semantic-based c

CloudQuery is a cloud infrastructure ETL tool and multi-cloud data pipeline designed to collect, synchronize, and normalize resource metadata from various cloud providers and SaaS platforms. It functions as a centralized asset inventory manager and security posture manager, extracting configuration and state data into relational databases, data lakes, or data warehouses. The system distinguishes itself by transforming complex, nested cloud API responses into flat relational tables, enabling the use of standard SQL for asset querying and analysis. It employs a modular plugin system for data ex

NextFaster is a Next.js e-commerce storefront that uses artificial intelligence to generate a complete product catalog, including categories, descriptions, and images. Product images are stored in cloud object storage and served directly via CDN, offloading delivery from the origin server. Pages are delivered with pre-rendered shells from the edge, with dynamic content streamed in afterward for fast initial interactivity. All write operations—such as orders and catalog updates—are handled through server-side functions for data consistency and security. The project differentiates itself by com

BilibiliSponsorBlock is a content filtering system and API server designed to identify and remove sponsored segments and filler content from Bilibili video playback. It utilizes a crowdsourced segment database where users contribute and vote on timestamps to create a shared repository of skippable video sections. The project features a video metadata synchronizer that links equivalent videos across different platforms, allowing skip markers and timing data to be shared between mirrored content. It implements a reputation-based permission system to manage submissions and edits, alongside a pri

Ce projet est une bibliothèque d'intégration AWS pandas et un framework de pipeline de données conçu pour simplifier le mouvement et la transformation des données entre la mémoire locale et les services de stockage et d'analyse AWS. Il fonctionne comme une boîte à outils de lac de données cloud et un gestionnaire de fichiers de stockage, permettant aux utilisateurs de lire, écrire et transformer des données structurées à travers divers environnements cloud. La bibliothèque se distingue comme un orchestrateur de calcul distribué capable de gérer des clusters dans des environnements tels qu'EMR pour traiter des jeux de données qui dépassent les limites de mémoire d'une seule machine. Elle fournit également des capacités spécialisées pour gérer des indices vectoriels et effectuer des recherches de similarité au sein de buckets de stockage cloud. Sa surface de capacité plus large couvre l'ETL de base de données cloud pour des services comme DynamoDB, RDS et Timestream, ainsi que la gestion de catalogue de données cloud via AWS Glue. Elle prend en charge l'analyse de données sans serveur via Athena et Redshift, et fournit des utilitaires pour gérer les objets S3, indexer des documents dans OpenSearch et analyser les journaux CloudWatch.

Wanderer is a self-hosted trail database and federated social network for storing GPS tracks and hiking routes. It functions as a GPX route manager and geographic route planner that allows users to catalog outdoor explorations in a private database. The system utilizes the ActivityPub protocol to enable decentralized federation, allowing users to follow others and share activities across independent server instances. This social layer includes collaborative route exchange, engagement management for likes and comments, and granular content visibility controls. The platform provides tools for

This project is a self-hosted media server for organizing, streaming, and tracking anime and manga collections. It functions as a BitTorrent streaming client that allows video content to be played directly from torrents and cloud storage, a manga reader and tracker, and a media processing system using hardware-accelerated transcoding to ensure browser compatibility. The system distinguishes itself through synchronized media viewing, enabling users to host watch parties by coordinating playback in real time across multiple devices. It also features an extensible framework with a JavaScript-bas

Gravitino is a federated metadata lake and unified data catalog designed to manage tables, files, and AI models across diverse data sources and cloud storage. It serves as a centralized interface for governing schemas, access controls, and tagging across relational databases, messaging queues, and object stores. The project distinguishes itself by unifying the management of AI assets, such as machine learning models and their version lineages, alongside traditional tabular data. It also implements the Iceberg REST specification to provide a standardized metadata server and proxy for lakehouse