Awesome GitHub RepositoriesData Catalogs

Este proyecto es un directorio curado por la comunidad de software de código abierto diseñado para su implementación en entornos de servidores privados y laboratorios domésticos. Sirve como un recurso integral para descubrir alternativas independientes y autohospedadas a los servicios en la nube convencionales, permitiendo a los usuarios mantener la propiedad total de los datos y el control sobre su infraestructura digital. El directorio está estructurado a través de una taxonomía jerárquica que organiza una vasta colección de aplicaciones en categorías lógicas, que van desde la gestión de medios y análisis de datos hasta la comunicación privada y herramientas de productividad en equipo. Se distingue por un proceso de revisión por pares colaborativo, donde los miembros de la comunidad validan la calidad y relevancia de cada envío para garantizar que el directorio siga siendo preciso y confiable. El proyecto cubre una amplia superficie de capacidades, incluyendo automatización de infraestructura, implementación de servicios basados en contenedores y gestión de configuración declarativa. Estas herramientas ayudan a los usuarios a mantener entornos de servidor reproducibles y gestionar dependencias de servicios complejas en hardware privado. El directorio se mantiene como un repositorio con control de versiones, asegurando que todas las actualizaciones y cambios impulsados por la comunidad sean rastreados y transparentes.

Dagster is a data orchestration platform designed to manage the entire lifecycle of data assets through declarative modeling and version-controlled code. It functions as a workflow engine that treats data assets as first-class primitives, allowing teams to define, schedule, and monitor complex pipelines while maintaining clear visibility into lineage, dependencies, and data quality. The platform distinguishes itself by using a code-as-configuration framework that enables standard software engineering practices, such as unit testing and local mocking, to be applied directly to data workflows.

The AWS Cloud Development Kit is an infrastructure-as-code framework that enables developers to define and provision cloud resources using familiar programming languages. By utilizing construct-based synthesis, it translates high-level, object-oriented code into declarative templates, allowing for the automated management of complex cloud environments through a centralized, code-driven control plane. The framework distinguishes itself through its ability to model infrastructure as a dependency-aware resource graph, ensuring that components are provisioned and updated in the correct order. It

DataHub is a metadata management platform designed to unify technical, operational, and business context across diverse data ecosystems. By utilizing a graph-based metadata model and an event-driven ingestion architecture, it creates a centralized source of truth that maps complex data relationships, lineage, and ownership. This foundational framework enables organizations to maintain a synchronized view of their data landscape, supporting both human-led discovery and automated data operations. The platform distinguishes itself through its focus on grounding artificial intelligence and autono

InsForge is a backend-as-a-service platform that provides an integrated suite of tools for managing relational databases, identity provision, object storage, and serverless compute. It functions as an open-source identity provider and a PostgreSQL database manager featuring integrated vector storage and row-level security. The platform serves as an LLM orchestration gateway, offering a unified endpoint to route requests across various AI providers through an OpenAI-compatible interface. It enables AI-driven application generation and connects AI agents to backend resources using a standardize

Clair is a container image vulnerability scanner and security analyzer. It performs static analysis of container images by matching package contents against vulnerability databases to identify security risks across different package formats and architectures. The project functions as both an image indexer and a vulnerability database manager. It processes container layers into intermediate representations to enable fast security lookups and synchronizes security metadata from multiple external sources to maintain a local registry. Capability areas include continuous security monitoring, whic

Delta is a lakehouse table format that brings ACID transactions and data warehouse consistency to large scale data lakes on cloud object storage. It serves as an ACID transaction manager, coordinating atomic commits and serializable isolation for concurrent reads and writes across distributed compute engines. The project provides a multi-engine interoperability layer that uses format translation to allow diverse SQL engines and processing frameworks to read and write the same tables. It functions as a data versioning system, utilizing a transaction log to enable time travel, historical snapsh

Higress is an AI API gateway and cloud-native traffic manager that functions as a Kubernetes ingress controller. It provides a centralized system for routing, securing, and optimizing traffic directed toward large language models, AI agents, and microservice architectures. The project distinguishes itself through deep AI orchestration, including the ability to host and manage Model Context Protocol servers that transform REST APIs into tools for AI agents. It features specialized AI infrastructure for model request proxying, protocol translation across multiple providers, and semantic-based c

CloudQuery is a cloud infrastructure ETL tool and multi-cloud data pipeline designed to collect, synchronize, and normalize resource metadata from various cloud providers and SaaS platforms. It functions as a centralized asset inventory manager and security posture manager, extracting configuration and state data into relational databases, data lakes, or data warehouses. The system distinguishes itself by transforming complex, nested cloud API responses into flat relational tables, enabling the use of standard SQL for asset querying and analysis. It employs a modular plugin system for data ex

NextFaster is a Next.js e-commerce storefront that uses artificial intelligence to generate a complete product catalog, including categories, descriptions, and images. Product images are stored in cloud object storage and served directly via CDN, offloading delivery from the origin server. Pages are delivered with pre-rendered shells from the edge, with dynamic content streamed in afterward for fast initial interactivity. All write operations—such as orders and catalog updates—are handled through server-side functions for data consistency and security. The project differentiates itself by com

BilibiliSponsorBlock is a content filtering system and API server designed to identify and remove sponsored segments and filler content from Bilibili video playback. It utilizes a crowdsourced segment database where users contribute and vote on timestamps to create a shared repository of skippable video sections. The project features a video metadata synchronizer that links equivalent videos across different platforms, allowing skip markers and timing data to be shared between mirrored content. It implements a reputation-based permission system to manage submissions and edits, alongside a pri

Este proyecto es una librería de integración de pandas con AWS y un framework de pipeline de datos diseñado para simplificar el movimiento y la transformación de datos entre la memoria local y los servicios de almacenamiento y análisis de AWS. Funciona como un toolkit de data lake en la nube y gestor de archivos de almacenamiento, permitiendo a los usuarios leer, escribir y transformar datos estructurados a través de varios entornos en la nube. La librería se distingue como un orquestador de cómputo distribuido capaz de gestionar clusters en entornos como EMR para procesar datasets que exceden los límites de memoria de una sola máquina. También proporciona capacidades especializadas para gestionar índices vectoriales y realizar búsquedas de similitud dentro de buckets de almacenamiento en la nube. Su superficie de capacidad más amplia cubre ETL de bases de datos en la nube para servicios como DynamoDB, RDS y Timestream, así como la gestión de catálogos de datos en la nube a través de AWS Glue. Admite análisis de datos sin servidor a través de Athena y Redshift, y proporciona utilidades para gestionar objetos S3, indexar documentos en OpenSearch y analizar registros de CloudWatch.

Wanderer is a self-hosted trail database and federated social network for storing GPS tracks and hiking routes. It functions as a GPX route manager and geographic route planner that allows users to catalog outdoor explorations in a private database. The system utilizes the ActivityPub protocol to enable decentralized federation, allowing users to follow others and share activities across independent server instances. This social layer includes collaborative route exchange, engagement management for likes and comments, and granular content visibility controls. The platform provides tools for

This project is a self-hosted media server for organizing, streaming, and tracking anime and manga collections. It functions as a BitTorrent streaming client that allows video content to be played directly from torrents and cloud storage, a manga reader and tracker, and a media processing system using hardware-accelerated transcoding to ensure browser compatibility. The system distinguishes itself through synchronized media viewing, enabling users to host watch parties by coordinating playback in real time across multiple devices. It also features an extensible framework with a JavaScript-bas

Gravitino is a federated metadata lake and unified data catalog designed to manage tables, files, and AI models across diverse data sources and cloud storage. It serves as a centralized interface for governing schemas, access controls, and tagging across relational databases, messaging queues, and object stores. The project distinguishes itself by unifying the management of AI assets, such as machine learning models and their version lineages, alongside traditional tabular data. It also implements the Iceberg REST specification to provide a standardized metadata server and proxy for lakehouse