Awesome GitHub RepositoriesDatabase Metadata Discovery

DBeaver is a universal database client and administration environment designed for managing diverse relational and non-relational database systems. It provides a unified graphical interface that enables users to perform data manipulation, schema migration, and performance monitoring across multiple platforms. By utilizing a standardized driver abstraction layer, the application translates generic requests into database-specific commands, ensuring consistent interaction regardless of the underlying technology. The project distinguishes itself through an extensible, plugin-based architecture th

OpenMetadata is an enterprise data catalog, metadata platform, and governance suite that functions as a knowledge graph for data assets. It serves as an AI-ready metadata layer, providing governed context and organizational memory to large language model agents via the Model Context Protocol. The platform distinguishes itself by capturing institutional knowledge, linking conversations, decisions, and remediation notes directly to data assets to preserve tribal knowledge. It integrates AI agents to automate metadata governance, such as suggesting descriptions and identifying sensitive data thr

DataHub is a metadata management system and data catalog platform designed to provide a centralized directory for discovering, managing, and documenting datasets across a diverse data stack. It serves as a comprehensive framework for metadata management, incorporating a data governance framework to classify sensitive information and assign ownership for organizational accountability. The platform distinguishes itself through AI-enabled data discovery, which connects large language models to a metadata graph to allow for natural language search and exploration of data assets. It also provides

DataHub is a metadata management platform designed to unify technical, operational, and business context across diverse data ecosystems. By utilizing a graph-based metadata model and an event-driven ingestion architecture, it creates a centralized source of truth that maps complex data relationships, lineage, and ownership. This foundational framework enables organizations to maintain a synchronized view of their data landscape, supporting both human-led discovery and automated data operations. The platform distinguishes itself through its focus on grounding artificial intelligence and autono

Popcorn Time is a cross-platform application that functions as a BitTorrent streaming client, enabling the playback of movies and television shows through sequential data downloading. It serves as a comprehensive media discovery platform and metadata API, providing tools to search, browse, and retrieve detailed information about entertainment content. The platform distinguishes itself through a robust streaming data provider service that maps regional streaming availability and resolves encrypted tokens into secure redirects for external media platforms. It supports global audiences by locali

Redis is a high-performance in-memory key-value store that functions as a distributed cache, message broker, and NoSQL database. It provides sub-millisecond read and write access to data stored in RAM and can operate as a vector database for indexing high-dimensional embeddings. The system supports a wide range of data storage and synchronization primitives, including the management of strings, hashes, lists, sets, and JSON documents. It enables real-time data operations through atomic transactions, hybrid persistence using snapshots and append-only logs, and high-availability configurations

Boto3 is the AWS SDK for Python, providing a programmatic interface for managing and automating AWS cloud infrastructure and services. It serves as a cloud management API client and resource manager for provisioning, configuring, and scaling virtual servers, databases, and storage. The library enables the implementation of infrastructure-as-code through declarative templates and scripts, allowing for the deployment of identical resource stacks across multiple accounts and geographic regions. It also provides a framework for coordinating distributed workflows, serverless functions, and contain

Predis is a PHP library for connecting to and executing commands against Redis and Valkey data stores. It functions as a client for managing data integration, providing dedicated implementations for cluster sharding, pub/sub messaging, and Sentinel-based service discovery. The project distinguishes itself through specialized clients for executing server-side Lua scripts with automated hash caching and a cluster client that supports gossip protocols and key distribution. It also implements a Sentinel client to manage high availability and failover within replicated environments. The library c

Dieses Projekt ist ein Integrations-Framework, das Apache Dubbo Remote Procedure Call (RPC) Dienste innerhalb von Spring Boot Anwendungen bootet. Es dient als Microservice-Kommunikations-Framework, das die Implementierung von RPC-Diensten, Service-Discovery und verteilter Governance durch automatisierte Konfiguration ermöglicht. Das Projekt zeichnet sich durch eine sprachübergreifende RPC-Brücke aus, die es Diensten in verschiedenen Sprachen ermöglicht, über Standards wie gRPC und Protobuf zu kommunizieren. Zudem ermöglicht es die Bereitstellung von Backend-Microservices als REST-Endpunkte unter Verwendung des Triple-Protokolls für den direkten Zugriff aus Webbrowsern und Drittanbieter-Clients. Das Framework deckt ein breites Spektrum an Funktionen ab, einschließlich verteilter Service-Governance für Traffic-Routing und Rate-Limiting, zentralisiertem Konfigurationsmanagement und Microservice-Observability für Request-Tracing und Health-Monitoring. Es unterstützt zudem diverse Transport-Layer und Speicherintegrationen für Redis und Memcached. Das Projekt bietet Starter und Konfigurationen zur Automatisierung des Bootstrappings der RPC-Infrastruktur innerhalb der Spring Boot Umgebung.

Amundsen is a data catalog and discovery platform that provides a centralized directory for indexing tables and dashboards. It functions as a metadata management system and search engine, allowing users to locate and understand available data assets across diverse distributed sources. The platform includes capabilities for data lineage tracking to map the origin and movement of datasets between systems. It also serves as a data profiling tool, calculating distribution and quality statistics for individual table columns to provide automated insights into the nature of the data. The system man

PostgREST ist ein Tool, das automatisch ein PostgreSQL-Datenbankschema in eine produktionsreife RESTful-API transformiert. Es dient als Datenbankzugriffsschicht und Abfrage-Engine, die HTTP-Anfragen direkt auf SQL-Abfragen abbildet und eine Low-Code-Schnittstelle für die Ausführung von Create-, Read-, Update- und Delete-Operationen bietet, ohne dass manueller Boilerplate-Code erforderlich ist. Das Projekt zeichnet sich durch schema-gesteuerte API-Generierung und metadatenbasierte Erkennung aus, um Datenbanktabellen als navigierbare Ressourcen offenzulegen. Es erweitert Standard-CRUD-Funktionen durch die Ausführung von benutzerdefiniertem und templated SQL, ein Plugin-basiertes Middleware-System zur Injektion von Geschäftslogik und die Möglichkeit, externe Shared Libraries zur Laufzeit zu laden. Das System deckt ein breites Spektrum an Funktionen ab, einschließlich komplexer Datenabfragen mit Tabellen-Joins, Aggregationen und Volltextsuche. Es implementiert ein umfassendes Sicherheits-Framework mit tokenbasierter Authentifizierung, granularen Berechtigungen auf Tabellenebene und CORS-Management. Zusätzliche operative Funktionen umfassen lokales Result-Caching, Server-Health-Monitoring und Konnektivität für verteilte SQL-Datenbanken und Amazon Redshift. Die Installation wird über mehrere Umgebungen hinweg unterstützt, einschließlich als eigenständige Binärdatei oder über Docker Compose- und Heroku-Automatisierungstemplates.

The Space and Time Go SDK is a development toolkit designed for interacting with decentralized storage environments and executing verifiable SQL queries. It provides the necessary infrastructure to manage database schemas, manipulate tables, and perform complex data operations within a distributed storage system. The SDK distinguishes itself by integrating cryptographic proof generation and verification directly into the database workflow. It enables the execution of SQL commands that produce mathematical evidence of data integrity, ensuring that results returned to an application remain accu

DevLake is a DevOps data platform and analytics tool designed to orchestrate data pipelines that ingest, transform, and sync metadata from external development tools into a unified database. It functions as a system for collecting and normalizing data from source control, CI/CD pipelines, and issue trackers into a standardized schema to enable consistent software delivery analytics. The platform distinguishes itself by transforming tool-specific data into a common domain model, allowing for the calculation of engineering metrics via SQL. It provides specialized frameworks for measuring DORA m