Awesome GitHub RepositoriesDatabase Metadata Discovery

DBeaver is a universal database client and administration environment designed for managing diverse relational and non-relational database systems. It provides a unified graphical interface that enables users to perform data manipulation, schema migration, and performance monitoring across multiple platforms. By utilizing a standardized driver abstraction layer, the application translates generic requests into database-specific commands, ensuring consistent interaction regardless of the underlying technology. The project distinguishes itself through an extensible, plugin-based architecture th

OpenMetadata is an enterprise data catalog, metadata platform, and governance suite that functions as a knowledge graph for data assets. It serves as an AI-ready metadata layer, providing governed context and organizational memory to large language model agents via the Model Context Protocol. The platform distinguishes itself by capturing institutional knowledge, linking conversations, decisions, and remediation notes directly to data assets to preserve tribal knowledge. It integrates AI agents to automate metadata governance, such as suggesting descriptions and identifying sensitive data thr

DataHub is a metadata management system and data catalog platform designed to provide a centralized directory for discovering, managing, and documenting datasets across a diverse data stack. It serves as a comprehensive framework for metadata management, incorporating a data governance framework to classify sensitive information and assign ownership for organizational accountability. The platform distinguishes itself through AI-enabled data discovery, which connects large language models to a metadata graph to allow for natural language search and exploration of data assets. It also provides

DataHub is a metadata management platform designed to unify technical, operational, and business context across diverse data ecosystems. By utilizing a graph-based metadata model and an event-driven ingestion architecture, it creates a centralized source of truth that maps complex data relationships, lineage, and ownership. This foundational framework enables organizations to maintain a synchronized view of their data landscape, supporting both human-led discovery and automated data operations. The platform distinguishes itself through its focus on grounding artificial intelligence and autono

Popcorn Time is a cross-platform application that functions as a BitTorrent streaming client, enabling the playback of movies and television shows through sequential data downloading. It serves as a comprehensive media discovery platform and metadata API, providing tools to search, browse, and retrieve detailed information about entertainment content. The platform distinguishes itself through a robust streaming data provider service that maps regional streaming availability and resolves encrypted tokens into secure redirects for external media platforms. It supports global audiences by locali

Redis is a high-performance in-memory key-value store that functions as a distributed cache, message broker, and NoSQL database. It provides sub-millisecond read and write access to data stored in RAM and can operate as a vector database for indexing high-dimensional embeddings. The system supports a wide range of data storage and synchronization primitives, including the management of strings, hashes, lists, sets, and JSON documents. It enables real-time data operations through atomic transactions, hybrid persistence using snapshots and append-only logs, and high-availability configurations

Boto3 is the AWS SDK for Python, providing a programmatic interface for managing and automating AWS cloud infrastructure and services. It serves as a cloud management API client and resource manager for provisioning, configuring, and scaling virtual servers, databases, and storage. The library enables the implementation of infrastructure-as-code through declarative templates and scripts, allowing for the deployment of identical resource stacks across multiple accounts and geographic regions. It also provides a framework for coordinating distributed workflows, serverless functions, and contain

Predis is a PHP library for connecting to and executing commands against Redis and Valkey data stores. It functions as a client for managing data integration, providing dedicated implementations for cluster sharding, pub/sub messaging, and Sentinel-based service discovery. The project distinguishes itself through specialized clients for executing server-side Lua scripts with automated hash caching and a cluster client that supports gossip protocols and key distribution. It also implements a Sentinel client to manage high availability and failover within replicated environments. The library c

Acest proiect este un framework de integrare care inițializează servicii de apel la distanță (RPC) Apache Dubbo în cadrul aplicațiilor Spring Boot. Acesta servește ca un framework de comunicare pentru microservicii care permite implementarea serviciilor RPC, descoperirea serviciilor și guvernanța distribuită prin configurare automată. Proiectul se distinge prin furnizarea unui bridge RPC cross-language, permițând serviciilor scrise în limbaje diferite să comunice prin standarde precum gRPC și Protobuf. De asemenea, permite expunerea microserviciilor backend ca endpoint-uri REST folosind protocolul Triple pentru acces direct din browsere web și clienți terți. Framework-ul acoperă o gamă largă de capabilități, inclusiv guvernanța serviciilor distribuite pentru rutarea traficului și limitarea ratei, gestionarea centralizată a configurației și observabilitatea microserviciilor pentru trasarea cererilor și monitorizarea stării de sănătate. De asemenea, suportă straturi de transport diverse și integrări de stocare pentru Redis și Memcached. Proiectul oferă startere și configurații pentru a automatiza inițializarea infrastructurii RPC în mediul Spring Boot.

Amundsen is a data catalog and discovery platform that provides a centralized directory for indexing tables and dashboards. It functions as a metadata management system and search engine, allowing users to locate and understand available data assets across diverse distributed sources. The platform includes capabilities for data lineage tracking to map the origin and movement of datasets between systems. It also serves as a data profiling tool, calculating distribution and quality statistics for individual table columns to provide automated insights into the nature of the data. The system man

PostgREST este un instrument care transformă automat o schemă de bază de date PostgreSQL într-un API RESTful gata de producție. Servește drept strat de acces la baza de date și motor de interogare care mapează cererile HTTP direct în interogări SQL, oferind o interfață low-code pentru executarea operațiunilor de creare, citire, actualizare și ștergere (CRUD) fără a necesita cod boilerplate manual. Proiectul se distinge prin utilizarea generării de API bazată pe schemă și descoperirea bazată pe metadate pentru a expune tabelele bazei de date ca resurse navigabile. Extinde capabilitățile CRUD standard prin executarea de SQL personalizat și șablonat, un sistem de middleware bazat pe plugin-uri pentru injectarea logicii de business și capacitatea de a încărca biblioteci partajate externe la runtime. Sistemul acoperă o gamă largă de capabilități, inclusiv interogarea complexă a datelor cu join-uri de tabele, agregări și căutare full-text. Implementează un framework de securitate cuprinzător care include autentificare bazată pe token, permisiuni granulare la nivel de tabel și gestionarea CORS. Caracteristicile operaționale suplimentare includ caching-ul local al rezultatelor, monitorizarea stării de sănătate a serverului și conectivitate pentru SQL distribuit și Amazon Redshift. Instalarea este suportată în mai multe medii, inclusiv ca binar independent sau prin șabloane de automatizare Docker Compose și Heroku.

The Space and Time Go SDK is a development toolkit designed for interacting with decentralized storage environments and executing verifiable SQL queries. It provides the necessary infrastructure to manage database schemas, manipulate tables, and perform complex data operations within a distributed storage system. The SDK distinguishes itself by integrating cryptographic proof generation and verification directly into the database workflow. It enables the execution of SQL commands that produce mathematical evidence of data integrity, ensuring that results returned to an application remain accu

DevLake is a DevOps data platform and analytics tool designed to orchestrate data pipelines that ingest, transform, and sync metadata from external development tools into a unified database. It functions as a system for collecting and normalizing data from source control, CI/CD pipelines, and issue trackers into a standardized schema to enable consistent software delivery analytics. The platform distinguishes itself by transforming tool-specific data into a common domain model, allowing for the calculation of engineering metrics via SQL. It provides specialized frameworks for measuring DORA m