awesome-repositories.com
Blog
awesome-repositories.com

Descubre los mejores repositorios open-source con nuestra búsqueda potenciada por IA.

ExplorarBúsquedas curadasAlternativas open-sourceSoftware autohospedableBlogMapa del sitio
ProyectoAcerca deCómo clasificamosPrensaServidor MCP
Aviso legalPrivacidadTérminos
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

323 repositorios

Awesome GitHub RepositoriesData Management

Tools and utilities for maintaining, organizing, protecting, and migrating data throughout its operational lifecycle.

Explore 323 awesome GitHub repositories matching data & databases · Data Management. Refine with filters or upvote what's useful.

Awesome Data Management GitHub Repositories

Encuentra los mejores repositorios con IA.Buscaremos los repositorios que mejor coincidan usando IA.
  • donnemartin/system-design-primerAvatar de donnemartin

    donnemartin/system-design-primer

    353,387Ver en GitHub↗

    Este proyecto es un recurso educativo integral y una guía de estudio centrada en la arquitectura de sistemas distribuidos y el diseño de infraestructura backend. Proporciona un plan de estudios estructurado para dominar los principios de escalabilidad, confiabilidad y rendimiento necesarios para diseñar sistemas de software complejos. El repositorio se distingue por ofrecer un enfoque metódico para la preparación de entrevistas técnicas, incorporando patrones de diseño, compensaciones arquitectónicas y herramientas de repetición espaciada para ayudar a los usuarios a retener conceptos complejos. Enfatiza el análisis basado en restricciones, enseñando a los usuarios cómo evaluar requisitos competitivos como latencia, consistencia y disponibilidad al redactar diseños arquitectónicos. El contenido cubre un amplio espectro de capacidades de diseño de sistemas, incluyendo estrategias para el escalado de bases de datos, gestión de tráfico y optimización de infraestructura. Detalla técnicas para el escalado horizontal, almacenamiento en caché multicapa, comunicación asíncrona y descubrimiento de servicios, al tiempo que proporciona marcos para realizar estimaciones de recursos y planificación de capacidad. La documentación está organizada como una guía de estudio, ofreciendo un camino sistemático a través de los fundamentos de la ingeniería backend y el diseño de sistemas a gran escala.

    Provides utilities for creating globally unique identifiers to ensure data consistency across distributed systems.

    Pythondesigndesign-patternsdesign-system
    Ver en GitHub↗353,387
  • chalarangelo/30-seconds-of-codeAvatar de Chalarangelo

    Chalarangelo/30-seconds-of-code

    128,121Ver en GitHub↗

    30-seconds-of-code is a comprehensive knowledge base and programming snippet library designed to support software engineering education and professional development. It provides a curated collection of reusable code units and technical guides that help developers master core language mechanics, design patterns, and architectural philosophies. The project distinguishes itself by offering a wide-ranging library of algorithmic solutions and web development patterns that are organized into modular, independently testable units. It emphasizes functional programming paradigms and declarative logic,

    Provides utilities for generating universally unique identifiers for data tracking.

    JavaScriptastroawesome-listcss
    Ver en GitHub↗128,121
  • immich-app/immichAvatar de immich-app

    immich-app/immich

    104,236Ver en GitHub↗

    Immich is a self-hosted media management platform designed to provide a centralized, private repository for photos and videos. It functions as a comprehensive system for organizing, backing up, and viewing personal media collections across mobile devices, web browsers, and external storage locations. By maintaining full control over data ownership and storage infrastructure, the platform ensures that users retain sovereignty over their digital assets. The system distinguishes itself through a distributed architecture that coordinates background media synchronization, real-time filesystem moni

    Identifies duplicate files using checksum verification during the backup process to prevent redundant storage and optimize bandwidth usage.

    TypeScriptbackup-toolfluttergoogle-photos
    Ver en GitHub↗104,236
  • doocs/advanced-javaAvatar de doocs

    doocs/advanced-java

    78,987Ver en GitHub↗

    This project is a comprehensive Java backend engineering guide and technical reference focused on high-concurrency design, distributed systems, and microservices architecture. It provides detailed strategies for decomposing monolithic applications, managing service discovery, and implementing the architectural patterns required for scalable backend environments. The repository distinguishes itself through an extensive collection of big data algorithmic references and database scaling strategies. It covers memory-efficient techniques for analyzing massive datasets, such as Top-K element extrac

    The system assigns each service its own private database or data store to avoid tight coupling.

    Javaadvanced-javadistributed-search-enginedistributed-systems
    Ver en GitHub↗78,987
  • caddyserver/caddyAvatar de caddyserver

    caddyserver/caddy

    73,492Ver en GitHub↗

    Caddy is an extensible, modular web server platform designed for high-performance traffic management and automated security. At its core, it functions as a dynamic HTTP gateway that handles request routing, static asset delivery, and reverse proxying through a chain of configurable handler modules. The system is built on a modular architecture that allows developers to extend server functionality by registering custom components, all managed through a unified lifecycle and provisioning framework. What distinguishes Caddy is its focus on automated infrastructure and zero-downtime operations. I

    Data portability utilities facilitate the safe export and import of storage contents, enabling seamless migration between different server environments.

    Goacmeautomatic-httpscaddy
    Ver en GitHub↗73,492
  • apache/supersetAvatar de apache

    apache/superset

    73,451Ver en GitHub↗

    Superset is a web-based business intelligence platform designed for data exploration, visualization, and interactive dashboarding. It functions as a query-driven analytics engine that connects to various SQL databases, allowing users to perform ad-hoc analysis, define virtual metrics, and build complex data visualizations through a centralized interface. The platform distinguishes itself through a robust semantic layer that transforms raw database schemas into calculated columns and virtual metrics, enabling consistent business logic across an organization. It features a plugin-based visualiz

    Demonstration datasets and example dashboards are included to facilitate immediate exploration of core functionality upon initial installation.

    TypeScriptanalyticsapacheapache-superset
    Ver en GitHub↗73,451
  • appflowy-io/appflowyAvatar de AppFlowy-IO

    AppFlowy-IO/AppFlowy

    72,474Ver en GitHub↗

    AppFlowy is a local-first knowledge base and collaborative workspace platform designed for structured information management. It functions as a modular productivity suite where users organize content through a block-based document model, allowing for flexible nesting and granular manipulation of data. The system prioritizes data sovereignty by enabling self-hosted storage, ensuring that sensitive information remains under user control while maintaining offline accessibility. The platform distinguishes itself through a decoupled architecture that separates its high-performance, memory-safe cor

    Enables advanced filtering, sorting, and grouping of tabular data to help users visualize and analyze complex datasets.

    Dartblogconfluence-alternativecontent-management
    Ver en GitHub↗72,474
  • protocolbuffers/protobufAvatar de protocolbuffers

    protocolbuffers/protobuf

    71,359Ver en GitHub↗

    Protocol Buffers es un mecanismo neutral al lenguaje y agnóstico a la plataforma para serializar datos estructurados. Proporciona una cadena de herramientas basada en esquemas que compila definiciones de datos declarativas en código fuente con seguridad de tipos, lo que permite una comunicación consistente y contratos de API fuertemente tipados en servicios escritos en diferentes lenguajes de programación. El proyecto se distingue por un formato binario altamente eficiente que utiliza codificación basada en etiquetas y compresión de enteros de ancho variable para minimizar el tamaño de la carga útil y la sobrecarga de procesamiento. Admite una gestión evolutiva y robusta de esquemas, lo que permite a los desarrolladores actualizar las estructuras de datos de forma incremental mientras mantienen la compatibilidad hacia atrás y hacia adelante. Esto se ve reforzado por un sistema de edición versionado que gestiona conjuntos de funciones y lógica de serialización en componentes de software distribuidos. Más allá de su serialización binaria central, el proyecto incluye capacidades para la conversión a JSON canónico con validación de esquemas, control granular de visibilidad de símbolos y seguimiento de presencia de campos para distinguir entre valores predeterminados y no establecidos. También proporciona optimizaciones especializadas, como la gestión de memoria basada en arena (arena-based) para implementaciones en C++, para mejorar el rendimiento durante la creación y limpieza de árboles de mensajes complejos.

    Facilitates the evolution of data structures over time while preserving backward and forward compatibility for distributed systems.

    C++marshallingprotobufprotobuf-runtime
    Ver en GitHub↗71,359
  • leonardomso/33-js-conceptsAvatar de leonardomso

    leonardomso/33-js-concepts

    66,467Ver en GitHub↗

    This project is a comprehensive educational repository designed to help developers master the core mechanics, runtime behaviors, and browser-native capabilities of the JavaScript language. It provides a structured knowledge base that covers fundamental language features, such as prototype-based inheritance and event-loop-based concurrency, alongside advanced topics like JIT-compiled execution and memory management. The repository distinguishes itself by offering deep-dive technical guides that bridge the gap between abstract language concepts and practical browser implementation. It features

    Master local storage mechanisms like IndexedDB and Web Storage APIs to maintain application state across browser sessions.

    JavaScriptangularconceptses6
    Ver en GitHub↗66,467
  • nocodb/nocodbAvatar de nocodb

    nocodb/nocodb

    63,466Ver en GitHub↗

    NocoDB is a visual platform that transforms relational databases into collaborative, spreadsheet-style workspaces. By acting as a headless database backend, it provides a unified environment for designing database structures, managing record relationships, and interacting with data without requiring manual SQL queries. The platform normalizes interactions across various SQL and NoSQL data sources, allowing users to manage complex datasets through a centralized interface. The project distinguishes itself by automatically generating RESTful and GraphQL APIs from existing database schemas, enabl

    Empowers users to filter, sort, and group tabular data for clearer analysis and efficient information management.

    TypeScriptairtableairtable-alternativeautomatic-api
    Ver en GitHub↗63,466
  • xingshaocheng/architect-awesomeAvatar de xingshaocheng

    xingshaocheng/architect-awesome

    60,821Ver en GitHub↗

    This project serves as a comprehensive knowledge base and reference for distributed systems engineering and enterprise software architecture. It provides a structured collection of technical resources, design patterns, and methodologies intended to assist in the design, maintenance, and scaling of complex, high-performance software environments. The repository distinguishes itself by offering deep dives into core architectural concepts such as actor-based concurrency, aspect-oriented interception, and inversion-of-control containers. It emphasizes the practical application of distributed syst

    Generate globally unique identifiers to ensure data consistency and prevent collisions across distributed nodes.

    Ver en GitHub↗60,821
  • minio/minioAvatar de minio

    minio/minio

    60,346Ver en GitHub↗

    MinIO is a software-defined, cloud-native object storage server designed to manage large volumes of unstructured data. It functions as a distributed storage cluster that aggregates multiple independent nodes into a unified, scalable pool, providing a high-performance infrastructure compatible with standard cloud storage protocols and application programming interfaces. The system utilizes a shared-nothing architecture that eliminates central metadata servers, relying instead on a decentralized hash table to map objects across the cluster. Data availability and resilience are maintained throug

    Splits data into fragments and distributes them across multiple drives to ensure availability during hardware or node failures.

    Goamazon-s3cloudcloudnative
    Ver en GitHub↗60,346
  • solido/awesome-flutterAvatar de Solido

    Solido/awesome-flutter

    60,327Ver en GitHub↗

    This project is a community-curated directory of resources, libraries, and tools designed to support developers working with the Flutter framework. It functions as a centralized knowledge base, organizing high-quality external references into a structured, human-readable format to assist in the discovery of technical materials for cross-platform application development. The directory distinguishes itself through a comprehensive index of the global Flutter ecosystem, including local user groups, meetups, and communication channels that connect developers to international support networks. It m

    Links to robust implementations for connecting applications to GraphQL services and managing remote data synchronization.

    Dartandroidawesomeawesome-list
    Ver en GitHub↗60,327
  • rails/railsAvatar de rails

    rails/rails

    58,690Ver en GitHub↗

    This project is a full-stack web framework designed for building database-backed applications through a standardized architectural pattern. It provides a comprehensive suite of integrated libraries that manage the entire request-response lifecycle, from routing incoming web traffic to rendering dynamic server-side templates. By utilizing an object-relational mapping layer, the framework allows developers to define domain models that map database tables directly to application objects, simplifying data persistence, schema migrations, and complex relationship management. The framework is distin

    Links binary assets directly to database records, managing the storage and retrieval of files through integrated model associations.

    Rubyactivejobactiverecordframework
    Ver en GitHub↗58,690
  • pmndrs/zustandAvatar de pmndrs

    pmndrs/zustand

    58,371Ver en GitHub↗

    Zustand is a state management library that provides a centralized store for managing shared application data. It functions as a reactive container that connects application state to components, allowing them to subscribe to specific slices of data and trigger updates automatically. By utilizing selector-based data access and immutable state updates, the library ensures that components only re-render when their observed data changes, maintaining a predictable and efficient data flow. The library distinguishes itself through a pluggable, middleware-based architecture that allows for the extensi

    Simplifies updates to complex nested data by automating the creation of new, immutable object structures.

    TypeScripthacktoberfesthooksreact
    Ver en GitHub↗58,371
  • rclone/rcloneAvatar de rclone

    rclone/rclone

    57,877Ver en GitHub↗

    This project is a command-line storage manager that provides a unified interface for performing file operations across local filesystems and diverse cloud storage providers. It functions as a cross-platform storage abstraction, utilizing a modular backend architecture to map heterogeneous cloud storage APIs into a standard set of file system operations. This allows for consistent data management and movement regardless of the underlying storage service. The tool serves as a network data transfer engine designed for automated data migration and cloud storage synchronization. It distinguishes i

    Maintains consistency between disparate data stores by automatically propagating file changes and metadata.

    Goazure-blobazure-blob-storageazure-files
    Ver en GitHub↗57,877
  • zylon-ai/private-gptAvatar de zylon-ai

    zylon-ai/private-gpt

    57,278Ver en GitHub↗

    This project is a privacy-first backend service designed to facilitate retrieval-augmented generation by processing local documents into searchable vector representations. It provides a modular architecture that allows users to ingest diverse file formats, manage document metadata, and perform semantic searches to provide context-aware responses for chat and completion requests. The system distinguishes itself through a database-agnostic abstraction layer that supports various storage backends, ranging from local disk storage to enterprise-grade vector databases. It offers flexible deployment

    Exposes metadata and identifiers for all stored documents to allow precise filtering and context selection during retrieval tasks.

    Python
    Ver en GitHub↗57,278
  • deepfakes/faceswapAvatar de deepfakes

    deepfakes/faceswap

    55,289Ver en GitHub↗

    Faceswap is a comprehensive framework for automated media manipulation and neural face synthesis. It provides a modular pipeline that manages the entire lifecycle of facial feature extraction, deep learning model training, and image conversion. By coordinating complex computer vision workflows, the system enables users to map facial identities between source and destination datasets while maintaining structural alignment and lighting consistency across video frames. The project distinguishes itself through a highly extensible plugin-based architecture that handles hardware-accelerated process

    Rebuilds alignment files by scanning directories of previously extracted faces to recover lost or corrupted metadata.

    Pythondeep-face-swapdeep-learningdeep-neural-networks
    Ver en GitHub↗55,289
  • ngosang/trackerslistAvatar de ngosang

    ngosang/trackerslist

    54,183Ver en GitHub↗

    This project is a curated, community-driven registry of public BitTorrent trackers designed to facilitate peer-to-peer file sharing. It serves as a centralized resource for network endpoints that coordinate connections between distributed clients, helping users discover and maintain reliable infrastructure for decentralized communication protocols. The repository distinguishes itself through a fully automated orchestration pipeline that ensures the lists remain current and accurate. Every day, background tasks perform distributed health monitoring to verify connectivity and filter out unrespo

    Ensures list accuracy through continuous automated health monitoring and synchronization of network resources.

    bittorrentbittorrent-trackerbittorrent-trackers
    Ver en GitHub↗54,183
  • maybe-finance/maybeAvatar de maybe-finance

    maybe-finance/maybe

    53,999Ver en GitHub↗

    Maybe is a self-hosted financial platform designed for private deployment, providing a centralized interface to track investments, budgets, and net worth. By running the application on your own infrastructure, you maintain full control over your sensitive financial data and privacy. The platform is delivered as a containerized application suite, utilizing a declarative configuration framework to manage service lifecycles. It distinguishes itself through a structured approach to version control, allowing users to pin specific release tags to ensure environment consistency and perform controlle

    Manages persistent data storage volumes during setup and maintenance to ensure state remains intact across service restarts.

    Rubyfinancehotwirepersonal-finance
    Ver en GitHub↗53,999
Ant.123456…17Siguiente
  1. Home
  2. Data & Databases
  3. Data Management

Explorar subetiquetas

  • Alignment File ReconstructionTools that scan existing media assets to regenerate metadata files required for facial alignment processes.
  • Automated Resource CurationSystems that automatically verify and update lists of network endpoints.
  • Backup and Recovery Utilities2 sub-etiquetasTools focused on the preservation, restoration, and safety of data states, distinct from active synchronization or migration.
  • Cryptographic Subaddress GenerationCreation of multiple derivative addresses linked to a single master account for privacy and tracking. **Distinct from Unique Identifier Generators:** Distinct from general unique ID generators by being cryptographically linked to a specific account for financial privacy.
  • Data Migration and Synchronization6 sub-etiquetasSystems for moving, syncing, or porting data between environments, distinct from internal lifecycle management.
  • Document and Record Handling3 sub-etiquetasInterfaces and operations for managing individual records, attachments, or indexed documents, distinct from bulk database management.
  • Erasure CodingData protection method that splits data into fragments to survive node failures.
  • GraphQL ClientsLibraries for interacting with GraphQL APIs.
  • Media DeduplicationDeduplication specifically targeting media assets via checksum verification during backup processes.
  • Sample Data Loaders1 sub-etiquetaScripts or utilities that populate an environment with demonstration datasets for testing and exploration.
  • Service-Private Data StoresArchitectural patterns where each microservice manages its own private database to ensure loose coupling. **Distinct from Data Management:** Distinct from general data management by focusing specifically on the microservice pattern of database-per-service.
  • State and Context Management2 sub-etiquetasTools for managing transient or application-specific state, distinct from persistent database storage.
  • Table Data Managers4 sub-etiquetasComponents that provide filtering, sorting, and grouping functionality for tabular data.
  • Unique Identifier Generators16 sub-etiquetasUtilities for creating globally unique identifiers to ensure data consistency across distributed systems.