awesome-repositories.com
博客
awesome-repositories.com

通过 AI 驱动的搜索,发现最优秀的开源仓库。

探索精选搜索开源替代品自托管软件博客网站地图
项目关于排名机制媒体报道MCP 服务器
法律隐私政策服务条款
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

323 个仓库

Awesome GitHub RepositoriesData Management

Tools and utilities for maintaining, organizing, protecting, and migrating data throughout its operational lifecycle.

Explore 323 awesome GitHub repositories matching data & databases · Data Management. Refine with filters or upvote what's useful.

Awesome Data Management GitHub Repositories

用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
  • donnemartin/system-design-primerdonnemartin 的头像

    donnemartin/system-design-primer

    353,387在 GitHub 上查看↗

    这是一个关于分布式系统架构和后端基础设施设计的综合教育资源和学习指南。它为掌握设计复杂软件系统所需的扩展性、可靠性和性能原则提供了结构化课程。 该仓库通过提供一种系统化的技术面试准备方法脱颖而出,结合了设计模式、架构权衡和间隔重复工具,帮助用户记忆复杂概念。它强调约束驱动的分析,教授用户在起草架构设计时如何评估延迟、一致性和可用性等相互竞争的需求。 内容涵盖了广泛的系统设计能力,包括数据库扩展、流量管理和基础设施优化策略。它详细介绍了水平扩展、多层缓存、异步通信和服务发现技术,同时还提供了用于执行资源估算和容量规划的框架。 文档以学习指南的形式组织,为后端工程和大规模系统设计的基础知识提供了系统化的路径。

    Provides utilities for creating globally unique identifiers to ensure data consistency across distributed systems.

    Pythondesigndesign-patternsdesign-system
    在 GitHub 上查看↗353,387
  • chalarangelo/30-seconds-of-codeChalarangelo 的头像

    Chalarangelo/30-seconds-of-code

    128,121在 GitHub 上查看↗

    30-seconds-of-code is a comprehensive knowledge base and programming snippet library designed to support software engineering education and professional development. It provides a curated collection of reusable code units and technical guides that help developers master core language mechanics, design patterns, and architectural philosophies. The project distinguishes itself by offering a wide-ranging library of algorithmic solutions and web development patterns that are organized into modular, independently testable units. It emphasizes functional programming paradigms and declarative logic,

    Provides utilities for generating universally unique identifiers for data tracking.

    JavaScriptastroawesome-listcss
    在 GitHub 上查看↗128,121
  • immich-app/immichimmich-app 的头像

    immich-app/immich

    104,236在 GitHub 上查看↗

    Immich is a self-hosted media management platform designed to provide a centralized, private repository for photos and videos. It functions as a comprehensive system for organizing, backing up, and viewing personal media collections across mobile devices, web browsers, and external storage locations. By maintaining full control over data ownership and storage infrastructure, the platform ensures that users retain sovereignty over their digital assets. The system distinguishes itself through a distributed architecture that coordinates background media synchronization, real-time filesystem moni

    Identifies duplicate files using checksum verification during the backup process to prevent redundant storage and optimize bandwidth usage.

    TypeScriptbackup-toolfluttergoogle-photos
    在 GitHub 上查看↗104,236
  • doocs/advanced-javadoocs 的头像

    doocs/advanced-java

    78,987在 GitHub 上查看↗

    This project is a comprehensive Java backend engineering guide and technical reference focused on high-concurrency design, distributed systems, and microservices architecture. It provides detailed strategies for decomposing monolithic applications, managing service discovery, and implementing the architectural patterns required for scalable backend environments. The repository distinguishes itself through an extensive collection of big data algorithmic references and database scaling strategies. It covers memory-efficient techniques for analyzing massive datasets, such as Top-K element extrac

    The system assigns each service its own private database or data store to avoid tight coupling.

    Javaadvanced-javadistributed-search-enginedistributed-systems
    在 GitHub 上查看↗78,987
  • caddyserver/caddycaddyserver 的头像

    caddyserver/caddy

    73,492在 GitHub 上查看↗

    Caddy is an extensible, modular web server platform designed for high-performance traffic management and automated security. At its core, it functions as a dynamic HTTP gateway that handles request routing, static asset delivery, and reverse proxying through a chain of configurable handler modules. The system is built on a modular architecture that allows developers to extend server functionality by registering custom components, all managed through a unified lifecycle and provisioning framework. What distinguishes Caddy is its focus on automated infrastructure and zero-downtime operations. I

    Data portability utilities facilitate the safe export and import of storage contents, enabling seamless migration between different server environments.

    Goacmeautomatic-httpscaddy
    在 GitHub 上查看↗73,492
  • apache/supersetapache 的头像

    apache/superset

    73,451在 GitHub 上查看↗

    Superset is a web-based business intelligence platform designed for data exploration, visualization, and interactive dashboarding. It functions as a query-driven analytics engine that connects to various SQL databases, allowing users to perform ad-hoc analysis, define virtual metrics, and build complex data visualizations through a centralized interface. The platform distinguishes itself through a robust semantic layer that transforms raw database schemas into calculated columns and virtual metrics, enabling consistent business logic across an organization. It features a plugin-based visualiz

    Demonstration datasets and example dashboards are included to facilitate immediate exploration of core functionality upon initial installation.

    TypeScriptanalyticsapacheapache-superset
    在 GitHub 上查看↗73,451
  • appflowy-io/appflowyAppFlowy-IO 的头像

    AppFlowy-IO/AppFlowy

    72,474在 GitHub 上查看↗

    AppFlowy is a local-first knowledge base and collaborative workspace platform designed for structured information management. It functions as a modular productivity suite where users organize content through a block-based document model, allowing for flexible nesting and granular manipulation of data. The system prioritizes data sovereignty by enabling self-hosted storage, ensuring that sensitive information remains under user control while maintaining offline accessibility. The platform distinguishes itself through a decoupled architecture that separates its high-performance, memory-safe cor

    Enables advanced filtering, sorting, and grouping of tabular data to help users visualize and analyze complex datasets.

    Dartblogconfluence-alternativecontent-management
    在 GitHub 上查看↗72,474
  • protocolbuffers/protobufprotocolbuffers 的头像

    protocolbuffers/protobuf

    71,359在 GitHub 上查看↗

    Protocol Buffers 是一种语言中立、平台无关的结构化数据序列化机制。它提供了一个模式驱动的工具链,将声明式数据定义编译为类型安全的源代码,从而在不同编程语言编写的服务之间实现一致的通信和强类型的 API 契约。 该项目以其高效的二进制线路格式脱颖而出,该格式利用基于标签的编码和变宽整数压缩来最小化有效载荷大小和处理开销。它支持稳健的演进式模式管理,允许开发者在保持向后和向前兼容性的同时增量更新数据结构。这得到了版本化版本系统的进一步支持,该系统管理跨分布式软件组件的功能集和序列化逻辑。 除了核心二进制序列化外,该项目还包括用于模式验证的规范 JSON 转换、细粒度的符号可见性控制以及用于区分默认值和未设置值的字段存在性跟踪功能。它还提供专门的优化,例如 C++ 实现中基于竞技场(arena)的内存管理,以提高创建和清理复杂消息树时的性能。

    Facilitates the evolution of data structures over time while preserving backward and forward compatibility for distributed systems.

    C++marshallingprotobufprotobuf-runtime
    在 GitHub 上查看↗71,359
  • leonardomso/33-js-conceptsleonardomso 的头像

    leonardomso/33-js-concepts

    66,467在 GitHub 上查看↗

    This project is a comprehensive educational repository designed to help developers master the core mechanics, runtime behaviors, and browser-native capabilities of the JavaScript language. It provides a structured knowledge base that covers fundamental language features, such as prototype-based inheritance and event-loop-based concurrency, alongside advanced topics like JIT-compiled execution and memory management. The repository distinguishes itself by offering deep-dive technical guides that bridge the gap between abstract language concepts and practical browser implementation. It features

    Master local storage mechanisms like IndexedDB and Web Storage APIs to maintain application state across browser sessions.

    JavaScriptangularconceptses6
    在 GitHub 上查看↗66,467
  • nocodb/nocodbnocodb 的头像

    nocodb/nocodb

    63,466在 GitHub 上查看↗

    NocoDB is a visual platform that transforms relational databases into collaborative, spreadsheet-style workspaces. By acting as a headless database backend, it provides a unified environment for designing database structures, managing record relationships, and interacting with data without requiring manual SQL queries. The platform normalizes interactions across various SQL and NoSQL data sources, allowing users to manage complex datasets through a centralized interface. The project distinguishes itself by automatically generating RESTful and GraphQL APIs from existing database schemas, enabl

    Empowers users to filter, sort, and group tabular data for clearer analysis and efficient information management.

    TypeScriptairtableairtable-alternativeautomatic-api
    在 GitHub 上查看↗63,466
  • xingshaocheng/architect-awesomexingshaocheng 的头像

    xingshaocheng/architect-awesome

    60,821在 GitHub 上查看↗

    This project serves as a comprehensive knowledge base and reference for distributed systems engineering and enterprise software architecture. It provides a structured collection of technical resources, design patterns, and methodologies intended to assist in the design, maintenance, and scaling of complex, high-performance software environments. The repository distinguishes itself by offering deep dives into core architectural concepts such as actor-based concurrency, aspect-oriented interception, and inversion-of-control containers. It emphasizes the practical application of distributed syst

    Generate globally unique identifiers to ensure data consistency and prevent collisions across distributed nodes.

    在 GitHub 上查看↗60,821
  • minio/miniominio 的头像

    minio/minio

    60,346在 GitHub 上查看↗

    MinIO is a software-defined, cloud-native object storage server designed to manage large volumes of unstructured data. It functions as a distributed storage cluster that aggregates multiple independent nodes into a unified, scalable pool, providing a high-performance infrastructure compatible with standard cloud storage protocols and application programming interfaces. The system utilizes a shared-nothing architecture that eliminates central metadata servers, relying instead on a decentralized hash table to map objects across the cluster. Data availability and resilience are maintained throug

    Splits data into fragments and distributes them across multiple drives to ensure availability during hardware or node failures.

    Goamazon-s3cloudcloudnative
    在 GitHub 上查看↗60,346
  • solido/awesome-flutterSolido 的头像

    Solido/awesome-flutter

    60,327在 GitHub 上查看↗

    This project is a community-curated directory of resources, libraries, and tools designed to support developers working with the Flutter framework. It functions as a centralized knowledge base, organizing high-quality external references into a structured, human-readable format to assist in the discovery of technical materials for cross-platform application development. The directory distinguishes itself through a comprehensive index of the global Flutter ecosystem, including local user groups, meetups, and communication channels that connect developers to international support networks. It m

    Links to robust implementations for connecting applications to GraphQL services and managing remote data synchronization.

    Dartandroidawesomeawesome-list
    在 GitHub 上查看↗60,327
  • rails/railsrails 的头像

    rails/rails

    58,690在 GitHub 上查看↗

    This project is a full-stack web framework designed for building database-backed applications through a standardized architectural pattern. It provides a comprehensive suite of integrated libraries that manage the entire request-response lifecycle, from routing incoming web traffic to rendering dynamic server-side templates. By utilizing an object-relational mapping layer, the framework allows developers to define domain models that map database tables directly to application objects, simplifying data persistence, schema migrations, and complex relationship management. The framework is distin

    Links binary assets directly to database records, managing the storage and retrieval of files through integrated model associations.

    Rubyactivejobactiverecordframework
    在 GitHub 上查看↗58,690
  • pmndrs/zustandpmndrs 的头像

    pmndrs/zustand

    58,371在 GitHub 上查看↗

    Zustand is a state management library that provides a centralized store for managing shared application data. It functions as a reactive container that connects application state to components, allowing them to subscribe to specific slices of data and trigger updates automatically. By utilizing selector-based data access and immutable state updates, the library ensures that components only re-render when their observed data changes, maintaining a predictable and efficient data flow. The library distinguishes itself through a pluggable, middleware-based architecture that allows for the extensi

    Simplifies updates to complex nested data by automating the creation of new, immutable object structures.

    TypeScripthacktoberfesthooksreact
    在 GitHub 上查看↗58,371
  • rclone/rclonerclone 的头像

    rclone/rclone

    57,877在 GitHub 上查看↗

    This project is a command-line storage manager that provides a unified interface for performing file operations across local filesystems and diverse cloud storage providers. It functions as a cross-platform storage abstraction, utilizing a modular backend architecture to map heterogeneous cloud storage APIs into a standard set of file system operations. This allows for consistent data management and movement regardless of the underlying storage service. The tool serves as a network data transfer engine designed for automated data migration and cloud storage synchronization. It distinguishes i

    Maintains consistency between disparate data stores by automatically propagating file changes and metadata.

    Goazure-blobazure-blob-storageazure-files
    在 GitHub 上查看↗57,877
  • zylon-ai/private-gptzylon-ai 的头像

    zylon-ai/private-gpt

    57,278在 GitHub 上查看↗

    This project is a privacy-first backend service designed to facilitate retrieval-augmented generation by processing local documents into searchable vector representations. It provides a modular architecture that allows users to ingest diverse file formats, manage document metadata, and perform semantic searches to provide context-aware responses for chat and completion requests. The system distinguishes itself through a database-agnostic abstraction layer that supports various storage backends, ranging from local disk storage to enterprise-grade vector databases. It offers flexible deployment

    Exposes metadata and identifiers for all stored documents to allow precise filtering and context selection during retrieval tasks.

    Python
    在 GitHub 上查看↗57,278
  • deepfakes/faceswapdeepfakes 的头像

    deepfakes/faceswap

    55,289在 GitHub 上查看↗

    Faceswap is a comprehensive framework for automated media manipulation and neural face synthesis. It provides a modular pipeline that manages the entire lifecycle of facial feature extraction, deep learning model training, and image conversion. By coordinating complex computer vision workflows, the system enables users to map facial identities between source and destination datasets while maintaining structural alignment and lighting consistency across video frames. The project distinguishes itself through a highly extensible plugin-based architecture that handles hardware-accelerated process

    Rebuilds alignment files by scanning directories of previously extracted faces to recover lost or corrupted metadata.

    Pythondeep-face-swapdeep-learningdeep-neural-networks
    在 GitHub 上查看↗55,289
  • ngosang/trackerslistngosang 的头像

    ngosang/trackerslist

    54,183在 GitHub 上查看↗

    This project is a curated, community-driven registry of public BitTorrent trackers designed to facilitate peer-to-peer file sharing. It serves as a centralized resource for network endpoints that coordinate connections between distributed clients, helping users discover and maintain reliable infrastructure for decentralized communication protocols. The repository distinguishes itself through a fully automated orchestration pipeline that ensures the lists remain current and accurate. Every day, background tasks perform distributed health monitoring to verify connectivity and filter out unrespo

    Ensures list accuracy through continuous automated health monitoring and synchronization of network resources.

    bittorrentbittorrent-trackerbittorrent-trackers
    在 GitHub 上查看↗54,183
  • maybe-finance/maybemaybe-finance 的头像

    maybe-finance/maybe

    53,999在 GitHub 上查看↗

    Maybe is a self-hosted financial platform designed for private deployment, providing a centralized interface to track investments, budgets, and net worth. By running the application on your own infrastructure, you maintain full control over your sensitive financial data and privacy. The platform is delivered as a containerized application suite, utilizing a declarative configuration framework to manage service lifecycles. It distinguishes itself through a structured approach to version control, allowing users to pin specific release tags to ensure environment consistency and perform controlle

    Manages persistent data storage volumes during setup and maintenance to ensure state remains intact across service restarts.

    Rubyfinancehotwirepersonal-finance
    在 GitHub 上查看↗53,999
上一个123456…17下一个
  1. Home
  2. Data & Databases
  3. Data Management

探索子标签

  • Alignment File ReconstructionTools that scan existing media assets to regenerate metadata files required for facial alignment processes.
  • Automated Resource CurationSystems that automatically verify and update lists of network endpoints.
  • Backup and Recovery Utilities2 个子标签Tools focused on the preservation, restoration, and safety of data states, distinct from active synchronization or migration.
  • Cryptographic Subaddress GenerationCreation of multiple derivative addresses linked to a single master account for privacy and tracking. **Distinct from Unique Identifier Generators:** Distinct from general unique ID generators by being cryptographically linked to a specific account for financial privacy.
  • Data Migration and Synchronization6 个子标签Systems for moving, syncing, or porting data between environments, distinct from internal lifecycle management.
  • Document and Record Handling3 个子标签Interfaces and operations for managing individual records, attachments, or indexed documents, distinct from bulk database management.
  • Erasure CodingData protection method that splits data into fragments to survive node failures.
  • GraphQL ClientsLibraries for interacting with GraphQL APIs.
  • Media DeduplicationDeduplication specifically targeting media assets via checksum verification during backup processes.
  • Sample Data Loaders1 个子标签Scripts or utilities that populate an environment with demonstration datasets for testing and exploration.
  • Service-Private Data StoresArchitectural patterns where each microservice manages its own private database to ensure loose coupling. **Distinct from Data Management:** Distinct from general data management by focusing specifically on the microservice pattern of database-per-service.
  • State and Context Management2 个子标签Tools for managing transient or application-specific state, distinct from persistent database storage.
  • Table Data Managers4 个子标签Components that provide filtering, sorting, and grouping functionality for tabular data.
  • Unique Identifier Generators16 个子标签Utilities for creating globally unique identifiers to ensure data consistency across distributed systems.