awesome-repositories.com
博客
awesome-repositories.com

通过 AI 驱动的搜索,发现最优秀的开源仓库。

探索精选搜索开源替代品自托管软件博客网站地图
项目关于排名机制媒体报道MCP 服务器
法律隐私政策服务条款
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

9 个仓库

Awesome GitHub RepositoriesData Integrity and Versioning

Systems ensuring the consistency, safety, and historical recoverability of data during write and synchronization operations.

Explore 9 awesome GitHub repositories matching data & databases · Data Integrity and Versioning. Refine with filters or upvote what's useful.

Awesome Data Integrity and Versioning GitHub Repositories

用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
  • syncthing/syncthingsyncthing 的头像

    syncthing/syncthing

    85,400在 GitHub 上查看↗

    Syncthing 是一个去中心化的文件同步引擎,通过点对点网状网络在多个设备间保持一致的数据状态。它作为后台守护进程运行,在受信任的节点之间自动复制文件的创建、修改和删除,无需中央服务器。通过利用内容可寻址块索引和块级增量同步,系统仅识别并传输文件的修改部分,从而确保在异构环境中高效地传播数据。 该项目以安全优先的架构著称,依赖相互 TLS 认证来验证设备身份,确保所有连接在加密上绑定到受信任的证书指纹。它支持灵活的同步模式,包括双向复制、用于备份的单向镜像以及基于引用的强制执行。为了增加隐私性,系统为不受信任的设备提供了文件夹级加密,并允许对网络流量进行细粒度控制,包括限制操作仅在本地网络进行或利用中继基础设施进行 NAT 穿透。 除了核心复制功能外,该平台还提供全面的管理工具,包括用于监控连接状态和吞吐量的 Web 仪表板,以及用于高级配置的命令行界面。它包含强大的版本控制策略以防止数据丢失,并通过原生服务集成和可观测性指标支持复杂的部署场景。该软件专为跨平台兼容性而设计,可通过标准包管理器或容器化环境安装。

    Tracks data state by indexing block-level cryptographic hashes to identify differences and reconcile content between devices.

    Gogop2ppeer-to-peer
    在 GitHub 上查看↗85,400
  • datawhalechina/hello-agentsdatawhalechina 的头像

    datawhalechina/hello-agents

    59,685在 GitHub 上查看↗

    This project provides a comprehensive framework for building, training, and managing autonomous agents. It enables the construction of systems that utilize language models to plan, manage memory, and execute multi-step tasks through iterative reasoning loops and tool-based actions. The framework distinguishes itself by offering specialized capabilities for interacting with graphical user interfaces and legacy software, allowing agents to perceive visual elements and perform actions like a human user. It supports complex, cross-application workflows through graph-based orchestration and provid

    Ensures batch file modifications are applied as atomic transactions to maintain system consistency.

    Pythonagentllmrag
    在 GitHub 上查看↗59,685
  • oi-wiki/oi-wikiOI-wiki 的头像

    OI-wiki/OI-wiki

    26,176在 GitHub 上查看↗

    This project is a comprehensive, community-maintained knowledge base and toolkit designed for competitive programming. It serves as a centralized repository for algorithmic theory, data structures, and mathematical techniques, providing a structured reference for informatics and collegiate programming competitions. The project distinguishes itself by integrating educational content with a robust suite of automation utilities. It provides a complete workflow for competitive programming, including tools for automated test case generation, solution verification, and direct interaction with onlin

    Creates temporary backups of open files to prevent data loss.

    TypeScriptacm-icpcacm-icpc-handbookalgorithms
    在 GitHub 上查看↗26,176
  • typicode/lowdbtypicode 的头像

    typicode/lowdb

    22,469在 GitHub 上查看↗

    Lowdb is a lightweight local data persistence library that manages application state as a JSON document. It functions as a database utility that stores information directly in local files or browser storage, removing the requirement for a dedicated database server or complex infrastructure. By treating stored data as standard objects and arrays, it provides a straightforward interface for managing application information. The library distinguishes itself through a modular adapter-based architecture that decouples data manipulation from the underlying storage medium. This design allows for the

    Protects data integrity by performing write operations as single atomic transactions.

    JavaScriptdatabaseelectronembeddable
    在 GitHub 上查看↗22,469
  • haiwen/seafilehaiwen 的头像

    haiwen/seafile

    14,845在 GitHub 上查看↗

    Seafile is a self-hosted file synchronization and sharing platform that provides a central server for maintaining file consistency across multiple devices. It functions as a cloud storage management system and a collaborative document suite, integrating tools for real-time teamwork and shared file management. The platform distinguishes itself through a metadata-driven file organizer that uses extensible properties and hierarchical tags instead of traditional folder structures. It includes client-side encrypted storage to protect private data using user-defined passwords before files leave the

    Implements a versioning system that tracks file iterations to allow recovery of previous document states.

    Ccloud-storagedocument-managementfile-sharing
    在 GitHub 上查看↗14,845
  • nextcloud/all-in-onenextcloud 的头像

    nextcloud/all-in-one

    9,082在 GitHub 上查看↗

    all-in-one is a containerized deployment system designed to install and manage a complete suite of productivity and collaboration services. It functions as a cloud suite deployer that orchestrates the installation of a self-hosted content platform, incorporating necessary dependencies via Docker or Kubernetes. The project distinguishes itself by providing a web-based dashboard for orchestrating, updating, and monitoring the lifecycle of service containers. It also serves as a local AI inference server, enabling the execution of generative text models, image diffusion, and speech processing on

    Tracks and manages multiple iterations of files with decay schedules to allow recovery.

    PHPbackupdockernextcloud
    在 GitHub 上查看↗9,082
  • carrierwaveuploader/carrierwavecarrierwaveuploader 的头像

    carrierwaveuploader/carrierwave

    8,785在 GitHub 上查看↗

    CarrierWave is a Ruby file upload library used to manage the uploading, storing, and retrieval of files within web frameworks such as Rails and Sinatra. It functions as an Active Record file manager that associates uploaded assets with database records. The project includes an image processing pipeline for generating thumbnails and derivative versions of uploaded images. It also features a file validation engine to restrict uploads based on allowlists or denylists of extensions and content types, and provides cloud storage integration to manage assets on remote providers. The library covers

    Creates multiple derivative versions of a single uploaded file, such as thumbnails with specific dimensions.

    Ruby
    在 GitHub 上查看↗8,785
  • tagspaces/tagspacestagspaces 的头像

    tagspaces/tagspaces

    4,935在 GitHub 上查看↗

    TagSpaces is an offline-first file tagging and organization platform that lets you manage local files with portable metadata stored directly in filenames or sidecar JSON files, eliminating the need for a central database. It functions as a full-text file search engine, a Kanban board file organizer, a local AI file assistant, an S3-compatible cloud file manager, and a web clipper and bookmark manager, all within a single application. The project distinguishes itself through a local-first architecture where all file operations, indexing, and AI processing run entirely on the device, with cloud

    Keeps previous versions of edited files to allow restoration and prevent data loss.

    TypeScriptelectronjavascriptnote-taking
    在 GitHub 上查看↗4,935
  • syncthing/syncthing-macossyncthing 的头像

    syncthing/syncthing-macos

    3,761在 GitHub 上查看↗

    Syncthing macOS is a native application bundle that wraps the Syncthing binary to provide decentralized, peer-to-peer file synchronization on macOS. It enables bidirectional data replication across multiple devices using a block exchange protocol, allowing files and folders to stay consistent without relying on a central cloud server. The project distinguishes itself by integrating the cross-platform synchronization engine into the macOS environment as a background service. It provides a system tray interface for quick access to the management GUI and supports automatic application startup th

    Compares local file states against global versions and transfers missing data blocks for consistency.

    Objective-Capplebackupcloud-sync
    在 GitHub 上查看↗3,761
  1. Home
  2. Data & Databases
  3. Data Integration & Synchronization
  4. Data Integrity and Versioning

探索子标签

  • Atomic File UpdatesTechniques that ensure file write operations either complete entirely or do not occur at all.
  • Content-Addressable Block IndexingMethods for identifying and retrieving data blocks based on the unique cryptographic hash of their content.
  • File Versioning Strategies4 个子标签Systems that track and manage multiple iterations of files to allow for recovery or historical auditing.