2 Repos
Bandwidth-efficient replication that downloads only specific ranges or blocks of a log.
Distinct from Replication Protocols: Specializes general replication protocols by focusing on the sparse/partial retrieval of log data.
Explore 2 awesome GitHub repositories matching data & databases · Sparse Replication. Refine with filters or upvote what's useful.
Dat is a peer-to-peer file synchronization tool that combines an append-only, hash-addressed log with Merkle tree verification, cryptographic access keys, live streaming replication, and swarm networking for sparse, versioned file sharing. It stores file data and metadata in a cryptographically signed, versioned append-only log where each entry is identified by its hash, and uses public-key cryptography to secure archives with separate read and write keys. The tool enables live streaming replication of data between peers as entries are appended, with Merkle tree integrity verification that su
Downloads only specific file ranges needed rather than entire archives, enabling efficient partial replication.
Hypercore is a distributed append-only logging system designed for maintaining cryptographically signed data streams that are replicated and verified across a network of peers. It provides verifiable data storage using a Merkle tree structure to ensure the integrity and authenticity of information through cryptographic proofs. The project is distinguished by its support for sparse data replication, which allows peers to download only the specific ranges or blocks of a log required for their current needs to reduce bandwidth. It also implements encrypted peer-to-peer messaging and the ability
Reduces bandwidth usage by downloading only specific ranges or individual blocks of data instead of the entire log.