# bobg/hashsplit

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/bobg-hashsplit).**

32 stars · 3 forks · Go · MIT

## Links

- GitHub: https://github.com/bobg/hashsplit
- awesome-repositories: https://awesome-repositories.com/repository/bobg-hashsplit.md

## Description

Hashsplitting is a way of dividing a byte stream into pieces based on the stream's content rather than on any predetermined chunk size. As the Splitter reads the stream it maintains a rolling checksum of the last several bytes. A chunk boundary occurs when the rolling checksum has enough…

## Tags

### Part of an Awesome List

- [Data Structures](https://awesome-repositories.com/f/awesome-lists/data/data-structures.md) — Content-based byte stream splitting.