1 repository
Awesome GitHub RepositoriesDifferential Processing
Processing only the changes between two versions of a dataset to optimize updates.
Distinct from Data Processing: Distinct from general data processing by focusing specifically on the delta between two commits.
Explore 1 awesome GitHub repository matching data & databases · Differential Processing. Refine with filters or upvote what's useful.
Awesome Differential Processing GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- treeverse/lakefs
treeverse/lakeFS
5,406Vezi pe GitHublakeFS is a data lake versioning system that provides Git-like branching and commits for large datasets stored in object storage. It functions as a version control layer, enabling the creation of immutable snapshots, atomic commits, and zero-copy branching to create isolated environments for data experimentation without duplicating physical files. The system serves as an S3-compatible storage gateway and an Iceberg REST catalog, allowing standard cloud storage protocols and compatible clients to manage versioned tables. It acts as a data quality gatekeeper by using an event-driven hook system
Updates embeddings by processing only the added, removed, or modified data between two commits.
Go
