1 repo
Systems that maintain intermediate computation results in memory to prevent redundant re-processing of data pipelines.
Explore 1 awesome GitHub repository matching software engineering & architecture · Incremental State Management. Refine with filters or upvote what's useful.
Pathway is a high-performance data processing framework designed for building unified batch and streaming pipelines. It functions as an orchestrator for complex data transformations, utilizing a differential dataflow engine to process updates incrementally. By treating static datasets and continuous event streams with