1 个仓库
Distributes computations across multiple cores by serializing input data and aggregating results using pickle and multiprocessing.
Distinct from Parallel Processing: Distinct from Parallel Processing: focuses on the specific mechanism of serializing data for distribution rather than general parallel execution patterns.
Explore 1 awesome GitHub repository matching data & databases · Serialization-Based Parallelization. Refine with filters or upvote what's useful.
Toolz is a Python library that implements functional programming utilities for iterable transformation, dictionary manipulation, function composition, and lazy evaluation. It provides a set of pure functions designed to work with Python's built-in data structures, enabling concise and composable data processing workflows. What distinguishes toolz is its support for curried partial application, allowing functions to be incrementally applied and reused. It includes dictionary-centric operations that handle nested structures, and offers iterable chain transformers that combine mapping, filtering
Provides parallel computation through serialization-based distribution across multiple cores.