9 个仓库
Iterators that partition data structures across multiple threads for parallel processing.
Distinct from Sequential Iterators: Distinct from Sequential Iterators: focuses on parallelizing data traversal rather than sequential access.
Explore 9 awesome GitHub repositories matching data & databases · Parallel Data Iterators. Refine with filters or upvote what's useful.
Async is a JavaScript asynchronous flow library designed to manage the execution and coordination of asynchronous tasks in Node.js and the browser. It provides functional utilities to wrap, process, and orchestrate complex asynchronous workflows. The library distinguishes itself through a comprehensive task orchestrator that handles dependency graphs to resolve circular references and manages concurrent task queues. It includes a unification bridge that allows callback-style and promise-based functions to operate within the same execution interface. The project covers several primary capabil
Tracks completion status and result indices of collection items to maintain original order during parallel processing.
Rayon is a data parallelism library for Rust that provides a framework for converting sequential computations into parallel operations. It enables the transformation of standard data structures and loops into parallel iterators, allowing workloads to be distributed across multiple processor cores. By utilizing a work-stealing scheduler, the library dynamically balances tasks to maximize throughput and minimize execution time. The library distinguishes itself through its focus on safe, scoped task synchronization, which ensures that all spawned operations complete before a scope exits to preve
Converts sequential data structures into parallel iterators to execute operations across multiple threads.
EnTT is a C++ library designed for data-oriented design and entity component system architecture. It provides a framework for managing game objects and simulation states by separating entity data from logic, allowing for the efficient organization and manipulation of large collections of related data objects. The library utilizes sparse sets to store entities and components in contiguous memory, which facilitates cache-friendly iteration and constant-time lookups. It employs template metaprogramming for compile-time type reflection and type-erasure techniques to provide a unified interface fo
Implements parallel iterators to traverse component pools efficiently for high-frequency simulation updates.
conc is a Go concurrency library and structured concurrency framework providing primitives for managing parallel tasks, mapping slices, and collecting results. It implements a system for spawning scoped tasks to ensure all child processes complete before their parent exits. The library includes a goroutine pool manager to limit active concurrent processes and a panic-safe task runner that catches panics in goroutines and propagates stack traces to the parent. It also provides a concurrent map-reduce tool for transforming data slices and processing streams in parallel while maintaining the ori
Splits data collections into individual units of work for concurrent processing across multiple Go routines.
more-itertools 是 Python itertools 模块的扩展库。它作为一个用于操作可迭代对象的工具包,提供了广泛的数据转换、组合生成和迭代器状态管理例程。 该库以高级状态管理和复杂的序列生成为特色。它提供了查看未来元素、在序列内搜索,以及从可能包含重复元素的集合中生成唯一排列、组合和集合划分的功能。 其更广泛的功能涵盖了数据处理任务,如递归展平、分组、填充和数据流重塑。它还包括用于流合并、局部邻域分析的窗口化以及线程安全的迭代同步的工具。 该项目还提供了用于数值序列处理的专门例程,包括矩阵乘法、离散线性卷积和傅里叶变换。
Wraps iterators in stateful classes to provide advanced capabilities like peeking, seeking, and consumption tracking.
more-itertools 是一个 Python 可迭代对象工具库,提供用于操作、过滤和转换数据序列的高级函数。它作为一个数据流处理工具包和一组用于迭代器状态管理的工具,扩展了标准 Python itertools 模块的功能。 该库包括一个用于生成排列、组合和幂集的组合数学工具包,以及用于数论计算和矩阵运算的例程。它还提供了用于流状态管理的工具,允许用户查看即将到来的元素或在序列内搜索,以控制数据的消费方式。 附加功能涵盖了用于分块、交错和展平复杂序列的数据处理例程。该工具包还包括分析可迭代对象属性和同步并发数据流的函数。
Ships utilities for peeking at elements and seeking within streams to precisely control sequence consumption.
This repository provides a collection of fundamental computer science algorithms and data structures implemented in Go. It serves as a technical reference and educational resource, offering reusable modules for common computational tasks including data organization, graph analysis, and numerical operations. The library distinguishes itself through the application of idiomatic Go patterns, utilizing generics for type abstraction and interface-driven polymorphism to ensure compile-time type safety. It emphasizes algorithmic efficiency by employing in-place memory mutation to reduce allocations
Employs iterative state management to perform repetitive calculations efficiently while avoiding the stack overhead of deep recursion.
该仓库作为使用 JavaScript 实现基础数据结构和算法的综合教育资源和技术参考。它提供了一个掌握核心计算机科学概念的结构化指南,专注于在 JavaScript 生态系统中应用数据组织技术和问题解决策略的实践。 这些材料涵盖了基本存储模式的实现,包括链表、树和图,以及算法效率的分析。通过评估渐近复杂度下的执行时间和内存使用情况,这些内容使开发者能够比较计算任务的不同方法,并识别数据检索和操作的最有效方法。 该集合通过详细说明解决复杂计算挑战的标准模式和逻辑,支持技术面试准备。它解决了状态管理和问题分解的迭代和递归方法,为在专业软件工程环境中编写高性能代码奠定了基础。
Manages internal state updates through sequential loops to avoid recursive overhead.
This project is a collection of classic computational algorithms and data structures implemented in JavaScript. It serves as a library of standardized procedures for sorting, searching, and graph traversal, alongside foundational data containers such as linked lists, heaps, trees, and hash tables. The library is designed to support computer science education and technical interview preparation by providing clean, readable implementations of fundamental principles. It emphasizes functional logic isolation and type-agnostic design, ensuring that computational tasks remain decoupled from applica
Uses internal pointers and iterative state management to maintain data structure integrity during operations.