9 个仓库
Awesome GitHub RepositoriesLazy Sequence Processing
Processing of data sequences using generators to avoid full memory allocation.
Distinct from Declarative Sequence Processing: Specializes declarative sequence processing into the specific implementation of lazy evaluation via generators.
Explore 9 awesome GitHub repositories matching software engineering & architecture · Lazy Sequence Processing. Refine with filters or upvote what's useful.
Awesome Lazy Sequence Processing GitHub Repositories
用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
- crazyguitar/pysheeet
crazyguitar/pysheeet
8,150在 GitHub 上查看pysheeet 是一个技术参考库，提供了一系列精选的代码片段和实现模式，用于高级 Python 开发、系统集成和高性能计算。它充当实现底层网络编程、原生 C 扩展以及异步和并发编程的综合指南。 该项目为大语言模型的开发和部署提供了专门的框架，包括用于分布式 GPU 推理和高性能服务的工具。它还包括用于高性能计算集群编排的详细模式，涵盖 GPU 资源分配和多节点工作负载管理。 该库涵盖了广泛的功能，包括安全网络通信和加密、对象关系映射和数据库管理，以及复杂数据结构和算法的实现。它还提供用于内存管理、通过外部函数接口（FFI）进行原生互操作以及系统级 OS 集成的实用程序。
Demonstrates the use of generator functions to produce data sequences lazily to minimize memory usage.
Python - jackzhenguo/python-small-examples
jackzhenguo/python-small-examples
8,132在 GitHub 上查看This project is a comprehensive library of practical Python code examples and patterns. It provides a collection of scripts and snippets designed to demonstrate a wide range of programming tasks, from basic syntax to advanced implementation patterns. The repository focuses on several core domains, including the implementation of concurrency and multithreading examples, data analysis snippets for cleaning and manipulating tabular data, and various data visualization examples. It also covers automation scripts for file system management and a variety of general programming patterns. Additional
Uses lazy evaluation and generators to process large datasets and nested lists without allocating full intermediate collections.
Pythondata-sciencemachine-learningpython - dtao/lazy.js
dtao/lazy.js
5,975在 GitHub 上查看Lazy.js is a JavaScript library that implements a lazy evaluation model for processing collections and data streams. It defers all computation until iteration begins, building chains of transformations that execute only when values are consumed, avoiding intermediate arrays and buffering. The library wraps data sources into a uniform sequence interface, enabling operations like map and filter to be chained together without materializing intermediate results. The library extends lazy processing beyond simple collections to handle asynchronous data sources, DOM events, strings, and Node.js stre
Processing collections and data streams by deferring computation until results are requested, avoiding intermediate arrays and iterating only as needed.
JavaScript - remeda/remeda
remeda/remeda
5,382在 GitHub 上查看Remeda 是一个为 TypeScript 设计的类型安全函数式工具库，用于构建数据转换流水线。它提供了一套辅助函数工具包，用于在处理数组和对象的同时保持严格的类型完整性。 该库的特点是支持数据优先（data-first）和数据最后（data-last）两种调用风格。它利用惰性求值来处理数据集合，仅在请求最终结果时才评估转换，从而避免创建中间集合副本。 该工具包涵盖了集合操作、函数组合以及模块化逻辑链的创建。这些功能使得构建能够通过一系列转换处理信息的数据流水线成为可能。
Processes large data sets using lazy evaluation to improve performance by resolving items only when needed.
TypeScript - reactor/reactor-core
reactor/reactor-core
5,224在 GitHub 上查看Reactor Core is a reactive programming toolkit and non-blocking foundation for composing asynchronous data pipelines on the JVM. It serves as an asynchronous stream processing framework and a backpressure management system, allowing developers to transform, filter, and combine sequences of events while regulating data flow between producers and consumers to prevent resource exhaustion. The library differentiates itself through a sophisticated concurrency scheduling system and demand-based flow control. It decouples signal processing from specific threads using a scheduler registry and provide
Implements sophisticated windowing operators to group streaming data by time intervals or element counts.
Javaasynchronousflowflux - ericniebler/range-v3
ericniebler/range-v3
4,367在 GitHub 上查看这是一个 C++ Ranges 库和标准模板库 (STL) 的扩展，提供了一系列用于处理数据序列的可组合算法和惰性视图。它作为惰性序列处理框架和模板元编程库，用于操作类型列表并执行编译时类型计算。 该项目通过使用管道语法和偏函数应用，在 C++ 中实现了函数式编程模式，从而创建可读的、从左到右的数据转换链。它允许构建按需过滤和转换元素的惰性数据流水线，以减少内存开销并避免不必要的拷贝。 该库涵盖了广泛的能力领域，包括序列操作、编译时类型操作以及自定义范围类型和迭代器的实现。它提供了用于急切的原地容器修改、基于投影的算法分发以及通过一系列类型级可调用对象管理类型列表的工具。
Implements a framework for building data pipelines that transform and filter elements on demand without full memory allocation.
C++ - erikrose/more-itertools
erikrose/more-itertools
4,074在 GitHub 上查看more-itertools 是一个 Python 可迭代对象工具库，提供用于操作、过滤和转换数据序列的高级函数。它作为一个数据流处理工具包和一组用于迭代器状态管理的工具，扩展了标准 Python itertools 模块的功能。 该库包括一个用于生成排列、组合和幂集的组合数学工具包，以及用于数论计算和矩阵运算的例程。它还提供了用于流状态管理的工具，允许用户查看即将到来的元素或在序列内搜索，以控制数据的消费方式。 附加功能涵盖了用于分块、交错和展平复杂序列的数据处理例程。该工具包还包括分析可迭代对象属性和同步并发数据流的函数。
Processes data sequences using generators to avoid full memory allocation via lazy evaluation.
Python - alibaba/coobjc
alibaba/coobjc
4,016在 GitHub 上查看coobjc 是一个 Objective-C 协程库，提供 await 方法和生成器，以简化 Objective-C 和 Swift 中的异步编程。它实现了非阻塞工作流，消除了嵌套回调和线程阻塞。 该工具包包括一个非阻塞 Foundation 包装器，可将同步的 Foundation 和 UIKit API 转换为可挂起的操作。它提供了一个用于通过 yield 按需生成值的惰性序列生成器，以及一个基于通道的通信工具，用于使用缓冲和非缓冲通道在并发任务之间交换数据。 该库涵盖了异步任务协调和状态管理，利用 Actor 模型防止数据竞争。其功能包括协程调度、取消，以及在不冻结用户界面的情况下执行文件系统和网络操作的能力。
Implements a lazy sequence generator to produce values on demand, reducing memory allocation for large data sets.
Objective-Cactoractor-modelarm64 - reactor/reactor
reactor/reactor
3,688在 GitHub 上查看Reactor is a reactive streams library and framework for building asynchronous data pipelines. It provides a system for coordinating execution contexts via an asynchronous event-loop manager, alongside a set of reactive abstractions for implementing high-performance TCP, UDP, QUIC, and HTTP services. The project includes a specialized testing tool for verifying the timing and order of asynchronous data flows and a bill of materials to synchronize compatible versions of core reactive libraries and networking add-ons. Its capability surface covers non-blocking network services, demand-based bac
Segments continuous asynchronous data streams into smaller sub-sequences based on size, time, or predicates.
