11 个仓库
Algorithms for mapping and transforming one sequence of data into another to optimize memory and processing.
Distinct from Sequence To Sequence Models: The candidates refer to ML Sequence-to-Sequence models (Transformers), whereas this is a general algorithmic utility for mapping data sequences.
Explore 11 awesome GitHub repositories matching data & databases · Sequence Transformations. Refine with filters or upvote what's useful.
This project is a markdown knowledge base used to maintain a curated collection of concise technical notes and write-ups across various programming languages and tools. It serves as a searchable personal reference library for documenting technical discoveries and software development patterns. The system implements a learning in public workflow, transforming markdown-based content storage into a static site. It utilizes directory-based routing to map folder structures to URL paths and employs schema-driven type generation to ensure data consistency across the knowledge base. The codebase cov
Produces a sequence of all intermediate values generated during a collection reduction.
pifs 是一个数学常数文件系统和无数据存储模拟器。它通过将文件数据映射到无限数学常数中的数字序列来模拟虚拟文件系统,从而消除了对物理磁盘存储的需求。 该系统作为一个实验性文件映射工具运行,将文件内容转换为数值常数内的坐标和偏移量。它利用虚拟元数据管理器来跟踪文件长度和位置,从而无需传统存储块即可实现数据检索。 该项目通过使用公式化偏移计算和基于索引的元数据跟踪来模拟标准文件层次结构,涵盖了实验性存储架构。
Implements the conversion of raw file content into digit sequences compatible with mathematical constants.
This project is a comprehensive Lisp AI implementation library that provides reference implementations for various artificial intelligence paradigms and symbolic algorithms. It functions as a multi-purpose toolkit containing a logic programming engine, a natural language processing suite, and a symbolic mathematics toolkit. The library is distinguished by its diverse architectural frameworks, including a Prolog-style execution engine that uses unification and goal-driven backtracking, and a system for simulating human decision-making through expert system shells and certainty factors. It also
Deno Data Storage & Sync applies a function to multiple sequences and writes results into a target sequence to minimize memory allocation.
The .NET Reactive Extensions Library is a framework for composing, querying, and transforming asynchronous data streams. It provides a non-blocking implementation of the observer pattern to manage notifications and data flows between producers and consumers, functioning as an event stream processing library. The project applies LINQ-style querying and filtering operators to asynchronous sequences. This allows for the handling of event-driven programming patterns by utilizing composable operators to process notifications as they occur. The library covers asynchronous data streaming and non-bl
Applies advanced operators to asynchronous enumerables for complex data transformations.
language-ext is a functional programming framework for C# that provides a suite of immutable data structures and monadic types. It enables the implementation of pure functional programming patterns, utilizing containers to manage side effects, optional values, and error handling. The library is distinguished by its advanced concurrency and state management tools, including a software transactional memory system and lock-free atomic references. It also provides specialized utilities for distributed systems, such as vector clocks for causality tracking and deterministic data conflict resolution
Applies mapping functions to each element of a lazy sequence to produce a new transformed sequence.
RxKotlin is a reactive programming library and asynchronous stream processor that provides Kotlin language extensions for composing event-based data streams. It serves as a set of Kotlin bindings for RxJava, allowing developers to transform, filter, and flatten sequences of data emitted over time. The library focuses on integrating RxJava patterns into Kotlin projects by applying language-specific conventions and idioms. It utilizes extension functions to simplify reactive programming patterns, reduce boilerplate, and optimize workflows within the reactive ecosystem. The toolkit covers a bro
Employs lazy transformations on data streams, ensuring operations are only executed upon observer subscription.
Reactor Core is a reactive programming toolkit and non-blocking foundation for composing asynchronous data pipelines on the JVM. It serves as an asynchronous stream processing framework and a backpressure management system, allowing developers to transform, filter, and combine sequences of events while regulating data flow between producers and consumers to prevent resource exhaustion. The library differentiates itself through a sophisticated concurrency scheduling system and demand-based flow control. It decouples signal processing from specific threads using a scheduler registry and provide
Provides a rich set of operators for mapping, flattening, and transforming asynchronous data sequences.
NCCL 是一个高性能通信库和分布式 GPU 计算框架,专为在单节点或多节点系统中的多个 GPU 之间执行集合和点对点数据交换而设计。它充当 RDMA GPU 传输层和内存编排器,为分布式 GPU 训练和推理提供高带宽的数据和模型梯度同步。 该库的特色在于能够直接从 GPU 内核执行通信原语,将主机 CPU 从关键路径中移除。它利用拓扑感知路径选择来优化数据移动,并采用包括 InfiniBand 和 NVLink 在内的基于 RDMA 的网络传输,以实现设备跨不同物理节点之间的零拷贝内存访问。 该项目涵盖了广泛的集合通信模式,包括归约(Reductions)、广播(Broadcasts)、收集(Gathers)和全对全交换(All-to-all exchanges),以及点对点远程内存访问。它提供全面的通信器管理,用于初始化、分区和调整 GPU 组大小,以及用于注册缓冲区和协调共享设备内存的专用内存管理。 该系统包括一套用于健康跟踪、诊断日志记录和实时事件监控的监控与可观测性工具,以及用于机器学习框架、CUDA Graphs、MPI 和 Python 的集成接口。
NCCL performs a reduction across multiple sources and copies the resulting value to destinations in a single operation.
这是一个 C++ Ranges 库和标准模板库 (STL) 的扩展,提供了一系列用于处理数据序列的可组合算法和惰性视图。它作为惰性序列处理框架和模板元编程库,用于操作类型列表并执行编译时类型计算。 该项目通过使用管道语法和偏函数应用,在 C++ 中实现了函数式编程模式,从而创建可读的、从左到右的数据转换链。它允许构建按需过滤和转换元素的惰性数据流水线,以减少内存开销并避免不必要的拷贝。 该库涵盖了广泛的能力领域,包括序列操作、编译时类型操作以及自定义范围类型和迭代器的实现。它提供了用于急切的原地容器修改、基于投影的算法分发以及通过一系列类型级可调用对象管理类型列表的工具。
Implements a comprehensive set of algorithms for mapping and transforming data sequences to optimize memory and processing.
more-itertools 是一个 Python 可迭代对象工具库,提供用于操作、过滤和转换数据序列的高级函数。它作为一个数据流处理工具包和一组用于迭代器状态管理的工具,扩展了标准 Python itertools 模块的功能。 该库包括一个用于生成排列、组合和幂集的组合数学工具包,以及用于数论计算和矩阵运算的例程。它还提供了用于流状态管理的工具,允许用户查看即将到来的元素或在序列内搜索,以控制数据的消费方式。 附加功能涵盖了用于分块、交错和展平复杂序列的数据处理例程。该工具包还包括分析可迭代对象属性和同步并发数据流的函数。
Offers algorithms for mapping and transforming sequences, including padding and repeating values.
This project is a library of algorithms for transforming, filtering, and combining asynchronous data streams in Swift. It provides a toolkit for managing asynchronous sequences, offering a concurrent sequence processor to merge, zip, and concatenate multiple streams into single outputs. The library distinguishes itself through specialized timing and flow control mechanisms. It implements asynchronous back-pressure to synchronize producer and consumer speeds and provides a toolkit for event timing, including debouncing, throttling, and the generation of periodic timers. The capability surface
Provides algorithms for mapping, filtering, and transforming asynchronous sequences into other sequences.