5 个仓库
Saving and loading multidimensional numerical arrays across various scientific file formats.
Distinct from Multi-Format Data Persistence: Focuses specifically on scientific numerical formats like NPY and CSV, rather than general database persistence.
Explore 5 awesome GitHub repositories matching data & databases · Numerical Array Persistence. Refine with filters or upvote what's useful.
This project is an educational resource and a collection of instructional materials for performing data manipulation and statistical analysis using Python. It provides a comprehensive set of guides and code examples for using the Pandas, NumPy, and Matplotlib libraries to analyze structured data. The resource includes a dedicated guide for reshaping, cleaning, and aggregating tabular data and time series via Pandas, alongside a reference for high-performance vectorized operations and linear algebra using NumPy. It also features tutorials for creating publication-quality charts, distribution p
Enables saving and loading multidimensional numerical arrays to disk in raw binary formats with compression support.
libigl 是一个 C++ 几何处理库,用于分析和操作 3D 三角形和四面体网格。它充当数值线性代数套件和网格操作框架,集成了几何变形引擎以实现刚性和多调和变换。 该项目以其仅头文件的库设计以及对专门变形技术的实现而著称,包括尽可能刚性 (rigid-as-possible) 和多调和形状变形。它还提供了一个可视化工具,用于通过交互式场景控制和网格拾取来渲染表面和标量场。 该库涵盖了广泛的功能,包括用于曲率和测地距离的几何分析、通过等值面提取和三角剖分进行的网格生成,以及通过各向异性变形进行的网格重构。它还支持布尔网格操作、表面参数化以及用于求解拉普拉斯方程和二次规划的数值优化。 该工具包包括用于导入和导出各种 3D 几何格式的实用程序,并支持与 Matlab 的互操作性,以便执行脚本和共享矩阵。
Persists large numerical arrays to disk using binary or ASCII formats for high precision.
ArrayFire 是一个硬件无关的计算框架和 JIT 编译张量引擎,专为高性能数值计算而设计。它作为一个 GPU 数值计算库和并行信号处理工具包,抽象了硬件后端,允许同一代码库在各种 GPU 架构和 CPU 上执行。 该项目以其使用表达式编译来融合操作并最小化内存开销的 JIT 引擎而脱颖而出。它采用延迟执行图来优化计算链,并提供互操作性原语以与 CUDA 和 OpenCL 等外部计算平台共享数据和执行上下文。 该库涵盖了广泛的功能,包括并行线性代数、数字信号处理和加速计算机视觉。它提供了用于机器学习实现、金融建模模拟以及求解物理系统模拟偏微分方程的工具。其张量管理系统处理多维数组分配、切片和主机-设备数据传输。
Saves and loads multidimensional numerical tensors to and from files using keys or indices.
Joblib 是一套用于并行化计算工作负载和优化大型数值数据集及函数结果存储的实用工具。它作为并行计算库和多进程包装器,将函数执行分配到多个 CPU 核心上,以加速独立任务和计算循环。 该项目提供了一个磁盘缓存框架,将昂贵的函数输出持久化到文件系统,仅在输入参数发生变化时才重新评估。它进一步专注于大型数值数组的序列化,利用高效的压缩和内存映射来优化海量数据集的存储和检索。 该工具包包括并行函数映射功能,并使用可插拔的执行后端来控制任务如何在可用硬件上分配。其存储层涵盖了复杂对象持久化和序列化数据的透明压缩。
Provides memory-mapping for large numerical arrays to allow efficient disk-based random access without consuming full RAM.
xtensor is a C++ multidimensional array library for numerical computing that provides N-dimensional containers with an interface mirroring the NumPy API. It utilizes a lazy evaluation expression engine to defer numerical computations until assignment, which minimizes memory allocations and intermediate copies. The library features a foreign memory array adaptor that allows it to wrap external buffers, such as NumPy arrays, to perform numerical operations in-place without duplicating data. It further optimizes performance through lazy broadcasting and a system that manages the lifetime of temp
Deno-xtensor reads and writes multidimensional arrays using CSV, NPY, and JSON formats for persistence.