Awesome GitHub RepositoriesArray Column Operations

Polars is a high-performance columnar data processing library designed for efficient analytical workflows. It functions as a structured data library that organizes information into typed columns, utilizing the Apache Arrow memory format to enable zero-copy data sharing and cache-friendly, vectorized operations. The engine is built to handle large-scale tabular datasets, providing both local and distributed analytical runtimes that scale from single-machine environments to multi-node clusters. The project distinguishes itself through a sophisticated lazy query engine that constructs abstract e

This is an educational tutorial that walks through implementing a complete JSON library from scratch in C. The project covers the full data lifecycle of JSON, including parsing text into structured in-memory representations, validating input against the specification, serializing data back into standard JSON output, and providing structured access to elements within parsed arrays and objects. The implementation is built around a hand-written recursive descent parser that processes JSON text by matching grammar rules to build a structured data tree. Parsed values are stored in a tagged union r

Lance is a versioned columnar data format and storage engine designed as a multimodal AI lakehouse. It serves as a vector database storage engine and a cloud object store dataset manager, organizing images, video, audio, and embeddings into a unified format optimized for machine learning workflows. The project distinguishes itself by combining a columnar layout for structured data with a specialized blob store for large multimodal tensors. It implements a hybrid search engine that integrates vector similarity search, full-text search, and SQL analytics on a single dataset, supported by a stor

Ibis is a portable Python dataframe library and multi-backend query engine that provides a unified interface for executing data transformations across diverse compute engines. It functions as a Python SQL expression compiler and dialect transpiler, allowing users to define data logic once and execute it across cloud warehouses, embedded databases, and distributed clusters without rewriting code. The project distinguishes itself through a database backend abstraction that decouples transformation logic from the underlying execution engine. It enables polyglot data workflows by mixing raw SQL s

Just 是一个 JavaScript 实用程序库集合，专为数据操作、函数式编程、性能优化、统计分析和字符串处理而设计。它提供了一套用于深度克隆、过滤和转换复杂对象与数组的工具。 该项目被构建为一系列零依赖模块，允许独立使用实用程序以最小化包大小。它实现了包括柯里化、管道和部分应用在内的函数式编程模式，并通过记忆化、防抖和节流提供执行控制。 该库涵盖了广泛的功能，包括深度对象操作、组合数据生成以及素数验证和数值钳位等数学运算。它还包括用于计算方差和标准差等指标的统计工具，以及用于大小写转换和字符串插值的文本处理实用程序。

Carp is a statically typed Lisp compiler that compiles Lisp-like syntax directly to C source code, enabling seamless integration with existing C libraries and low-level system programming. It manages memory deterministically at compile time using ownership tracking and linear types, eliminating garbage collection pauses and runtime overhead while ensuring type safety through an inferred static type system. The language distinguishes itself through compile-time macro expansion and metaprogramming capabilities, allowing code generation and transformation before final binary output. It enforces

jsondiffpatch 是一个 JSON 差异和补丁库，旨在计算两个 JSON 对象之间的差异并应用这些更改以同步状态。它作为一个同步工具，用于计算增量并应用补丁来更新或还原复杂的嵌套 JavaScript 对象。 该项目提供了符合 RFC 6902 JSON Patch 标准的原子更新实现，以及一个将数据增量转换为人类可读 HTML 视图的视觉差异渲染器。它包括一个专门的文本差异工具，用于对 JSON 数据值中的长字符串执行细粒度的字符级分析。 该库涵盖了广泛的功能，包括递归增量生成和使用最长公共子序列（LCS）算法的数组差异计算。它支持逻辑数组差异分析，通过自定义哈希检测项目移动，并提供多种格式输出选项，如彩色控制台格式和用于视觉比较的专用 React 组件。

Arroyo is a high-performance stream processing platform built in Rust. It executes continuous SQL queries on streaming data with event-time semantics, enabling accurate windowed aggregations, joins, and stateful computations on unbounded event streams. The platform uses native Rust execution for high throughput and low latency, with periodic checkpointing for exactly-once fault tolerance and horizontal scaling across distributed workers. The system integrates deeply with Kafka for reading and writing topics with exactly-once delivery and supports change data capture (CDC) from MySQL and Postg

Rueidis is a high-performance Redis client library for Go that provides a type-safe and asynchronous interface for interacting with Redis servers. It includes a full implementation of the Redis serialization protocol and a dedicated connection manager to handle pooling, multiplexing, and automatic pipelining. The library is distinguished by its support for RDMA connectivity to reduce latency and CPU overhead. It features a distributed lock manager that implements majority-based locking and optimistic concurrency control, as well as client-side caching with invalidation signals to minimize net