Awesome GitHub RepositoriesArray Column Operations

Polars is a high-performance columnar data processing library designed for efficient analytical workflows. It functions as a structured data library that organizes information into typed columns, utilizing the Apache Arrow memory format to enable zero-copy data sharing and cache-friendly, vectorized operations. The engine is built to handle large-scale tabular datasets, providing both local and distributed analytical runtimes that scale from single-machine environments to multi-node clusters. The project distinguishes itself through a sophisticated lazy query engine that constructs abstract e

This is an educational tutorial that walks through implementing a complete JSON library from scratch in C. The project covers the full data lifecycle of JSON, including parsing text into structured in-memory representations, validating input against the specification, serializing data back into standard JSON output, and providing structured access to elements within parsed arrays and objects. The implementation is built around a hand-written recursive descent parser that processes JSON text by matching grammar rules to build a structured data tree. Parsed values are stored in a tagged union r

Lance is a versioned columnar data format and storage engine designed as a multimodal AI lakehouse. It serves as a vector database storage engine and a cloud object store dataset manager, organizing images, video, audio, and embeddings into a unified format optimized for machine learning workflows. The project distinguishes itself by combining a columnar layout for structured data with a specialized blob store for large multimodal tensors. It implements a hybrid search engine that integrates vector similarity search, full-text search, and SQL analytics on a single dataset, supported by a stor

Ibis is a portable Python dataframe library and multi-backend query engine that provides a unified interface for executing data transformations across diverse compute engines. It functions as a Python SQL expression compiler and dialect transpiler, allowing users to define data logic once and execute it across cloud warehouses, embedded databases, and distributed clusters without rewriting code. The project distinguishes itself through a database backend abstraction that decouples transformation logic from the underlying execution engine. It enables polyglot data workflows by mixing raw SQL s

Just es una colección de librerías de utilidades de JavaScript diseñadas para la manipulación de datos, programación funcional, optimización del rendimiento, análisis estadístico y procesamiento de cadenas. Proporciona un conjunto de herramientas para clonación profunda, filtrado y transformación de objetos y arrays complejos. El proyecto está estructurado como una serie de módulos sin dependencias, permitiendo que las utilidades se utilicen de forma independiente para minimizar el tamaño del bundle. Implementa patrones de programación funcional incluyendo currying, piping y aplicación parcial, y proporciona control de ejecución mediante memoización, debouncing y throttling. La librería cubre un amplio rango de capacidades, incluyendo manipulación profunda de objetos, generación de datos combinatorios y operaciones matemáticas como verificación de números primos y acotación numérica. También incluye herramientas estadísticas para calcular métricas como varianza y desviación estándar, así como utilidades de procesamiento de texto para conversión de casos e interpolación de cadenas.

Carp is a statically typed Lisp compiler that compiles Lisp-like syntax directly to C source code, enabling seamless integration with existing C libraries and low-level system programming. It manages memory deterministically at compile time using ownership tracking and linear types, eliminating garbage collection pauses and runtime overhead while ensuring type safety through an inferred static type system. The language distinguishes itself through compile-time macro expansion and metaprogramming capabilities, allowing code generation and transformation before final binary output. It enforces

jsondiffpatch es una librería de diff y patch para JSON diseñada para calcular las diferencias entre dos objetos JSON y aplicar esos cambios para sincronizar estados. Funciona como una herramienta de sincronización para calcular deltas y aplicar parches para actualizar o revertir objetos complejos de JavaScript anidados. El proyecto proporciona una implementación compatible con el estándar RFC 6902 JSON Patch para actualizaciones atómicas y un renderizador de diferencias visuales que convierte los deltas de datos en vistas HTML legibles por humanos. Incluye una herramienta de diff de texto especializada para realizar análisis detallados a nivel de carácter en cadenas largas dentro de valores de datos JSON. La librería cubre una amplia gama de capacidades, incluyendo la generación recursiva de deltas y el cálculo de diferencias de arrays utilizando algoritmos de subsecuencia común más larga (LCS). Admite el diffing lógico de arrays para detectar movimientos de elementos mediante hashing personalizado y ofrece opciones de salida multiformato, como formato de consola codificado por colores y un componente de React dedicado para comparaciones visuales.

Arroyo is a high-performance stream processing platform built in Rust. It executes continuous SQL queries on streaming data with event-time semantics, enabling accurate windowed aggregations, joins, and stateful computations on unbounded event streams. The platform uses native Rust execution for high throughput and low latency, with periodic checkpointing for exactly-once fault tolerance and horizontal scaling across distributed workers. The system integrates deeply with Kafka for reading and writing topics with exactly-once delivery and supports change data capture (CDC) from MySQL and Postg

Rueidis is a high-performance Redis client library for Go that provides a type-safe and asynchronous interface for interacting with Redis servers. It includes a full implementation of the Redis serialization protocol and a dedicated connection manager to handle pooling, multiplexing, and automatic pipelining. The library is distinguished by its support for RDMA connectivity to reduce latency and CPU overhead. It features a distributed lock manager that implements majority-based locking and optimistic concurrency control, as well as client-side caching with invalidation signals to minimize net