18 Repos
General-purpose toolkits for cleaning, transforming, and querying structured data.
Distinct from Data Manipulation Libraries: Existing candidates were too narrow (columnar formats) or purely categorized as 'awesome lists'.
Explore 18 awesome GitHub repositories matching data & databases · Data Manipulation Libraries. Refine with filters or upvote what's useful.
Lodash is a JavaScript utility library and data manipulation toolkit. It provides a collection of modular functions for transforming, filtering, and validating arrays, objects, strings, and numbers. The project functions as a functional programming toolkit, offering capabilities for function composition, currying, and lazy evaluation. It includes mechanisms for execution control, such as debouncing and throttling, to manage the timing and frequency of function invocations. The library covers a broad surface of data operations, including deep cloning and merging of complex nested structures,
Ships a vast suite of methods for deep cloning, merging, and transforming complex nested data structures.
AndroidUtilCode is an Android utility library and system API wrapper designed to reduce development boilerplate. It provides a collection of helper classes for common tasks including system settings management, file I/O, and hardware access. The project distinguishes itself through a comprehensive toolset for device management and UI assistance. It includes specialized capabilities for monitoring battery status, managing system volume and brightness, and implementing UI helpers to prevent duplicate click events. It also provides a dedicated system for coordinate conversion between different m
Includes functions for data type conversion, array manipulation, and Chinese to Pinyin transliteration.
Immutable.js is a library of persistent data structures and a functional state management toolkit. It provides a collection of immutable objects and arrays that prevent direct mutation to ensure predictable state management in JavaScript applications. The library utilizes structural sharing to efficiently create new versions of data without full copying and implements lazy sequence processing to chain data transformations that execute only when values are requested. It also supports batch mutation processing, allowing multiple changes to be applied to a temporary mutable copy before returning
Provides a comprehensive toolkit for transforming, filtering, and querying structured data while maintaining immutability.
DevToysMac is a native macOS developer utility suite designed to encode, decode, and transform common data formats. It serves as a centralized tool suite for formatting and converting developer data into human-readable or machine-compatible strings. The application provides a set of tools for developer data manipulation, including JSON validation and formatting, Base64 encoding and decoding, and URL encoding and decoding. It also includes a text manipulation toolkit for cleaning up configuration files and developer logs through common string operations. The software is built as a SwiftUI des
Offers a toolkit for cleaning and transforming structured developer data.
Boost is a collection of portable, high-performance source libraries that extend the C++ standard library. It provides a wide range of reusable components, data structures, and algorithms designed to add capabilities to the base language across different platforms. The project is distinguished by its extensive focus on compile-time template metaprogramming and generic programming. It implements advanced architectural patterns such as policy-based design, concept-based type validation, and the use of SFINAE for conditional template resolution to minimize runtime overhead. The library covers a
Provides a suite of reusable algorithms for filtering, mapping, and transforming data collections.
This project is a metadata query engine and indexer for markdown files, designed to transform YAML frontmatter and inline fields into dynamic tables and lists. It provides a background process that extracts tags and custom fields into a searchable database, enabling the automated indexing of notes. The system is distinguished by its dual approach to data retrieval: a dedicated query language for SQL-like filtering and grouping, and a JavaScript data API. This API allows for programmatic metadata extraction and the creation of custom views and extensions using TypeScript typings. Its broader
Provides comprehensive array transformations including filtering, mapping, sorting, and flattening of metadata lists.
Gopher-lua is a complete implementation of the Lua language and its standard libraries written natively in Go. It serves as an embedded scripting engine and virtual machine that allows Go applications to execute Lua scripts and exchange data between the host and the script environment. The project provides a bytecode compiler to transform source code into a binary format for faster execution. It enables deep integration between the two languages by allowing the registration of native Go functions to be called from scripts, and the invocation of script functions directly from Go. The engine c
Provides utilities for manipulating Lua tables as collection data sets through sorting, inserting, and removing elements.
Hyperf is a high-performance PHP coroutine framework designed for building microservices and middleware. It utilizes non-blocking coroutines to handle high concurrency and low-latency request processing, providing a foundation for scalable distributed systems. The framework is distinguished by an aspect-oriented programming based dependency injector that enables pluggable components and meta-programming. It includes a coroutine-optimized object-relational mapper with integrated model caching and an orchestration toolkit for microservice governance, featuring service discovery, circuit breaker
Offers utility methods for filtering, mapping, and transforming arrays and lazy collections.
Masuit.Tools is a comprehensive static utility library for .NET and ASP.NET Core development. It provides a broad collection of reusable helper methods and infrastructure components that cover common programming tasks without requiring dependency injection or instance management. The library is organized as flat utility classes, making its functionality directly accessible from anywhere in a project. The toolkit distinguishes itself through a wide range of integrated capabilities that go beyond typical utility libraries. It includes a multithreaded range-request file downloader with pause and
Ships utilities for safe collection manipulation including add, remove, insert, and reorder operations.
Doctrine Collections is a PHP library that provides object-oriented abstractions for managing and manipulating groups of objects with array-like functionality. It wraps native PHP arrays in an object-oriented interface, enabling cleaner data manipulation through methods for filtering, mapping, and iteration. The library supports callback-driven transformation, applying a callback to every element and returning a new collection with the transformed values. It also enables criteria expression querying, allowing selection of matching elements by applying a criteria object with comparison express
Works with arrays and lists through an object-oriented interface for cleaner data manipulation.
CppGuide is a curated collection of educational resources and practical guides focused on C++ server development, Linux kernel internals, concurrent programming, network protocols, and security exploitation. It provides structured learning paths for backend developers, covering everything from interview preparation to building high-performance network servers and understanding operating system fundamentals. The guide distinguishes itself by offering in-depth, hands-on tutorials that walk through real-world implementations, including building a Redis-like server from scratch, designing custom
Teaches creating and manipulating arrays, slices, and maps for ordered and keyed data storage.
Apache Hive is a SQL-on-Hadoop data warehouse that enables querying and managing petabytes of data stored in distributed storage such as HDFS and cloud storage services. It provides a familiar SQL interface for batch analytics and reporting, supported by a core set of components including the HiveServer2 Thrift service for remote query execution, the Hive Metastore Service for central metadata management, the Hive ACID Transaction Engine for concurrent read-write operations, and the Hive LLAP Interactive Engine for low-latency analytical processing. The WebHCat REST API offers an HTTP interfac
Performs set operations and element-level queries on arrays and maps, including sorting and filtering.
go-funk ist eine Bibliothek für funktionale Programmierung in Go, die eine Reihe von Hilfsfunktionen zur Transformation und Abfrage von Slices und Maps bereitstellt. Sie ermöglicht einen deklarativen Programmierstil für die Manipulation von Sammlungen und Datentransformationen, wodurch wiederkehrende manuelle Schleifen reduziert werden. Die Bibliothek implementiert Funktionen höherer Ordnung für gängige Operationen, einschließlich Mapping, Filtern und Suchen in Datenstrukturen mittels Prädikaten und Callbacks. Sie enthält Dienstprogramme zur Erkennung der Existenz von Elementen und zum Finden gemeinsamer Elemente zwischen Sammlungen. Diese Funktionen werden durch generische Typ-Constraints und interface-basierte Typ-Assertionen unterstützt, um sicherzustellen, dass die Operationen über verschiedene Elementtypen hinweg funktionieren.
Provides utilities for filtering, mapping, and transforming Go slices and maps.
Helmfile is a declarative tool for managing Kubernetes Helm releases across multiple environments. It defines the desired state of releases in version-controlled YAML files and synchronizes the cluster to match that state, acting as both a release manager and a state sync orchestrator. The tool layers environment-specific values, secrets, and lifecycle hooks onto shared release definitions, enabling consistent multi-environment deployments. Helmfile distinguishes itself through several integrated capabilities: it generates separate dependency lockfiles per environment for staged rollout of ch
Helmfile combines, sorts, deduplicates, slices, and computes set operations on lists and maps.
Corcel transforms a remote WordPress site into a local data source by wrapping its REST API in an object-relational mapper. As a headless CMS bridge, it synchronizes remote posts, pages, users, and options into local models, enabling offline querying and manipulation from external PHP applications. The library uses pluggable adapters to fetch different WordPress resource types and a schema-based translation layer that converts WordPress post types and fields into local definitions. It validates user credentials against a remote WordPress database and integrates with the host framework’s authe
Creates, updates, and deletes WordPress entities such as posts, pages, users, comments, and metadata from a remote application.
Sprig is a comprehensive library of helper functions designed to extend the Go text template engine. It provides a wide array of custom functions that can be injected into the engine to enable complex data manipulation and logic directly within templates. The project offers specialized capabilities for cryptography, including the generation of private keys, X.509 certificates, and secure password hashes. It also includes advanced logic extensions for semantic versioning comparison, ternary evaluations, and the resolution of environment variables from the host operating system. The library co
Provides a toolkit for transforming structured data, including merging dictionaries and filtering lists, during template execution.
Python-Guide-CN ist eine chinesische Übersetzung eines umfassenden Leitfadens für idiomatische Python-Programmierung und Softwareentwicklung. Er dient als kuratiertes Programmier-Tutorial und Ökosystem-Referenz und bietet einen strukturierten Pfad zum Erlernen von Python-Syntax, Standardbibliotheken und professionellen Coding-Mustern. Das Projekt zeichnet sich dadurch aus, dass es detaillierte Anweisungen für das Einrichten von Entwicklungsumgebungen unter Windows, macOS und Linux bietet. Es konzentriert sich spezifisch auf die Auswahl von Interpretern und die Verwaltung virtueller Umgebungen, um einen konsistenten Arbeitsplatz zu gewährleisten. Der Leitfaden deckt eine breite Palette technischer Funktionen ab, einschließlich Software-Test-Workflows, Paketverteilung und der Implementierung von Coding-Best-Practices. Er bietet zudem Anleitungen zur Webentwicklung, REST-API-Konstruktion und wissenschaftlichem Rechnen, einschließlich Datenanalyse und Visualisierung.
Teaches the use of generator expressions and comprehensions for memory-efficient manipulation of data collections.
Velociraptor is a digital forensics and incident response platform, endpoint detection and response system, and visibility tool. It provides a query engine and remote forensic collector used to hunt for indicators of compromise and perform triage across a fleet of hosts. The system is distinguished by its specialized query language for interrogating host state and parsing binary files. It features a notebook environment that combines markdown documentation with executable query cells to standardize investigative workflows and enable collaborative reporting. The platform covers a wide range o
Transforms and decodes collected host state information using a specialized query language.