8 个仓库
Low-overhead processing of large-scale nested data collections using lazy operations.
Distinct from High Performance: Focuses on functional collection processing for memory efficiency, unlike candidates targeting hardware scalers or image processing.
Explore 8 awesome GitHub repositories matching data & databases · High-Performance Collection Processing. Refine with filters or upvote what's useful.
Hutool is a comprehensive suite of Java extensions designed to serve as a standard library extension. Its primary purpose is to reduce development boilerplate for common programming tasks and data manipulation through a collection of utility classes. The project provides specialized toolkits for database management using active record patterns and connection pooling, as well as network communication via a simplified HTTP client and asynchronous socket management. It includes security and identity capabilities such as symmetric and asymmetric encryption, image captcha generation, and JWT token
Implements Bloom filters for memory-efficient probabilistic membership verification.
Draft-js is a framework for building customizable rich text editors within React applications. It functions as a content editable framework that separates the underlying data model from the visual rendering layer, acting as a rich text content engine to manage complex text data and formatting. The project utilizes an immutable state management system to ensure consistent updates and predictable undo history. It manages editor state through persistent data structures, providing an immutable data state manager to prevent accidental mutation. The framework includes capabilities for high perform
Performs large-scale transformations and grouping on nested collections with minimal memory overhead.
EASTL is a C++ Standard Template Library implementation consisting of containers, iterators, and algorithms. It provides cross-platform data structures and a template-based algorithm library designed for use in resource-constrained game engine environments. The library focuses on game engine memory management, providing specialized utilities that ensure predictable memory allocation and high-performance access for real-time applications. These containers maintain consistent behavior across different operating systems and hardware platforms. The project covers high-performance C++ development
Provides high-performance containers for organizing and accessing data collections consistently across platforms.
RedisInsight is a graphical user interface and management tool for browsing, analyzing, and administering Redis databases. It provides a visual environment for exploring key-value data structures, managing database instances, and performing data analysis across different operating systems and deployments. The tool distinguishes itself by providing dedicated visual managers for complex operations, including a vector database manager for configuring embeddings and similarity searches, a query workbench for executing raw commands and Lua scripts, and a performance monitoring dashboard for tracki
Uses probabilistic algorithms to perform high-performance membership checks with significantly reduced memory overhead.
Pholcus is a distributed web crawling system designed for large-scale data scraping. It employs a master-worker distribution model to coordinate high-concurrency scraping tasks across a network of remote client nodes, enabling both horizontal and vertical data collection. The system features a hot-loadable rule engine that allows extraction and navigation logic to be updated at runtime without restarting the process. It handles dynamic content through headless browser integration and bypasses bot detection using proxy rotation, automated user authentication, and simulated human behavior. The
Uses static compiled code for high-performance scraping or dynamic files for hot-loading rules without restarting the system.
SpringSide 4 is an enterprise Java reference architecture and utility library built on the Spring Framework. It provides a pragmatic, best-practice application stack for building RESTful web services, web applications, and data access layers, along with a curated collection of high-performance utility classes for common operations like text, date, collection, reflection, concurrency, and I/O handling. The project distinguishes itself by combining a complete reference application scaffold with production-oriented infrastructure. It includes a JPA-based data access layer that automatically tran
Ships a curated collection of high-performance utility classes for common operations.
This library provides a collection of specialized data structures for the Swift language that extend the standard library with advanced container types. It includes implementations for double-ended queues using ring-buffers, priority queues based on min-max heaps, and memory-efficient bit-set and bit-array storage for boolean values. The project features ordered collections that maintain elements in sorted order via B-tree implementations, as well as persistent sets and dictionaries that use compressed prefix trees to share data between mutated copies. It also provides specialized containers
Provides a comprehensive suite of high-performance Swift data structures, including priority queues and deques.
这是一个 Ruby 客户端库和协议驱动程序,用于将 Ruby 应用程序与 Redis 数据库集成。它作为一个通信层,管理协议版本并提供执行数据库操作的统一接口。 该库支持多种部署拓扑,包括独立实例、用于高可用性主节点发现和故障转移的 Redis Sentinel,以及具有槽位感知请求路由和节点发现的 Redis Cluster。它还提供使用一致性哈希的客户端分片,以将数据分布在独立的服务器上。 广泛的功能包括原子事务管理和用于服务器端转换的 Lua 脚本,以及对地理空间坐标和流等专用数据类型的支持。性能通过命令流水线和原生解析扩展进行优化,而安全性则通过 SSL/TLS 加密和双向证书认证进行处理。 该客户端包含使用容器编排独立和集群数据库拓扑的工具,用于自动化集成测试。
Uses a high-performance extension driver to accelerate the processing of large data replies and high-volume pipelines.