Awesome GitHub RepositoriesLow-Latency Data Retrieval

Bigcache is a thread-safe, in-memory key-value store for Go designed to minimize garbage collection pauses. It functions as a memory-optimized cache capable of storing gigabytes of data while maintaining low latency during high-volume operations. The system avoids garbage collection overhead by managing memory through large byte arrays and manual allocation. It utilizes a circular-buffer layout to reuse space and lock-striped sharding to reduce contention during concurrent read and write access. The project provides capabilities for high-volume in-memory caching and low-latency data retrieva

Sui is a blockchain platform featuring an object-centric state model and resource-oriented smart contracts. It utilizes parallel transaction execution to increase network throughput and supports programmable transaction blocks that bundle multiple operations into single atomic units. The platform distinguishes itself with a capability-based access control system and zero-knowledge login mechanisms, enabling users to authenticate via identity providers without seed phrases. It also implements deterministic object addressing to allow predictable state lookups and supports the creation of soulbo

Feast is a machine learning feature store and MLOps data infrastructure layer. It provides a centralized system for managing and serving features across offline training and online production environments, utilizing an online feature serving layer for low-latency retrieval. The project centers on a feature registry that acts as a central catalog for defining, governing, and discovering feature services. It employs a unified data access layer to decouple feature retrieval from physical storage and includes a point-in-time data generator to create historically accurate training datasets that pr

Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis

Optimism 是一个以太坊 Optimistic Rollup 扩容栈，旨在通过在二层网络处理交易并将状态结算至以太坊主网来提高交易吞吐量。它作为一个扩容框架，利用 Rollup 定序器对交易进行排序、生成区块，并将批量数据提交至主链。 该系统具备欺诈证明系统，利用链上指令模拟来解决争议并验证状态转换的正确性。它还包含一套专门的工具集，用于部署和升级引导及维护该扩容网络所需的智能合约。 该项目涵盖了广泛的功能领域，包括区块链状态同步、跨链消息路由以及具备高可用故障转移功能的定序器管理。它还为数据可用性、故障证明生成以及开发区块链组件的面向服务框架提供了基础设施。 该仓库包含一个开发工具包，提供账户管理、网络模拟和集成测试等实用程序，用于验证系统行为和升级稳定性。

kphp-kdb 是一个专为高吞吐量读写操作设计的 NoSQL 数据库引擎和 PHP 扩展。它作为直接集成到 PHP 运行时中的持久化层，为高负载环境提供了一个非关系型存储系统。 该项目包含一个编译器，可将动态 PHP 源代码转换为静态类型的 C++ 代码。此过程消除了运行时解释开销，从而实现了原生执行速度并降低了资源消耗。 该系统利用原生 C++ 绑定和无模式（schema-less）存储引擎来确保低延迟的数据访问。这些功能的核心在于高负载数据存储以及通过静态代码转换优化 PHP 执行。

rippled is a peer-to-peer node implementation for the XRP Ledger. It serves as a distributed ledger consensus engine and a blockchain API gateway, allowing servers to validate transactions and maintain a shared, immutable sequence of ledger state. The project features a built-in decentralized exchange engine capable of executing atomic cross-currency payments and managing order books. It includes an on-chain asset management system for issuing and controlling fungible tokens and NFTs, as well as a Byzantine Fault Tolerant system for coordinating validators. The platform provides comprehensiv

Arroyo is a high-performance stream processing platform built in Rust. It executes continuous SQL queries on streaming data with event-time semantics, enabling accurate windowed aggregations, joins, and stateful computations on unbounded event streams. The platform uses native Rust execution for high throughput and low latency, with periodic checkpointing for exactly-once fault tolerance and horizontal scaling across distributed workers. The system integrates deeply with Kafka for reading and writing topics with exactly-once delivery and supports change data capture (CDC) from MySQL and Postg

该项目是一个协议工具、服务器和索引器，用于管理比特币区块链上的数字工件和商品。它为将任意数据铭刻到单个聪 (satoshi) 上以创建永久、不可变的资产和收藏品提供了核心基础设施。 该系统实现了用于创建、铸造和转移原生数字商品的 Runes 协议。它通过根据挖矿顺序追踪聪的稀有度，并建立父子溯源映射以验证链上铭文的血统和真实性而脱颖而出。 该项目涵盖了广泛的区块链操作，包括资产索引、基于描述符的钱包管理以及托管区块浏览器界面。它支持高级内容工作流，如递归铭文、批量资产分发以及 HTML 和 SVG 内容的沙盒渲染。 用户可以通过命令行界面和为外部应用程序提供程序化 JSON 端点的服务器来管理这些操作。

Erigon is an Ethereum execution client and blockchain archive node designed to maintain full or archive copies of the blockchain. It functions as a Proof-of-Stake validator, an Ethereum RPC server, and a network validator operation tool, providing the core infrastructure to validate blocks and secure the chain. The project distinguishes itself through high-performance storage and data distribution, utilizing a flat key-value state storage system instead of a Merkle Patricia Trie to increase read and write speeds. It employs BitTorrent-based data distribution for immutable historical blockchai