7 个仓库
Processes for reclaiming disk space by removing obsolete historical state data.
Distinguishing note: Focuses on state-specific pruning rather than general database maintenance.
Explore 7 awesome GitHub repositories matching data & databases · State Pruning. Refine with filters or upvote what's useful.
Geth is a comprehensive execution client for the Ethereum network, serving as a foundational node implementation that processes transactions, maintains the distributed ledger state, and participates in peer-to-peer consensus. It provides a robust infrastructure for synchronizing, validating, and serving blockchain data, utilizing a persistent Merkle Patricia Trie database to ensure the cryptographic integrity of historical records. As a sandboxed smart contract runtime, it executes bytecode according to deterministic protocol rules, enabling the deployment and interaction of decentralized appl
Reclaims disk space by removing obsolete historical state data after snapshot generation.
NodeBB is a real-time, self-hosted community forum platform built on Node.js. It is designed to support scalable discussion environments by utilizing a document-oriented database for content storage and an in-memory engine for high-speed data retrieval and session management. The platform provides a comprehensive administrative interface for managing user groups, forum settings, and system health. What distinguishes the platform is its native support for federated social networking via the ActivityPub protocol, allowing forums to exchange content, synchronize discussions, and interact with de
Automatically deletes transient data and inactive user profiles on a recurring schedule to manage database growth.
Optuna is a Python-based hyperparameter optimization framework designed to automate the search for optimal machine learning model configurations. It functions as a Bayesian optimization library that systematically tests parameter combinations to maximize or minimize objective functions, streamlining the model development process through iterative evaluation. The project distinguishes itself through a define-by-run dynamic construction model, which allows users to build complex, conditional search spaces using standard programming logic. Its architecture is highly modular, featuring a pluggabl
Interrupts trial execution when intermediate results indicate poor performance, allowing the system to reclaim resources.
Reth is a modular, high-performance Ethereum execution layer client written in Rust. It serves as a full Ethereum node that syncs, validates, and serves blockchain data, functioning as an archive node implementation, a high-throughput RPC node server, and a snapshot sync tool. The project is built around a modular component architecture that allows assembling custom node behavior by swapping independent Rust crates for consensus, execution, mempool, and networking. The client distinguishes itself through a staged sync pipeline that downloads headers and bodies online before processing the res
Removes old block and state data to reduce storage usage while preserving recent history.
Loro is a conflict-free replicated data type (CRDT) framework and collaborative state engine designed for building real-time collaborative applications. It provides a distributed data synchronizer that enables multiple users to edit shared documents and complex nested structures—such as maps, lists, trees, and counters—with automatic state convergence without requiring a central server. The project distinguishes itself through a versioned document store that supports branching, forking, and merging via a directed acyclic graph of causal operation history. It enables advanced version control c
Provides state pruning to remove obsolete historical operations and reduce memory usage while preserving the current state.
Grin 是一个协议实现和区块链节点,提供了一个机密交易系统。它使用 Pedersen 承诺和同态加密来验证价值完整性并确保一致的货币供应,而无需透露具体的交易金额或参与者身份。 该项目的特色在于交互式交易交换模型,钱包协调多轮数据交换以构建已签名的交易。为了保持匿名性,系统支持洋葱路由交易交付,并通过专门的中继机制掩盖原始 IP 地址。它还结合了内存硬工作量证明 (PoW) 以抵御 ASIC 挖矿主导地位,并利用具有 Merkle Mountain Range 存储的状态修剪账本模型来减少区块链磁盘占用。 代码库涵盖了广泛的功能,包括执行无需信任的跨链原子交换、管理分层确定性钱包以及运行全网节点。它提供了用于内存受限挖矿、通过时间锁执行加密合约以及使用认证加密进行安全客户端-服务器通信的工具。 该节点可以作为容器镜像部署,并支持持久化缓存数据。
Reduces blockchain disk footprint by removing spent output commitments and range proofs from local storage.
Cartography 是一个基于图的架构可视化和安全分析框架。它从各种云、身份和软件即服务(SaaS)提供商处提取数据,在中央图数据库中建模资源、用户和安全发现之间的复杂关系。通过映射这些相互依赖关系,该平台使组织能够获得对其环境的可见性,并通过图遍历查询识别潜在的安全风险。 该平台以其基于本体的规范化和跨平台实体关联而著称,将来自多个来源的异构数据映射到一个统一、一致的模型中。它采用模块化摄取管道和基于模式的过滤来维护此图,通过对陈旧节点的自动状态修剪确保架构数据保持准确。这种方法允许发现跨越不同云、设备和身份管理系统的复杂攻击路径和安全配置错误。 除了核心建模外,该系统还为资产清单、身份治理和软件供应链分析提供了广泛的功能。它支持广泛的集成,包括云原生计算和网络资源、端点管理遥测以及开发生命周期元数据。用户可以通过定义自定义安全规则、添加专门的数据分析作业或通过其模块化框架集成新的情报来源来扩展平台的功能。 该项目使用 Python 实现,并提供了用于配置摄取模块和定义自定义图查询的文档。
Maintains data accuracy by automatically removing nodes and relationships that were not updated during the latest synchronization cycle.