7 Repos
Processes for reclaiming disk space by removing obsolete historical state data.
Distinguishing note: Focuses on state-specific pruning rather than general database maintenance.
Explore 7 awesome GitHub repositories matching data & databases · State Pruning. Refine with filters or upvote what's useful.
Geth is a comprehensive execution client for the Ethereum network, serving as a foundational node implementation that processes transactions, maintains the distributed ledger state, and participates in peer-to-peer consensus. It provides a robust infrastructure for synchronizing, validating, and serving blockchain data, utilizing a persistent Merkle Patricia Trie database to ensure the cryptographic integrity of historical records. As a sandboxed smart contract runtime, it executes bytecode according to deterministic protocol rules, enabling the deployment and interaction of decentralized appl
Reclaims disk space by removing obsolete historical state data after snapshot generation.
NodeBB is a real-time, self-hosted community forum platform built on Node.js. It is designed to support scalable discussion environments by utilizing a document-oriented database for content storage and an in-memory engine for high-speed data retrieval and session management. The platform provides a comprehensive administrative interface for managing user groups, forum settings, and system health. What distinguishes the platform is its native support for federated social networking via the ActivityPub protocol, allowing forums to exchange content, synchronize discussions, and interact with de
Automatically deletes transient data and inactive user profiles on a recurring schedule to manage database growth.
Optuna is a Python-based hyperparameter optimization framework designed to automate the search for optimal machine learning model configurations. It functions as a Bayesian optimization library that systematically tests parameter combinations to maximize or minimize objective functions, streamlining the model development process through iterative evaluation. The project distinguishes itself through a define-by-run dynamic construction model, which allows users to build complex, conditional search spaces using standard programming logic. Its architecture is highly modular, featuring a pluggabl
Interrupts trial execution when intermediate results indicate poor performance, allowing the system to reclaim resources.
Reth is a modular, high-performance Ethereum execution layer client written in Rust. It serves as a full Ethereum node that syncs, validates, and serves blockchain data, functioning as an archive node implementation, a high-throughput RPC node server, and a snapshot sync tool. The project is built around a modular component architecture that allows assembling custom node behavior by swapping independent Rust crates for consensus, execution, mempool, and networking. The client distinguishes itself through a staged sync pipeline that downloads headers and bodies online before processing the res
Removes old block and state data to reduce storage usage while preserving recent history.
Loro is a conflict-free replicated data type (CRDT) framework and collaborative state engine designed for building real-time collaborative applications. It provides a distributed data synchronizer that enables multiple users to edit shared documents and complex nested structures—such as maps, lists, trees, and counters—with automatic state convergence without requiring a central server. The project distinguishes itself through a versioned document store that supports branching, forking, and merging via a directed acyclic graph of causal operation history. It enables advanced version control c
Provides state pruning to remove obsolete historical operations and reduce memory usage while preserving the current state.
Grin is a protocol implementation and blockchain node that provides a confidential transaction system. It uses Pedersen Commitments and homomorphic encryption to verify value integrity and ensure a consistent money supply without revealing specific transaction amounts or participant identities. The project distinguishes itself through an interactive transaction exchange model, where wallets coordinate multi-round data exchanges to build signed transactions. To maintain anonymity, the system supports onion-routed transaction delivery and masks originating IP addresses through specialized relay
Reduces blockchain disk footprint by removing spent output commitments and range proofs from local storage.
Cartography ist ein graphbasiertes Framework zur Infrastrukturvisualisierung und Sicherheitsanalyse. Es erfasst Daten von verschiedenen Cloud-, Identitäts- und Software-as-a-Service-Anbietern, um komplexe Beziehungen zwischen Ressourcen, Benutzern und Sicherheitsergebnissen in einer zentralen Graphdatenbank zu modellieren. Durch die Abbildung dieser Abhängigkeiten ermöglicht die Plattform Unternehmen, Transparenz über ihre Umgebung zu gewinnen und potenzielle Sicherheitsrisiken durch Graph-Traversal-Abfragen zu identifizieren. Die Plattform zeichnet sich durch ihre ontologiebasierte Normalisierung und plattformübergreifende Entitätskorrelation aus, die heterogene Daten aus mehreren Quellen in ein einheitliches, konsistentes Modell überführen. Sie verwendet modulare Ingestions-Pipelines und schema-basierte Filterung, um diesen Graphen zu pflegen und sicherzustellen, dass Infrastrukturdaten durch automatisiertes, zustandsbasiertes Bereinigen veralteter Knoten korrekt bleiben. Dieser Ansatz ermöglicht die Entdeckung komplexer Angriffspfade und Sicherheitsfehlkonfigurationen, die sich über disparate Cloud-, Geräte- und Identitätsmanagementsysteme erstrecken. Über die Kernmodellierung hinaus bietet das System umfangreiche Funktionen für Asset-Inventarisierung, Identitäts-Governance und Software-Supply-Chain-Analyse. Es unterstützt eine breite Palette von Integrationen, einschließlich Cloud-nativer Compute- und Netzwerkressourcen, Endpunkt-Management-Telemetrie und Metadaten des Entwicklungslebenszyklus. Benutzer können die Funktionalität der Plattform erweitern, indem sie benutzerdefinierte Sicherheitsregeln definieren, spezialisierte Datenanalyse-Jobs hinzufügen oder neue Intelligenzquellen über das modulare Framework integrieren. Das Projekt ist in Python implementiert und bietet Dokumentation für die Konfiguration von Ingestionsmodulen und die Definition benutzerdefinierter Graph-Abfragen.
Maintains data accuracy by automatically removing nodes and relationships that were not updated during the latest synchronization cycle.