1 Repo
Serializers that collapse nested object hierarchies into dotted key paths to minimize token usage.
Distinct from Materialized Path Modeling: Distinct from Materialized Path Modeling: focuses on the serialization technique for token reduction rather than database-level tree storage.
Explore 1 awesome GitHub repository matching data & databases · Path-Folding Serializers. Refine with filters or upvote what's useful.
Toon is a data serialization library and toolkit designed to convert complex objects into compact, human-readable formats optimized for large language models. By focusing on token efficiency, the library minimizes the context window footprint of structured data through techniques like key folding and tabular layout optimization. It provides a streaming-capable processor that handles the encoding and decoding of hierarchical data while maintaining structural integrity. The project distinguishes itself through its path-aware transformation pipeline and configurable serialization logic, which al
Collapses nested hierarchies into dotted key paths to reduce token consumption for language models.