2 repository-uri
Insertion of already-serialized JSON bytes into a document to avoid redundant encoding.
Distinct from JSON Serializers: Focuses on embedding raw bytes rather than standard object-to-JSON conversion.
Explore 2 awesome GitHub repositories matching data & databases · Pre-serialized Blob Embedding. Refine with filters or upvote what's useful.
orjson is a high-performance Python library for serializing and deserializing JSON data. It functions as both a JSON parsing library and a serialization engine, converting data between native Python objects and UTF-8 encoded bytes. The project provides specialized support for converting complex Python data structures, including dataclasses, datetime objects, and NumPy arrays and scalars, into JSON format. It also allows for the insertion of pre-serialized JSON blobs into documents to maintain processing speed. The library includes capabilities for memory-efficient deserialization through key
Allows inserting pre-formatted JSON blobs into documents to maintain maximum processing speed.
msgspec is a high-performance data modeling, serialization, and schema validation toolkit for Python. It serves as a type-safe serialization framework that integrates schema enforcement and data parsing into a single pass, functioning as both a data serialization library and a schema validation system based on standard Python type annotations. The project distinguishes itself through high-performance structural primitives, including compilation-based routine generation and zero-copy buffer parsing. It optimizes memory usage via garbage collection-aware layouts and reduces processing overhead
Inserts raw bytes of already-encoded JSON into larger structures to avoid redundant encoding overhead.