7 Repos
Libraries specifically designed for converting Python objects to and from simple data types.
Distinct from Python Libraries: Existing candidates are too generic or unrelated to serialization.
Explore 7 awesome GitHub repositories matching programming languages & runtimes · Python Serialization Libraries. Refine with filters or upvote what's useful.
Jsonnet is a structured configuration generation language that extends JSON with variables, conditionals, and object-oriented features to create reusable templates. It is designed to eliminate duplication in configuration data by providing a data templating language that can produce structured output from concise, programmable templates. The language distinguishes itself through an object-oriented inheritance model that allows field override, mixin composition, and self-referencing for modular configuration reuse. It supports lazy evaluation with thunks to defer computation until values are f
Serializes structured data into Python literal syntax using a built-in manifest function.
Marshmallow is a Python data serialization library and validation framework. It functions as a bridge that transforms complex application objects into primitive data types for storage or network transmission and vice versa. The library utilizes a schema-based approach to validate that incoming data conforms to specific types and constraints. It employs a two-way transformation pipeline consisting of separate load and dump phases to handle deserialization and serialization. The framework supports class-based schema definitions with declarative field validation and recursive schema nesting for
Provides a comprehensive library for converting complex Python objects to and from simple data types.
Exploits Python pickle deserialization vulnerabilities in ML model storage contexts.
Ultrajson ist eine hochperformante Python-JSON-Bibliothek und ein C-basierter Parser, der entwickelt wurde, um Parsing-Overhead zu minimieren. Er bietet eine C-Implementierung der JSON-Spezifikation, um schnelles Enkodieren und Dekodieren von Daten zu ermöglichen. Das Projekt fungiert als konkaurrenter JSON-Prozessor und unterstützt Multi-Threaded-Serialisierung und -Deserialisierung, um den Datendurchsatz zu erhöhen und blockierende Ausführungen zu verhindern. Die Funktionen decken Python-Datenserialisierung und hochperformante JSON-Verarbeitung für Echtzeit-Datenpipelines ab. Dies beinhaltet das Parsen von JSON-Daten und das Serialisieren nativer Objekte in JSON-Strings.
Specifically designed for converting complex Python objects into JSON strings for efficient storage and transmission.
pycdc is a reverse engineering toolset that decompiles and disassembles compiled Python bytecode files back into readable source code. It parses .pyc file headers, reconstructs abstract syntax trees from bytecode instructions, and handles version-specific opcodes across Python versions 1.0 through 3.13 with endian-aware binary parsing. The tool recovers numeric constants, string literals, and marshalled Python objects from compiled bytecode, supporting both file-based and in-memory bytecode loading. It provides a human-readable disassembly listing of bytecode instructions alongside full sourc
Loads serialized Python objects from a byte stream, reconstructing their types and values for further processing.
Fory is a cross-language serialization framework and binary data serializer designed to convert complex object graphs into a compact binary format for high-performance data exchange. It includes an IDL-based schema compiler to transform interface definition language files into type-safe native data models and a schema evolution manager to maintain forward and backward compatibility. The project features a zero-copy data access layer that allows reading specific fields from binary rows without deserializing the entire object. It supports dual-mode serialization, enabling a toggle between a por
Handles Python-specific types like lambdas and functions for same-language traffic.
msgspec is a high-performance data modeling, serialization, and schema validation toolkit for Python. It serves as a type-safe serialization framework that integrates schema enforcement and data parsing into a single pass, functioning as both a data serialization library and a schema validation system based on standard Python type annotations. The project distinguishes itself through high-performance structural primitives, including compilation-based routine generation and zero-copy buffer parsing. It optimizes memory usage via garbage collection-aware layouts and reduces processing overhead
A high-performance toolkit for encoding and decoding Python objects using JSON, MessagePack, YAML, and TOML.