18 个仓库
Libraries for converting objects to and from structured formats.
Distinguishing note: Focuses on the core serialization/deserialization capability.
Explore 18 awesome GitHub repositories matching data & databases · Serialization Libraries. Refine with filters or upvote what's useful.
这是一个全面的、由社区策划的目录,组织了庞大的 Python 软件库、框架和工具生态。它作为一个中心化知识库,旨在促进生态导航并加速开发者在整个软件开发生命周期中的发现过程。 该目录通过提供按技术领域分类的结构化资源索引脱颖而出,范围从基础开发工具到专业工程领域。它涵盖了人工智能、数据科学、Web 开发和基础设施管理等高级能力,使开发者能够为特定的技术挑战识别经过验证的解决方案。 该项目涵盖了广泛的能力领域,包括依赖管理、静态代码分析和自动化测试工具。它还编目了用于持久数据存储、云基础设施编排和接口开发的资源,为构建和维护复杂软件系统提供了统一的参考。
Transform intricate object structures into portable formats suitable for storage or network transmission.
This project serves as a comprehensive language ecosystem index, functioning as a centralized, community-curated directory for the Go programming language. It organizes a vast landscape of software components, libraries, and development tools into a structured, navigable hierarchy, enabling developers to efficiently discover resources tailored to specific functional domains. The repository distinguishes itself through a decentralized contribution model, where community-driven updates ensure the index remains current with the rapidly evolving software landscape. Beyond simple resource listing,
Converts complex object structures into portable binary formats using schema-based generation.
This project is a comprehensive, curated directory of high-quality libraries, tools, and educational resources for C and C++ development. It serves as an ecosystem discovery index, helping developers navigate the vast landscape of third-party components, frameworks, and technical documentation available for the language. The collection is distinguished by its focus on high-performance systems programming and technical mastery. It provides deep coverage of specialized domains including SIMD-accelerated data processing, compile-time template metaprogramming, and asynchronous event-driven archit
Transform complex object structures into portable formats like JSON or binary using these reliable serialization solutions.
This project is a community-driven directory that aggregates essential software projects and educational content for the Node.js ecosystem. It functions as a centralized knowledge base and discovery index, designed to simplify the navigation of a fragmented technical landscape by providing a structured collection of high-quality links, tools, and learning materials. The repository distinguishes itself through a decentralized, peer-reviewed curation model. By utilizing standard version control workflows and pull requests, the community ensures that all listed resources undergo human verificati
Presents specialized encoders and decoders for transforming complex data structures into portable formats.
This library is a header-only C++ framework designed for the serialization, parsing, and manipulation of structured data. It provides a recursive variant data model that represents arbitrary structures as native types, allowing developers to navigate, modify, and patch hierarchical data using standard pointer paths and declarative update patterns. The project distinguishes itself through its template-based architecture, which enables type-safe data structures and custom type mapping at compile time. It offers a unified interface for binary format abstraction, supporting multiple compact repre
Converts complex application objects into structured text formats for storage or network transmission.
This project is a comprehensive, community-driven directory of software resources, libraries, and frameworks for the Java programming language. It serves as a centralized knowledge base designed to help developers discover tools and industry-standard solutions for building and maintaining software applications. The repository distinguishes itself through a hierarchical taxonomy that organizes a vast array of technical components into a structured, navigable tree. By relying on distributed peer contributions, the index remains a living resource that reflects current community-recommended pract
Lists Java data serialization libraries.
FlatBuffers is a cross-platform serialization library designed for performance-critical applications that require efficient, zero-copy data access. By organizing data in a structured binary format, it allows applications to read and write complex data structures directly from memory-mapped buffers without the need for intermediate parsing or temporary object allocation. The project distinguishes itself through a schema-driven approach that balances high-performance access with long-term data evolution. It utilizes a unique memory layout featuring relative offsets and inline fixed-size structu
FlatBuffers enables reading and writing binary data structures in Kotlin by generating classes from schemas and accessing fields as native properties for type-safe serialization.
Toon is a data serialization library and toolkit designed to convert complex objects into compact, human-readable formats optimized for large language models. By focusing on token efficiency, the library minimizes the context window footprint of structured data through techniques like key folding and tabular layout optimization. It provides a streaming-capable processor that handles the encoding and decoding of hierarchical data while maintaining structural integrity. The project distinguishes itself through its path-aware transformation pipeline and configurable serialization logic, which al
Provides a toolkit for converting complex objects into space-optimized, human-readable formats.
Gson is a Java library designed for the serialization and deserialization of objects into structured text formats. It functions as a reflection-based data mapper, inspecting class structures at runtime to automatically convert memory-resident objects into data representations and reconstruct them back into typed language objects. The library distinguishes itself through a modular type-adapter pattern that allows for custom conversion rules for complex or nested structures. It also provides robust support for production environments by generating build-time metadata and configuration rules, wh
Converts complex object graphs into structured text formats and reconstructs them back into typed language objects.
simdjson is a high-performance, header-only C++ library designed for parsing, querying, and serializing JSON data with minimal memory overhead. It functions as a hardware-aware data processing engine that leverages vector instructions to achieve gigabyte-per-second parsing speeds. By detecting host processor capabilities at runtime, the library automatically selects the most efficient instruction sets to accelerate structural analysis and validation. The library distinguishes itself through a focus on extreme efficiency and resource management. It utilizes memory mapping and padded buffer ali
Provides automated conversion between custom objects and JSON strings using compile-time reflection and mapping hooks.
Skynet is a distributed game server framework designed for building scalable online game backends. It utilizes distributed actor-based clusters and real-time network communication to manage high-concurrency session coordination across multiple nodes. The framework includes a cluster management orchestrator for coordinating services via cluster-wide messaging and dynamic configuration updates. It features a multi-protocol network gateway supporting TCP, UDP, and WebSockets, alongside a data encoding layer using BSON and Sproto serialization for efficient information transfer between distribute
Ships a serialization library for encoding and decoding complex structured data using BSON and Sproto.
This project is a framework for the efficient serialization and deserialization of data structures. It provides a unified, macro-based interface that automates the conversion of complex internal objects into standardized formats and reconstructs them from raw input streams or buffers. By leveraging compile-time code generation, the library minimizes manual implementation overhead while ensuring consistent logic across diverse data types. The framework distinguishes itself through a format-agnostic data model and a visitor-based parsing architecture that decouples data structures from specific
Implements manual serialization and deserialization logic for complex data structures.
YYText is an iOS rich text framework used for rendering and editing complex attributed text. It features an asynchronous text rendering engine that calculates layout on background threads to maintain interface performance, alongside an attributed text serializer for converting rich text structures into storable formats. The framework provides specialized tools for non-rectangular text layout, allowing text to wrap around custom container paths and exclusion shapes. It also supports advanced typography requirements, including vertical text formatting for East Asian languages and the applicatio
Provides a serializer to convert complex rich text structures into storable formats and restore them.
gray-matter 是一个用于分离、解析和序列化文本文档中结构化配置数据的库。它作为一个文档元数据提取器,将结构化块从文件正文中隔离出来,并作为一个序列化库将数据对象转换回格式化字符串。 该项目支持从字符串或文件的开头提取 YAML、JSON 和 TOML 元数据块。它包含识别元数据存在以及根据起始分隔符后的字符确定所用特定格式语言的机制。 该系统通过基于插件的解析引擎和自定义解析器注册进行扩展,允许用户定义逻辑来处理非标准元数据语言。其功能涵盖元数据语言识别、文件元数据提取以及对称序列化以重构原始文档格式。
Converts structured data objects back into formatted front matter strings for document reconstruction.
这是一个基于 Netty 构建的远程过程调用(RPC)框架,用于分布式服务之间的异步通信。它提供了跨网络执行远程过程调用所需的基础设施,允许客户端和服务器在不阻塞的情况下进行交互。 该框架利用 Zookeeper 进行服务注册和动态发现,确保服务提供者可以在运行时自动定位。它包含一个服务版本管理器,用于组织和跟踪服务接口的不同迭代,从而实现多个版本的并行部署。 该系统通过 Kryo 实现二进制序列化,将 Java 对象转换为紧凑的字节流进行网络传输。它还结合了一个分布式负载均衡器,使用随机或轮询策略在提供者之间路由请求,并使用基于心跳的监控来跟踪服务可用性和连接健康状况。
Utilizes the Kryo library for converting Java objects into binary formats for network transport.
notion-py 是一个 Python 库,作为与 Notion 页面和数据库交互的非官方 API 客户端。它作为一个对象关系映射器,将 Notion 数据库表和块转换为 Python 类,以进行结构化数据管理。 该项目具有一个响应式同步层,使用长轮询和回调使本地 Python 对象与远程更改保持更新。它包括一个具有磁盘持久性的线程安全本地数据缓存,以减少网络请求,以及一个用于将 Markdown 文本转换为格式化的 Notion 内容块和富文本结构的转换器。 该库涵盖了广泛的功能,包括内容块的程序化管理、带有过滤和排序的数据库查询以及用户身份管理。它还支持将富文本序列化为 CommonMark Markdown,同时保留 LaTeX 和样式属性。
Serializes nested remote rich text formats into CommonMark markdown while preserving styling and LaTeX.
Aleth 是一个 Ethereum C++ 客户端及全节点实现。它提供了一个用于运行和调试字节码的虚拟机执行器、区块链状态调试器,以及一个使用递归长度前缀 (RLP) 格式进行数据编解码的序列化库。 该项目包含一个专用的挖矿工具,用于生成区块并对哈希硬件性能进行基准测试。此外,它还配备了一个状态调试器,能够分析执行前后的状态变化,并为虚拟机生成分步执行跟踪。 其实现涵盖了节点操作,包括通过引导节点 (bootnodes) 进行节点发现、基于快照的状态同步,以及用于签署交易的加密密钥管理。它还提供了一个框架,用于验证共识稳定性、模拟智能合约逻辑,并在私有网络中部署合约。
Ships a library for encoding and decoding data using the Recursive Length Prefix format.
PalDB 是一个为 Java 设计的可嵌入键值存储引擎,用于高性能数据检索。它作为一个库,将数据持久化到单个不可变的二进制文件中,为写多读少的负载提供了存储解决方案,与标准内存集合相比,其内存开销极小。 该系统通过写一次数据布局脱颖而出,消除了在并发读取操作期间对锁定机制的需求。通过利用内存映射文件访问和排序键索引,该引擎能够直接在进程地址空间内进行快速查找。这种架构支持将静态数据集作为只读文件分发,并可由多个应用程序实例嵌入和访问。 该库包含一个高性能数据序列化框架,允许开发者定义将复杂对象转换为紧凑二进制流的自定义逻辑。这种可扩展性确保了独特的数据结构可以在本地应用程序环境中高效地存储和检索。
Provides a framework for converting complex custom objects into compact binary formats for efficient storage and retrieval.