awesome-repositories.com
Blog
awesome-repositories.com

Entdecke die besten Open-Source-Repositories mit KI-gestützter Suche.

EntdeckenKuratierte SuchenOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjektÜber unsHow we rankPresseMCP-Server
RechtlichesDatenschutzAGB
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

268 Repos

Awesome GitHub RepositoriesData Serialization

Mechanisms for encoding, parsing, and serializing data structures into formats suitable for storage or transmission.

Explore 268 awesome GitHub repositories matching data & databases · Data Serialization. Refine with filters or upvote what's useful.

Awesome Data Serialization GitHub Repositories

Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
  • mzabriskie/axiosAvatar von mzabriskie

    mzabriskie/axios

    109,096Auf GitHub ansehen↗

    Axios is a promise-based HTTP client used to make asynchronous network requests in both browser and Node.js environments. It functions as a multi-environment network adapter that abstracts the transport layer to ensure consistent behavior across different runtimes. The project distinguishes itself through a request lifecycle management system that allows for the cancellation of active requests, the setting of timeouts, and the monitoring of upload and download transfer progress. It includes a mechanism for intercepting network traffic, enabling the transformation of outgoing requests and inco

    Implements automatic serialization of JavaScript objects into JSON, multipart form data, or URL-encoded formats for transmission.

    JavaScript
    Auf GitHub ansehen↗109,096
  • axios/axiosAvatar von axios

    axios/axios

    109,077Auf GitHub ansehen↗

    Axios is an isomorphic, promise-based HTTP client designed for making asynchronous network requests across different JavaScript execution environments, including the browser and Node.js. It functions as a JSON API client that serializes JavaScript objects into JSON and parses server responses into structured data. The project features a system for managing reusable client instances with shared configurations, such as base URLs and default settings. It includes a mechanism for intercepting outgoing requests and incoming responses globally, allowing data to be transformed before it reaches the

    Serializes JavaScript objects into JSON and multipart formats for transmission over the network.

    JavaScripthacktoberfesthttp-clientjavascript
    Auf GitHub ansehen↗109,077
  • fffaraz/awesome-cppAvatar von fffaraz

    fffaraz/awesome-cpp

    71,817Auf GitHub ansehen↗

    This project is a comprehensive, curated directory of high-quality libraries, tools, and educational resources for C and C++ development. It serves as an ecosystem discovery index, helping developers navigate the vast landscape of third-party components, frameworks, and technical documentation available for the language. The collection is distinguished by its focus on high-performance systems programming and technical mastery. It provides deep coverage of specialized domains including SIMD-accelerated data processing, compile-time template metaprogramming, and asynchronous event-driven archit

    Discovers lightweight and high-performance parsers and generators for JSON data structures.

    awesomeawesome-listc
    Auf GitHub ansehen↗71,817
  • pallets/flaskAvatar von pallets

    pallets/flask

    71,703Auf GitHub ansehen↗

    Flask is a micro web framework designed for building web services with a flexible, lightweight structure. It functions as a standard-compliant WSGI application server, providing the essential tools required to register URL routes, handle incoming HTTP requests, and construct responses. By utilizing a central application object, it allows developers to manage routing rules, template settings, and resource loading within a unified project environment. The framework distinguishes itself through a modular component architecture that enables the organization of routes, templates, and static files

    Built-in utilities transform application data into structured JSON responses, including secure rendering options for embedding content directly into HTML.

    Pythonflaskjinjapallets
    Auf GitHub ansehen↗71,703
  • protocolbuffers/protobufAvatar von protocolbuffers

    protocolbuffers/protobuf

    71,359Auf GitHub ansehen↗

    Protocol Buffers ist ein sprachneutraler, plattformunabhängiger Mechanismus zur Serialisierung strukturierter Daten. Es bietet eine schema-gesteuerte Toolchain, die deklarative Datendefinitionen in typsicheren Quellcode kompiliert und so eine konsistente Kommunikation und stark typisierte API-Verträge über Dienste hinweg ermöglicht, die in verschiedenen Programmiersprachen geschrieben sind. Das Projekt zeichnet sich durch ein hocheffizientes binäres Wire-Format aus, das tag-basiertes Encoding und eine Komprimierung von Ganzzahlen mit variabler Breite nutzt, um Payload-Größe und Verarbeitungs-Overhead zu minimieren. Es unterstützt ein robustes, evolutionäres Schema-Management, das es Entwicklern ermöglicht, Datenstrukturen inkrementell zu aktualisieren und dabei Abwärts- und Aufwärtskompatibilität zu wahren. Dies wird zusätzlich durch ein versioniertes Edition-System unterstützt, das Feature-Sets und Serialisierungslogik über verteilte Softwarekomponenten hinweg verwaltet. Über die binäre Kern-Serialisierung hinaus umfasst das Projekt Funktionen für die kanonische JSON-Konvertierung mit Schema-Validierung, granulare Symbol-Sichtbarkeitskontrolle und Feld-Präsenzverfolgung, um zwischen Standard- und nicht gesetzten Werten zu unterscheiden. Es bietet zudem spezialisierte Optimierungen, wie Arena-basiertes Speichermanagement für C++-Implementierungen, um die Performance bei der Erstellung und Bereinigung komplexer Nachrichtenbäume zu verbessern.

    Encodes complex data structures into a dense binary representation optimized for high-performance storage and transmission.

    C++marshallingprotobufprotobuf-runtime
    Auf GitHub ansehen↗71,359
  • opendatalab/mineruAvatar von opendatalab

    opendatalab/MinerU

    67,734Auf GitHub ansehen↗

    MinerU is a document parsing pipeline designed to transform unstructured files into machine-readable, structured data. It utilizes deep learning models to perform layout analysis, identifying document regions and extracting complex content such as mathematical expressions. By combining these neural network inferences with geometric heuristics, the system reconstructs the reading order and structural hierarchy of documents to ensure accurate data representation. The project distinguishes itself through a multi-stage processing workflow that integrates layout detection, optical character recogn

    Encodes extracted document features and spatial coordinates into a standardized schema for seamless interoperability.

    Pythonai4sciencedocument-analysisextract-data
    Auf GitHub ansehen↗67,734
  • leonardomso/33-js-conceptsAvatar von leonardomso

    leonardomso/33-js-concepts

    66,467Auf GitHub ansehen↗

    This project is a comprehensive educational repository designed to help developers master the core mechanics, runtime behaviors, and browser-native capabilities of the JavaScript language. It provides a structured knowledge base that covers fundamental language features, such as prototype-based inheritance and event-loop-based concurrency, alongside advanced topics like JIT-compiled execution and memory management. The repository distinguishes itself by offering deep-dive technical guides that bridge the gap between abstract language concepts and practical browser implementation. It features

    Parses complex data structures using advanced serialization techniques, including custom revivers, replacers, and handling for circular references.

    JavaScriptangularconceptses6
    Auf GitHub ansehen↗66,467
  • socketio/socket.ioAvatar von socketio

    socketio/socket.io

    63,195Auf GitHub ansehen↗

    Socket.io is a real-time communication engine that enables bidirectional, event-based data exchange between clients and servers. It provides a robust transport-agnostic protocol layer that automatically manages connection lifecycles, including heartbeat signals, automatic reconnection, and seamless fallback between WebSockets and HTTP long-polling. By maintaining persistent links, it ensures reliable messaging across diverse network environments. The project distinguishes itself through a scalable, distributed architecture that supports multi-node synchronization and room-based message routin

    Transforms messages into wire-ready formats suitable for transmission over various network transport layers.

    TypeScriptjavascriptnodejssocket-io
    Auf GitHub ansehen↗63,195
  • lodash/lodashAvatar von lodash

    lodash/lodash

    61,235Auf GitHub ansehen↗

    Lodash is a JavaScript utility library and data manipulation toolkit. It provides a collection of modular functions for transforming, filtering, and validating arrays, objects, strings, and numbers. The project functions as a functional programming toolkit, offering capabilities for function composition, currying, and lazy evaluation. It includes mechanisms for execution control, such as debouncing and throttling, to manage the timing and frequency of function invocations. The library covers a broad surface of data operations, including deep cloning and merging of complex nested structures,

    Recursively evaluates equality between complex data structures by comparing their internal properties.

    JavaScriptjavascriptlodashmodules
    Auf GitHub ansehen↗61,235
  • ffmpeg/ffmpegAvatar von FFmpeg

    FFmpeg/FFmpeg

    61,176Auf GitHub ansehen↗

    FFmpeg is a cross-platform multimedia framework designed for the recording, conversion, and streaming of audio and video content. It functions as a comprehensive toolkit that provides both a command-line utility for direct media manipulation and a collection of low-level libraries for integration into custom applications. At its core, the project utilizes a packet-based stream engine and a format-agnostic abstraction layer to handle diverse media standards, containers, and network protocols. The framework distinguishes itself through a modular, graph-based filter execution model that allows f

    Modifies the structure of encoded media packets without full re-encoding to adjust stream properties or resolve compatibility issues.

    Caudiocffmpeg
    Auf GitHub ansehen↗61,176
  • remix-run/react-routerAvatar von remix-run

    remix-run/react-router

    56,460Auf GitHub ansehen↗

    React Router is a navigation and data-loading framework that maps URL patterns to nested component hierarchies. It functions as a full-stack router, coordinating server-side resource fetching with client-side hydration to synchronize application state across different environments. By providing a declarative interface for routing, it manages navigation and state transitions while ensuring consistent page structures through root layout management. The framework distinguishes itself through its focus on type safety and incremental adoption. It automatically generates static type definitions for

    Supports native response serialization, allowing data loaders to return plain objects for efficient handling.

    TypeScript
    Auf GitHub ansehen↗56,460
  • deepfakes/faceswapAvatar von deepfakes

    deepfakes/faceswap

    55,289Auf GitHub ansehen↗

    Faceswap is a comprehensive framework for automated media manipulation and neural face synthesis. It provides a modular pipeline that manages the entire lifecycle of facial feature extraction, deep learning model training, and image conversion. By coordinating complex computer vision workflows, the system enables users to map facial identities between source and destination datasets while maintaining structural alignment and lighting consistency across video frames. The project distinguishes itself through a highly extensible plugin-based architecture that handles hardware-accelerated process

    Maintains persistent state across extraction, training, and conversion sessions by storing frame-level facial data in structured files.

    Pythondeep-face-swapdeep-learningdeep-neural-networks
    Auf GitHub ansehen↗55,289
  • chinese-poetry/chinese-poetryAvatar von chinese-poetry

    chinese-poetry/chinese-poetry

    51,906Auf GitHub ansehen↗

    This project is a comprehensive dataset and archive of classical Chinese poetry, prose, and Confucian classics. It serves as a digital humanities corpus, providing machine-readable access to hundreds of thousands of poems and detailed poet biographies, specifically spanning the Tang and Song dynasties. The collection is distinguished by its scholarly depth, incorporating textual variation annotations to track disputed characters across different source editions. It also includes tonal pattern mapping to describe the rhythmic and phonetic structures of the verse, alongside a popularity ranking

    Validates the structural integrity of the poetry collection using JSON schemas to ensure data consistency.

    JavaScriptchinesechinese-poetryci
    Auf GitHub ansehen↗51,906
  • aobingjava/javafamilyAvatar von AobingJava

    AobingJava/JavaFamily

    36,959Auf GitHub ansehen↗

    JavaFamily is a curated set of learning paths and reference guides for backend engineering, distributed systems, and virtual machine internals. It provides a structured curriculum covering the Java language, operating system concepts, and network protocols. The project features detailed study guides for the Java virtual machine architecture, including memory management and garbage collection. It also includes a comprehensive reference for distributed systems, covering microservices, remote procedure call frameworks, and scalable system design. The collection covers a broad range of technical

    Details mechanisms for encoding and serializing data structures into byte streams for storage and transmission.

    interviewjavajava8
    Auf GitHub ansehen↗36,959
  • rubaxa/sortableAvatar von RubaXa

    RubaXa/Sortable

    31,135Auf GitHub ansehen↗

    Sortable is a JavaScript drag and drop library used to create reorderable lists of HTML elements. It is a framework-agnostic tool and a touch-enabled interaction library that functions across modern browsers and touch devices without dependencies on specific web frameworks. The library enables the movement and cloning of elements between different containers using shared group configurations. It supports the repositioning of multiple items simultaneously and the use of specific drag handles to restrict which areas of an element trigger a move. Additional capabilities include programmatic sor

    Converts the current sequence of items into a data array for saving or restoring state.

    JavaScript
    Auf GitHub ansehen↗31,135
  • dmlc/xgboostAvatar von dmlc

    dmlc/xgboost

    28,471Auf GitHub ansehen↗

    XGBoost is a distributed machine learning library for implementing scalable gradient boosting decision trees used for regression, classification, and ranking. It functions as a predictive model framework and a cross-language toolkit, providing a core implementation with native bindings for Python, R, Java, Scala, and C++. The system is designed as a GPU-accelerated library that utilizes CUDA and NCCL to speed up the training of decision tree ensembles. It operates as a distributed framework capable of scaling training and prediction across multi-node clusters and GPU environments to process m

    Saves and loads models using a locale-independent JSON format for cross-platform reproducibility.

    C++distributed-systemsgbdtgbm
    Auf GitHub ansehen↗28,471
  • openai/openai-agents-pythonAvatar von openai

    openai/openai-agents-python

    27,191Auf GitHub ansehen↗

    This project is a Python framework for building autonomous, event-driven agent systems. It provides a unified runtime for orchestrating multi-agent workflows, managing persistent conversation state, and executing code within secure, isolated sandbox environments. The framework is designed to handle complex task delegation, allowing agents to invoke other agents as tools while maintaining context across multi-turn interactions. The framework distinguishes itself through its deep integration with the Model Context Protocol, enabling agents to connect to external data sources and remote services

    Structures agent responses using strict JSON schemas and custom data models for predictable output.

    Pythonagentsaiframework
    Auf GitHub ansehen↗27,191
  • nativescript/nativescriptAvatar von NativeScript

    NativeScript/NativeScript

    25,446Auf GitHub ansehen↗

    NativeScript is a cross-platform mobile development framework that enables the creation of native iOS and Android applications using JavaScript or TypeScript. It provides a direct bridge to native platform APIs, allowing developers to invoke native classes, methods, and properties directly from script code while maintaining full access to underlying mobile operating system features. The framework distinguishes itself through its direct native UI rendering, which maps declarative markup components to actual platform-native widgets rather than web-based views. This architecture is supported by

    Converts data between JavaScript and native platform formats for seamless API communication.

    TypeScriptandroidangularcapacitor
    Auf GitHub ansehen↗25,446
  • libgdx/libgdxAvatar von libgdx

    libgdx/libgdx

    24,816Auf GitHub ansehen↗

    LibGDX is a Java-based framework designed for cross-platform game development, enabling the creation and deployment of 2D and 3D games across desktop, mobile, and web environments from a single codebase. It functions as a comprehensive library that abstracts hardware-accelerated graphics, audio, input, and file system access, providing a unified interface for developers to manage game logic and application lifecycles. The framework distinguishes itself through a high-performance architecture that prioritizes efficiency and native interoperability. It utilizes a batch-oriented graphics pipelin

    Converts XML data into a document object model or processes it using event-based callbacks.

    Java2d3dandroid
    Auf GitHub ansehen↗24,816
  • toon-format/toonAvatar von toon-format

    toon-format/toon

    24,642Auf GitHub ansehen↗

    Toon is a data serialization library and toolkit designed to convert complex objects into compact, human-readable formats optimized for large language models. By focusing on token efficiency, the library minimizes the context window footprint of structured data through techniques like key folding and tabular layout optimization. It provides a streaming-capable processor that handles the encoding and decoding of hierarchical data while maintaining structural integrity. The project distinguishes itself through its path-aware transformation pipeline and configurable serialization logic, which al

    Encodes objects and arrays into compact, indentation-based formats optimized for language model token efficiency.

    TypeScriptdata-formatllmserialization
    Auf GitHub ansehen↗24,642
Vorherige123456…14Nächste
  1. Home
  2. Data & Databases
  3. Data Processing Pipelines
  4. Data Serialization

Unter-Tags erkunden

  • Alignment Data ExportConverting proprietary alignment data into human-readable formats.
  • Alignment Metadata StoresStructured storage for frame-level facial data to maintain state across sessions.
  • Buffer Serialization Interfaces3 Sub-TagsWraps raw memory regions with serialization interfaces to simplify reading and writing structured data types. **Distinct from Data Serialization:** Distinct from general data serialization: focuses on direct buffer-based serialization and endianness handling.
  • Custom Data Parsers1 Sub-TagUser-defined logic for serializing and deserializing data packets to support specific formats.
  • Data Packet Encoding2 Sub-TagsFormatting messages into specific wire protocols for transport over network layers.
  • Drag-and-DropSerialization of data into a store during drag operations for later retrieval at a drop target. **Distinct from Data Serialization:** Focuses specifically on data serialization for the drag-and-drop API, not general data encoding
  • JSON Libraries3 Sub-TagsParsers and generators for JSON data structures.
  • JSON Serializers10 Sub-TagsLibraries and utilities that convert application data into JSON format for storage, transmission, or API responses.
  • JSON-Schema11 Sub-TagsEncoding data into JSON formats validated against specific schemas for interoperability.
  • Kotlin Type Serialization2 Sub-TagsSpecialized serialization for Kotlin-specific types like data classes and unsigned primitives. **Distinct from Data Type Serialization Configurations:** Specific to Kotlin language constructs rather than general data serialization configurations.
  • Length-Delimited Message Framing1 Sub-TagUse of size headers to identify and parse variable-length data segments.
  • PHP Serialized Data ProcessingSpecialized handling of PHP serialized strings to maintain structural integrity during content modification. **Distinct from Data Serialization:** Focuses on recalculating string lengths within PHP serialized objects specifically, rather than general encoding/decoding
  • Schema Compatibility Validators2 Sub-TagsMechanisms that verify data structures against defined rules to ensure backward and forward compatibility during evolution.
  • Schema ExtensionsMechanisms for augmenting existing data structures with additional fields or metadata without altering the original definitions.
  • Scientific Tensor SerializationSerialization of multi-dimensional numerical arrays for scientific reproducibility. **Distinct from Data Serialization:** Distinct from general Data Serialization: specifically targets complex tensor structures and numerical precision preservation.
  • Security FiltersMechanisms for filtering serialized data based on security context. **Distinct from Data Serialization:** Distinct from general Data Serialization: focuses on security-aware field filtering during serialization.
  • Self-Describing Chunked SerializationSerialization using containers with embedded type information to ensure binary compatibility across versions. **Distinct from Data Serialization:** Specializes general data serialization by focusing on self-describing chunks for kernel-user space compatibility.
  • Serial Data ParsersTransform streams that convert raw binary serial data into structured messages using delimiters or fixed lengths. **Distinct from Data Serialization:** Distinct from Data Serialization: focuses on parsing serial port byte streams, not general data encoding formats.
  • Serial-to-Network ConvertersExposing local serial hardware to network protocols by converting serial data streams to TCP. **Distinct from Data Serialization:** Distinct from general data serialization: focuses on the physical-to-network transport bridge for serial hardware.
  • Serialization Configuration Managers2 Sub-TagsControls the inclusion of type identifiers in serialized data to enable runtime introspection while managing bandwidth. **Distinct from Data Serialization:** Distinct from general data serialization: focuses on the configuration of serialization metadata for introspection.
  • Serialization ProtocolsRules governing the layout and ordering of data fields within a serialized binary format.
  • Serialized Data Integrity PreservationTools that ensure serialized PHP data structures remain valid after text replacement by updating length prefixes. **Distinct from Data Serialization:** Focuses on the preservation of integrity during modification, not the act of serialization itself
  • Serialized Data QueryingCapabilities for querying values stored within serialized blobs using database-level patterns. **Distinct from Data Serialization:** Focuses on querying serialized state for search, rather than the encoding/decoding process itself.
  • Serialized String UpdatersSpecialized tools for modifying text within serialized objects without corrupting the internal data structure. **Distinct from Data Serialization:** Specifically targets the update process within already serialized data, unlike general serialization mechanisms
  • Signed SerializersSerialization mechanisms that include cryptographic signatures to verify data integrity and origin. **Distinct from Data Serialization:** Distinct from general Data Serialization: focuses specifically on the security aspect of signed payloads to prevent forgery.
  • Variable Width Memory SerializationSerialization mechanisms that handle non-contiguous memory allocation for variable-width data streams. **Distinct from Variable-Width Integer Encodings:** Distinct from [f4_mt1] as it focuses on memory block allocation rather than integer encoding schemes.
  • XML ParsersLibraries for parsing and manipulating XML data.