awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
lemire avatar

lemire/simdjson

0
View on GitHub↗
23,860 stars·1,260 forks·C++·Apache-2.0·31 viewssimdjson.org↗

Simdjson

simdjson is a high-performance JSON parser that utilizes SIMD instructions to process gigabytes of data per second. It functions as a SIMD JSON parser, a multithreaded NDJSON processing library, a UTF-8 validation engine, and a tool for JSON minification and string building.

The project focuses on high-throughput data processing, enabling the ingestion of massive JSON volumes and the verification of UTF-8 encoding standards. It includes dedicated capabilities for constructing JSON strings with optimized memory usage and removing unnecessary whitespace from documents to reduce file size.

The system supports the processing of newline-delimited JSON files through multithreaded functions and provides a specialized builder for efficient JSON generation.

Features

  • SIMD Parsers - Uses SIMD vector instructions to process multiple bytes simultaneously for high-speed structural analysis of JSON.
  • High-Performance Parsers - Implements a JSON parsing library optimized for extreme throughput using SIMD and hardware-specific acceleration.
  • JSON Parsers - Implements a high-performance library for parsing and mapping JSON data structures.
  • JSON Processing - Provides high-speed serialization and deserialization of JSON data using specialized hardware instructions.
  • NDJSON Parsers - Provides a high-performance multithreaded parser specifically optimized for newline-delimited JSON data.
  • Encoding Validators - Provides a high-throughput engine to verify that documents adhere to the UTF-8 encoding standard.
  • Big Data Processing - Accelerates the ingestion of massive NDJSON volumes into analytics engines via multithreaded processing.
  • JSON Construction Utilities - Provides programmatic JSON construction utilities to optimize memory usage and performance.
  • JSON Minifiers - Removes unnecessary whitespace from JSON documents to reduce file size while preserving data.
  • JSON Content Generators - Programmatically constructs JSON strings using a specialized builder to optimize memory usage.
  • Branchless Indexing - Implements branchless index generation to avoid conditional jumps during JSON tokenization.
  • Lazy Materialization - Delays the conversion of raw bytes into typed data until the specific field is requested.
  • SIMD Buffer Padding - Allocates extra space at the end of buffers to allow wide SIMD loads without memory access violations.
  • Two-Stage Parsing - Separates initial structural scanning from final value extraction to maximize CPU pipeline efficiency.
  • JSON Processing - Extremely fast SIMD-accelerated JSON parsing.
  • Serialization and Parsing - SIMD-accelerated JSON parsing library.
  • Json - Listed in the “Json” section of the Awesome Cpp Cn awesome list.

Star history

Star history chart for lemire/simdjsonStar history chart for lemire/simdjson

How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI

Frequently asked questions

What does lemire/simdjson do?

simdjson is a high-performance JSON parser that utilizes SIMD instructions to process gigabytes of data per second. It functions as a SIMD JSON parser, a multithreaded NDJSON processing library, a UTF-8 validation engine, and a tool for JSON minification and string building.

What are the main features of lemire/simdjson?

The main features of lemire/simdjson are: SIMD Parsers, High-Performance Parsers, JSON Parsers, JSON Processing, NDJSON Parsers, Encoding Validators, Big Data Processing, JSON Construction Utilities.

Which projects share features with lemire/simdjson?

Projects with overlapping indexed features include: simdjson/simdjson — simdjson is a high-performance, header-only C++ library designed for parsing, querying, and serializing JSON data with… tencent/rapidjson — RapidJSON is a header-only C++ library designed for high-performance parsing, generation, and manipulation of JSON… miloyip/rapidjson — RapidJSON is a high-performance C++ library used for parsing and generating JSON data. It provides both document… open-source-parsers/jsoncpp — JsonCpp is a C++ library for parsing, manipulating, and generating JSON data. It functions as a data interchange tool… ibireme/yyjson — yyjson is a high-performance C library for parsing, serializing, and manipulating JSON data structures. It functions… ultrajson/ultrajson — Ultrajson is a high-performance Python JSON library and C-based parser designed to minimize parsing overhead. It…

Projects sharing features with Simdjson

These projects share indexed features with Simdjson. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
  • simdjson/simdjsonsimdjson avatar

    simdjson/simdjson

    23,260View on GitHub↗

    simdjson is a high-performance, header-only C++ library designed for parsing, querying, and serializing JSON data with minimal memory overhead. It functions as a hardware-aware data processing engine that leverages vector instructions to achieve gigabyte-per-second parsing speeds. By detecting host processor capabilities at runtime, the library automatically selects the most efficient instruction sets to accelerate structural analysis and validation. The library distinguishes itself through a focus on extreme efficiency and resource management. It utilizes memory mapping and padded buffer ali

    C++aarch64arm64avx2
    View on GitHub↗23,260
  • tencent/rapidjsonTencent avatar

    Tencent/rapidjson

    15,000View on GitHub↗

    RapidJSON is a header-only C++ library designed for high-performance parsing, generation, and manipulation of JSON data. It functions as a dual-mode engine, providing both an in-memory document object model for tree-based manipulation and a stream-based interface for event-driven processing. The library is built to minimize memory footprint and maximize execution speed, making it suitable for resource-constrained environments. The library distinguishes itself through advanced memory management and optimization techniques, including in-situ parsing that modifies input buffers directly to elimi

    C++
    View on GitHub↗15,000
  • miloyip/rapidjsonmiloyip avatar

    miloyip/rapidjson

    15,095View on GitHub↗

    RapidJSON is a high-performance C++ library used for parsing and generating JSON data. It provides both document object model and stream-based interfaces to transform JSON strings into structured data and vice versa. The library includes a JSON schema validator to verify that documents conform to predefined rules and a Unicode transcoder for converting strings between UTF-8, UTF-16, and UTF-32 encodings. It also supports relaxed parsing for non-standard JSON containing comments or trailing commas. Additional capabilities cover JSON pointer navigation for locating specific values and string s

    C++
    View on GitHub↗15,095
  • open-source-parsers/jsoncppopen-source-parsers avatar

    open-source-parsers/jsoncpp

    8,850View on GitHub↗

    JsonCpp is a C++ library for parsing, manipulating, and generating JSON data. It functions as a data interchange tool that provides a JSON parser to convert formatted text into structured data and a JSON serializer to transform internal data structures back into valid JSON strings. The library features the ability to preserve non-standard JSON comments during the deserialization and serialization process, which supports the management of human-readable configuration files. The project implements a tree-based internal representation for programmatic data access and uses a builder-based config

    C++
    View on GitHub↗8,850
Compare all 30 related projects→