4 مستودعات
Architectures for the incremental ingestion and parsing of concatenated JSON documents or streams.
Distinct from Stream Processing: Distinct from general Stream Processing: focuses specifically on JSON-formatted data streams rather than generic high-velocity data ingestion.
Explore 4 awesome GitHub repositories matching data & databases · JSON. Refine with filters or upvote what's useful.
simdjson is a high-performance, header-only C++ library designed for parsing, querying, and serializing JSON data with minimal memory overhead. It functions as a hardware-aware data processing engine that leverages vector instructions to achieve gigabyte-per-second parsing speeds. By detecting host processor capabilities at runtime, the library automatically selects the most efficient instruction sets to accelerate structural analysis and validation. The library distinguishes itself through a focus on extreme efficiency and resource management. It utilizes memory mapping and padded buffer ali
Handling continuous streams or concatenated JSON documents incrementally to maintain low memory usage while maintaining high throughput.
gjson is a Go JSON parser designed for schema-less reading and value extraction. It allows for the retrieval of specific data from JSON documents using dot-notation paths without requiring the definition of predefined Go structs. The library provides tools for path-based querying, including the use of wildcards and index-based queries to locate data within objects and arrays. It also functions as a JSON lines processor, treating multi-line documents as arrays to iterate and query individual entries. Additional capabilities include converting JSON values into native Go types such as strings,
Parses and iterates through multi-line JSON documents to handle large datasets or log files efficiently.
RapidJSON is a high-performance C++ library used for parsing and generating JSON data. It provides both document object model and stream-based interfaces to transform JSON strings into structured data and vice versa. The library includes a JSON schema validator to verify that documents conform to predefined rules and a Unicode transcoder for converting strings between UTF-8, UTF-16, and UTF-32 encodings. It also supports relaxed parsing for non-standard JSON containing comments or trailing commas. Additional capabilities cover JSON pointer navigation for locating specific values and string s
Supports parsing large JSON documents in parts across multiple threads to prevent interface freezing.
oboe.js هو محلل JSON للبث (Streaming) وعميل HTTP مصمم لمعالجة البيانات بشكل تزايدي. يسمح للتطبيقات بالتعامل مع كائنات JSON الفردية فور وصولها من طلب شبكة أو بث قابل للقراءة قبل اكتمال التنزيل بالكامل. تعمل المكتبة كمحول لبث JSON، مما يتيح تعديل وتصفية وتعيين العقد (Nodes) أثناء التنقل. وتتميز باختيار العقد بناءً على المسار لتشغيل دوال الاستدعاء (Callbacks) عند مطابقة أنماط معينة، ويمكنها إنهاء اتصال الشبكة مبكراً بمجرد العثور على البيانات المطلوبة لتوفير النطاق الترددي. للتعامل مع مجموعات بيانات أكبر من ذاكرة النظام المتاحة، تستخدم المكتبة إدارة ذاكرة قائمة على البث للتخلص من العقد التي تمت معالجتها. كما تدعم دمج السجلات التاريخية مع التحديثات في الوقت الفعلي من خلال اتصالات طويلة الأمد، وتوفر القدرة على استعادة البيانات الجزئية في حال انقطاع الاتصال.
Processes incoming JSON data incrementally, enabling the application to act on individual objects before the full response is received.