Awesome GitHub RepositoriesMemory-Efficient Streaming

Fastjson is a Java data binding framework and serialization library designed to convert objects to JSON strings and parse JSON data into typed objects. It functions as a JSON parser and stream processor capable of transforming JSON strings into data structures. The project emphasizes high performance JSON processing and memory management, specifically through the use of a pipeline to stream oversized JSON objects and texts to prevent memory exhaustion. It provides capabilities for JSON data serialization and deserialization workflows, including custom JSON data mapping and the ability to def

Got is a promise-based HTTP request library for Node.js that supports HTTP/2 and streaming. It provides a system for making network requests with a focus on asynchronous control flow and type-safe API client development. The library is distinguished by its middleware-based request lifecycle, which uses interceptors and plugins to modify request options and response data. It includes a configurable automatic retry mechanism with backoff strategies, a built-in HTTP response cache, and a cookie-jar system for maintaining persistent sessions. Broad capabilities cover data handling through duplex

Gron is a command line utility that transforms nested JSON data into a flat list of path-value assignments. This process converts hierarchical structures into line-based statements, mapping every leaf value to its absolute path to make the data compatible with standard text-processing tools. The tool allows for the bidirectional transformation of data, enabling the reconstruction of original nested JSON objects from flattened path assignments. It can ingest JSON from local files, standard input, or remote URLs, with the ability to route network traffic through proxy servers. The utility supp

This project is a structured Node.js programming course and educational guide designed to teach JavaScript backend development. It provides a sequence of workshops and interactive tutorials that focus on the fundamentals of the Node.js runtime and its core modules. The material emphasizes asynchronous programming, specifically covering non-blocking I/O, callback patterns, and event-driven architecture. It includes a practical exploration of the core API for managing network applications, file system operations, and binary data. The curriculum covers module management and dependency resolutio

Proxygen is a collection of C++ libraries for building high-performance HTTP servers and clients. It provides a protocol parser that converts raw network bytes into high-level transaction objects and includes a network stack for processing web traffic over the QUIC transport protocol. The project implements a layered protocol abstraction and a QUIC-based transport integration to support multiple versions of the HTTP standard, including HTTP/3. It utilizes state-machine based parsing and an event-driven I/O loop to manage concurrent network connections. The library covers asynchronous buffer

WeixinBot is a framework for WeChat account automation and bot development. It provides a programmable interface to monitor incoming messages and trigger automated actions within the WeChat ecosystem. The system emulates a browser session using a WebSocket-based protocol and establishes identity through QR code authentication. It maintains session-state persistence to keep accounts active without repeated verification. The project covers message processing for text, images, voice notes, and location data, and supports the transmission of emojis and links. It includes utilities for user conta

oboe.js is a streaming JSON parser and HTTP stream client designed for incremental data processing. It allows applications to act upon individual JSON objects as they arrive from a network request or readable stream before the entire download completes. The library functions as a JSON stream transformer, enabling the modification, filtering, and mapping of nodes on the fly. It features path-based node selection to trigger callbacks when specific patterns are matched and can terminate a network connection early once required data is found to save bandwidth. To handle datasets larger than avai

Beast एक C++ लाइब्रेरी है जिसे लो-लेवल HTTP और WebSocket क्लाइंट्स और सर्वर्स को लागू करने के लिए बनाया गया है। यह एक एसिंक्रोनस नेटवर्किंग फ्रेमवर्क के रूप में कार्य करता है जिसे नॉन-ब्लॉकिंग I/O ऑपरेशन्स और लेयर्ड स्ट्रीम स्टैक्स को कंपोज़ करने के लिए डिज़ाइन किया गया है, जो विशेष रूप से Boost.Asio एसिंक्रोनस मॉडल का उपयोग करता है। यह लाइब्रेरी HTTP/1.1 और WebSocket प्रोटोकॉल का व्यापक कार्यान्वयन प्रदान करती है। HTTP के लिए, इसमें चंक्ड ट्रांसफर एन्कोडिंग, इंक्रीमेंटल बॉडी रीडिंग और रिक्वेस्ट पाइपलाइनिंग के समर्थन के साथ मैसेज को पार्स और सीरियलाइज़ करने के लिए प्रिमिटिव्स शामिल हैं। इसका WebSocket कार्यान्वयन हैंडशेक, सबप्रोटोकॉल नेगोशिएशन, मैसेज फ्रैगमेंटेशन और कंट्रोल फ्रेम्स के माध्यम से लाइवनेस मॉनिटरिंग सहित द्विदिश संचार के पूरे लाइफसाइकिल को कवर करता है। Beast में डायनामिक और सीक्वेंस-आधारित मेमोरी बफ़र्स के माध्यम से स्कैटर-गेदर I/O को ऑप्टिमाइज़ करने के लिए नेटवर्क बफ़र मैनेजमेंट टूल्स का एक विशेष सूट शामिल है। यह एन्क्रिप्टेड स्ट्रीम्स, सर्टिफिकेट ऑथेंटिकेशन और सुरक्षित कनेक्शन टर्मिनेशन के लिए SSL/TLS लेयर्स को एकीकृत करके सुरक्षित नेटवर्क संचार को भी कवर करता है। यह फ्रेमवर्क स्थिर नेटवर्क एप्लिकेशन डेवलपमेंट का समर्थन करने के लिए फाइल I/O और सिस्टम सिग्नल मैनेजमेंट के लिए क्रॉस-प्लेटफॉर्म एब्स्ट्रैक्शन प्रदान करता है।

Memgraph is an in-memory, distributed graph database designed for high-performance labeled property graph management. It utilizes a Cypher query engine for declarative data retrieval and manipulation, providing a scalable knowledge graph backend that integrates vector search and graph traversals. The system distinguishes itself as a real-time graph analytics platform, employing native C++ and CUDA implementations to execute complex network analysis and dynamic community detection on streaming data. It provides specialized support for AI integration, including GraphRAG capabilities, the constr

evpp is a C++ network library and framework designed for building high-performance network services using TCP, UDP, and HTTP protocols. It provides an asynchronous event loop to manage nonblocking I/O operations and concurrent network connections across multiple threads. The framework includes specialized tools for asynchronous DNS resolution and a system for asynchronous task scheduling using a managed thread pool. It also features a nonblocking HTTP server and client with integrated connection pooling. The project covers low-level transport layer connectivity for TCP and UDP, as well as hi

The Datadog Agent is an infrastructure monitoring agent and host telemetry collector. It functions as a background process that gathers system metrics and application health data to send to a centralized monitoring platform. The project operates as a plugin-based metric collector, using a modular system of independent check scripts to gather data from various third-party services and applications. It serves as a remote telemetry transmitter, providing a pipeline to stream infrastructure and system information to a remote analysis and alerting backend. Its capabilities cover application perfo

This project provides a browser-based media player and server-side bridging component designed to render live network camera feeds directly within web applications. By utilizing standard browser media APIs, it enables the playback of video streams without the need for external plugins or proprietary software. The system functions by routing raw network camera data through a server-side proxy that translates specialized protocols into browser-compatible formats. This bridge facilitates real-time media delivery by managing network traffic and decapsulating stream headers directly within the bro

Tiramisu is a polyhedral C++ compiler framework designed to express and optimize data-parallel algorithms for diverse hardware accelerators. It provides a programming interface that allows developers to define mathematical expressions, manage loop iteration spaces, and organize functions targeting heterogeneous architectures. The system features an advanced compilation infrastructure that abstracts computations into a hardware-agnostic intermediate representation before lowering them into native machine code or hardware configuration bitstreams. It calculates exact data flow dependencies thro