8 مستودعات
Techniques for allocating and manipulating raw memory chunks for binary data.
Distinct from Memory-Efficient Streaming: Specifically targets the use of memory buffers for binary data, complementing streaming pipelines.
Explore 8 awesome GitHub repositories matching data & databases · Buffer Management. Refine with filters or upvote what's useful.
This project is a structured Node.js programming course and educational guide designed to teach JavaScript backend development. It provides a sequence of workshops and interactive tutorials that focus on the fundamentals of the Node.js runtime and its core modules. The material emphasizes asynchronous programming, specifically covering non-blocking I/O, callback patterns, and event-driven architecture. It includes a practical exploration of the core API for managing network applications, file system operations, and binary data. The curriculum covers module management and dependency resolutio
Provides instruction on using memory buffers to efficiently process binary data and large datasets.
Proxygen is a collection of C++ libraries for building high-performance HTTP servers and clients. It provides a protocol parser that converts raw network bytes into high-level transaction objects and includes a network stack for processing web traffic over the QUIC transport protocol. The project implements a layered protocol abstraction and a QUIC-based transport integration to support multiple versions of the HTTP standard, including HTTP/3. It utilizes state-machine based parsing and an event-driven I/O loop to manage concurrent network connections. The library covers asynchronous buffer
Utilizes non-blocking memory buffers to efficiently queue and stream data between the network socket and the application.
WeixinBot is a framework for WeChat account automation and bot development. It provides a programmable interface to monitor incoming messages and trigger automated actions within the WeChat ecosystem. The system emulates a browser session using a WebSocket-based protocol and establishes identity through QR code authentication. It maintains session-state persistence to keep accounts active without repeated verification. The project covers message processing for text, images, voice notes, and location data, and supports the transmission of emojis and links. It includes utilities for user conta
Provides background downloading of binary image and voice data to maintain system responsiveness.
Beast هي مكتبة C++ لتنفيذ عملاء وخوادم HTTP وWebSocket منخفضة المستوى. تعمل كإطار عمل للشبكات غير المتزامنة مصمم لتركيب عمليات الإدخال/الإخراج غير المحظورة (non-blocking I/O) ومكدسات التدفق الطبقية لإدارة حركة مرور الشبكة المتزامنة، وتحديداً باستخدام نموذج Boost.Asio غير المتزامن. توفر المكتبة تنفيذاً شاملاً لبروتوكولات HTTP/1.1 وWebSocket. بالنسبة لـ HTTP، تتضمن بدائيات لتحليل وتسلسل الرسائل مع دعم لترميز النقل المجزأ (chunked transfer encoding)، وقراءة الجسم التزايدية، وخطوط أنابيب الطلبات. يغطي تنفيذ WebSocket دورة الحياة الكاملة للاتصال ثنائي الاتجاه، بما في ذلك المصافحات، والتفاوض على البروتوكول الفرعي، وتجزئة الرسائل، ومراقبة الحيوية عبر إطارات التحكم. تتضمن Beast مجموعة متخصصة من الأدوات لإدارة مخازن الشبكة المؤقتة لتحسين الإدخال/الإخراج من نوع scatter-gather من خلال مخازن ذاكرة ديناميكية وقائمة على التسلسل. كما تغطي اتصالات الشبكة الآمنة عبر دمج طبقات SSL/TLS للتدفقات المشفرة، ومصادقة الشهادات، وإنهاء الاتصال الآمن. يوفر إطار العمل تجريدات عبر المنصات للإدخال/الإخراج للملفات وإدارة إشارات النظام لدعم تطوير تطبيقات شبكة مستقرة.
Uses dynamic and sequence-based buffer concepts to handle incremental data parsing.
evpp is a C++ network library and framework designed for building high-performance network services using TCP, UDP, and HTTP protocols. It provides an asynchronous event loop to manage nonblocking I/O operations and concurrent network connections across multiple threads. The framework includes specialized tools for asynchronous DNS resolution and a system for asynchronous task scheduling using a managed thread pool. It also features a nonblocking HTTP server and client with integrated connection pooling. The project covers low-level transport layer connectivity for TCP and UDP, as well as hi
Uses asynchronous network buffers to optimize data throughput between sockets and the application.
The Datadog Agent is an infrastructure monitoring agent and host telemetry collector. It functions as a background process that gathers system metrics and application health data to send to a centralized monitoring platform. The project operates as a plugin-based metric collector, using a modular system of independent check scripts to gather data from various third-party services and applications. It serves as a remote telemetry transmitter, providing a pipeline to stream infrastructure and system information to a remote analysis and alerting backend. Its capabilities cover application perfo
Implements non-blocking memory buffers to stream telemetry data between the agent and remote monitoring endpoints.
This project provides a browser-based media player and server-side bridging component designed to render live network camera feeds directly within web applications. By utilizing standard browser media APIs, it enables the playback of video streams without the need for external plugins or proprietary software. The system functions by routing raw network camera data through a server-side proxy that translates specialized protocols into browser-compatible formats. This bridge facilitates real-time media delivery by managing network traffic and decapsulating stream headers directly within the bro
Manages incoming network packets in a memory-efficient queue to ensure smooth video rendering despite fluctuations in network latency.
Tiramisu is a polyhedral C++ compiler framework designed to express and optimize data-parallel algorithms for diverse hardware accelerators. It provides a programming interface that allows developers to define mathematical expressions, manage loop iteration spaces, and organize functions targeting heterogeneous architectures. The system features an advanced compilation infrastructure that abstracts computations into a hardware-agnostic intermediate representation before lowering them into native machine code or hardware configuration bitstreams. It calculates exact data flow dependencies thro
Represents memory buffers and creates specific views on existing buffers to handle data access operations efficiently.