28 Repos
Mechanisms for passing data between processes using shared memory to reduce latency.
Distinguishing note: Focuses on memory-efficient frame passing between threads.
Explore 28 awesome GitHub repositories matching data & databases · Shared Memory Buffers. Refine with filters or upvote what's useful.
QtScrcpy is a cross-platform desktop application designed for mirroring and controlling Android devices. It functions as a high-performance client that captures mobile display output and streams it to a computer monitor, enabling real-time interaction through a persistent connection. The application distinguishes itself by supporting the simultaneous management of multiple mobile devices from a single interface, allowing for batch operations and synchronized inputs. Users can map standard desktop mouse and keyboard actions to mobile touch events using custom scripts, facilitating efficient na
Passes decoded video frames between threads using efficient memory pointers to avoid copying.
PostgreSQL is an object-relational database management system designed for the persistent storage and retrieval of structured information. It functions as an ACID-compliant database server, utilizing standard query language protocols to maintain data consistency and reliability across large-scale application datasets. The system distinguishes itself through an extensible architecture that allows for the definition of custom data types, operators, and indexing methods. It employs multi-version concurrency control to enable simultaneous read and write operations without blocking, supported by a
Provides a global memory area for frequently accessed data pages to minimize disk I/O.
Tracy is a real-time performance profiling framework for C and C++ applications. It provides a software instrumentation library that captures high-resolution telemetry data, which is then visualized through a separate graphical interface to identify bottlenecks and resource allocation issues. The system utilizes a client-server architecture that enables remote profiling, allowing performance data to be captured on a target machine and analyzed on a workstation. It employs lock-free event logging and shared-memory ring buffers to minimize the overhead of data collection, ensuring that the main
Employs circular buffers in shared memory to store telemetry events with minimal overhead.
This project provides a full Python interpreter compiled to WebAssembly, enabling the execution of Python code and scientific libraries directly within web browsers and server-side environments. By bridging the gap between language runtimes, it allows developers to run computational tasks, manage packages, and perform data analysis in client-side environments without requiring a backend server. The platform distinguishes itself through a comprehensive foreign function interface that enables bidirectional data exchange, object proxying, and function calling between Python and JavaScript. It in
Enables high-performance data processing by transferring raw memory buffers and typed arrays between language runtimes.
MNN is a high-performance inference engine and framework designed for on-device machine learning. It provides a comprehensive environment for executing, optimizing, and deploying neural network models directly on mobile and resource-constrained edge devices. The framework distinguishes itself through a robust model optimization toolkit that supports quantization, compression, and structural graph manipulation to minimize memory footprint and maximize execution speed. It features a modular architecture that abstracts hardware-specific backends, allowing models to run efficiently across diverse
Minimizes resource overhead by sharing thread pools and memory buffers across multiple concurrent model execution sessions.
F Prime ist ein komponentenbasiertes Framework für die Entwicklung und Bereitstellung von Embedded- und Raumfahrtsoftware. Es bietet eine modulare Architektur, die Softwarelogik von Kommunikationsschnittstellen entkoppelt und es Entwicklern ermöglicht, Systemstrukturen über eine domänenspezifische Modellierungssprache zu definieren. Dieser modellbasierte Ansatz ermöglicht eine automatisierte Codegenerierung, die Konsistenz über komplexe Systemtopologien hinweg gewährleistet und gleichzeitig strikte Schnittstellenverträge zwischen Softwaremodulen aufrechterhält. Das Framework zeichnet sich durch sein integriertes Build-System und eine Suite für Bodendatenoperationen aus. Es automatisiert den gesamten Lebenszyklus von Embedded-Software, von der Cross-Kompilierung und dem Abhängigkeitsmanagement bis hin zur Generierung von Telemetrie- und Befehlsschnittstellen. Durch die Bereitstellung einer einheitlichen Umgebung für Onboard-Flugsoftware und bodengestützte Überwachung erleichtert es die nahtlose Integration, das Testen sowie die Steuerung und Überwachung verteilter Embedded-Systeme über verschiedene Hardwareplattformen hinweg. Über die Kernarchitektur hinaus enthält das Projekt umfassende Werkzeuge für die Systembeobachtbarkeit, einschließlich Echtzeit-Telemetrie-Visualisierung, Ereignisprotokollierung und diagnostischer Tracing-Funktionen. Es unterstützt eine breite Palette von Bereitstellungsszenarien, von Bare-Metal-Umgebungen bis hin zu Echtzeitbetriebssystemen, und bietet Mechanismen für Speicherverwaltung, zustandsgesteuerte Verhaltensmodellierung und asynchrone Aufgabenausführung. Das Projekt wird als C++-Repository mit umfangreicher Dokumentation und Build-System-Unterstützung für die plattformübergreifende Entwicklung gepflegt.
Provides port-based memory allocation for data containers to support component-level data production.
The Android NDK samples provide a comprehensive collection of code examples demonstrating how to integrate C and C++ native code into Android applications. This repository serves as a practical guide for developers utilizing the Android Native Development Kit to implement performance-critical application components that require direct hardware access and low-level system interaction. The project highlights the use of the Java Native Interface to bridge managed code with native modules, enabling cross-language function calls and efficient data exchange. It demonstrates how to manage native act
Shares raw memory regions between managed and native layers to eliminate expensive data copying.
RealtimeSTT is a local speech-to-text engine and real-time automatic speech recognition server. It utilizes transformer-based recognition and omnilingual pipelines to convert live audio streams into text, providing a WebSocket-based streaming API for raw PCM audio transmission. The project is distinguished by a dual-backend transcription pipeline that uses a lightweight engine for immediate partial suggestions and a heavier model for final high-accuracy results. It includes a wake word detection system to trigger recording and employs a shared-resource inference model to distribute heavy spee
Loads heavy speech models into memory once and shares them across multiple concurrent user sessions to minimize overhead.
Napajs is an embeddable JavaScript engine and multi-threaded runtime designed to be integrated directly into other software applications as a component. It serves as a parallel computation framework that allows JavaScript code to execute across multiple threads, bypassing the standard single-threaded event loop limitation to handle CPU-intensive tasks. The runtime is distinguished by its ability to load and execute modules from the NPM ecosystem and its pluggable execution environment. This architecture allows for custom implementations of memory allocation, system logging, and performance me
Transports typed arrays via shared memory buffers to allow multiple threads to modify data without copying.
Torch7 is a scientific computing environment and tensor computation library used for deep learning research and numerical analysis. It functions as a Lua-based framework for training neural networks and learning agents, providing a toolkit for implementing architectures and training through reinforcement learning algorithms. The project is distinguished by its tight integration with C, utilizing a binding layer to map high-level scripting to low-level C structures for direct memory access. It supports hardware-accelerated computation by offloading linear algebra and convolution operations to
Creates new tensors that reference existing memory buffers to allow shared modifications without duplication.
wasm-bindgen is a glue code generator and interoperability tool that facilitates high-level communication and data exchange between compiled Rust modules and JavaScript environments. It functions as a memory bridge and type definition generator, allowing the exchange of complex data types and the calling of functions across execution boundaries. The project distinguishes itself by automating the conversion of data types and function signatures using attribute-based bindings. It generates the necessary JavaScript and WebAssembly wrappers to manage linear memory mapping and creates automatic Ty
Provides shared memory buffers and atomic operations to coordinate execution across multiple web worker threads.
Neon is a framework for writing high-performance native Node.js modules using the Rust programming language. It serves as a foreign function interface bridge and a toolchain for bootstrapping, compiling, and managing Rust-based extensions. The project provides a cross-language memory manager that handles buffers and object borrowing to ensure safe memory access between Rust and JavaScript. It enables the mapping of data types and function calls across the language boundary, allowing Rust functions to be exported to the script environment and JavaScript functions to be called from Rust. The f
Provides shared memory buffers to allow zero-copy data exchange between Rust and JavaScript.
ANE is an open-source framework for training neural networks directly on Apple's Neural Engine hardware, bypassing Apple's public Core ML toolchain through reverse-engineered private APIs. It provides low-level control over the ANE, enabling developers to compile custom compute graphs into binary kernels, partition transformer model layers into hardware-compatible subgraphs, and share GPU-allocated memory with the Neural Engine via zero-copy IOSurface buffers. The framework distinguishes itself by offering direct access to hardware performance counters and power telemetry for benchmarking thr
Shares GPU-allocated buffers directly with the Neural Engine via IOSurface to eliminate data copying.
fio is a storage performance benchmarking tool and synthetic I/O workload generator. It functions as a storage device profiler and I/O trace replay engine, enabling the measurement of throughput and latency for storage devices and file systems. The project is distinguished by its ability to act as a distributed storage stress tester, managing multiple remote server backends via a single controller to evaluate network storage. It also includes specialized capabilities for storage deduplication analysis by generating redundant data buffers to test the efficiency of deduplication subsystems. Th
Uses shared-memory semaphore locks to coordinate execution and track the state of concurrent child processes.
opencv4nodejs ist eine Reihe von JavaScript-Wrappern und ein natives C++-Addon, das Node.js-Bindings für die OpenCV-Bibliothek bereitstellt. Es fungiert als Computer-Vision-Bibliothek und Bildverarbeitungs-Framework, das leistungsstarke C++-Algorithmen für eine JavaScript-Umgebung verfügbar macht. Das Projekt ermöglicht die Ausführung von Vision-Algorithmen zur Gesichtserkennung, Objektverfolgung und Analyse visueller Daten unter Verwendung tiefer neuronaler Netze. Es enthält Funktionen für die Datenmusterklassifizierung, Texterkennung und die Identifizierung von Gesichtsmerkmalen und Gesten. Das Framework deckt eine breite Palette an Funktionen ab, einschließlich automatisierter Bildverarbeitung, optischer Zeichenerkennung und Echtzeit-Videoanalyse. Es bietet Tools für Matrix-Arithmetik-Operationen, Pixeldaten-Zugriff sowie die Verwaltung von Bilddateien und Live-Video-Capturing. Das Ressourcenmanagement wird durch asynchrone Aufgabenausführung und externes Speicher-Tracking gehandhabt, um die Reaktionsfähigkeit der Event-Loop aufrechtzuerhalten.
Utilizes shared memory buffers to pass large image matrices between JavaScript and C++ without expensive data copying.
monoio is a high-performance asynchronous runtime and executor for Rust. It implements a thread-per-core concurrency model that pins tasks to specific CPU cores to eliminate synchronization overhead and data migration. The runtime leverages the io_uring interface to perform non-blocking system calls and reduce kernel-user mode memory copying. It utilizes a high-performance I/O driver and zero-copy TCP stream wrapping to manage data transfer via shared-memory buffers. The project provides capabilities for CPU core affinity management, low-latency system programming, and high-performance netwo
Uses shared-memory buffers to create stable communication channels between user space and kernel mode.
node-opencv is a high-performance C++ native addon and bridge that connects Node.js applications to the OpenCV library. It serves as an image processing toolkit and computer vision library, allowing JavaScript code to execute vision algorithms and image manipulation operations through native bindings. The project provides specialized capabilities for face and shape detection, as well as face identity recognition using trained models. It includes tools for object motion tracking through optical flow and background subtraction, along with the ability to identify specific patterns and analyze sh
Utilizes zero-copy image buffers to share raw pixel data between JavaScript and C++ without expensive copying.
Diffusion Policy ist ein Robot-Learning-Framework, das Diffusionsmodelle verwendet, um visuelle Beobachtungen auf präzise Aktionstrajektorien abzubilden. Es fungiert als Imitation-Learning-Toolkit und Visuomotor-Policy-Learner und bietet ein System zum Training neuronaler Netze, die menschliches Verhalten durch die Generierung robotischer Bewegungen basierend auf Bild- und Sensordaten replizieren. Das Framework verwendet einen konditionalen Denoising-Prozess, um Sequenzen robotischer Bewegungen zu samplen, was es ermöglicht, multimodale Aktionsverteilungen zu handhaben, bei denen mehrere gültige Trajektorien für einen einzelnen Zustand existieren können. Es nutzt score-basiertes Aktionsmodellieren und einen Roboter-Aktionsgenerator, um präzise Verhaltensweisen für komplexe physische Aufgaben zu erzeugen. Das Projekt deckt eine umfassende Robotik-Datenpipeline ab, einschließlich der Sammlung von menschengeführten Demonstrationen und der Speicherung groß angelegter Trajektorien in komprimierten, gechunkten Formaten. Seine Steuerungsfunktionen umfassen Receding-Horizon-Control via Sliding-Window-Ausführung und asynchrone Aktionsbereitstellung an Hardware-Controller, um hochfrequente Beobachtungsschleifen aufrechtzuerhalten. Das System enthält Tools für das Experiment-Management, wie Workspace-Encapsulation und Modell-Checkpointing, sowie Policy-Evaluierung zum Testen auf physischer oder simulierter Hardware.
Employs shared-memory buffering to capture high-frequency camera data and reduce processing latency.
QtAV is a cross-platform media engine and multimedia framework that combines FFmpeg decoding with the Qt framework for audio and video rendering. It functions as a hardware-accelerated video player, an OpenGL video renderer, and a multimedia stream transcoder. The project distinguishes itself through a hardware-abstraction decoding layer that utilizes GPU interfaces such as VA-API and VideoToolbox to decode high-resolution video. It employs a zero-copy memory transfer path to move decoded video data directly to graphics APIs, reducing CPU overhead and enabling high-performance YUV rendering.
Implements a zero-copy path to transfer decoded video data directly to GPU buffers, reducing CPU overhead.
This project is an X11 window system server that coordinates graphical output and input devices. It functions as a display server, a hardware driver manager for graphics and input modules, and a graphics server capable of rendering directly to a generic framebuffer. The server provides multi-seat display management to isolate input and display devices for different concurrent users. It also implements namespace isolation to separate clients and restrict resource access, preventing interference between different user sessions or processes. The system manages GPU driver integration through dyn
Transfers pixel data between clients and server using shared memory buffers for efficient graphical updates.