Awesome GitHub RepositoriesZero-Copy Memory Mappings

Meilisearch is a Rust-based search engine providing typo-tolerant full-text and vector-based semantic search with real-time conversational capabilities.

simdjson is a high-performance, header-only C++ library designed for parsing, querying, and serializing JSON data with minimal memory overhead. It functions as a hardware-aware data processing engine that leverages vector instructions to achieve gigabyte-per-second parsing speeds. By detecting host processor capabilities at runtime, the library automatically selects the most efficient instruction sets to accelerate structural analysis and validation. The library distinguishes itself through a focus on extreme efficiency and resource management. It utilizes memory mapping and padded buffer ali

Candle is a minimalist machine learning framework and deep learning inference engine designed for the Rust programming language. It functions as a low-level tensor computation library, providing the necessary primitives for multi-dimensional array operations and mathematical transformations required to execute pre-trained neural network models. The framework distinguishes itself through a focus on memory efficiency and hardware utilization. It employs static-typed tensor operations to enforce shape validation and memory safety at compile time, while utilizing a lazy-loaded computational graph

This project is a cross-platform graphics and compute framework that provides a unified, hardware-agnostic abstraction layer for rendering and parallel processing. It enables developers to build high-performance applications that execute consistently across diverse operating systems and hardware backends, including Vulkan, Metal, and DirectX. By mapping high-level graphics commands to native APIs, it serves as a portable foundation for both real-time 3D rendering and general-purpose GPU computing. The framework distinguishes itself through a robust architecture that supports both native deskt

This is a mobile object database and NoSQL local data store that replaces relational tables with a schema-based model. It functions as a reactive data store, using live object observations and change notifications to trigger automatic user interface refreshes. The system provides built-in mobile cloud data synchronization to keep local datasets consistent with a remote server across multiple devices. It also includes security features for encrypted local storage, protecting sensitive on-disk data using at-rest encryption keys and fine-grained access control. Broad capabilities include object

Realm-Cocoa is a NoSQL mobile database engine and reactive object database designed for local data storage on mobile devices. It serves as a non-relational alternative to Core Data and SQLite, storing data as objects rather than tables. The system functions as an encrypted local store that protects sensitive application data using encryption. It provides reactive data synchronization, allowing application objects and user interfaces to update automatically when the underlying database changes.

Mold is a high-performance linker designed to replace standard system tools for the creation of executable binaries and shared libraries. It functions as a drop-in replacement for existing linkers, focusing on accelerating the final build phase of large software projects to improve developer productivity. The tool achieves its performance by utilizing multi-threaded processing to distribute the linking of object files across multiple CPU cores. It supports cross-architecture binary linking, allowing it to process compiled files for diverse platforms efficiently. By intercepting standard linke

Redpanda is a distributed event streaming engine designed to serve as a high-performance, drop-in replacement for existing event-driven architectures. It provides a foundation for building and scaling applications that require reliable data movement, analytical querying, and strict operational compliance across both cloud and self-managed environments. The platform distinguishes itself through a shared-nothing architecture that utilizes thread-per-core execution and a non-blocking asynchronous input/output engine to maximize throughput. It maintains data consistency through a consensus-based

OpenVINO is an AI inference engine and model serving platform designed to execute optimized deep learning models across CPUs, GPUs, and NPUs through a unified API. It includes a model optimization toolkit for converting, quantizing, and compressing models from various frameworks, alongside a specialized generative AI runtime for large language models. The project distinguishes itself through a plugin-based hardware acceleration layer that maps neural network operations to vendor-specific drivers. It features advanced execution mechanisms such as continuous batching, speculative decoding, and

Seastar is a C++ server application framework and asynchronous programming library designed for building high-performance, shared-nothing server applications. It functions as a high-performance I/O engine providing direct disk and network access through a shared-nothing framework that partitions data and execution across CPU cores. The framework distinguishes itself through a thread-per-core architecture that eliminates locking and resource contention by assigning one execution thread to each physical CPU core. It implements a userspace TCP/IP stack and kernel-bypass techniques, integrating w

Sled is an embedded key-value store and ACID-compliant database designed for high-performance data persistence. It functions as a log-structured storage engine that organizes data using B+ trees to support efficient range queries and prefix scans. The engine implements a zero-copy data store model, utilizing epoch-based reclamation to provide direct references to cached values without memory allocations. It distinguishes itself through a combination of write-ahead logging, page cache optimizations to reduce write amplification on flash storage, and serializable transactions for atomic multi-k

Crossbeam is a concurrency toolkit for Rust providing low-level primitives for writing multi-threaded programs. It focuses on lock-free data structures and memory management primitives designed for shared-memory concurrent environments. The project includes a work-stealing scheduler that uses double-ended queues to balance workloads across multiple processor cores. This system enables the implementation of work-stealing deques to distribute tasks and prevent bottlenecks. The toolkit covers broader capabilities for parallel algorithm development, multi-threaded task scheduling, and general co

Kitex is a high-performance remote procedure call framework for building distributed microservices in Go. It provides a communication system compatible with gRPC and Protobuf standards and includes a suite of tools for microservices governance. The framework features proxyless service mesh integration, which allows it to manage network traffic and governance directly without adding sidecar proxy latency. It optimizes data throughput through a high-performance communication library that minimizes memory copies. The system covers a broad surface of distributed capabilities, including service d

Hertz is a high-performance Go HTTP framework designed for building scalable microservices, RESTful APIs, and AI applications. It functions as a high-performance web server and a communication framework for microservices, utilizing non-blocking I/O and zero-copy memory management to handle high-concurrency traffic. The project distinguishes itself through a microservices communication toolkit that supports high-efficiency remote procedure calls via gRPC and Thrift protocols. It implements an asynchronous middleware engine based on an onion model, allowing for a pluggable request-response pipe

MessagePack-CSharp is a high-performance binary serialization library for .NET applications that converts object graphs into the MessagePack format. It functions as a C# data serialization toolkit and a polymorphic binary encoder capable of handling abstract classes and interfaces using union keys to identify concrete derived types. The library provides a binary format transcoder to transform binary data into human-readable JSON for debugging. It supports ahead-of-time formatter generation to avoid runtime overhead and implements LZ4 binary compression to reduce the size of serialized data.

Pony is an open-source, actor-model, capabilities-secure, high performance programming language

cuml, एक GPU-एक्सेलेरेटेड मशीन लर्निंग लाइब्रेरी और फ्रेमवर्क है जो टैबुलर डेटा प्रीप्रोसेसिंग और मॉडल निष्पादन को गति देने के लिए CUDA का उपयोग करता है। यह NVIDIA GPUs और GPU क्लस्टर्स पर क्लासिफिकेशन, रिग्रेशन और क्लस्टरिंग मॉडल्स को प्रशिक्षित और डिप्लॉय करने के लिए टूल्स का एक सूट प्रदान करता है। लाइब्रेरी को स्केलेबिलिटी के लिए डिज़ाइन किया गया है, जो एक डिस्ट्रिब्यूटेड GPU मशीन लर्निंग वातावरण प्रदान करती है जो सिंगल-डिवाइस मेमोरी से अधिक डेटासेट्स को संभालने के लिए हार्डवेयर एक्सेलेरेटर्स और नोड्स में गणना और डेटा फैला सकती है। यह मानक एस्टिमेटर इंटरफ़ेस को मिरर करती है ताकि मौजूदा वर्कफ़्लो के भीतर CPU-आधारित मॉडल्स को GPU-एक्सेलेरेटेड वर्शन्स के साथ बदला जा सके। प्रोजेक्ट मशीन लर्निंग क्षमताओं की एक विस्तृत श्रृंखला को कवर करता है, जिसमें सुपरवाइज्ड लर्निंग, अनसुपरवाइज्ड क्लस्टरिंग, नियरेस्ट नेबर सर्च और हाई-डायमेंशनल डाइमेंशनलिटी रिडक्शन शामिल है।

NCCL is a high-performance communication library and distributed GPU computing framework designed for executing collective and point-to-point data exchanges across multiple GPUs in single or multi-node systems. It serves as an RDMA GPU transport layer and memory orchestrator, facilitating high-bandwidth synchronization of data and model gradients for distributed GPU training and inference. The library is distinguished by its ability to execute communication primitives directly from GPU kernels, removing the host CPU from the critical path. It utilizes topology-aware path selection to optimize

MemoryPack C# और Unity के लिए एक उच्च-प्रदर्शन बाइनरी सीरियलाइज़ेशन लाइब्रेरी है। यह मेमोरी आवंटन और एन्कोडिंग ओवरहेड को कम करने के लिए डिज़ाइन किया गया एक ज़ीरो-एलोकेशन डेटा पाइपलाइन और स्कीमा-इवोल्यूशन फ्रेमवर्क प्रदान करता है। प्रोजेक्ट रनटाइम रिफ्लेक्शन से बचने के लिए कंपाइल-टाइम सोर्स जनरेटर्स का उपयोग करता है और अधिकतम थ्रूपुट के लिए ज़ीरो-एन्कोडिंग बाइनरी फॉर्मेट लागू करता है। यह एक ज़ीरो-एलोकेशन दृष्टिकोण के माध्यम से खुद को अलग करता है जो कचरा संग्रहण (garbage collection) दबाव को कम करने के लिए ऑब्जेक्ट इंस्टेंस का पुन: उपयोग करता है और अनमैनेज्ड स्ट्रक्ट्स के मेमोरी लेआउट को सीधे बाइनरी स्ट्रीम में कॉपी करता है। लाइब्रेरी बैकवर्ड कम्पैटिबिलिटी के लिए बाइनरी स्कीमा वर्ज़निंग को कवर करती है और बड़े डेटासेट के लिए एसिंक्रोनस कलेक्शन स्ट्रीमिंग का समर्थन करती है। इसमें C# और TypeScript के बीच डेटा एक्सचेंज के लिए डेटा संरचनाओं को सिंक्रोनाइज़ करने के लिए एक TypeScript टाइप जनरेटर शामिल है। अतिरिक्त क्षमताओं में पेलोड कम्प्रेशन, कस्टम फ़ॉर्मेटर इम्प्लीमेंटेशन और सीरियलाइज़ेशन कॉलबैक्स शामिल हैं।

rkyv, Rust के लिए एक ज़ीरो-कॉपी डीसीरियलाइज़ेशन फ्रेमवर्क है जो मेमोरी-मैपेबल डेटा आर्काइव्स के लिए एक बाइनरी सीरियलाइज़ेशन फॉर्मेट प्रदान करता है। यह जटिल डेटा संरचनाओं को बाइट्स में मैप करने और नई मेमोरी आवंटित किए बिना या डेटा कॉपी किए बिना सीधे बफ़र से एक्सेस करने की अनुमति देता है। यह प्रोजेक्ट पॉलीमॉर्फिक प्रकारों और ट्रेट ऑब्जेक्ट्स के सीरियलाइज़ेशन को सक्षम बनाता है, जो बाइनरी रूप के भीतर उनके डायनामिक व्यवहार और संरचना को बनाए रखता है। यह सुनिश्चित करने के लिए कि डेटा मेमोरी में कहीं भी लोड होने पर मान्य रहे, यह रिलेटिव-पॉइंटर एड्रेसिंग और बाइट-एलाइंड स्ट्रक्चर पैकिंग का उपयोग करता है। यह फ्रेमवर्क डायरेक्ट मेमोरी मैपिंग के माध्यम से हाई-परफॉरमेंस डेटा पर्सिस्टेंस और लो-लेटेंसी स्टेट मैनेजमेंट को कवर करता है। यह एप्लिकेशन द्वारा आवश्यक होने पर ज़ीरो-कॉपी डेटा एक्सेस और पूर्ण डेटा प्रकार पुनर्निर्माण दोनों के लिए मैकेनिज्म प्रदान करता है।