awesome-repositories.com
Blog
awesome-repositories.com

Descubre los mejores repositorios open-source con nuestra búsqueda potenciada por IA.

ExplorarBúsquedas curadasAlternativas open-sourceSoftware autohospedableBlogMapa del sitio
ProyectoAcerca deCómo clasificamosPrensaServidor MCP
Aviso legalPrivacidadTérminos
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

28 repositorios

Awesome GitHub RepositoriesDirect Memory Data Transfer

Mechanisms for exchanging large data arrays between managed and native memory using direct buffers.

Distinct from Shared Memory Data Exchange: Distinct from general shared memory exchange: focuses on Java-to-native array transfer.

Explore 28 awesome GitHub repositories matching data & databases · Direct Memory Data Transfer. Refine with filters or upvote what's useful.

Awesome Direct Memory Data Transfer GitHub Repositories

Encuentra los mejores repositorios con IA.Buscaremos los repositorios que mejor coincidan usando IA.
  • lovell/sharpAvatar de lovell

    lovell/sharp

    32,340Ver en GitHub↗

    Sharp is a high-performance image processing library for Node.js. It serves as a native extension and wrapper for the libvips framework, providing tools for image resizing, format conversion, and programmatic data manipulation. The project enables the transformation of images into web-friendly formats such as WebP and AVIF while preserving color profiles and alpha channels. It also provides capabilities for generating blank image buffers with specified dimensions and background colors. The library covers a broad range of image manipulation utilities, including rotation, extraction, compositi

    Implements direct memory data transfer between the Node.js heap and native memory for high-performance image data handling.

    JavaScriptavifcropexif
    Ver en GitHub↗32,340
  • javascript-tutorial/en.javascript.infoAvatar de javascript-tutorial

    javascript-tutorial/en.javascript.info

    25,344Ver en GitHub↗

    This project is a comprehensive JavaScript programming tutorial and language reference. It serves as a web development education resource providing instruction on modern language fundamentals, object-oriented design, and advanced asynchronous programming patterns. The resource functions as both a frontend development guide and a technical reference. It covers core language features such as closures, prototypes, promises, and typed arrays, while providing practical lessons on managing browser data and handling network requests. The content spans several key capability areas, including browser

    Teaches the use of fixed-type views over raw binary buffers to handle numeric data.

    HTMLenglishjavascripttutorial
    Ver en GitHub↗25,344
  • libgdx/libgdxAvatar de libgdx

    libgdx/libgdx

    24,816Ver en GitHub↗

    LibGDX is a Java-based framework designed for cross-platform game development, enabling the creation and deployment of 2D and 3D games across desktop, mobile, and web environments from a single codebase. It functions as a comprehensive library that abstracts hardware-accelerated graphics, audio, input, and file system access, providing a unified interface for developers to manage game logic and application lifecycles. The framework distinguishes itself through a high-performance architecture that prioritizes efficiency and native interoperability. It utilizes a batch-oriented graphics pipelin

    Exchanges large data arrays between Java and native code using direct memory buffers to minimize overhead.

    Java2d3dandroid
    Ver en GitHub↗24,816
  • gpujs/gpu.jsAvatar de gpujs

    gpujs/gpu.js

    15,377Ver en GitHub↗

    This library is a JavaScript framework for general-purpose computing on graphics processing units. It enables the execution of parallel mathematical operations directly within the browser by offloading data-heavy calculations to graphics hardware. The project functions as a web-based math accelerator that converts standard JavaScript functions into shader code for execution on the graphics processor. It provides a unified interface that detects available graphics APIs and manages data transfer between system and graphics memory. To ensure compatibility across diverse environments, the library

    Manages data transfer between system and graphics memory using structured buffers to minimize latency.

    JavaScriptglslgpgpugpu
    Ver en GitHub↗15,377
  • sql-js/sql.jsAvatar de sql-js

    sql-js/sql.js

    13,632Ver en GitHub↗

    sql.js is a serverless, in-memory SQL database engine that ports SQLite to WebAssembly for use within a web browser. It provides a JavaScript interface to initialize relational databases, execute SQL queries, and manage structured data without requiring a backend server. The project enables the import and export of database states using typed arrays, allowing in-memory data to be persisted as files. It supports high-precision integer retrieval via BigInt and utilizes prepared statements to increase execution speed and security. The engine includes capabilities for client-side data management

    Uses JavaScript typed arrays to map the database's linear memory and internal state for efficient access.

    JavaScript
    Ver en GitHub↗13,632
  • geniusvjr/learningnotesAvatar de GeniusVJR

    GeniusVJR/LearningNotes

    13,145Ver en GitHub↗

    LearningNotes es una base de conocimientos técnicos y guía de estudio de ingeniería centrada en los internos del framework de Android, la arquitectura del sistema y la optimización del rendimiento móvil. Sirve como referencia para analizar la secuencia de arranque de Android, el arranque de procesos y la inicialización de servicios del sistema. El proyecto proporciona guías detalladas sobre el rendimiento móvil, incluyendo estrategias para reducir las huellas de memoria, identificar fugas de memoria y optimizar la decodificación de imágenes. Además, cubre la comunicación entre procesos de Android utilizando AIDL y el controlador del kernel Binder, así como manuales de arquitectura de software para desacoplar la lógica de negocio de las interfaces de usuario a través de patrones como MVVM y MVP. Más allá del desarrollo móvil, el repositorio incluye una base de conocimientos de ciencias de la computación para la preparación de entrevistas técnicas, cubriendo estructuras de datos, algoritmos y conceptos de sistemas operativos. También cuenta con una referencia práctica para el control de versiones de Git, detallando la gestión de repositorios, sincronización y flujos de trabajo de ramificación.

    Reduces data copying overhead during cross-process communication by mapping memory between kernel and user spaces.

    Ver en GitHub↗13,145
  • tencent/xluaAvatar de Tencent

    Tencent/xLua

    10,101Ver en GitHub↗

    xLua is a scripting bridge and C++ wrapper used to embed the Lua language into host applications. It facilitates bidirectional data exchange and function calls between scripts and the host environment. The project includes a runtime patching tool for replacing application logic and fixing bugs without requiring a system restart. It features a coroutine orchestrator that wraps asynchronous operations into linear code and a script validator that verifies digital signatures to ensure code authenticity and integrity before execution. To minimize memory overhead and garbage collection, the system

    Passes complex data structures via raw memory pointers to avoid expensive object allocation and garbage collection overhead.

    Ccsharpluaunity
    Ver en GitHub↗10,101
  • morvanzhou/pytorch-tutorialAvatar de MorvanZhou

    MorvanZhou/PyTorch-Tutorial

    8,458Ver en GitHub↗

    This project is a collection of PyTorch learning resources and educational guides designed to teach the construction and training of neural networks. It serves as a comprehensive deep learning tutorial covering various model architectures and practical implementation strategies. The resources provide specific guidance on implementing computer vision tasks, such as image classification and synthetic imagery generation, as well as reinforcement learning agents using value networks and experience replay. It also covers sequential data modeling through recurrent networks and generative modeling u

    Provides utilities for transferring tensors between GPU and CPU memory to enable operations not supported on graphics hardware.

    Jupyter Notebookautoencoderbatchbatch-normalization
    Ver en GitHub↗8,458
  • jerryscript-project/jerryscriptAvatar de jerryscript-project

    jerryscript-project/jerryscript

    7,399Ver en GitHub↗

    JerryScript is a lightweight, ECMAScript-compliant JavaScript engine and bytecode compiler designed for resource-constrained devices. It serves as an embedded interpreter and IoT scripting runtime, enabling the execution of JavaScript code within native C applications on hardware with limited memory. The project differentiates itself through a focus on low-memory runtime management, utilizing bytecode precompilation and pre-compiled state snapshots to reduce startup time and memory overhead. It features a C-binding native bridge for bidirectional communication between native code and scripts,

    Constructs JavaScript typed arrays directly from raw memory buffers using specific offsets and lengths.

    C
    Ver en GitHub↗7,399
  • bitwiseshiftleft/sjclAvatar de bitwiseshiftleft

    bitwiseshiftleft/sjcl

    7,208Ver en GitHub↗

    sjcl is a JavaScript cryptography library providing a collection of primitives for encryption, hashing, and encoding within a web browser. It functions as an AES symmetric encryption tool, a cryptographic hashing library, and a Base32 data encoder. The project provides implementations for the Advanced Encryption Standard to secure data through symmetric key encryption and decryption. It also enables the generation of fixed-length data fingerprints to verify information integrity and authenticity. The library covers a broader range of security capabilities, including client-side data hashing,

    Uses JavaScript typed arrays to manage raw bytes and binary buffers for efficient memory access.

    JavaScript
    Ver en GitHub↗7,208
  • dop251/gojaAvatar de dop251

    dop251/goja

    6,914Ver en GitHub↗

    Goja is a JavaScript engine and ECMAScript compliant interpreter implemented entirely in Go. It serves as an embedded scripting engine that allows Go applications to execute JavaScript code and integrate a programmable scripting layer without relying on Cgo or external native dependencies. The project functions as a bridge between Go and JavaScript, enabling bidirectional data exchange and function invocation. It allows Go hosts to expose native structs, slices, and maps as JavaScript objects and arrays, while providing mechanisms to export script values and functions back into native Go type

    Handles fixed-length binary data buffers and views using standardized integer array types.

    Go
    Ver en GitHub↗6,914
  • chyingp/nodejs-learning-guideAvatar de chyingp

    chyingp/nodejs-learning-guide

    6,874Ver en GitHub↗

    This project is a learning guide and collection of study notes designed to teach Node.js backend development. It provides a comprehensive core API reference and practical demonstrations for implementing server-side logic, network programming, and system APIs. The guide specifically covers advanced technical domains including process management for scaling applications via clusters and child processes, as well as network programming for building TCP, UDP, and HTTP services. It also includes detailed instructional material on security implementation, focusing on cryptographic hashing and encryp

    Implements raw byte handling using binary buffers for memory-efficient data manipulation.

    Rubycryptoexpressnodejs
    Ver en GitHub↗6,874
  • nvidia/isaac-gr00tAvatar de NVIDIA

    NVIDIA/Isaac-GR00T

    6,222Ver en GitHub↗

    Transfers decoded image data directly to CV-CUDA, PyTorch, or CuPy without copying through host memory.

    Jupyter Notebook
    Ver en GitHub↗6,222
  • nodeca/pakoAvatar de nodeca

    nodeca/pako

    6,081Ver en GitHub↗

    Pako is a pure JavaScript compression library that ports the C zlib library to JavaScript, providing deflate and gzip compression and decompression capabilities. It runs in both browser and Node.js environments by using typed arrays and universal JavaScript, avoiding platform-specific APIs for cross-platform compatibility. The library handles data through bitwise operations for Huffman coding and LZ77 matching, and automatically encodes string inputs to UTF-8 before compression while decoding them back on decompression. It supports streaming chunk-based processing, allowing incremental data h

    Uses Uint8Array for raw binary data input and output, avoiding string conversions for performance.

    JavaScript
    Ver en GitHub↗6,081
  • mscdex/ssh2Avatar de mscdex

    mscdex/ssh2

    5,790Ver en GitHub↗

    ssh2 is a JavaScript implementation of the SSH2 protocol for Node.js, providing the core components necessary to create secure clients and servers. It enables the establishment of authenticated sessions for remote server automation and secure communication. The project distinguishes itself by providing a complete suite of tools for identity management, including utilities for generating and parsing cryptographic key pairs and integrating with external authentication agents. It also functions as a tunneling proxy capable of routing TCP, HTTP, X11, and SOCKSv5 network traffic through encrypted

    Implements low-level binary parsing using buffers to handle the SSH protocol's packet structures.

    JavaScript
    Ver en GitHub↗5,790
  • toji/gl-matrixAvatar de toji

    toji/gl-matrix

    5,654Ver en GitHub↗

    gl-matrix is a high-performance JavaScript library for vector and matrix math, purpose-built for real-time 3D graphics and physics simulations. It stores all vectors and matrices as typed arrays (Float32Array or Float64Array) in column-major order, matching the memory layout expected by OpenGL and WebGL shaders without requiring transposition. The library is implemented from scratch with zero external dependencies, keeping its bundle size minimal for web and Node.js environments. The library distinguishes itself through its immutable operation pattern, where each math function returns a new t

    Computes vector and matrix operations with typed arrays for high-performance 3D graphics and physics calculations.

    JavaScript
    Ver en GitHub↗5,654
  • liuwons/wxbotAvatar de liuwons

    liuwons/wxBot

    5,317Ver en GitHub↗

    wxBot es un framework y kit de herramientas para la automatización de mensajería en WeChat. Proporciona una interfaz programática para enviar y recibir mensajes, permitiendo la creación y despliegue de chatbots automatizados y bots de redes sociales dentro de la plataforma WeChat. El sistema integra servicios y scripts externos para automatizar flujos de trabajo basados en chat y comunicaciones de usuario. Permite la operación programática de bots para manejar conversaciones y notificaciones automáticamente.

    Implements binary packet parsing to decode structured data from the WeChat network buffer.

    Python
    Ver en GitHub↗5,317
  • microsoft/synapsemlAvatar de microsoft

    microsoft/SynapseML

    5,230Ver en GitHub↗

    SynapseML es una biblioteca de machine learning de Apache Spark diseñada para construir y escalar flujos de trabajo de machine learning y pipelines de datos a través de clústeres distribuidos. Sirve como framework de pipeline de machine learning distribuido y motor de inferencia distribuido para ejecutar predicciones aceleradas por hardware y tareas de deep learning en conjuntos de datos a gran escala. El proyecto funciona como una capa de integración de IA en la nube, permitiendo a los usuarios aplicar servicios de inteligencia artificial preentrenados para texto, visión y voz dentro de pipelines distribuidos. También incluye un conjunto dedicado de herramientas para la detección de anomalías distribuida para identificar valores atípicos multivariados y de series temporales en datos de alta dimensión. La biblioteca cubre una amplia gama de capacidades, incluyendo visión artificial distribuida para análisis de rostros e imágenes, procesamiento de lenguaje natural escalable para análisis de texto y traducción, y el entrenamiento de árboles de decisión potenciados por gradiente (gradient boosted decision trees). Proporciona herramientas para búsqueda de similitud mediante modelado de k-vecinos más cercanos, explicabilidad de modelos mediante atribución de características y la orquestación de flujos de trabajo de aprendizaje por refuerzo. El sistema utiliza una arquitectura de pipeline componible y admite la inferencia de modelos basada en ONNX para compatibilidad multiplataforma.

    Optimizes data movement and memory usage between distributed partitions and native datasets using direct memory transfer.

    Scalaaiapache-sparkazure
    Ver en GitHub↗5,230
  • exif-js/exif-jsAvatar de exif-js

    exif-js/exif-js

    4,979Ver en GitHub↗

    exif-js es una librería de JavaScript para extraer metadatos de imágenes directamente en el navegador. Funciona como un analizador de búfer de imagen binario que lee bytes de imagen sin procesar para recuperar detalles técnicos sin necesidad de que los archivos se carguen en un servidor. La librería analiza datos siguiendo los estándares EXIF e IPTC para extraer configuraciones de cámara, marcas de tiempo, coordenadas GPS, leyendas, palabras clave e información de derechos de autor. Utiliza matrices tipadas y recorrido basado en desplazamiento para navegar por las estructuras de imagen y mapear identificadores numéricos a etiquetas legibles por humanos.

    Uses typed arrays to interpret sequences of binary data for metadata extraction.

    JavaScript
    Ver en GitHub↗4,979
  • tingsongyu/pytorch-tutorial-2ndAvatar de TingsongYu

    TingsongYu/PyTorch-Tutorial-2nd

    4,555Ver en GitHub↗

    Este proyecto es un recurso educativo integral y un curso para construir redes neuronales usando PyTorch. Cubre los bloques de construcción fundamentales del deep learning, incluyendo la manipulación de tensores, la diferenciación automática y la construcción de componentes modulares de redes neuronales. El repositorio sirve como guía técnica para varios dominios especializados. Proporciona detalles de implementación para tareas de visión artificial como clasificación de imágenes, detección de objetos y segmentación semántica, así como flujos de trabajo de procesamiento de lenguaje natural que involucran transformers, redes recurrentes y modelos generativos. Además, incluye una referencia para IA generativa, centrándose específicamente en la síntesis de imágenes mediante modelos de difusión y redes adversarias. El material se extiende a pipelines de optimización y despliegue de modelos. Cubre técnicas para reducir el tamaño del modelo y aumentar la velocidad de inferencia mediante cuantización y la exportación de modelos a formatos como ONNX y TensorRT. Otras áreas de capacidad incluyen ingeniería de datos para carga paralela, evaluación de modelos mediante métricas personalizadas y el despliegue de modelos de lenguaje grandes (LLM) de código abierto. El proyecto se entrega principalmente como una serie de Jupyter Notebooks.

    Pins tensors in memory to prevent disk swapping and accelerate data transfer from CPU to GPU.

    Jupyter Notebookcomputer-visiondeepsortdiffusion-models
    Ver en GitHub↗4,555
Ant.12Siguiente
  1. Home
  2. Data & Databases
  3. Shared Memory Data Exchange
  4. Direct Memory Data Transfer

Explorar subetiquetas

  • GPU Memory Transfers for Deep LearningTransfers decoded image data directly to CV-CUDA, PyTorch, or CuPy without copying through host memory. **Distinct from Direct Memory Data Transfer:** Distinct from Direct Memory Data Transfer: specifically targets GPU memory transfers for deep learning frameworks, not general Java-to-native array exchange.
  • Memory Exchange MappingsConfigures workloads to utilize specific memory exchange channels by mapping device nodes directly into container namespaces. **Distinct from Direct Memory Data Transfer:** Distinct from Direct Memory Data Transfer: focuses on the mapping of device nodes for memory exchange rather than the transfer mechanism itself.
  • Typed-Array Buffers2 sub-etiquetasStructured memory buffers used for efficient data transfer between system memory and graphics hardware. **Distinct from Direct Memory Data Transfer:** Distinct from Direct Memory Data Transfer: focuses on typed-array structures for GPU memory management rather than general Java-to-native transfer.