17 个仓库
Utilities for processing binary data and numeric types efficiently using specialized memory-managed lists.
Distinct from Type-Safe Data Handling: Distinct from general type-safe handling: focuses on high-performance memory management for binary and numeric data.
Explore 17 awesome GitHub repositories matching software engineering & architecture · Binary Data Processing. Refine with filters or upvote what's useful.
This project is a comprehensive technical reference and programming cheatsheet for the Python language. It serves as a curated catalog of language features, syntax patterns, and standard library functions designed to help developers identify and apply correct coding patterns. The documentation covers a broad range of functional areas, including language fundamentals such as object-oriented structuring, functional logic, and list comprehensions. It also provides guidance on utilizing the standard library for data analysis, file management, networking, and concurrent execution. The reference e
Covers the conversion of numerical sequences into byte objects for low-level binary communication.
This project is an educational repository and collection of algorithms implemented in C++. It provides a structured set of code examples covering mathematics, computer science, and physics for reference and learning. The collection includes implementations of data structures for managing hierarchical and linear data, such as binary search trees and AVL trees. It also features simulations of computer science concepts, including CPU scheduling and the resolution of combinatorial puzzles. The repository further covers cryptographic examples through the implementation of classic encryption and e
Provides utilities for processing binary data, including Hamming distance and set bit calculations.
This project is a comprehensive JavaScript programming tutorial and language reference. It serves as a web development education resource providing instruction on modern language fundamentals, object-oriented design, and advanced asynchronous programming patterns. The resource functions as both a frontend development guide and a technical reference. It covers core language features such as closures, prototypes, promises, and typed arrays, while providing practical lessons on managing browser data and handling network requests. The content spans several key capability areas, including browser
Explains how to handle raw binary buffers, files, and text encoding for non-textual data.
The Dart SDK is a comprehensive development kit for building cross-platform applications using a multi-paradigm programming language. It provides a unified toolchain that supports both just-in-time compilation for rapid development and ahead-of-time compilation for high-performance native machine code. The platform is built on a sound static type system and an isolate-based concurrency framework, which executes independent tasks in separate memory heaps to achieve parallelism without shared state contention. The SDK distinguishes itself through a versatile compilation pipeline that transforms
Processes binary data and numeric types efficiently using specialized lists designed for high-performance memory management.
This is an open-source educational website that translates and localizes MIT's Missing Semester course, teaching practical computing skills for computer science students. The curriculum covers developer tooling, shell scripting, version control, security fundamentals, and open-source collaboration, with a focus on core computing skills including data processing pipelines, workflow automation, secure remote access, shell productivity, Vim editing, and Git version control. The project distinguishes itself by teaching command-line mastery, shell scripting, and automation to boost daily developer
Teaches processing binary data streams using command-line tools like piping and compression.
LuaJIT 是一个高性能 Lua 语言实现和即时编译器。它作为一个嵌入式脚本引擎和动态二进制翻译器,在执行过程中将可移植字节码转换为原生机器码。 该项目专注于高性能脚本编写,通过将字节码翻译为特定架构的指令,实现接近编译后 C 代码的执行速度。它利用专为最小内存开销设计的轻量级运行时环境。 该系统支持通过位运算进行二进制数据处理,并通过集成 C 协程实现异步任务管理。它还提供了运行时代码生成和创建自定义机器码指令的功能。
Uses bitwise operations and low-level memory access to efficiently process binary formats.
Daft is a distributed dataframe library and multimodal data processor designed to handle large-scale structured and unstructured data. It functions as a vectorized execution engine that processes tables alongside images, audio, and video, utilizing a unified schema to manage diverse data types. The project distinguishes itself by combining distributed data engineering with large-scale AI inference. It provides an AI data pipeline for batch-optimizing model prompts and generating high-dimensional text embeddings, while utilizing zero-copy memory sharing to execute custom Python functions witho
Encodes, decodes, and compresses binary or string values using various codecs.
Racket 是一种通用的、多范式编程语言,属于 Lisp 家族,专为语言创建而设计。它作为一个语言工作台,通过灵活的宏和模块系统,为设计和实现自定义编程语言提供了一个平台。 该系统的特色在于提供了一套全面的语义工程套件,允许构建专门的语言子集和教育层。它包括用于自定义语言设计的工具,如词法分析器和解析器生成,以及在读取时定义模块扩展规则和动态语言选择的能力。 该项目提供了一个集成开发环境,内置编辑器、可视化调试器和软件包管理器。其功能范围扩展到涵盖 2D 图形渲染、二进制数据处理、SQL 和演绎数据库集成以及图形用户界面构建的通用标准库。 该环境支持将源代码编译为独立的二进制可执行文件以进行分发。
Provides capabilities for parsing and serializing complex binary formats and data structures using defined patterns.
这是一个跨平台移动文件系统 API,提供了一个用于直接读写设备文件系统的原生桥接。它作为一个存储管理库和原生资产访问层,允许应用程序与本地文件和系统级文档目录进行交互。 该库包括一个移动文件传输客户端,用于在远程服务器和本地设备存储之间下载和上传文件。这些传输支持进度追踪和分段数据传输。 广泛的能力涵盖了本地文件和目录管理,包括复制、移动和修改文件的能力。它提供用于检索绝对系统路径、检查文件元数据、计算数据完整性校验和以及查询可用设备存储容量的实用程序。该项目还支持从内部应用程序资源文件夹中检索和复制文件。
Provides utilities for calculating file checksums and processing binary data to ensure transfer integrity.
Wuffs is a toolset for generating memory-safe, sandboxed parsers and decoders from domain-specific language specifications. It functions as a compiler that transforms these specifications into executable code for C, Go, or Rust, specifically designed to decode untrusted file formats while preventing buffer and integer overflows. The project employs a sandboxed execution model that prohibits system calls and manual memory management to ensure computations are side-effect free. It utilizes a refined type system and compile-time constraint verification to enforce memory safety, alongside saturat
Processes byte arrays and slices using explicit endianness to validate file signatures safely.
Kaitai Struct 是一个声明式二进制规范框架,提供跨多种编程语言的自动化解析器和序列化器生成。它使用一种可移植的领域特定语言来描述二进制文件和网络数据包的布局,并将这些规范转换为用于读取和写入二进制数据的源代码。 该系统通过将单一结构定义翻译为包括 C++、C#、Go、Java、JavaScript、Python 和 Rust 在内的多种语言的原生源代码,实现了跨语言数据处理。这种方法允许在不同平台上实现相同的二进制数据规范,而无需手动重写解析逻辑。 该框架涵盖二进制数据建模和处理,包括管理用于偏移导航的读取指针以及应用解压和解密等数据转换的能力。它还提供格式规范调试工具,以验证二进制数据布局与其声明性描述之间的映射。
Processes byte arrays through XOR, rotation, and Zlib decompression to decode compressed or obfuscated content.
这是一个技术研究和分析指南,专注于 Node.js 的内部架构。它提供了对运行时的深入检查,重点关注引擎如何管理内存句柄、执行异步操作以及实现核心模块逻辑。 该指南专门分析了将原生 C++ 类和函数集成到 JavaScript 中的过程,并记录了 libuv 事件循环的行为。它包括通过识别 V8 编译器回退和分析执行以提高资源效率来优化性能的详细参考。 该材料涵盖了广泛的内部系统,包括用于 TCP 和 UDP 的底层网络编程、用于集群和子进程的进程管理,以及非阻塞 I/O 的机制。它还探讨了缓冲区、流和原生到脚本绑定层的源代码级实现。
Analyzes the handling of raw byte sequences for high-performance binary data processing.
该项目是一个全面的 JavaScript 编程教程和前端 Web 开发课程。它作为一个结构化的教育资源,用于学习 JavaScript 语言,涵盖从基础语法到高级异步模式和现代编程技术的各个方面。 该资源作为一个前端工程教科书和 CSS 布局指南,提供有关构建响应式用户界面的详细教学材料。它涵盖了自定义 Web 组件的设计,以及应用样式和定位以创建有效的前端界面。 该课程包含几个核心能力领域,包括文档对象模型(DOM)的操作、用于网络请求和二进制数据处理的 Web API 集成,以及本地浏览器数据存储的管理。它还提供有关变量作用域、函数上下文和正则表达式等语言基础的指导。 内容以基于 Markdown 的静态站点形式交付,其中结构化文件被转换为静态 HTML 页面。
Teaches how to process binary data and numeric types using buffers, blobs, and file readers.
Kùzu is an embedded property graph database engine designed for high-performance analytical queries and local data management. It operates as a library within the host application process, utilizing a columnar-based storage architecture and just-in-time query compilation to execute complex graph traversals and pattern matching efficiently. By mapping database files directly into system memory, it ensures data durability and high-speed access while maintaining ACID-compliant transactional integrity. The engine distinguishes itself by integrating vector similarity search and full-text search di
Enables conversion and manipulation of binary data directly within graph query expressions.
This project is a PHP library that serves as a configuration file processor, providing a bridge to translate human-readable YAML text into native PHP arrays and objects. It functions as both a parser for converting YAML content into application-ready data structures and a serializer for transforming PHP data back into formatted YAML strings. The library includes security protections designed to prevent memory exhaustion and stack overflow attacks when processing untrusted documents. It ensures structural integrity through syntax validation and provides a command-line utility to check files fo
Serves as a bridge that translates human-readable YAML files into application-ready PHP data structures.
msgspec is a high-performance data modeling, serialization, and schema validation toolkit for Python. It serves as a type-safe serialization framework that integrates schema enforcement and data parsing into a single pass, functioning as both a data serialization library and a schema validation system based on standard Python type annotations. The project distinguishes itself through high-performance structural primitives, including compilation-based routine generation and zero-copy buffer parsing. It optimizes memory usage via garbage collection-aware layouts and reduces processing overhead
Provides efficient binary serialization using MessagePack and zero-copy buffer parsing for high throughput.
Umbrella is a comprehensive ecosystem of TypeScript-based libraries and a mono-repository designed for UI rendering, mathematical frameworks, WebAssembly bridging, and functional data processing. It provides a suite of tools for managing reactive data streams, binary serialization, and specialized memory management. The project includes a reactive component model for generating HTML, SVG, and Canvas elements from nested data structures, as well as a system for integrating JavaScript and WebAssembly through generated bindings. It features a mathematical framework for linear algebra, tensor ope
Provides a toolkit for binary data processing and specialized memory-managed lists in TypeScript.