wader/fq

Features

• Binary Data Analysis - Parses raw bytes and bit-streams into structured, queryable formats to inspect file layouts and extract data fields.
• Functional - Implements a declarative, functional language designed for filtering, mapping, and transforming nested binary structures.
• Binary Data Querying - Provides a functional query language to extract, transform, and navigate complex decoded binary structures.
• Binary Tree Filtering - Allows selecting specific nodes or values within a decoded binary tree based on custom filter conditions.
• Binary Tree Searchers - Ships a search utility to locate specific values and regex patterns across decoded binary trees.
• Bit-Level Decoders - Transforms binary data into a slice of indexable individual bits for granular low-level analysis.
• Byte-Level Decoders - Converts binary data into a slice of indexable raw bytes for low-level file inspection.
• Binary-to-JSON Converters - Translates decoded binary structures into standard JSON formats for external integration.
• Hierarchical Binary Decoding - Parses raw byte streams into hierarchical, indexable objects that mirror the internal structure of complex binary formats.
• Lazy Query Pipelines - Transforms binary inputs through a pipeline of filters and decoders that process data only as required by the query.
• Binary Data Slicing - Isolates specific byte or bit ranges from a file or decoded field and exports them as raw binary.
• Binary to JSON Transcoders - Converts decoded binary structures into human-readable JSON objects and arrays for developer inspection.
• Command-Line Data Processors - Functions as a command-line tool for decoding, transforming and analyzing raw byte streams into structured formats.
• Data Transformation Pipelines - Processes binary inputs through a configurable pipeline of decoders, filters, and encoding converters.
• Binary Format Decoders - Converts raw bytes into structured data using built-in decoders or manual specifications.
• Nested Format Decoders - Supports parsing complex binary structures where one format is embedded within another.
• Pluggable Decoder Registries - Implements a pluggable architecture where format-specific parsing logic is dynamically loaded.
• Bit-Level Binary Parsers - Provides low-level bit-level slicing, bitwise operations and cryptographic hashing on raw binary files.
• Bit-Level Slicing - Provides granular access to data through precise extraction of arbitrary bit ranges within binary blobs.
• Custom Binary Decoders - Allows users to define custom decoding logic to parse proprietary binary formats into hierarchical structures.
• Binary Blob Manipulations - Implements low-level utilities for slicing, concatenating, and modifying raw binary blobs.
• Custom Decoder Specifications - Allows users to specify custom logic and schemas for parsing proprietary binary formats.
• Bitwise Manipulation - Performs low-level bitwise logic operations including AND, OR, XOR, and shifts for raw data manipulation.
• Structured Querying - Implements a declarative, functional query system for filtering and mapping decoded hierarchical binary structures.
• Binary-to-Text Serialization - Implements bidirectional translation between raw binary blobs and structured text formats like JSON and YAML.
• Binary Structure Visualizations - Displays decoded values as trees including byte offsets, hex representations, and bit-range details.
• Data Format Translators - Translates structured data between binary, text-based serialization formats, and various number bases.
• Binary Encodings - Renders binary data into visual representations such as hex strings and base64.
• Format Metadata Inspection - Decodes and displays the internal structure of media, network, and serialization formats through tree-based visualization.
• Binary Protocol Diagnostics - Ships introspection and diagnostic tools used to analyze complex binary protocols and identify data issues.
• Binary Stream Transformers - Provides CLI capabilities to modify, slice, and concatenate binary streams or convert data representations.
• Interactive REPLs - Includes an interactive shell with auto-completion for testing queries in real-time.
• Binary Format Plugins - Provides a system of interchangeable decoder plugins for specific binary formats like ASN1, Mach-O, and Avro OCF.
• Network Traffic Analyzers - Reassembles fragmented TCP streams and decrypts TLS traffic for application-level communication inspection.
• TCP Stream Reassembly - Reconstructs fragmented network packets into contiguous data streams by tracking sequence numbers and session metadata.
• Binary File Comparisons - Provides a tool for calculating differences between two binary inputs after applying filters to isolate specific fields.
• Structured Text Decoders - Parses structured text formats like XML, HTML, TOML, YAML, and CSV into queryable structures.
• Bitwise Logic Operations - Performs bit-level slicing and bitwise logic operations to modify or analyze raw binary data at the byte level.
• Encrypted Traffic Decoders - Decodes and decrypts TLS records using keylog files to inspect encrypted network communications.
• Network Traffic Analysis - Reassembles fragmented TCP streams and decrypts TLS traffic to inspect application-level communication protocols.
• Binary Analysis - Inspects and decodes binary data formats.
• Command Line Tools - Tool for processing binary formats using jq.
• More to explore - Binary data processing tool.

Star history