7 repository-uri
Sequential processing of text data to minimize memory consumption by avoiding loading entire files.
Distinct from Event-Based Stream Processing: The candidates provided are for event-based data streams, remote process stdin, or VCS commits, not general sequential text highlighting.
Explore 7 awesome GitHub repositories matching software engineering & architecture · Stream-Based Text Processing. Refine with filters or upvote what's useful.
PHP-Console-Highlighter este un evidențiator de sintaxă și un formator de cod pentru consolă conceput pentru a aplica codificarea prin culori codului sursă PHP pentru afișarea în medii de terminal. Funcționează ca un utilitar pentru a transforma textul PHP simplu în cod vizual structurat pentru interfețe de linie de comandă. Instrumentul permite revizuirea codului bazată pe terminal și oferă ieșire formatată pentru instrumentele de analiză statică PHP și aplicațiile de linie de comandă. Utilizează tokenizarea bazată pe regex și maparea culorilor secvențelor ANSI pentru a traduce token-urile de sintaxă în text colorat.
Processes input strings sequentially to apply highlighting without loading the entire file into memory.
Spark is a suite of command line utilities designed to render numeric data sets as compact visual graphs using Unicode characters. It functions as a terminal data visualizer and charting tool that converts sequences of numbers into visual trend lines within a shell environment. The tool generates sparkline graphs by mapping numeric value ranges to specific Unicode block characters. It utilizes linear value scaling to normalize input numbers to fit within available character heights and processes data sequentially from the standard input stream to produce real-time visual output. These capabi
Processes numeric input sequentially from the standard input stream to minimize memory consumption.
htmlparser2 is a collection of tools for high-performance markup parsing, DOM manipulation, and incremental stream processing. It functions as an HTML and XML parser that converts markup strings into structured object trees, alongside a streaming markup parser designed for memory-efficient processing of large documents. The project includes a DOM manipulation library for querying, modifying, and serializing document object model trees. It also provides a web feed parser to extract structured metadata and entries from RSS, RDF, and Atom feeds. The library covers broad capabilities in data par
Consumes markup data incrementally through a writable interface to process large documents without full memory loading.
JSON-java is a Java library for parsing and generating JSON text and mapping it to Java objects and collections. It functions as a serialization framework for converting class instances and data structures into standardized JSON strings. The project includes a JSON pointer implementation for retrieving specific values from documents using string or URI fragment representations. It also provides a converter for translating data structures between JSON and XML, as well as a translator for transforming data between JSON and web formats such as HTTP headers, cookies, and comma-delimited lists. T
Processes large JSON documents using input and output streams to minimize memory usage.
This project is a collection of Go libraries designed to reduce the size of multiple web formats while preserving functional integrity. It serves as a high-performance text processor and multi-format asset compressor for shrinking HTML, CSS, JavaScript, JSON, SVG, and XML files by removing redundant characters. The tool is designed for both static batch processing and real-time use. It includes middleware capabilities to intercept and minify web responses on the fly based on MIME types or file extensions, allowing for content compression during active data streams. The processing suite cover
Implements stream-based text processing using reader and writer interfaces to maintain a low memory footprint for large assets.
Flex is a scanner generator and lexical analyzer generator that transforms regular expression definitions into software capable of converting input text into tokens. It primarily generates C and C++ source code for use in the development of compilers and interpreters. The tool provides a specific generator for producing object-oriented scanner implementations as classes, allowing lexical analysis tools to integrate directly into C++ software projects. It also includes a cross-compilation toolchain to build scanner implementations for target platforms different from the host machine. The proj
Implements memory chunking to minimize system calls while processing input text streams.
TinyOBJLoader is a single-header C++ library designed for parsing Wavefront OBJ files. It functions as a stream-based text parser that extracts vertex, normal, and texture data into structured arrays for use in graphics and physics engines. The project distinguishes itself as a high-performance geometry loader that utilizes multi-threading to distribute the processing of large-scale 3D environments across multiple CPU cores. It includes a mesh triangulator that converts complex polygons into triangles to ensure compatibility with standard graphics hardware. The library supports a variety of
Reads raw text input sequentially to minimize memory overhead when converting files into structured vertex arrays.