10 रिपॉजिटरी
Systems optimized for processing massive volumes of text with predictable memory and time complexity.
Distinct from Text Processing: Candidates focus on audio, collections, or AI inference; this is general-purpose high-performance text processing via regex.
Explore 10 awesome GitHub repositories matching data & databases · High-Performance Text Processing. Refine with filters or upvote what's useful.
cppformat is a type-safe C++ formatting library that serves as a high-performance alternative to standard C++ input and output streams for converting data into formatted strings. It integrates a compile-time format validator to ensure format specifiers match argument types, preventing runtime crashes. The library includes a positional argument engine that enables the reordering of text arguments for internationalization and localization. It also features a Unicode text formatter to ensure consistent and portable character representation across different operating systems. The project provide
Provides a high-performance alternative to standard C++ I/O streams for converting data into strings.
Xi Editor is a high-performance text editor core written in Rust. It employs a decoupled architecture that separates core logic from the presentation layer using a JSON-based client-server protocol. The project features a language-agnostic plugin system that communicates with external extensions via JSON messages over pipes. It manages text buffers using a persistent rope data structure to enable efficient editing of very large files. The system supports asynchronous editor workflows by running expensive operations in background threads using data snapshots. This prevents background processi
Ensures high-performance editing of very large files with low latency using a rope data structure.
re2 is a C++ regular expression library designed for high-performance text processing. It is a non-backtracking regex engine that provides linear-time pattern matching, ensuring that execution time remains proportional to the size of the input string regardless of the pattern used. The library supports UTF-8 and Latin-1 text encodings for searching and extracting substrings. It includes capabilities for multi-pattern optimization, allowing multiple regular expressions to be combined into a single representation to scan text for several patterns in one pass. The project covers core regex oper
Ensures predictable execution time and memory usage when processing large volumes of text with regular expressions.
Bloop is an AI code analysis tool and semantic search engine designed for understanding and querying large-scale codebases. It utilizes a high-performance indexing system written in Rust to enable fast symbol and text retrieval across multiple programming languages. The project differentiates itself by using on-device embeddings for semantic code search, allowing users to locate logic based on meaning and intent rather than exact keywords. It combines a language model with a retrieval-augmented generation approach to provide a natural language interface for conversational querying and the gen
Employs high-performance regular expression processing to rapidly filter and isolate specific text segments across large volumes of source code.
Oni2 is a high-performance, extensible text editor and project-based file manager. It functions as a modal code editor, utilizing a keyboard grammar of verbs and motions to navigate and modify source code without a mouse. It also serves as an LSP client, integrating Language Server Protocol servers to provide code completion, symbol navigation, and refactoring. The editor distinguishes itself by acting as a VSCode extension host, allowing it to load and execute language servers and debuggers from the VSCode ecosystem. It provides a programmable environment where custom functionality is implem
Utilizes a high-performance environment optimized for the speed and efficiency of writing and modifying text files.
यह प्रोजेक्ट एक pandas डेटा विश्लेषण कुकबुक और Python डेटा साइंस गाइड है। यह संरचित डेटा को साफ करने, हेरफेर करने और विश्लेषण करने के लिए प्रोग्रामेटिक व्यंजनों और उदाहरणों का एक संग्रह प्रदान करता है। यह प्रोजेक्ट डेटा प्रोसेसिंग स्क्रिप्ट निष्पादित करते समय एक सुसंगत कार्यक्षेत्र और पुनरुत्पादनीय निर्भरता सुनिश्चित करने के लिए एक कंटेनरीकृत विश्लेषण वातावरण प्रदान करने पर केंद्रित है। यह डेटा साइंस क्षमताओं की एक विस्तृत श्रृंखला को कवर करता है, जिसमें बाहरी स्रोतों से डेटा इंजेक्शन, रॉ डेटा क्लीनिंग और खोजपूर्ण डेटा विश्लेषण शामिल है। ये व्यंजन प्रदर्शित करते हैं कि फ़िल्टरिंग, समूहीकृत डेटा को एग्रीगेट करने और टेक्स्ट डेटा को प्रोसेस करने जैसी तकनीकों के माध्यम से संरचित डेटा विश्लेषण कैसे किया जाए।
Performs high-performance string operations to transform text data for analysis.
Lark एक Python पार्सिंग टूलकिट है जिसका उपयोग ग्रामर को परिभाषित करने और रॉ टेक्स्ट को एनोटेटेड पार्स ट्रीज़ में बदलने के लिए किया जाता है। यह एक एब्सट्रैक्ट सिंटैक्स ट्री जनरेटर और ग्रामर डेफिनेशन भाषा के रूप में कार्य करता है, जो टर्मिनल्स और रेगुलर एक्सप्रेशंस के माध्यम से भाषा के नियमों को निर्दिष्ट करता है। यह लाइब्रेरी दो प्राथमिक पार्सिंग इम्प्लीमेंटेशन प्रदान करती है: एक Earley पार्सिंग लाइब्रेरी जो एम्बिग्युटी और लेफ्ट-रिकर्शन सहित सभी कॉन्टेक्स्ट-फ्री भाषाओं को संभालने में सक्षम है, और एक हाई-परफॉरमेंस LALR पार्सिंग लाइब्रेरी जिसे कम मेमोरी ओवरहेड वाली डिटरमिनिस्टिक भाषाओं के लिए डिज़ाइन किया गया है।
Uses LALR algorithms to process large volumes of text with high efficiency and low memory usage.
This is a collection of classical algorithms and data structures implemented as a header-only C++ library. It provides a suite of tools for general algorithm implementation, including data structure management, graph theory analysis, and string processing. The library is distinguished by its specialized toolkits for cryptographic hashing and encoding, featuring implementations of MD5, SHA-1, and Base64. It also includes advanced capabilities for high-performance string processing via suffix trees and arrays, as well as computational number theory for primality testing and arbitrary-precision
Uses suffix trees and arrays for high-performance pattern matching and text analysis.
Chumsky is a parser combinator library used to build high-performance parsers by composing small parsing functions into complex grammars. It provides multiple parsing engines, including recursive descent and precedence-climbing implementations for resolving the order of operations in mathematical and logical expressions. The library is distinguished by its zero-copy text parsing, which minimizes memory allocations to increase throughput, and its ability to run without a standard library for use in embedded or resource-constrained environments. It also features an error-recovering parser that
Enables high-performance text processing optimized for low memory and high throughput in resource-constrained environments.
This is a Rust regular expression library that provides a finite automata engine for searching and matching text patterns. It functions as a Unicode-compliant text scanner designed to guarantee linear time execution on all inputs to prevent catastrophic backtracking. The engine supports both single and multi-pattern search capabilities, allowing it to scan a piece of text for multiple regular expressions simultaneously. It operates on both strings and raw byte slices to identify matching text segments. The library covers text parsing, string validation, and pattern searching. It includes cap
Provides high-performance text extraction with guaranteed linear time complexity to prevent performance crashes.