36 repositorios
Utilities for transforming, parsing, and managing structured data, text formats, and binary objects.
Explore 36 awesome GitHub repositories matching programming languages & runtimes · Data & Text Processing. Refine with filters or upvote what's useful.
Este proyecto es un directorio integral curado por la comunidad que organiza un vasto panorama de bibliotecas, frameworks y herramientas de software de Python. Sirve como una base de conocimientos centralizada diseñada para facilitar la navegación del ecosistema y acelerar el descubrimiento de desarrolladores en todo el ciclo de vida del desarrollo de software. El directorio se distingue por proporcionar un índice estructurado de recursos categorizados por dominio técnico, que van desde utilidades de desarrollo fundamentales hasta campos de ingeniería especializados. Cubre capacidades de alto nivel que incluyen inteligencia artificial, ciencia de datos, desarrollo web y gestión de infraestructura, lo que permite a los desarrolladores identificar soluciones verificadas para desafíos técnicos específicos. El proyecto abarca una amplia superficie de capacidades, incluyendo herramientas para la gestión de dependencias, análisis de código estático y pruebas automatizadas. También cataloga recursos para el almacenamiento de datos persistentes, orquestación de infraestructura en la nube y desarrollo de interfaces, proporcionando una referencia unificada para construir y mantener sistemas de software complejos.
Merge raw data with predefined structures to produce formatted text or document outputs.
Vue es un framework de JavaScript progresivo basado en componentes diseñado para construir interfaces de usuario reactivas y aplicaciones de una sola página. Se centra en un sistema de plantillas declarativo que transforma HTML en funciones de renderizado eficientes, permitiendo a los desarrolladores organizar interfaces complejas en unidades aisladas y reutilizables que se sincronizan automáticamente con el estado de la aplicación. El framework se distingue por un sistema de reactividad de seguimiento de dependencias que monitorea el acceso a los datos durante el renderizado para activar actualizaciones precisas. Proporciona una arquitectura flexible que admite tanto la adopción incremental como una biblioteca ligera como el desarrollo de aplicaciones a gran escala. Los desarrolladores pueden aprovechar un modelo de extensibilidad basado en plugins robusto para inyectar lógica global, mientras que la reconciliación del DOM virtual del framework asegura actualizaciones de interfaz eficientes calculando mutaciones mínimas. Más allá de sus capacidades de renderizado principales, el proyecto incluye un conjunto completo de herramientas para gestionar el estado de la aplicación, enrutamiento basado en URL y renderizado del lado del servidor. Ofrece un amplio soporte para la composición de componentes, distribución de contenido y gestión de animaciones, junto con medidas de seguridad integradas como el escape automático de contenido para prevenir vulnerabilidades comunes. El framework se distribuye con declaraciones de tipo oficiales para admitir el análisis estático y puede instalarse a través de gestores de paquetes estándar o integrarse directamente en entornos de navegador a través de etiquetas de script.
Uses inner content of component elements as templates instead of treating it as distributed content.
This project serves as a comprehensive language ecosystem index, functioning as a centralized, community-curated directory for the Go programming language. It organizes a vast landscape of software components, libraries, and development tools into a structured, navigable hierarchy, enabling developers to efficiently discover resources tailored to specific functional domains. The repository distinguishes itself through a decentralized contribution model, where community-driven updates ensure the index remains current with the rapidly evolving software landscape. Beyond simple resource listing,
Parses templates to merge data with structures for automated document generation.
Angular is a platform for building web applications using a component-based architecture. It provides a comprehensive suite of tools for managing encapsulated UI units, including hierarchical dependency injection, a declarative template system, and fine-grained reactivity through signals. The framework supports complex application requirements such as client-side routing, form management, and internationalization. The project includes a command-line interface for scaffolding and build automation, alongside a testing ecosystem for unit and integration verification. It offers multiple rendering
Connects template expressions directly to native DOM events via a declarative syntax.
Bun is a high-performance runtime environment designed to execute JavaScript and TypeScript applications with minimal latency and high throughput. Built on a native core implemented in Zig, it provides a unified execution engine that leverages JavaScriptCore for efficient memory management and low-latency startup. The project functions as an all-in-one toolchain, integrating a native bundler, transpiler, package manager, and test runner into a single command-line interface. What distinguishes Bun is its focus on native system integration and developer productivity. It features a high-performa
Constructs blob objects from various data sources including strings and binary chunks to facilitate standardized web-based data handling.
Hugo is a high-performance static site generator that transforms source content and templates into optimized web assets. Built with a focus on speed and scalability, it provides a comprehensive framework for managing large-scale documentation and editorial projects through structured content organization, taxonomies, and a flexible template-driven rendering engine. The project distinguishes itself through a sophisticated build system that utilizes incremental caching to minimize redundant processing during site updates. It supports complex content requirements by enabling multidimensional mod
Converts source content and template files into high-performance, production-ready static HTML.
Django is a full-stack web framework designed for rapid backend development. It provides an integrated environment for building data-driven applications by combining an object-relational mapping layer for database management with a modular request-response pipeline for handling HTTP traffic. The framework emphasizes security and maintainability, offering a suite of tools to protect against common web vulnerabilities while decoupling site structure from implementation through a centralized URL routing system. A defining characteristic of the framework is its ability to generate production-read
Separates presentation logic from code by parsing custom markup into dynamic HTML through a sandboxed rendering engine.
This project is a curated directory of software repositories specifically selected to help newcomers make their first open-source contributions. It serves as a collaborative knowledge base that aggregates entry-level development opportunities, providing a structured path for novice developers to practice version control and engage with active software communities. The repository distinguishes itself through a community-driven model where project listings are populated and verified by external contributors. This distributed peer review process ensures the directory remains current, while the u
Utilities for transforming, parsing, and managing structured data, text formats, and binary objects.
Vite is a frontend build toolchain that provides a unified development and production pipeline for modern web applications. It functions as a modular, environment-agnostic build engine that leverages native ES modules to serve source code directly to the browser, eliminating the need for expensive bundling during the development phase. By maintaining an environment-aware module graph, it supports concurrent development across client, server, and custom runtime environments. The project distinguishes itself through a high-performance development server that utilizes a hot module replacement pr
Supports importing pre-compiled binary modules with initialization helpers for efficient WebAssembly delivery.
Tesseract is a neural network-based optical character recognition engine designed to convert scanned images and digital documents into machine-readable, searchable text. It functions as both a command-line utility for automating large-scale digitization workflows and a cross-platform library that can be embedded into desktop, mobile, or server-side applications. By utilizing long short-term memory networks, the engine provides robust text extraction across more than one hundred languages and dozens of scripts. The project distinguishes itself through a sophisticated document layout analysis f
Adjust recognition accuracy for domain-specific terminology by utilizing user-defined word lists and custom patterns.
HanLP is a natural language processing library and deep learning framework specifically optimized for the Chinese language, while also functioning as a multilingual text processor. It serves as a toolkit for performing linguistic analysis, semantic understanding, and script conversion. The project distinguishes itself through a dedicated focus on Chinese linguistic structures, including a specialized script converter for transforming text between Simplified Chinese, Traditional Chinese, and Pinyin. It further supports domain-specific model training to improve the recognition of professional t
Allows defining custom word lists to force, merge, or correct how text is split into tokens.
This project is a Chinese text segmentation library and tokenizer designed to split Chinese sentences into individual words. It serves as a natural language processing tool for splitting characters into words, tagging parts of speech, and extracting keywords using statistical analysis. The library distinguishes itself through support for custom dictionary configuration and vocabulary file management, allowing users to override default segmentation rules for domain-specific accuracy. It also includes a TF-IDF keyword extractor to identify significant words and core topics within documents. Th
Supports specifying custom dictionary files to improve word identification and segmentation accuracy.
Fairseq is a PyTorch toolkit for sequence-to-sequence modeling, specializing in neural machine translation, automatic speech recognition, and large-scale language model training. It provides a framework for processing and aligning diverse data sources, including text, audio, and video, to support tasks such as speech-to-text conversion and multimodal sequence learning. The project is distinguished by its distributed training capabilities, which utilize parameter sharding, mixed-precision training, and CPU offloading to handle models that exceed single-device memory. It also includes specializ
Binarizes raw text datasets into a format optimized for efficient loading during model training and evaluation.
Fasthttp is a high-performance networking framework for Go, designed to maximize throughput and minimize memory overhead in demanding web applications. It functions as a specialized HTTP server and client library that prioritizes efficient resource management, allowing developers to build scalable services capable of handling massive concurrent traffic with minimal garbage collection pressure. The library distinguishes itself through a focus on zero-allocation processing and low-level optimization. It achieves this by recycling temporary request and response objects through managed pools and
Loads and parses template definitions from local files to facilitate structural reuse.
FileSaver.js is a client-side utility library designed to trigger browser download prompts for files generated within a web application or retrieved from remote web addresses. It enables the export of data directly to a user's local device, eliminating the need for server-side processing or backend infrastructure to handle file creation and storage. The library functions as a wrapper for the browser Blob API, simplifying the process of encapsulating binary data and mapping it to temporary object URLs. By programmatically managing anchor elements and their download attributes, it simulates use
A tool that simplifies the creation and downloading of files from Blob objects across all modern web browsers.
This project is a development framework that enables the creation of cross-platform mobile mini programs using the component-based architecture and reactive data binding of Vue.js. It functions as a build system that transforms web-oriented component code into native-compatible templates and logic, allowing developers to build modular user interfaces that run within restricted mobile environments. The framework distinguishes itself through a sophisticated build pipeline that deconstructs single-file components into platform-specific templates, logic, and style files. It employs compile-time t
Maps component data and event handlers to native templates to keep the UI synchronized.
Analysis-ik is a Chinese text segmenter and analysis plugin for Lucene-based search engines. It provides a specialized analyzer for splitting Chinese sentences into meaningful words to improve indexing and search accuracy within Elasticsearch and OpenSearch. The project features a dynamic dictionary manager that can load word libraries and stop-word files from remote HTTP endpoints. It monitors metadata headers on these remote files to trigger automatic vocabulary updates without requiring a service restart. The analyzer supports both fine-grained exhaustive and coarse-grained smart segmenta
Allows defining user-provided word lists and stop-word files to override default segmentation behavior.
Tiktoken is a library for converting raw text into numerical sequences using byte pair encoding schemes. It functions as a toolkit for managing tokenization processes, enabling the transformation of text into the specific numerical formats required by language models. The library provides mechanisms for automated encoder selection, allowing users to retrieve the correct tokenization configuration based on specific model names. It also supports the definition and registration of custom tokenization schemes, which facilitates the use of specialized vocabularies or unique model architectures wit
Optimizes text processing tasks by converting large volumes of text into efficient encoded sequences.
This project is a comprehensive Python toolkit designed for natural language processing, research, and education. It functions as a linguistic data processor that provides a standardized framework for managing, cleaning, and analyzing large collections of annotated text corpora and lexical resources. The library distinguishes itself through its integration of both symbolic and statistical methods, allowing users to perform complex tasks ranging from rule-based grammar parsing to machine learning-driven classification. It offers a modular pipeline for text processing, enabling the transformati
Provides a modular pipeline for transforming raw, unstructured language data into structured formats through tokenization and normalization.
LanguageTool is a multilingual grammar and style checking engine designed to detect spelling, grammar, and writing errors across multiple languages. It provides automated proofreading capabilities that can be deployed as a self-hosted server or executed as a standalone local desktop application. The project distinguishes itself through a flexible rule development framework, allowing linguistic patterns to be defined via XML or implemented as custom Java classes. It utilizes n-gram frequency modeling for confused word detection and supports neural word embeddings to improve disambiguation betw
Supports the use of user-defined word lists to improve and refine spell-checking accuracy.