awesome-repositories.com
Blog
MCP
awesome-repositories.com

Descubre los mejores repositorios open-source con nuestra búsqueda potenciada por IA.

ExplorarBúsquedas curadasAlternativas open-sourceSoftware autohospedableBlogMapa del sitio
ProyectoServidor MCPAcerca deCómo clasificamosPrensa
Aviso legalPrivacidadTérminos
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

36 repositorios

Awesome GitHub RepositoriesData & Text Processing

Utilities for transforming, parsing, and managing structured data, text formats, and binary objects.

Explore 36 awesome GitHub repositories matching programming languages & runtimes · Data & Text Processing. Refine with filters or upvote what's useful.

Awesome Data & Text Processing GitHub Repositories

Encuentra los mejores repositorios con IA.Buscaremos los repositorios que mejor coincidan usando IA.
  • vinta/awesome-pythonAvatar de vinta

    vinta/awesome-python

    303,207Ver en GitHub↗

    Este proyecto es un directorio integral curado por la comunidad que organiza un vasto panorama de bibliotecas, frameworks y herramientas de software de Python. Sirve como una base de conocimientos centralizada diseñada para facilitar la navegación del ecosistema y acelerar el descubrimiento de desarrolladores en todo el ciclo de vida del desarrollo de software. El directorio se distingue por proporcionar un índice estructurado de recursos categorizados por dominio técnico, que van desde utilidades de desarrollo fundamentales hasta campos de ingeniería especializados. Cubre capacidades de alto nivel que incluyen inteligencia artificial, ciencia de datos, desarrollo web y gestión de infraestructura, lo que permite a los desarrolladores identificar soluciones verificadas para desafíos técnicos específicos. El proyecto abarca una amplia superficie de capacidades, incluyendo herramientas para la gestión de dependencias, análisis de código estático y pruebas automatizadas. También cataloga recursos para el almacenamiento de datos persistentes, orquestación de infraestructura en la nube y desarrollo de interfaces, proporcionando una referencia unificada para construir y mantener sistemas de software complejos.

    Merge raw data with predefined structures to produce formatted text or document outputs.

    Pythonawesomecollectionspython
    Ver en GitHub↗303,207
  • vuejs/vueAvatar de vuejs

    vuejs/vue

    209,900Ver en GitHub↗

    Vue es un framework de JavaScript progresivo basado en componentes diseñado para construir interfaces de usuario reactivas y aplicaciones de una sola página. Se centra en un sistema de plantillas declarativo que transforma HTML en funciones de renderizado eficientes, permitiendo a los desarrolladores organizar interfaces complejas en unidades aisladas y reutilizables que se sincronizan automáticamente con el estado de la aplicación. El framework se distingue por un sistema de reactividad de seguimiento de dependencias que monitorea el acceso a los datos durante el renderizado para activar actualizaciones precisas. Proporciona una arquitectura flexible que admite tanto la adopción incremental como una biblioteca ligera como el desarrollo de aplicaciones a gran escala. Los desarrolladores pueden aprovechar un modelo de extensibilidad basado en plugins robusto para inyectar lógica global, mientras que la reconciliación del DOM virtual del framework asegura actualizaciones de interfaz eficientes calculando mutaciones mínimas. Más allá de sus capacidades de renderizado principales, el proyecto incluye un conjunto completo de herramientas para gestionar el estado de la aplicación, enrutamiento basado en URL y renderizado del lado del servidor. Ofrece un amplio soporte para la composición de componentes, distribución de contenido y gestión de animaciones, junto con medidas de seguridad integradas como el escape automático de contenido para prevenir vulnerabilidades comunes. El framework se distribuye con declaraciones de tipo oficiales para admitir el análisis estático y puede instalarse a través de gestores de paquetes estándar o integrarse directamente en entornos de navegador a través de etiquetas de script.

    Uses inner content of component elements as templates instead of treating it as distributed content.

    TypeScriptframeworkfrontendjavascript
    Ver en GitHub↗209,900
  • avelino/awesome-goAvatar de avelino

    avelino/awesome-go

    175,576Ver en GitHub↗

    This project serves as a comprehensive language ecosystem index, functioning as a centralized, community-curated directory for the Go programming language. It organizes a vast landscape of software components, libraries, and development tools into a structured, navigable hierarchy, enabling developers to efficiently discover resources tailored to specific functional domains. The repository distinguishes itself through a decentralized contribution model, where community-driven updates ensure the index remains current with the rapidly evolving software landscape. Beyond simple resource listing,

    Parses templates to merge data with structures for automated document generation.

    Goawesomeawesome-listgo
    Ver en GitHub↗175,576
  • angular/angularAvatar de angular

    angular/angular

    100,360Ver en GitHub↗

    Angular is a platform for building web applications using a component-based architecture. It provides a comprehensive suite of tools for managing encapsulated UI units, including hierarchical dependency injection, a declarative template system, and fine-grained reactivity through signals. The framework supports complex application requirements such as client-side routing, form management, and internationalization. The project includes a command-line interface for scaffolding and build automation, alongside a testing ecosystem for unit and integration verification. It offers multiple rendering

    Connects template expressions directly to native DOM events via a declarative syntax.

    TypeScriptangularjavascriptpwa
    Ver en GitHub↗100,360
  • oven-sh/bunAvatar de oven-sh

    oven-sh/bun

    93,257Ver en GitHub↗

    Bun is a high-performance runtime environment designed to execute JavaScript and TypeScript applications with minimal latency and high throughput. Built on a native core implemented in Zig, it provides a unified execution engine that leverages JavaScriptCore for efficient memory management and low-latency startup. The project functions as an all-in-one toolchain, integrating a native bundler, transpiler, package manager, and test runner into a single command-line interface. What distinguishes Bun is its focus on native system integration and developer productivity. It features a high-performa

    Constructs blob objects from various data sources including strings and binary chunks to facilitate standardized web-based data handling.

    Rustbunbundlerjavascript
    Ver en GitHub↗93,257
  • gohugoio/hugoAvatar de gohugoio

    gohugoio/hugo

    88,701Ver en GitHub↗

    Hugo is a high-performance static site generator that transforms source content and templates into optimized web assets. Built with a focus on speed and scalability, it provides a comprehensive framework for managing large-scale documentation and editorial projects through structured content organization, taxonomies, and a flexible template-driven rendering engine. The project distinguishes itself through a sophisticated build system that utilizes incremental caching to minimize redundant processing during site updates. It supports complex content requirements by enabling multidimensional mod

    Converts source content and template files into high-performance, production-ready static HTML.

    Goblog-enginecmscontent-management-system
    Ver en GitHub↗88,701
  • django/djangoAvatar de django

    django/django

    87,878Ver en GitHub↗

    Django is a full-stack web framework designed for rapid backend development. It provides an integrated environment for building data-driven applications by combining an object-relational mapping layer for database management with a modular request-response pipeline for handling HTTP traffic. The framework emphasizes security and maintainability, offering a suite of tools to protect against common web vulnerabilities while decoupling site structure from implementation through a centralized URL routing system. A defining characteristic of the framework is its ability to generate production-read

    Separates presentation logic from code by parsing custom markup into dynamic HTML through a sandboxed rendering engine.

    Pythonappsdjangoframework
    Ver en GitHub↗87,878
  • mungell/awesome-for-beginnersAvatar de MunGell

    MunGell/awesome-for-beginners

    86,586Ver en GitHub↗

    This project is a curated directory of software repositories specifically selected to help newcomers make their first open-source contributions. It serves as a collaborative knowledge base that aggregates entry-level development opportunities, providing a structured path for novice developers to practice version control and engage with active software communities. The repository distinguishes itself through a community-driven model where project listings are populated and verified by external contributors. This distributed peer review process ensures the directory remains current, while the u

    Utilities for transforming, parsing, and managing structured data, text formats, and binary objects.

    awesomeawesome-listbeginner-project
    Ver en GitHub↗86,586
  • vitejs/viteAvatar de vitejs

    vitejs/vite

    81,611Ver en GitHub↗

    Vite is a frontend build toolchain that provides a unified development and production pipeline for modern web applications. It functions as a modular, environment-agnostic build engine that leverages native ES modules to serve source code directly to the browser, eliminating the need for expensive bundling during the development phase. By maintaining an environment-aware module graph, it supports concurrent development across client, server, and custom runtime environments. The project distinguishes itself through a high-performance development server that utilizes a hot module replacement pr

    Supports importing pre-compiled binary modules with initialization helpers for efficient WebAssembly delivery.

    TypeScriptbuild-tooldev-serverfrontend
    Ver en GitHub↗81,611
  • tesseract-ocr/tesseractAvatar de tesseract-ocr

    tesseract-ocr/tesseract

    74,751Ver en GitHub↗

    Tesseract is a neural network-based optical character recognition engine designed to convert scanned images and digital documents into machine-readable, searchable text. It functions as both a command-line utility for automating large-scale digitization workflows and a cross-platform library that can be embedded into desktop, mobile, or server-side applications. By utilizing long short-term memory networks, the engine provides robust text extraction across more than one hundred languages and dozens of scripts. The project distinguishes itself through a sophisticated document layout analysis f

    Adjust recognition accuracy for domain-specific terminology by utilizing user-defined word lists and custom patterns.

    C++hacktoberfestlstmmachine-learning
    Ver en GitHub↗74,751
  • hankcs/hanlpAvatar de hankcs

    hankcs/HanLP

    36,413Ver en GitHub↗

    HanLP is a natural language processing library and deep learning framework specifically optimized for the Chinese language, while also functioning as a multilingual text processor. It serves as a toolkit for performing linguistic analysis, semantic understanding, and script conversion. The project distinguishes itself through a dedicated focus on Chinese linguistic structures, including a specialized script converter for transforming text between Simplified Chinese, Traditional Chinese, and Pinyin. It further supports domain-specific model training to improve the recognition of professional t

    Allows defining custom word lists to force, merge, or correct how text is split into tokens.

    Pythondependency-parserhanlpnamed-entity-recognition
    Ver en GitHub↗36,413
  • fxsjy/jiebaAvatar de fxsjy

    fxsjy/jieba

    35,027Ver en GitHub↗

    This project is a Chinese text segmentation library and tokenizer designed to split Chinese sentences into individual words. It serves as a natural language processing tool for splitting characters into words, tagging parts of speech, and extracting keywords using statistical analysis. The library distinguishes itself through support for custom dictionary configuration and vocabulary file management, allowing users to override default segmentation rules for domain-specific accuracy. It also includes a TF-IDF keyword extractor to identify significant words and core topics within documents. Th

    Supports specifying custom dictionary files to improve word identification and segmentation accuracy.

    Python
    Ver en GitHub↗35,027
  • facebookresearch/fairseqAvatar de facebookresearch

    facebookresearch/fairseq

    32,228Ver en GitHub↗

    Fairseq is a PyTorch toolkit for sequence-to-sequence modeling, specializing in neural machine translation, automatic speech recognition, and large-scale language model training. It provides a framework for processing and aligning diverse data sources, including text, audio, and video, to support tasks such as speech-to-text conversion and multimodal sequence learning. The project is distinguished by its distributed training capabilities, which utilize parameter sharding, mixed-precision training, and CPU offloading to handle models that exceed single-device memory. It also includes specializ

    Binarizes raw text datasets into a format optimized for efficient loading during model training and evaluation.

    Python
    Ver en GitHub↗32,228
  • valyala/fasthttpAvatar de valyala

    valyala/fasthttp

    23,264Ver en GitHub↗

    Fasthttp is a high-performance networking framework for Go, designed to maximize throughput and minimize memory overhead in demanding web applications. It functions as a specialized HTTP server and client library that prioritizes efficient resource management, allowing developers to build scalable services capable of handling massive concurrent traffic with minimal garbage collection pressure. The library distinguishes itself through a focus on zero-allocation processing and low-level optimization. It achieves this by recycling temporary request and response objects through managed pools and

    Loads and parses template definitions from local files to facilitate structural reuse.

    Go
    Ver en GitHub↗23,264
  • eligrey/filesaver.jsAvatar de eligrey

    eligrey/FileSaver.js

    22,032Ver en GitHub↗

    FileSaver.js is a client-side utility library designed to trigger browser download prompts for files generated within a web application or retrieved from remote web addresses. It enables the export of data directly to a user's local device, eliminating the need for server-side processing or backend infrastructure to handle file creation and storage. The library functions as a wrapper for the browser Blob API, simplifying the process of encapsulating binary data and mapping it to temporary object URLs. By programmatically managing anchor elements and their download attributes, it simulates use

    A tool that simplifies the creation and downloading of files from Blob objects across all modern web browsers.

    JavaScript
    Ver en GitHub↗22,032
  • meituan-dianping/mpvueAvatar de Meituan-Dianping

    Meituan-Dianping/mpvue

    20,345Ver en GitHub↗

    This project is a development framework that enables the creation of cross-platform mobile mini programs using the component-based architecture and reactive data binding of Vue.js. It functions as a build system that transforms web-oriented component code into native-compatible templates and logic, allowing developers to build modular user interfaces that run within restricted mobile environments. The framework distinguishes itself through a sophisticated build pipeline that deconstructs single-file components into platform-specific templates, logic, and style files. It employs compile-time t

    Maps component data and event handlers to native templates to keep the UI synchronized.

    JavaScriptminimpvuevue
    Ver en GitHub↗20,345
  • infinilabs/analysis-ikAvatar de infinilabs

    infinilabs/analysis-ik

    17,468Ver en GitHub↗

    Analysis-ik is a Chinese text segmenter and analysis plugin for Lucene-based search engines. It provides a specialized analyzer for splitting Chinese sentences into meaningful words to improve indexing and search accuracy within Elasticsearch and OpenSearch. The project features a dynamic dictionary manager that can load word libraries and stop-word files from remote HTTP endpoints. It monitors metadata headers on these remote files to trigger automatic vocabulary updates without requiring a service restart. The analyzer supports both fine-grained exhaustive and coarse-grained smart segmenta

    Allows defining user-provided word lists and stop-word files to override default segmentation behavior.

    Javaanalyzereasysearchelasticsearch
    Ver en GitHub↗17,468
  • openai/tiktokenAvatar de openai

    openai/tiktoken

    17,323Ver en GitHub↗

    Tiktoken is a library for converting raw text into numerical sequences using byte pair encoding schemes. It functions as a toolkit for managing tokenization processes, enabling the transformation of text into the specific numerical formats required by language models. The library provides mechanisms for automated encoder selection, allowing users to retrieve the correct tokenization configuration based on specific model names. It also supports the definition and registration of custom tokenization schemes, which facilitates the use of specialized vocabularies or unique model architectures wit

    Optimizes text processing tasks by converting large volumes of text into efficient encoded sequences.

    Python
    Ver en GitHub↗17,323
  • nltk/nltkAvatar de nltk

    nltk/nltk

    14,649Ver en GitHub↗

    This project is a comprehensive Python toolkit designed for natural language processing, research, and education. It functions as a linguistic data processor that provides a standardized framework for managing, cleaning, and analyzing large collections of annotated text corpora and lexical resources. The library distinguishes itself through its integration of both symbolic and statistical methods, allowing users to perform complex tasks ranging from rule-based grammar parsing to machine learning-driven classification. It offers a modular pipeline for text processing, enabling the transformati

    Provides a modular pipeline for transforming raw, unstructured language data into structured formats through tokenization and normalization.

    Pythonmachine-learningnatural-language-processingnlp
    Ver en GitHub↗14,649
  • languagetool-org/languagetoolAvatar de languagetool-org

    languagetool-org/languagetool

    14,597Ver en GitHub↗

    LanguageTool is a multilingual grammar and style checking engine designed to detect spelling, grammar, and writing errors across multiple languages. It provides automated proofreading capabilities that can be deployed as a self-hosted server or executed as a standalone local desktop application. The project distinguishes itself through a flexible rule development framework, allowing linguistic patterns to be defined via XML or implemented as custom Java classes. It utilizes n-gram frequency modeling for confused word detection and supports neural word embeddings to improve disambiguation betw

    Supports the use of user-defined word lists to improve and refine spell-checking accuracy.

    Javagrammarnatural-languagenatural-language-processing
    Ver en GitHub↗14,597
Ant.12Siguiente
  1. Home
  2. Programming Languages & Runtimes
  3. Programming Utilities
  4. Data & Text Processing

Explorar subetiquetas

  • Blob ConstructorsUtilities for creating blob objects from various data sources.
  • Custom Dictionaries1 sub-etiquetaUser-defined word lists used to bias or improve text recognition accuracy.
  • Dataset BinarizationProcesses of converting text datasets into binary formats to optimize ingestion speed. **Distinct from Data & Text Processing:** Focuses on the binary conversion process for model loading rather than general text processing utilities.
  • Template Engines6 sub-etiquetasLibraries that merge data with predefined structures to generate formatted text or document output.
  • Text Processing OptimizersUtilities for optimizing the transformation of large text volumes into efficient encoded sequences. **Distinct from Data & Text Processing:** Distinct from general data and text processing: focuses on performance optimization for byte pair encoding pipelines.
  • Textual Data LoadingImporting content from various document formats and web sources for AI processing. **Distinct from Data & Text Processing:** Focuses specifically on the ingestion and loading phase from diverse sources, rather than general transformation.
  • WebAssembly LoadersSupport for importing and initializing WebAssembly binary modules.