awesome-repositories.com
Blog
awesome-repositories.com

Découvrez les meilleurs dépôts open-source grâce à notre recherche par IA.

ExplorerRecherches sélectionnéesAlternatives open sourceLogiciels auto-hébergésBlogPlan du site
ProjetÀ proposNotre méthodologiePresseServeur MCP
Mentions légalesConfidentialitéConditions d'utilisation
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

324 dépôts

Awesome GitHub RepositoriesNatural Language Processing

Libraries and techniques for analyzing, processing, and extracting insights from human language data.

Explore 324 awesome GitHub repositories matching artificial intelligence & ml · Natural Language Processing. Refine with filters or upvote what's useful.

Awesome Natural Language Processing GitHub Repositories

Trouvez les meilleurs dépôts grâce à l'IA.Nous recherchons les dépôts les plus pertinents grâce à l'IA.
  • vinta/awesome-pythonAvatar de vinta

    vinta/awesome-python

    303,207Voir sur GitHub↗

    Ce projet est un répertoire complet, organisé par la communauté, qui structure un vaste paysage de bibliothèques, frameworks et outils logiciels Python. Il sert de base de connaissances centralisée conçue pour faciliter la navigation dans l'écosystème et accélérer la découverte par les développeurs tout au long du cycle de vie du développement logiciel. Le répertoire se distingue en fournissant un index structuré de ressources classées par domaine technique, allant des utilitaires de développement fondamentaux aux domaines d'ingénierie spécialisés. Il couvre des capacités de haut niveau, notamment l'intelligence artificielle, la science des données, le développement web et la gestion d'infrastructure, permettant aux développeurs d'identifier des solutions éprouvées pour des défis techniques spécifiques. Le projet englobe une large surface de capacités, notamment des outils pour la gestion des dépendances, l'analyse de code statique et les tests automatisés. Il catalogue également des ressources pour le stockage de données persistantes, l'orchestration d'infrastructure cloud et le développement d'interfaces, fournissant une référence unifiée pour la construction et la maintenance de systèmes logiciels complexes.

    Extract linguistic insights and perform sentiment analysis using advanced natural language processing techniques.

    Pythonawesomecollectionspython
    Voir sur GitHub↗303,207
  • avelino/awesome-goAvatar de avelino

    avelino/awesome-go

    175,576Voir sur GitHub↗

    This project serves as a comprehensive language ecosystem index, functioning as a centralized, community-curated directory for the Go programming language. It organizes a vast landscape of software components, libraries, and development tools into a structured, navigable hierarchy, enabling developers to efficiently discover resources tailored to specific functional domains. The repository distinguishes itself through a decentralized contribution model, where community-driven updates ensure the index remains current with the rapidly evolving software landscape. Beyond simple resource listing,

    Apply algorithms for language detection and human language data analysis.

    Goawesomeawesome-listgo
    Voir sur GitHub↗175,576
  • openai/whisperAvatar de openai

    openai/whisper

    102,828Voir sur GitHub↗

    This project is a speech recognition and translation engine that utilizes a sequence-to-sequence transformer architecture to convert audio into text. It is built upon a weakly supervised learning framework, which leverages large-scale, unlabelled audio-transcript data to create generalized speech representations capable of performing simultaneous transcription, language identification, and translation. The system distinguishes itself through a unified multi-task modeling approach that shares token sequences across different objectives, allowing it to handle diverse languages and vocabularies

    Converts raw text into subword units using byte-level sequences to handle diverse languages without requiring language-specific rules.

    Python
    Voir sur GitHub↗102,828
  • openai/codexAvatar de openai

    openai/codex

    91,445Voir sur GitHub↗

    Codex is an automated programming tool and generative code assistant designed to interpret developer intent through a natural language interface. It functions as a machine learning model trained on public code repositories to provide intelligent code completion, suggestions, and refactoring within development environments. By translating human instructions into executable code snippets, the system bridges the gap between high-level technical requirements and functional software implementation. The engine utilizes transformer-based sequence modeling and supervised fine-tuning to align its outp

    Decomposes raw text into sub-word units to represent diverse programming languages and syntax structures efficiently.

    Rust
    Voir sur GitHub↗91,445
  • paddlepaddle/paddleocrAvatar de PaddlePaddle

    PaddlePaddle/PaddleOCR

    82,412Voir sur GitHub↗

    PaddleOCR is a comprehensive optical character recognition framework designed for detecting and transcribing text from images and documents into structured, machine-readable formats. It provides a modular computer vision pipeline that decouples image preprocessing, text detection, and character recognition into independent, configurable stages. This architecture supports automated document digitization and multilingual text recognition, capable of identifying text in over one hundred languages across diverse environments ranging from scanned documents to industrial scenes. The framework disti

    Transforms visual document layouts into structured, machine-readable formats like JSON or Markdown while correcting for perspective and artifacts.

    Pythonai4sciencechineseocrdocument-parsing
    Voir sur GitHub↗82,412
  • developer-y/cs-video-coursesAvatar de Developer-Y

    Developer-Y/cs-video-courses

    81,816Voir sur GitHub↗

    This project is a community-driven educational repository that serves as a comprehensive directory of university-level computer science video lectures. It provides a structured learning path for students and professionals, aggregating high-quality academic resources to facilitate self-paced study across a wide range of technical disciplines. The repository distinguishes itself through a collaborative maintenance model, utilizing version control workflows to allow contributors to expand and update the collection. Content is organized within a single, version-controlled document that leverages

    Aggregates expert lectures on processing and interpreting human language through computational models.

    algorithmsbioinformaticscomputational-biology
    Voir sur GitHub↗81,816
  • mlabonne/llm-courseAvatar de mlabonne

    mlabonne/llm-course

    80,178Voir sur GitHub↗

    This project is a comprehensive educational curriculum and engineering handbook focused on the lifecycle of large language models. It serves as a structured knowledge base for machine learning practitioners, covering the fundamental mathematical and architectural principles of transformer-based sequence modeling, as well as the practical implementation of supervised instruction fine-tuning and preference-based model alignment. The repository distinguishes itself by providing a deep dive into advanced model composition and optimization techniques. It details methodologies for weight-space mode

    Covers the essential techniques for bridging human language and machine understanding through advanced natural language processing methods.

    courselarge-language-modelsllm
    Voir sur GitHub↗80,178
  • d2l-ai/d2l-zhAvatar de d2l-ai

    d2l-ai/d2l-zh

    78,493Voir sur GitHub↗

    This project is an open-source, interactive educational platform designed to teach deep learning through a comprehensive, code-first curriculum. It provides a structured learning path that covers foundational mathematics, modern neural network architectures, and practical optimization techniques, enabling practitioners to master complex artificial intelligence concepts through hands-on experimentation. The platform distinguishes itself by integrating technical explanations with executable Jupyter notebooks. This design allows readers to modify code and hyperparameters in real-time, facilitati

    Guides learners through constructing vector representations that capture semantic relationships between words.

    Pythonbookchinesecomputer-vision
    Voir sur GitHub↗78,493
  • tensorflow/modelsAvatar de tensorflow

    tensorflow/models

    77,663Voir sur GitHub↗

    This repository serves as a centralized collection of state-of-the-art deep learning architectures and reference implementations designed for research and application development. It provides a comprehensive toolkit for computer vision and natural language processing, offering pre-built models and training pipelines for tasks ranging from image classification and object detection to complex sequence modeling. The project distinguishes itself by providing a flexible execution harness that manages the entire training lifecycle, including data ingestion and backpropagation. It supports scalable

    Implements advanced transformer-based architectures for large-scale text understanding, sequence modeling, and generation.

    Python
    Voir sur GitHub↗77,663
  • awesomedata/awesome-public-datasetsAvatar de awesomedata

    awesomedata/awesome-public-datasets

    75,979Voir sur GitHub↗

    This project is a community-maintained, open-access directory of high-quality public datasets. It serves as a centralized reference point for researchers, developers, and data scientists to locate reliable information sources across a wide spectrum of industries and scientific fields. By providing a structured index, the repository facilitates the discovery of data necessary for exploratory analysis, machine learning model training, and the development of data-intensive applications. The directory distinguishes itself through a lightweight, platform-agnostic approach to resource indexing that

    Gathers linguistic datasets and text corpora to support natural language processing tasks.

    aaron-swartzawesome-public-datasetsdatasets
    Voir sur GitHub↗75,979
  • tesseract-ocr/tesseractAvatar de tesseract-ocr

    tesseract-ocr/tesseract

    74,751Voir sur GitHub↗

    Tesseract is a neural network-based optical character recognition engine designed to convert scanned images and digital documents into machine-readable, searchable text. It functions as both a command-line utility for automating large-scale digitization workflows and a cross-platform library that can be embedded into desktop, mobile, or server-side applications. By utilizing long short-term memory networks, the engine provides robust text extraction across more than one hundred languages and dozens of scripts. The project distinguishes itself through a sophisticated document layout analysis f

    Parses complex document images by detecting tab-stops and structural cues to deduce reading order and column layout.

    C++hacktoberfestlstmmachine-learning
    Voir sur GitHub↗74,751
  • josephmisiti/awesome-machine-learningAvatar de josephmisiti

    josephmisiti/awesome-machine-learning

    72,867Voir sur GitHub↗

    This project is a comprehensive, community-driven directory of machine learning resources, software libraries, and educational materials. It serves as a centralized knowledge base for developers and researchers, organizing tools and frameworks by their primary programming language and technical domain to simplify discovery across the artificial intelligence ecosystem. The collection distinguishes itself by providing a cross-language development index that spans diverse programming environments, including C, C++, Rust, Clojure, and Python. It covers a wide range of specialized capabilities, fr

    Brings together utilities for parsing and analyzing natural language data.

    Python
    Voir sur GitHub↗72,867
  • opendatalab/mineruAvatar de opendatalab

    opendatalab/MinerU

    67,734Voir sur GitHub↗

    MinerU is a document parsing pipeline designed to transform unstructured files into machine-readable, structured data. It utilizes deep learning models to perform layout analysis, identifying document regions and extracting complex content such as mathematical expressions. By combining these neural network inferences with geometric heuristics, the system reconstructs the reading order and structural hierarchy of documents to ensure accurate data representation. The project distinguishes itself through a multi-stage processing workflow that integrates layout detection, optical character recogn

    Identifies document regions, tables, and text hierarchies to convert complex visual layouts into machine-readable data.

    Pythonai4sciencedocument-analysisextract-data
    Voir sur GitHub↗67,734
  • sindresorhus/awesome-nodejsAvatar de sindresorhus

    sindresorhus/awesome-nodejs

    65,973Voir sur GitHub↗

    This project is a community-driven directory that aggregates essential software projects and educational content for the Node.js ecosystem. It functions as a centralized knowledge base and discovery index, designed to simplify the navigation of a fragmented technical landscape by providing a structured collection of high-quality links, tools, and learning materials. The repository distinguishes itself through a decentralized, peer-reviewed curation model. By utilizing standard version control workflows and pull requests, the community ensures that all listed resources undergo human verificati

    Collects advanced linguistic processing engines for parsing, tokenizing, and analyzing human language text.

    awesomeawesome-listjavascript
    Voir sur GitHub↗65,973
  • ds4sd/doclingAvatar de DS4SD

    DS4SD/docling

    62,172Voir sur GitHub↗

    Docling is a multimodal content converter and document parser designed to transform PDFs, Office files, and HTML into structured Markdown or JSON for generative AI applications. It functions as an OCR document processor and a PDF layout analyzer that extracts tables, charts, and hierarchical structures while preserving the original page layout. The system operates as a local-first inference engine, allowing for the processing of sensitive data in air-gapped environments without external network connectivity. It can also be deployed as an API or a Model Context Protocol server to provide parsi

    Uses specialized models to identify structural elements like headers, tables, and lists to maintain document hierarchy.

    Python
    Voir sur GitHub↗62,172
  • docling-project/doclingAvatar de docling-project

    docling-project/docling

    61,674Voir sur GitHub↗

    Docling is a modular framework designed for document parsing, layout analysis, and structured data extraction. It transforms unstructured files and web content into a unified, hierarchical data model that preserves the spatial and semantic relationships between text, tables, images, and layout elements. By normalizing diverse input formats into a consistent internal representation, the library enables uniform processing across various document types. The project distinguishes itself through a schema-driven approach that maps document regions to strongly-typed objects, ensuring data accuracy t

    Parses hierarchical document structures to identify and relate text, tables, and images for intelligent content analysis.

    Pythonaiconvertdocument-parser
    Voir sur GitHub↗61,674
  • karpathy/nanogptAvatar de karpathy

    karpathy/nanoGPT

    59,730Voir sur GitHub↗

    nanoGPT is a lightweight engine for training and fine-tuning transformer-based language models from scratch. It provides a minimalist codebase designed for educational exploration and rapid experimentation with neural network architectures, utilizing self-attention and feed-forward layers to process sequences and predict subsequent elements. The project distinguishes itself through a focus on high-speed data ingestion and hardware-accelerated performance. It includes a dedicated pipeline for transforming raw text into memory-mapped binary files, which enables efficient streaming during traini

    Decomposes raw text into numerical units using character-level tokenization for model ingestion.

    Python
    Voir sur GitHub↗59,730
  • datawhalechina/hello-agentsAvatar de datawhalechina

    datawhalechina/hello-agents

    59,685Voir sur GitHub↗

    This project provides a comprehensive framework for building, training, and managing autonomous agents. It enables the construction of systems that utilize language models to plan, manage memory, and execute multi-step tasks through iterative reasoning loops and tool-based actions. The framework distinguishes itself by offering specialized capabilities for interacting with graphical user interfaces and legacy software, allowing agents to perceive visual elements and perform actions like a human user. It supports complex, cross-application workflows through graph-based orchestration and provid

    Converts raw text into sub-word units using frequency-based algorithms to create efficient vocabulary representations.

    Pythonagentllmrag
    Voir sur GitHub↗59,685
  • meta-llama/llamaAvatar de meta-llama

    meta-llama/llama

    59,464Voir sur GitHub↗

    Llama is a computational framework and runtime environment designed for executing transformer-based neural networks locally. It functions as a generative AI inference engine, enabling the processing of input sequences through pre-trained model weights to produce text completions and structured data outputs directly on your own hardware. The system distinguishes itself through specialized memory and computation management techniques, including memory-mapped weight loading and quantization-aware inference, which allow for efficient execution on standard consumer hardware. It utilizes a stateles

    Decomposes raw text into numerical tokens suitable for processing by transformer-based neural networks.

    Python
    Voir sur GitHub↗59,464
  • sharkdp/batAvatar de sharkdp

    sharkdp/bat

    59,284Voir sur GitHub↗

    This project is a command-line text viewer designed to enhance terminal output through automatic syntax highlighting and integrated file management. It functions as a replacement for standard system pagers, providing a readable interface for large text streams, source code, and markup files by applying color-coded formatting directly to the terminal output. The utility distinguishes itself through deep integration with version control systems, allowing users to inspect repository status and historical file changes with visual markers displayed in the output margin. It employs heuristic-based

    Detects programming languages by analyzing file content and extensions to apply the correct syntax highlighting rules.

    Rustclicommand-linegit
    Voir sur GitHub↗59,284
Préc.123456…17Suivant
  1. Home
  2. Artificial Intelligence & ML
  3. Natural Language Processing

Explorer les sous-tags

  • Agent Prompt ProcessorsProcesses user input through a language model that decides whether to use tools, executes them, and produces a final response. **Distinct from Natural Language Processing:** Distinct from Natural Language Processing: focuses on the agentic loop of tool selection and execution, not general linguistic analysis.
  • Deep Learning ApproachesApplication of deep learning techniques such as RNNs, CNNs, embeddings, and transformers to natural language processing tasks. **Distinct from Natural Language Processing:** Distinct from general Natural Language Processing: this specifically focuses on deep learning methods (RNNs, CNNs, BERT) rather than traditional NLP or rule-based approaches.
  • Document Layout Analysis4 sous-tagsTools for parsing and extracting structural information from complex documents to identify text, tables, and layout hierarchies.
  • Educational ImplementationsInstructional code and lessons for implementing core NLP techniques like word embeddings and translation. **Distinct from Natural Language Processing:** Distinct from general NLP: focuses specifically on the educational delivery of these implementations.
  • Execution PipelinesWorkflows and command-line interfaces for orchestrating sequential NLP tasks such as prediction and classification. **Distinct from Natural Language Processing:** Covers the operational pipeline for executing tasks, whereas the parent is the broad field of NLP techniques.
  • Heuristic Language DetectorsSystems that identify languages by analyzing file extensions and content patterns rather than full parsing.
  • Language Model Pretraining3 sous-tagsMethods for training language models on large text corpora before downstream task fine-tuning.
  • Mathematical Expression ParsingTranslating human-readable text into executable mathematical operations and formulas. **Distinct from Natural Language Query Parsing:** Specific to mathematical operations rather than general data retrieval queries or LLM commands
  • NLP Applications5 sous-tagsPractical use cases for NLP models.
  • NLP Debugging ToolsDiagnostic utilities for identifying input segments that cause incorrect or biased model decisions. **Distinct from Natural Language Processing:** Distinct from Natural Language Processing: focuses on the debugging and diagnostic aspect of NLP models rather than general language processing.
  • Natural Language Resources1 sous-tagCurated collections of NLP datasets, models, and linguistic tools.
  • Quantifier Scope ResolutionProcesses and resolves the ambiguity of quantifiers within a logical form of a sentence. **Distinct from Natural Language Processing:** Focuses on linguistic quantifier ambiguity in logical forms rather than regular expression or sampling quantifiers
  • Singularization RulesLogic for converting plural nouns back to their singular forms. **Distinct from Word Stemming:** Distinct from stemming as it focuses on grammatical singularization of nouns rather than root-word reduction.
  • Stopword-Driven TokenizersTokenization logic utilizing language-specific dictionaries for accurate text extraction. **Distinct from Natural Language Processing:** Distinct from general NLP: focuses on the specific implementation of stopword-based tokenization for multilingual extraction.
  • Structured Document Extraction5 sous-tagsProcesses that convert visual document layouts into machine-readable formats like JSON or Markdown.
  • Study ResourcesEducational materials and guides for learning NLP techniques and models. **Distinct from Natural Language Processing:** Focuses on learning resources rather than software libraries or implementation toolkits
  • Technical GuidesIn-depth technical documentation and reference materials for understanding complex language processing architectures. **Distinct from Natural Language Processing:** Distinct from general NLP libraries: focuses on educational reference material for model internals rather than functional code libraries.
  • Text Data PreparationProcesses raw string columns into structured formats compatible with NLP pipelines. **Distinct from Natural Language Processing:** Focuses on the preparatory conversion of raw strings into structured dataframe columns, distinct from general NLP analysis.
  • Text Tokenization11 sous-tagsUtilities for segmenting raw text into words, sentences, or smaller tokens for linguistic analysis. **Distinct from Text Tokenization:** Distinct from Natural Language Processing: focuses specifically on the initial segmentation of text strings into tokens.
  • Text VectorizationsConverting text into numerical vectors using bag-of-words, TF-IDF, Word2Vec, and Doc2Vec embeddings for classification and similarity. **Distinct from Natural Language Processing:** Distinct from Natural Language Processing: focuses specifically on text vectorization techniques, not general NLP analysis.
  • Tokenizers3 sous-tagsComponents that decompose raw text into sub-word units or tokens based on statistical frequency and normalization rules.
  • Tools1 sous-tagSoftware libraries and utilities designed for parsing, processing, and analyzing natural language data.
  • Training Pipelines1 sous-tagBuilding text processing pipelines and language models for text generation using reference implementations. **Distinct from Natural Language Processing:** Distinct from Natural Language Processing: focuses on the training pipeline aspect rather than general NLP analysis or datasets.
  • Transfer Learning1 sous-tagMethods for fine-tuning pre-trained models on specific downstream tasks.
  • Word Embeddings20 sous-tagsVector representations of words capturing semantic relationships.
  • Word Stemming2 sous-tagsTechniques for reducing words to their root or base forms to normalize text across different languages. **Distinct from Word Embeddings:** Distinct from Word Embeddings: focuses on heuristic root-word reduction rather than vector-based semantic representations.