19 repos
Automated processes for identifying and categorizing people, organizations, and locations within unstructured text.
Distinct from Entity Extraction Pipelines: Distinct from Entity Extraction Pipelines: focuses on general-purpose named entity recognition rather than graph-specific relationship construction.
Explore 19 awesome GitHub repositories matching artificial intelligence & ml · Textual Entity Extractors. Refine with filters or upvote what's useful.
This repository serves as a comprehensive research platform and toolkit for advancing machine learning, quantum computing, and large-scale scientific data analysis. It provides foundational frameworks for developing complex algorithmic systems, offering the necessary infrastructure for distributed training, computational graph execution, and high-performance model development. The project distinguishes itself by integrating specialized research domains with robust, privacy-preserving methodologies. It supports diverse scientific discovery through tools for quantum simulation, physics-informed
Identifies and categorizes people, organizations, and locations within unstructured text to support information extraction.
HanLP is a natural language processing library and deep learning framework specifically optimized for the Chinese language, while also functioning as a multilingual text processor. It serves as a toolkit for performing linguistic analysis, semantic understanding, and script conversion. The project distinguishes itself through a dedicated focus on Chinese linguistic structures, including a specialized script converter for transforming text between Simplified Chinese, Traditional Chinese, and Pinyin. It further supports domain-specific model training to improve the recognition of professional t
Provides automated processes for identifying and categorizing people, organizations, and locations within unstructured text.
spaCy is a Python natural language processing framework designed for industrial-scale text processing. It converts raw text into structured data for machine learning pipelines through a combination of statistical language model trainers, transformer-based text processors, and syntactic dependency parsers. The project enables the integration of pretrained transformer architectures to perform complex linguistic analysis and multi-task learning. It also provides a specialized system for neural named entity recognition to identify and categorize key entities within text. The framework covers a b
Identifies and categorizes key entities like people, organizations, and locations using neural models.
FinGPT is a suite of specialized financial tools and a framework for adapting large language models to the financial domain. It provides a set of pipelines for financial entity extraction, sentiment analysis, and retrieval-augmented generation to improve the accuracy of financial information systems. The project distinguishes itself through efficient training workflows, utilizing low-rank adaptation and quantized low-rank adaptation to fine-tune models on consumer-grade hardware. It employs market-labeled datasets and reinforcement learning that uses actual stock price movements as reward sig
Recognizes and classifies specific financial entities, such as company names and ticker symbols, within text.
Flair is a transformer-based natural language processing framework used to build and train models for text classification and sequence tagging. It provides a specialized library for generating contextual text embeddings and performing linguistic analysis. The framework includes dedicated tools for named entity recognition, including the identification of specialized biomedical entities across multiple languages. It further supports entity linking to map identified text mentions to unique entries within general or biomedical knowledge bases. The project covers a broad range of language analys
Implements comprehensive named entity recognition for classifying proper nouns like people and locations across multiple languages.
Flair is a natural language processing framework for training and applying models for sequence labeling and text classification. It provides a system for generating word embeddings and identifying semantic entities within text. The framework includes a dedicated system for zero and few-shot learning, enabling text classification and entity extraction using minimal training examples by leveraging pre-trained knowledge. Its capabilities cover named entity recognition, sentiment analysis, and the training of specialized models using custom datasets. It also includes tooling for the visual highl
Identifies and categorizes specific entities like people, locations, and organizations within unstructured text.
Unstructured is an enterprise-grade data orchestration engine designed to transform raw, unstructured files into structured, machine-readable formats. It functions as a comprehensive platform for document ingestion, partitioning, and enrichment, specifically engineered to prepare complex data for retrieval-augmented generation and agentic AI workflows. The platform distinguishes itself through its sophisticated document processing strategies, which combine rule-based extraction with vision-language models to handle diverse file layouts, tables, and images. It provides a modular architecture t
Identifies and categorizes entities like people, organizations, and locations within unstructured text to provide structured metadata.
Compromise is a natural language processing library and rule-based text parser designed to analyze unstructured text. It functions as a toolkit for identifying parts of speech, linguistic patterns, and semantic meaning, while providing specialized engines for named entity recognition and the parsing of temporal and numeric data. The project is distinguished by its linguistic morphological engine, which can conjugate verbs across different tenses and inflect nouns and adjectives. It further allows for linguistic model customization through a plugin system that enables the extension of lexicons
Identifies and extracts specific categories of information such as people, places, and organizations from text.
Compromise is a natural language processing library and rule-based engine designed for English text manipulation, analysis, and parsing. It provides a toolkit for tokenizing text, identifying parts of speech, and performing linguistic analysis to achieve semantic understanding of unstructured strings. The project distinguishes itself through its ability to programmatically transform grammar, such as modifying verb tenses, noun plurality, and adjective forms. It also functions as a named entity recognizer capable of extracting people, places, organizations, dates, and contact information from
Identifies and categorizes people, places, organizations, and dates from unstructured text.
Presidio is a PII detection and anonymization framework designed to identify and mask personally identifiable information in text. It functions as a PII recognition pipeline and a data masking engine, using a combination of machine learning, regular expressions, and rule-based logic to locate sensitive entities. The system acts as an NER model orchestrator, allowing for the integration of external named entity recognition models and PII detectors to support multi-language privacy scrubbing. It employs a plugin-based recognizer architecture that can be extended with custom recognizers, deny-li
Allows the definition of custom detection rules using regular expressions and deny-lists within configuration files.
Stanza is a Python natural language processing library designed for tokenization, lemmatization, and dependency parsing across many human languages using neural models. It provides a neural processing pipeline that converts raw text into structured linguistic data objects, alongside a specialized analyzer for extracting medical insights from clinical and biomedical language. The project includes a wrapper that connects Python scripts to Java-based natural language processing tools and remote annotation servers. This enables a bridge for extracting linguistic annotations and analysis data from
Provides specialized syntactic analysis and entity recognition to extract medical insights from clinical language.
ansj_seg is a Java NLP toolkit and segmentation library designed for processing Chinese text. It functions as a word segmenter, part-of-speech tagger, and named entity recognizer to divide continuous Chinese characters into meaningful words and tokens. The library utilizes statistical models for text segmentation and provides capabilities for identifying and extracting person names from unstructured documents. It also assigns grammatical categories to tokens to determine their linguistic roles within a sentence. The toolkit supports domain-specific text processing through the use of custom d
Identifies and extracts person names from unstructured Chinese documents using customized recognition rules.
This is a demonstration project from OpenAI that showcases a multi-agent customer service workflow built with the OpenAI Agents SDK. It coordinates several specialized AI agents to handle common airline support tasks such as flight booking and cancellation, refunds and compensation, seat and special service requests, real-time flight information, and airline policy FAQ responses, all within a single conversational interface. The system routes incoming customer requests to the appropriate specialized agent based on intent, and enforces guardrails to block off-topic or malicious requests. It su
Tags responses with source references and recognized entities to provide transparency and context for users.
Knwl.js is a JavaScript named entity recognition library and text entity extractor. It functions as an extensible text parsing engine designed to scan unstructured strings for specific data patterns and convert them into structured information. The engine utilizes a modular framework that allows for the recognition of custom data types. This is achieved through a plugin system for language pattern matching, enabling the integration of custom logic to identify unique data types within text. The library identifies and isolates entities such as dates, times, phone numbers, emails, and locations
Scans strings for specific data patterns and converts them into structured information.
Knwl.js is a JavaScript named entity recognition library and rule-based text parser. It serves as an extensible information extraction tool designed to identify and pull structured entities, such as dates, times, and locations, from unstructured text strings. The library allows for the definition of specialized rules and custom plugins to identify and extract unique pieces of information. This extensibility enables the automation of information retrieval by converting human-readable text into structured formats for applications and databases. The system utilizes regular expression matching a
Supports the definition of domain-specific entity detection rules via custom plugins and regular expressions.
ActiveLabel.swift is a rich text parsing library and interactive text label for iOS. It functions as a replacement for standard labels, identifying specific text patterns within strings and applying distinct visual styles to recognized entities. The project enables the detection and highlighting of hashtags, mentions, and URLs using a custom regular expression text recognizer. It allows for the definition of project-specific text patterns and uses predicate-based filtering to determine if detected entities should be highlighted or ignored. The system manages user interaction through entity t
Provides custom rules to evaluate whether recognized hashtags and mentions should be highlighted.
BioGPT is a biomedical large language model and domain-specific transformer designed for processing and creating specialized medical text. It functions as a generative tool and knowledge extraction engine trained on large-scale scientific literature to produce human-like scientific prose and factual responses to queries. The project provides specialized capabilities for biomedical named entity recognition and the extraction of complex relations from unstructured medical corpora. It is designed to identify and classify biological entities through data mining and relation extraction to support
Identifies relationships between biomedical entities such as chemicals, diseases, and drugs from text.
Duckling is a deterministic named entity recognizer and natural language entity extractor. It transforms unstructured text into machine-readable data by mapping language-specific input strings to universal structured formats. The system utilizes a rule-based engine and composable language rules to resolve entities without relying on probabilistic models. It supports multilingual text parsing across various regional locales, employing a logic-driven approach to normalize diverse natural language expressions into standardized numeric values. The project covers the extraction and normalization
Allows for the definition of domain-specific entity detection rules via composable language rules and configurations.
QuantMuse is an algorithmic trading platform and quantitative trading framework that integrates large language models with mathematical analysis to automate market insights and trading strategies. It functions as a system for building, backtesting, and executing strategies using both historical and real-time market data. The framework is distinguished by its use of large language models for financial analysis and sentiment extraction from news and social media. It utilizes autonomous agents with chain-of-thought reasoning to generate market intelligence and strategic reports, while employing
Identifies company names, tickers, and monetary values from unstructured financial text using specialized recognizers.