Projects sharing features with OpenNRE

Duckling is a deterministic named entity recognizer and natural language entity extractor. It transforms unstructured text into machine-readable data by mapping language-specific input strings to universal structured formats. The system utilizes a rule-based engine and composable language rules to resolve entities without relying on probabilistic models. It supports multilingual text parsing across various regional locales, employing a logic-driven approach to normalize diverse natural language expressions into standardized numeric values. The project covers the extraction and normalization

JioNLP is a Chinese natural language processing toolkit designed for cleaning, normalizing, and extracting structured information from unstructured text. It functions as a linguistic analyzer for Chinese characters and a rule-based named entity extractor, providing a specialized system for sentiment scoring and synthetic data generation for machine learning workflows. The project features a lexicon-based sentiment analysis engine that computes numerical emotional tone scores and a data augmentation library that uses back-translation and synonym replacement to expand training datasets. It incl

GoLearn is a machine learning library for the Go programming language. It provides a supervised learning framework and a toolkit for building, training, and evaluating predictive models through a standardized interface. The project implements a data frame system that loads CSV files into structured grids for matrix operations. It includes a preprocessing library for discretizing continuous variables and a model evaluation toolkit that utilizes confusion matrices and cross-validation to measure precision and recall. The library covers data engineering and management, including the ability to

This project is a comprehensive Python toolkit designed for natural language processing, research, and education. It functions as a linguistic data processor that provides a standardized framework for managing, cleaning, and analyzing large collections of annotated text corpora and lexical resources. The library distinguishes itself through its integration of both symbolic and statistical methods, allowing users to perform complex tasks ranging from rule-based grammar parsing to machine learning-driven classification. It offers a modular pipeline for text processing, enabling the transformati

KnowledgeGraphData is a collection of structured datasets and corpora designed to provide a foundational layer for cognitive intelligence and artificial intelligence systems. It primarily consists of large-scale Chinese knowledge graph datasets, including entity-relation data and NLP training sets used to drive semantic understanding and automated question answering. The project focuses on the construction and export of massive entity-attribute-value graphs, organizing knowledge into portable formats. It provides specialized domain partitioning to tailor information retrieval for professional

Knwl.js is a JavaScript named entity recognition library and rule-based text parser. It serves as an extensible information extraction tool designed to identify and pull structured entities, such as dates, times, and locations, from unstructured text strings. The library allows for the definition of specialized rules and custom plugins to identify and extract unique pieces of information. This extensibility enables the automation of information retrieval by converting human-readable text into structured formats for applications and databases. The system utilizes regular expression matching a

nano-graphrag is a retrieval system that uses knowledge graphs to provide structured context for large language model responses. It functions as a knowledge graph indexer that transforms unstructured text into a network of entities and relationships, as well as a hybrid graph retrieval system. The project differentiates itself by combining local neighborhood searches with global community summaries to answer complex natural language questions. It includes a knowledge graph visualizer that generates HTML representations of entities and their relationships to map indexed knowledge. The framewo

Named entity recognition is a natural language processing library that implements statistical and neural sequence labeling models to extract entities from text. The toolkit provides implementations for hidden Markov models, conditional random fields, and bidirectional recurrent neural networks combined with conditional random field layers. The library supports training machine learning models on annotated training corpora using maximum likelihood estimation for parameter and transition structure estimation. It includes ensemble majority voting consensus strategies to combine independent outpu

Gensim is a natural language processing toolkit designed for large-scale text analysis and the training of semantic vector embeddings. It provides a framework for identifying latent thematic structures within document collections and calculating semantic similarity between text segments using unsupervised statistical algorithms. The project is distinguished by its ability to handle datasets that exceed available system memory through incremental corpus streaming, which processes documents one at a time from disk. It utilizes sparse vector representations and dictionary-based token mapping to

Lihang is a statistical learning algorithm library and framework providing implementations of supervised and unsupervised machine learning models. It functions as a reference repository that translates statistical learning theories into executable code for data classification and pattern recognition. The project features specialized tools for probabilistic model implementation, utilizing likelihood estimation and Bayesian methods to determine optimal model parameters. It includes a sequential data labeling tool for identifying patterns in ordered data sequences and supports both linear and no

text2vec is a text vectorization toolkit and semantic similarity framework used to convert words and sentences into numerical vectors. It provides integrated toolsets for generating embeddings, calculating semantic closeness, and implementing lexical and semantic search. The project includes a model fine-tuning pipeline for optimizing embedding and matching models using supervised or unsupervised datasets. It further distinguishes itself by providing a text embedding API that allows vectorization models to be deployed as network services via gRPC or HTTP protocols. The framework covers a bro

This project is a TensorFlow implementation of a convolutional neural network designed for text classification. It functions as a deep learning text categorizer that assigns predefined labels to text documents by identifying and analyzing learned patterns within training sets. The model utilizes a sequence of embedding-layer vectorization, convolutional layers for feature extraction, and max-pooling downsampling to process text data. Final category probabilities are determined through a dense-layer classification system. The workflow covers the end-to-end machine learning lifecycle, includin

Compromise is a natural language processing library and rule-based text parser designed to analyze unstructured text. It functions as a toolkit for identifying parts of speech, linguistic patterns, and semantic meaning, while providing specialized engines for named entity recognition and the parsing of temporal and numeric data. The project is distinguished by its linguistic morphological engine, which can conjugate verbs across different tenses and inflect nouns and adjectives. It further allows for linguistic model customization through a plugin system that enables the extension of lexicons

Smile is a comprehensive JVM machine learning library and statistical computing toolkit. It provides a suite of algorithms for classification, regression, and clustering, implemented natively for Java, Scala, and Kotlin. The project also functions as a deep learning framework, a natural language processing library, and an inference engine for large language models. The library distinguishes itself through GPU acceleration via LibTorch bindings and support for the ONNX model interchange format. It includes specialized capabilities for large language model inference, featuring Byte-Pair Encodin

This repository is a comprehensive educational program and deep learning framework designed to teach practical deep learning using PyTorch through notebooks and code examples. It serves as a high-level library for building, training, and deploying neural networks, acting as a model training orchestrator that coordinates PyTorch models, optimizers, and loss functions. The project provides specialized toolkits for computer vision, natural language processing, and tabular data preprocessing. It distinguishes itself through advanced training controls such as discriminative learning rates, a two-w

Compromise is a natural language processing library and rule-based engine designed for English text manipulation, analysis, and parsing. It provides a toolkit for tokenizing text, identifying parts of speech, and performing linguistic analysis to achieve semantic understanding of unstructured strings. The project distinguishes itself through its ability to programmatically transform grammar, such as modifying verb tenses, noun plurality, and adjective forms. It also functions as a named entity recognizer capable of extracting people, places, organizations, dates, and contact information from

Racer is a self-driving remote-controlled car platform that integrates hardware schematics, an autonomous vehicle training framework, and a machine learning control system. It provides the necessary tools to build, train, and operate autonomous vehicles. The platform includes 3D-printable design files and electronic schematics for constructing custom vehicle chassis and circuitry. This hardware is supported by a software toolkit that translates model predictions into steering and speed commands for the physical vehicle. The system covers supervised learning processes that map sensor data to

This project is a computer vision system for monocular depth estimation and 3D point cloud generation. It provides a supervised depth learning framework and a depth predictor capable of estimating spatial distance and disparity from single 2D images using pretrained neural networks. The system includes tools to transform 2D depth images into 3D point clouds via pixel coordinate backprojection and converts 3D point cloud data into 2D depth maps. It utilizes a training pipeline that supports model fine-tuning and hyperparameter optimization. The library covers broader capabilities in spatial a

Transformers Tasks is a collection of toolkits and scripts dedicated to language model fine-tuning, natural language processing tasks, and transformer-based pipelines. The project functions as a natural language processing toolkit and transformer pipeline library, providing Python scripts and algorithms designed to adapt foundational language models and route text inputs through modular processing workflows. The repository covers supervised fine-tuning pipelines and reinforcement learning alignment procedures that optimize generative text outputs through reward modeling and policy gradient lo

This project is a conversational AI software development kit and framework used to build interactive chatbots that engage in natural language conversations and execute tasks for end users. It provides a multi-channel bot framework that connects conversational agents to various external messaging services using standardized adapters. The SDK includes a conversational workflow orchestrator and a natural language processing toolkit for analyzing user intent and extracting entities to route conversation flows. It further incorporates a speech integration framework that enables bidirectional audio

Synonyms is a natural language processing library and semantic similarity engine specifically designed for Chinese text. It functions as a word embedding toolkit and tokenizer that extracts semantic meaning and identifies synonyms by calculating the conceptual closeness between words and sentences. The system provides a toolkit for Chinese word embedding and synonym discovery, allowing for the retrieval of semantically similar words to expand vocabulary. It distinguishes itself through a configuration-driven approach to model loading, which supports the integration of custom word embeddings t

GraphGPT is an LLM knowledge graph generator that extracts entities and relationships from unstructured text to create visual knowledge graphs. It functions as a natural language graph interface and an unstructured data extraction pipeline, transforming raw text into structured triples for mapping complex information networks. The system enables dynamic knowledge mapping by allowing users to build and update network visualizations through conversational queries and text-based instructions. This allows for the conversion of unstructured data into visual graphs to identify patterns and connecti

SentencePiece is a text segmentation engine and tokenization library designed for machine learning workflows. It provides a comprehensive toolkit for transforming raw text into subword units or numerical identifiers, enabling consistent data representation for neural network training and inference. The library supports the training of segmentation models from raw text, allowing for the creation of custom vocabularies tailored to specific domain requirements. The project distinguishes itself through its byte-level encoding and fallback mechanisms, which ensure that every input can be represent

Spider is a web-based platform designed for automated data extraction, providing a centralized framework to collect, process, and route structured information from websites. It functions as a comprehensive pipeline that manages the entire lifecycle of data gathering, from initial configuration to final storage in external databases or message queues. The platform distinguishes itself through a visual configuration interface that allows users to define extraction rules and manage scraping templates without writing custom code. It supports both static and dynamic content retrieval by integratin

DeepPavlov is a conversational AI framework and deep learning NLP library designed for building end-to-end dialogue systems and chatbots. It functions as an NLP pipeline orchestrator that allows users to compose pre-trained models and text processing components into sequential data flows for complex linguistic tasks. The system is distinguished by its ability to act as a chatbot deployment server, exposing trained conversational models as web services via REST and Socket APIs. It utilizes JSON-based pipeline configurations and dynamic variable interpolation to decouple model logic from infras

bert4keras is a lightweight reimplementation of the BERT transformer architecture for the Keras deep learning framework. It serves as a natural language processing toolkit and transformer model library used for text classification, sequence labeling, and semantic embedding extraction. The framework includes a sequence-to-sequence model system for question answering and text generation, as well as a model inference server to deploy trained transformers as web APIs for real-time predictions. Capabilities cover a broad range of natural language understanding tasks, including reading comprehensi

Promptify is a suite of tools designed for model evaluation, prompt management, token cost tracking, structured extraction, and unified API gateway access. It provides a standardized interface to manage requests and responses across multiple large language model providers. The project features a prompt management platform for engineering and versioning prompts with structured output validation. It includes a dedicated evaluation framework to measure model performance using precision, recall, and f1 scores against labeled datasets, alongside a token cost tracker to monitor the financial expens