Sockeye is an open-source sequence-to-sequence framework for Neural Machine Translation built on PyTorch. It implements distributed training and optimized inference for state-of-the-art models, powering Amazon Translate and other MT applications. Recent developments and changes are tracked in…
The main features of awslabs/sockeye are: Natural Language Processing, Python NLP Libraries.
Open-source alternatives to awslabs/sockeye include: stanfordnlp/stanza — Stanza is a Python natural language processing library designed for tokenization, lemmatization, and dependency… columbia-applied-data-science/rosetta — Tools, wrappers, etc... for data science with a concentration on text processing. allenai/allennlp — AllenNLP is a PyTorch-based research library and deep learning language toolkit designed for developing and training… artificiai/multilingual-latent-dirichlet-allocation-lda — A Multilingual Latent Dirichlet Allocation (LDA) Pipeline with Stop Words Removal, n-gram features, and Inverse… chartbeat-labs/textacy — NLP, before and after spaCy. bigartm/bigartm — Fast topic modeling platform.
Stanza is a Python natural language processing library designed for tokenization, lemmatization, and dependency parsing across many human languages using neural models. It provides a neural processing pipeline that converts raw text into structured linguistic data objects, alongside a specialized analyzer for extracting medical insights from clinical and biomedical language. The project includes a wrapper that connects Python scripts to Java-based natural language processing tools and remote annotation servers. This enables a bridge for extracting linguistic annotations and analysis data from
AllenNLP is a PyTorch-based research library and deep learning language toolkit designed for developing and training neural network architectures for linguistic tasks. It provides a distributed training system that coordinates data and gradients across multiple GPUs and a framework for integrating pretrained transformer architectures. The system distinguishes itself with a dedicated algorithmic bias mitigation tool used to identify and reduce bias in linguistic model predictions. It also includes model influence analysis to interpret predictions by calculating the influence of specific traini
A Multilingual Latent Dirichlet Allocation (LDA) Pipeline with Stop Words Removal, n-gram features, and Inverse Stemming, in Python.
