2 repository-uri
Awesome GitHub RepositoriesParallel Translation Corpora
Aligned multilingual text datasets used for training machine translation models.
Distinct from Parallel Corpus Mining: Focuses on the provided dataset itself rather than the mining techniques used to create it.
Explore 2 awesome GitHub repositories matching data & databases · Parallel Translation Corpora. Refine with filters or upvote what's useful.
Awesome Parallel Translation Corpora GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- brightmart/nlp_chinese_corpus
brightmart/nlp_chinese_corpus
9,903Vezi pe GitHubThis is a large-scale collection of curated Chinese text corpora designed for training natural language processing models. The project provides a variety of datasets, including a deduplicated archive of millions of news articles with titles and keywords, high-quality categorized question-and-answer pairs, and parallel translation corpora. The collection includes millions of aligned Chinese and English sentence pairs used for cross-lingual model training and machine translation development. It also contains filtered question-and-answer data organized by label for the construction of knowledge-
Provides millions of aligned Chinese and English sentence pairs for machine translation training.
bertchinesechinese-corpus - esbatmop/mnbvc
esbatmop/MNBVC
4,123Vezi pe GitHubMNBVC is a dataset pipeline and toolkit designed for the collection, cleaning, and normalization of massive text and code corpora used to train large language models. It provides specialized tools for harvesting source code, commit histories, and repository metadata from version control platforms, alongside a multilingual text corpus collector for gathering parallel text and academic papers. The project distinguishes itself through comprehensive capabilities for processing diverse document types, including a PDF-to-text converter that transforms complex layouts and formulas into structured JS
Provides access to multilingual datasets where Chinese text is aligned with equivalent translations in multiple other languages.
chinesechinese-languagechinese-nlp
