1 repository
Awesome GitHub RepositoriesCustom Language Model Loaders
Replace the default Kenlm language model with a user-trained or smaller model for resource-constrained environments.
Distinct from Language Modeling Data Loading: Distinct from Language Modeling Data Loading: focuses on loading custom language models for inference, not data loading for training.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Custom Language Model Loaders. Refine with filters or upvote what's useful.
Awesome Custom Language Model Loaders GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- shibing624/pycorrector
shibing624/pycorrector
6,473Vezi pe GitHubpycorrector is an open-source toolkit for detecting and correcting spelling and grammar errors in Chinese text. It combines multiple correction approaches, including rule-based methods using Kenlm n-gram language models and confusion sets, as well as deep learning correctors built on BERT, GPT, and T5 models. The toolkit also provides a command-line interface for batch processing Chinese text files with configurable detection and output options. The project distinguishes itself by offering a range of correction strategies that can be mixed and matched. Rule-based correction uses character-lev
Replaces the default Kenlm language model with a user-trained or smaller model for resource-constrained environments.
Pythoncscerror-correctionerror-detection
