1 repositorio
Awesome GitHub RepositoriesCustom Language Model Loaders
Replace the default Kenlm language model with a user-trained or smaller model for resource-constrained environments.
Distinct from Language Modeling Data Loading: Distinct from Language Modeling Data Loading: focuses on loading custom language models for inference, not data loading for training.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Custom Language Model Loaders. Refine with filters or upvote what's useful.
Awesome Custom Language Model Loaders GitHub Repositories
Encuentra los mejores repositorios con IA.Buscaremos los repositorios que mejor coincidan usando IA.
- shibing624/pycorrector
shibing624/pycorrector
6,473Ver en GitHubpycorrector is an open-source toolkit for detecting and correcting spelling and grammar errors in Chinese text. It combines multiple correction approaches, including rule-based methods using Kenlm n-gram language models and confusion sets, as well as deep learning correctors built on BERT, GPT, and T5 models. The toolkit also provides a command-line interface for batch processing Chinese text files with configurable detection and output options. The project distinguishes itself by offering a range of correction strategies that can be mixed and matched. Rule-based correction uses character-lev
Replaces the default Kenlm language model with a user-trained or smaller model for resource-constrained environments.
Pythoncscerror-correctionerror-detection
