This project is a Chinese text segmentation library and tokenizer designed to split Chinese sentences into individual words. It serves as a natural language processing tool for splitting characters into words, tagging parts of speech, and extracting keywords using statistical analysis. The library distinguishes itself through support for custom dictionary configuration and vocabulary file management, allowing users to override default segmentation rules for domain-specific accuracy. It also includes a TF-IDF keyword extractor to identify significant words and core topics within documents. Th
SnowNLP is a Python library for Chinese natural language processing. It provides tools for text segmentation, sentiment analysis, document classification, and phonetic transliteration. The library includes capabilities for training and saving custom machine learning models for tokenization and sentiment analysis using raw training datasets. It covers a range of linguistic processing areas, including parts of speech tagging, sentence splitting, and text similarity measurement. The toolkit also provides utilities for extracting key information through text summarization and calculating word im
This project is a community-driven knowledge base and curated repository focused on natural language processing and large language model development. It serves as a centralized index for high-quality tools, libraries, and research materials, organizing technical resources into structured, version-controlled documentation to assist developers in navigating the evolving artificial intelligence ecosystem. The repository distinguishes itself by acting as an aggregator for AI model evaluation and benchmarking. It provides access to tools that enable the simultaneous comparison of multiple conversa
Python bindings to the dutch NLP tool Frog (pos tagger, lemmatiser, NER tagger, morphological analysis, shallow parser, dependency parser)
The main features of proycon/python-frog are: Natural Language Processing, NLP Frameworks.
Open-source alternatives to proycon/python-frog include: isnowfy/snownlp — SnowNLP is a Python library for Chinese natural language processing. It provides tools for text segmentation,… fxsjy/jieba — This project is a Chinese text segmentation library and tokenizer designed to split Chinese sentences into individual… fighting41love/funnlp — This project is a community-driven knowledge base and curated repository focused on natural language processing and… 2shou/textgrocery — A simple short-text classification tool based on LibLinear. abadojack/whatlanggo — Natural language detection library for Go. a2800276/porter — porter stemmer.
