PyThaiNLP v3.1.0 Released!

This is the release version for PyThaiNLP v3.1.0

You can install by pip install pythainlp==3.1.0.

Documentation: https://pythainlp.github.io/docs/3.1

Report bug: https://github.com/PyThaiNLP/pythainlp/issues

See PyThaiNLP 3.1 change log

See 3.1 Milestone.

What is new?

Deprecation and other API changes

#687 Remove deprecated function

• pythainlp.word_vector; doesnt_match, get_model, most_similar_cosmul, sentence_vectorizer, similarity. use WordVector class instead
• pythainlp.util.delete_tone. use pythainlp.util.remove_tonemark instead
• Remove pythainlp.util.time_time. use pythainlp.util.time_to_thaiword instead
• pythainlp.tokenize.syllable_tokenize. use pythainlp.tokenize.subword_tokenize instead

Dependency Parsing

• Now, PyThaiNLP support dependency_parsing 🎉 Add pythainlp.parse.dependency_parsing #706

Name Entity Tagging

• #665 Add Thai-NNER pythainlp.tag.NNER
• #658 Add LST20NER onnx model. It is LST20NER model to onnx model from fine-turning by WangchanBERTa model.

Transliteration

• #659 Add ISO 11940 transliteration
• #660 Add Thai W2P v0.2
• #686 Add wunsen
• #694 Wunsen Mandarin and Japanese update

PyThaiNLP Corpus downloader

• #656 Add support zip/tar.gz to download corpus

Text normalization

• #673 Add a normalising rule for Lakkhangyao ๅ

Translate

• #674 add gpu option

Text summarize

• #679 Add mt5 cpe kmutt thai sentence sum

Util

• #682 Add live-dead syllable classification
• #684 Add live dead syllable classify
• #690 Add tone detector

Soundex

• #699 Add Thai-English Cross-Language Transliterated Word Retrieval using Soundex Technique

Other

• #689 map NG tag to PART
• #691 Remove TinyDB as a dependency
• #692 Fix notifications that newer versions of corpora are available
• Add warning about LST20 license

Contributors

New Contributors

• @chameleonTK made their first contribution in #673
• @vikimark made their first contribution in #674
• @BLKSerene made their first contribution in #691
• @cakimpei made their first contribution in #694

Full Changelog: v3.0.10...v3.1.0

All Contributors

Thanks all the contributors. (Image made with contributors-img)

We build Thai NLP.

PyThaiNLP