NLP开源中文分词工具

Jieba: https://github.com/fxsjy/jieba

SnowNLP: https://github.com/isnowfy/snownlp

PkuSeg: https://github.com/lancopku/pkuseg-python

THULAC: https://github.com/thunlp/THULAC-Python

pyhanlp: https://github.com/hankcs/pyhanlp

pyltp: https://github.com/HIT-SCIR/pyltp

stanfordcorenlp: https://github.com/Lynten/stanford-corenlp

 

ref：

Python中文分词工具大合集：安装、使用和测试