tokenizers-collection

A simple iterator for using a set of Chinese tokenizer

Installation

sudo pip3 install tokenizers-collection

Should I use sudo? pip or pip3?

Releases

Version Released Buster
Python 3.7
Bullseye
Python 3.9
Files
0.1.2 2018-08-28    
0.1.1 2018-08-28    
0.1.0 2018-08-28    

Issues with this package?

Page last updated 2022-08-04 05:51:58 UTC