maketoken

分词工具, 把文件中的词分割成token

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install maketoken

Dependencies

Releases

Version Released Bookworm
Python 3.11
Trixie
Python 3.13
Files
0.0.3 2020-03-05
0.0.2 2020-03-05

Issues with this package?

Page last updated 2026-09-03 03:23:17 UTC