piwheels

easy-tokenizer

tokenizer tool

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install easy-tokenizer

Dependencies

• None

Releases

Version	Released	Bookworm Python 3.11	Trixie Python 3.13	Files
0.0.10	2020-03-03
easy_tokenizer-0.0.10-py2.py3-none-any.whl (9 KB)
0.0.9	2020-01-16
easy_tokenizer-0.0.9-py2.py3-none-any.whl (9 KB)
0.0.8	2019-11-14
easy_tokenizer-0.0.8-py2.py3-none-any.whl (9 KB)
0.0.7	2019-11-14
easy_tokenizer-0.0.7-py2.py3-none-any.whl (9 KB)
0.0.5	2019-10-24
easy_tokenizer-0.0.5-py2.py3-none-any.whl (8 KB)
0.0.4	2019-10-24
easy_tokenizer-0.0.4-py2.py3-none-any.whl (8 KB)
0.0.2	2019-10-23
easy_tokenizer-0.0.2-py2.py3-none-any.whl (8 KB)
0.0.1	2019-10-23
easy_tokenizer-0.0.1-py2.py3-none-any.whl (8 KB)

Issues with this package?

• Search issues for this package
• Package or version missing? Open a new issue
• Something else? Open a new issue