piwheels

tokenizer-xm

Tokenizing with options to include contractions, lemmatize and stem.

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install tokenizer-xm

Dependencies

• nltk
• pandas

Releases

Version	Released	Bookworm Python 3.11	Trixie Python 3.13	Files
1.0.2	2021-08-31
tokenizer_xm-1.0.2-py3-none-any.whl (7 KB)
1.0.1	2021-08-31
tokenizer_xm-1.0.1-py3-none-any.whl (7 KB)
1.0	2021-08-31
tokenizer_xm-1.0-py3-none-any.whl (7 KB)
0.5	2019-12-09
tokenizer_xm-0.5-py3-none-any.whl (5 KB)
0.4	2019-11-19
tokenizer_xm-0.4-py3-none-any.whl (3 KB)
0.2	2019-09-20
tokenizer_xm-0.2-py3-none-any.whl (4 KB)
0.1	2019-09-20
tokenizer_xm-0.1-py3-none-any.whl (4 KB)

Issues with this package?

• Search issues for this package
• Package or version missing? Open a new issue
• Something else? Open a new issue