piwheels

mosestokenizer

Wrappers for several pre-processing scripts from the Moses toolkit.

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install mosestokenizer

Dependencies

• openfile
• uctools
• toolwrapper
• docopt

Releases

Version	Released	Bullseye Python 3.9	Bookworm Python 3.11	Trixie Python 3.13	Files
1.2.1	2021-10-22
mosestokenizer-1.2.1-py3-none-any.whl (48 KB)
1.1.0	2019-10-24
mosestokenizer-1.1.0-py3-none-any.whl (48 KB)
1.0.0	2017-05-24
mosestokenizer-1.0.0-py3-none-any.whl (50 KB)
0.5.0	2017-05-24
mosestokenizer-0.5.0-py3-none-any.whl (48 KB)
0.3.0	2016-08-17
mosestokenizer-0.3.0-py3-none-any.whl (43 KB)

Issues with this package?

• Search issues for this package
• Package or version missing? Open a new issue
• Something else? Open a new issue