fast-tokenizer-python

PaddleNLP Fast Tokenizer Library written in C++

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install fast-tokenizer-python

Releases

Version Released Buster
Python 3.7
Bullseye
Python 3.9
Bookworm
Python 3.11
Files
1.0.2.post1 2023-02-19
1.0.2 2023-02-17
1.0.1 2023-01-12
1.0.0 2022-11-18

Issues with this package?

Page last updated 2023-10-28 04:31:12 UTC