jptranstokenizer

Japanese tokenizer with transformers library

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install jptranstokenizer

Releases

Version Released Bullseye
Python 3.9
Bookworm
Python 3.11
Files
0.4.0 2024-02-02    
0.3.2 2023-05-09  
0.3.1 2023-03-04  
0.3.0 2023-02-08  
0.2.0 2023-01-19  
0.1.3 2022-12-30  
0.1.2 2022-10-17  
0.1.0 2022-09-27  
0.0.4 2022-09-26  
0.0.3 2022-09-21  
0.0.2 2022-08-24  
0.0.1 2022-08-24  

Issues with this package?

Page last updated 2025-07-17 20:54:35 UTC