japre

Custom pretokenizers for Japanese language models

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install japre

Releases

Version Released Bullseye
Python 3.9
Bookworm
Python 3.11
Files
0.1.4 2022-04-18  
0.1.3 2022-04-15  
0.1.2 2022-04-15  
0.1.1 2022-04-15  
0.1.0 2022-04-15  

Issues with this package?

Page last updated 2025-07-18 04:09:15 UTC