rftokenizer

A character-wise tokenizer for morphologically rich languages

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install rftokenizer

Releases

Version Released Bullseye
Python 3.9
Bookworm
Python 3.11
Files
2.3.2 2025-03-07    
2.3.1 2025-03-07    
2.3.0 2024-12-17    
2.2.0 2024-02-01    
2.0.1 2021-08-19  
2.0.0 2021-08-19  
1.1.0 2020-05-23  
1.0.1 2019-08-01  

Issues with this package?

Page last updated 2025-03-07 22:13:45 UTC