tiny_tokenizer

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install tiny-tokenizer

Releases

Version Released Bullseye
Python 3.9
Bookworm
Python 3.11
Files
3.4.0 2020-08-15    
3.3.0 2020-08-15    
3.2.0 2020-08-15    
3.1.0 2019-12-28  
3.0.2 2019-12-23  
3.0.1 2019-09-27  
3.0.0 2019-09-27  
2.1.0 2019-07-22  
2.0.0 2019-07-10  
1.3.1 2019-07-09  
1.3.0 2019-06-27  
1.2.1 2019-06-14  
1.2.0 2019-05-28  
1.1.0 2018-12-25  
1.0.4 2018-12-25  
1.0.3 2018-12-25  
1.0.2 2018-11-21  
1.0.1 2018-09-09  
1.0 2018-09-09  

Issues with this package?

Page last updated 2025-06-27 22:09:04 UTC