sentencepiece

Unsupervised text tokenizer and detokenizer.

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install sentencepiece

Dependencies

  • None

Releases

Version Released Bullseye
Python 3.9
Bookworm
Python 3.11
Files
0.2.1 2025-08-12
0.2.0 2024-02-19    
0.1.99 2023-05-02    
0.1.98 2023-04-12    
0.1.97 2022-08-07    
0.1.96 2021-06-18    
0.1.95 2021-01-10    
0.1.94 2020-10-24    
0.1.92 yanked 2020-06-08    
0.1.91 2020-05-21    
0.1.90 2020-05-13
0.1.86 2020-04-24    
0.1.85 2019-12-15
0.1.83 2019-08-16    
0.1.82 2019-04-13
0.1.81 2019-03-22
0.1.8 2019-01-11
0.1.7 2018-12-26
0.1.6 2018-11-12
0.1.5 2018-10-29
0.1.4 2018-08-26
0.1.3 2018-07-30    
0.1.2 2018-07-13    
0.1.1 2018-06-26    
0.1.0 2018-06-10    
0.0.9 2018-05-11    
0.0.7 2018-04-29    
0.0.6 2018-04-18    
0.0.5 2018-04-09    
0.0.4 2018-02-28    
0.0.3 2017-12-17    
0.0.2 2017-11-08    
0.0.0 2017-08-28    

Issues with this package?

Page last updated 2025-08-16 17:36:26 UTC