gpt3_tokenizer

Encoder/Decoder and tokens counter for GPT3

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install gpt3-tokenizer

Releases

Version Released Buster
Python 3.7
Bullseye
Python 3.9
Bookworm
Python 3.11
Files
0.1.5 2024-04-26      
0.1.4 2023-05-16    
0.1.3 2023-03-25    
0.1.2 2023-03-24    
0.1.1 2023-03-24    
0.1.0 2023-03-24    

Issues with this package?

Page last updated 2024-04-28 23:20:37 UTC