llmtokens

Count tokens and explore chat templates using HuggingFace tokenizers or OpenAI tiktoken

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install llmtokens

Dependencies

Releases

Version Released Bullseye
Python 3.9
Bookworm
Python 3.11
Trixie
Python 3.13
Files
0.1.1 2026-02-01      
0.1.0 2026-02-01      

Issues with this package?

Page last updated 2026-02-28 08:23:14 UTC