hugtokencraft

HugTokenCraft is a user-friendly Python library that simplifies the process of modifying the vocabulary of a PreTrainedTokenizer from HuggingFace Transformers, making it accessible without additional…

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install hugtokencraft

Releases

Version Released Bullseye
Python 3.9
Bookworm
Python 3.11
Files
0.1.0 2024-05-21    

Issues with this package?

Page last updated 2025-06-27 17:16:45 UTC