tokenizer-adapter

A simple to adapt a pretrained language model to a new vocabulary

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install tokenizer-adapter

Dependencies

  • None

Releases

Version Released Bullseye
Python 3.9
Bookworm
Python 3.11
Trixie
Python 3.13
Files
0.2.0 2025-08-12      
0.1.2 2024-01-17      
0.1.1 2024-01-15      
0.1.0 2024-01-15      

Issues with this package?

Page last updated 2025-10-21 18:57:34 UTC