piwheels

transformer-smaller-training-vocab

Temporary remove unused tokens during training to save ram and speed.

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install transformer-smaller-training-vocab

Dependencies

• torch
• transformers

Releases

Version	Released	Bullseye Python 3.9	Bookworm Python 3.11	Files
0.4.2	2025-06-15
transformer_smaller_training_vocab-0.4.2-py3-none-any.whl (14 KB)
0.4.1	2025-04-16
transformer_smaller_training_vocab-0.4.1-py3-none-any.whl (14 KB)
0.4.0	2024-04-05
transformer_smaller_training_vocab-0.4.0-py3-none-any.whl (14 KB)
0.3.3	2023-12-04
transformer_smaller_training_vocab-0.3.3-py3-none-any.whl (14 KB)
0.3.2	2023-09-18
transformer_smaller_training_vocab-0.3.2-py3-none-any.whl (14 KB)
0.3.1	2023-08-17
transformer_smaller_training_vocab-0.3.1-py3-none-any.whl (14 KB)
0.2.4	2023-05-22
transformer_smaller_training_vocab-0.2.4-py3-none-any.whl (14 KB)
0.2.3	2023-03-25
transformer_smaller_training_vocab-0.2.3-py3-none-any.whl (12 KB)
0.2.2	2023-03-20
transformer_smaller_training_vocab-0.2.2-py3-none-any.whl (12 KB)
0.2.1	2023-03-17
transformer_smaller_training_vocab-0.2.1-py3-none-any.whl (12 KB)
0.2.0	2023-02-19
transformer_smaller_training_vocab-0.2.0-py3-none-any.whl (12 KB)
0.1.8	2023-02-05
transformer_smaller_training_vocab-0.1.8-py3-none-any.whl (12 KB)
0.1.7	2023-01-06
transformer_smaller_training_vocab-0.1.7-py3-none-any.whl (12 KB)
0.1.0	2023-01-06
transformer_smaller_training_vocab-0.1.0-py3-none-any.whl (12 KB)

Issues with this package?

• Search issues for this package
• Package or version missing? Open a new issue
• Something else? Open a new issue