lm-datasets

A collection of datasets for language model training including scripts for downloading, preprocesssing, and sampling.

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install lm-datasets

Dependencies

Releases

Version Released Bookworm
Python 3.11
Trixie
Python 3.13
Files
0.0.2 2023-12-15    
0.0.1 2023-09-18    

Issues with this package?

Page last updated 2026-09-03 09:26:54 UTC