lm-datasets

A collection of datasets for language model training including scripts for downloading, preprocesssing, and sampling.

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install lm-datasets

Dependencies

Releases

Version Released Bullseye
Python 3.9
Bookworm
Python 3.11
Trixie
Python 3.13
Files
0.0.2 2023-12-15      
0.0.1 2023-09-18      

Issues with this package?

Page last updated 2026-05-12 23:13:12 UTC