piwheels

lm-eval

A framework for evaluating language models

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install lm-eval

Dependencies

• scikit-learn
• pybind11
• more-itertools
• jsonlines
• accelerate
• pytablewriter
• zstandard
• torch
• tqdm-multiprocess
• transformers
• rouge-score
• evaluate
• datasets
• sacrebleu
• sqlitedict
• numexpr
• word2number
• dill
• peft

Releases

Version	Released	Bullseye Python 3.9	Bookworm Python 3.11	Files
0.4.9.1	2025-08-04
lm_eval-0.4.9.1-py3-none-any.whl (7 MB)
0.4.9	2025-06-19
lm_eval-0.4.9-py3-none-any.whl (7 MB)
0.4.8	2025-03-05
lm_eval-0.4.8-py3-none-any.whl (4 MB)
0.4.7	2024-12-17
lm_eval-0.4.7-py3-none-any.whl (2 MB)
0.4.5	2024-10-08
lm_eval-0.4.5-py3-none-any.whl (2 MB)
0.4.4	2024-09-05
lm_eval-0.4.4-py3-none-any.whl (2 MB)
0.4.3	2024-07-01
lm_eval-0.4.3-py3-none-any.whl (2 MB)
0.4.2	2024-03-18
lm_eval-0.4.2-py3-none-any.whl (1 MB)
0.4.1	2024-01-31
lm_eval-0.4.1-py3-none-any.whl (1 MB)
0.4.0	2023-12-22
lm_eval-0.4.0-py3-none-any.whl (972 KB)
0.3.0	2022-12-08
lm_eval-0.3.0-py3-none-any.whl (174 KB)
0.2.0	2022-03-07
lm_eval-0.2.0-py3-none-any.whl (140 KB)
0.0.1	2021-09-02
lm_eval-0.0.1-py3-none-any.whl (100 KB)

Issues with this package?

• Search issues for this package
• Package or version missing? Open a new issue
• Something else? Open a new issue