piwheels

lighteval

A lightweight and configurable evaluation package

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install lighteval

Dependencies

• openai
• nltk
• scikit-learn
• gitpython
• termcolor
• numpy
• typer
• rich
• torch
• pytablewriter
• pydantic
• httpx
• sentencepiece
• langcodes
• transformers
• hf-xet
• accelerate
• rouge-score
• pycountry
• colorlog
• huggingface-hub
• inspect-ai
• fsspec
• sacrebleu
• datasets
• aenum
• protobuf
• latex2sympy2-extended

Releases

Version	Released	Bullseye Python 3.9	Bookworm Python 3.11	Trixie Python 3.13	Files
0.13.0	2025-11-24
lighteval-0.13.0-py3-none-any.whl (598 KB)
0.12.2	2025-11-12
lighteval-0.12.2-py3-none-any.whl (589 KB)
0.12.1	2025-11-06
lighteval-0.12.1-py3-none-any.whl (590 KB)
0.12.0	2025-11-04
lighteval-0.12.0-py3-none-any.whl (591 KB)
0.11.0	2025-09-22
lighteval-0.11.0-py3-none-any.whl (452 KB)
0.10.0	2025-05-22
lighteval-0.10.0-py3-none-any.whl (423 KB)
0.9.2	2025-05-07
lighteval-0.9.2-py3-none-any.whl (408 KB)
0.9.1	2025-05-07
lighteval-0.9.1-py3-none-any.whl (408 KB)
0.9.0	2025-05-06
lighteval-0.9.0-py3-none-any.whl (408 KB)
0.8.1	2025-03-24
lighteval-0.8.1-py3-none-any.whl (401 KB)
0.7.0	2025-01-03
lighteval-0.7.0-py3-none-any.whl (343 KB)
0.6.2	2024-10-23
lighteval-0.6.2-py3-none-any.whl (328 KB)
0.5.0	2024-09-24
lighteval-0.5.0-py3-none-any.whl (256 KB)
0.4.0a0 pre-release	2024-09-05
lighteval-0.4.0a0-py3-none-any.whl (255 KB)
0.3.0	2024-03-29
lighteval-0.3.0-py3-none-any.whl (222 KB)
0.3.0a0 pre-release	2024-03-29
lighteval-0.3.0a0-py3-none-any.whl (222 KB)
0.2.0	2024-03-01
lighteval-0.2.0-py3-none-any.whl (158 KB)
0.1.1	2024-02-09
lighteval-0.1.1-py3-none-any.whl (156 KB)
0.1.1.dev0 pre-release	2024-02-09
lighteval-0.1.1.dev0-py3-none-any.whl (156 KB)
0.1.0	2024-02-08
lighteval-0.1.0-py3-none-any.whl (136 KB)
0.0.2	2024-02-08
lighteval-0.0.2-py3-none-any.whl (136 KB)
0.0.1	2023-10-19

Issues with this package?

• Search issues for this package
• Package or version missing? Open a new issue
• Something else? Open a new issue