evalscope
EvalScope: Lightweight LLMs Evaluation Framework
Installation
In a virtualenv (see these instructions if you need to create one):
pip3 install evalscope
Dependencies
- pyyaml
- word2number
- sacrebleu
- zhconv
- requests
- openai
- rouge-score
- jsonschema
- jieba
- jinja2
- more-itertools
- pandas
- sympy
- overrides
- pydantic
- rouge-chinese
- tqdm
- rich
- pillow
- jsonlines
- colorlog
- tabulate
- dotenv
- pylatexenc
- transformers
- docstring-parser
- latex2sympy2-extended
- modelscope
- nltk
- plotly
- markdown
- editdistance
Releases
| Version | Released | Bullseye Python 3.9 |
Bookworm Python 3.11 |
Trixie Python 3.13 |
Files |
|---|---|---|---|---|---|
| 1.6.0 | 2026-04-13 | ||||
| 1.5.2.post1 | 2026-03-31 | ||||
| 1.5.2 | 2026-03-31 | ||||
| 1.5.1 | 2026-03-23 | ||||
| 1.5.0 | 2026-03-10 | ||||
| 1.4.2 | 2026-01-19 | ||||
| 1.4.1 | 2026-01-05 | ||||
| 1.4.0 | 2025-12-16 | ||||
| 1.3.0 | 2025-11-28 | ||||
| 1.2.0 | 2025-11-11 | ||||
|
|||||
| 1.1.1 | 2025-10-27 | ||||
|
|||||
| 1.1.0 | 2025-10-14 | ||||
|
|||||
| 1.0.2 | 2025-09-23 | ||||
|
|||||
| 1.0.1 | 2025-09-05 | ||||
|
|||||
| 1.0.0 | 2025-08-25 | ||||
|
|||||
| 0.17.1 | 2025-07-21 | ||||
|
|||||
| 0.17.0 | 2025-07-04 | ||||
|
|||||
| 0.16.3 | 2025-06-24 | ||||
| 0.16.2 | 2025-06-23 | ||||
| 0.16.1 | 2025-06-03 | ||||
| 0.16.0 | 2025-05-19 | ||||
| 0.15.1 | 2025-04-30 | ||||
| 0.15.0 | 2025-04-28 | ||||
| 0.14.0 | 2025-04-10 | ||||
| 0.13.2 | 2025-04-01 | ||||
| 0.13.1 | 2025-03-24 | ||||
| 0.13.0 | 2025-03-14 | ||||
| 0.12.1 | 2025-03-10 | ||||
| 0.12.0 | 2025-02-27 | ||||
| 0.11.0 | 2025-02-13 | ||||
| 0.10.1 | 2025-01-23 | ||||
| 0.10.0 | 2025-01-20 | ||||
| 0.9.0 | 2025-01-03 | ||||
| 0.8.2 | 2024-12-26 | ||||
| 0.8.1 | 2024-12-17 | ||||
| 0.8.0 | 2024-12-14 | ||||
| 0.7.2 | 2024-12-04 | ||||
| 0.7.1 | 2024-11-28 | ||||
| 0.7.0 | 2024-11-28 | ||||
| 0.6.1 | 2024-11-22 | ||||
|
|
|||||
| 0.6.0 | 2024-11-08 | ||||
|
|
|||||
| 0.6.0rc0 pre-release | 2024-11-14 | ||||
|
|
|||||
| 0.5.5 | 2024-10-15 | ||||
|
|
|||||
| 0.5.5rc1 pre-release | 2024-09-29 | ||||
|
|
|||||
| 0.5.5rc0 pre-release | 2024-09-24 | ||||
|
|
|||||
| 0.5.4 | 2024-09-23 | ||||
|
|
|||||
| 0.5.3 | 2024-08-29 | ||||
|
|
|||||
| 0.5.2 | 2024-08-05 | ||||
|
|
|||||
| 0.5.0 | 2024-07-29 | ||||
|
|
|||||
| 0.5.0rc0 pre-release | 2024-07-29 | ||||
|
|
|||||
Issues with this package?
- Search issues for this package
- Package or version missing? Open a new issue
- Something else? Open a new issue