inspect-ai
Framework for large language model evaluations
Installation
In a virtualenv (see these instructions if you need to create one):
pip3 install inspect-ai
Dependencies
- jsonref
- jsonlines
- debugpy
- nest-asyncio2
- python-dotenv
- jsonschema
- psutil
- sniffio
- pyyaml
- pydantic
- jsonpatch
- shortuuid
- ijson
- s3fs
- typing-extensions
- exceptiongroup
- beautifulsoup4
- rich
- fsspec
- docstring-parser
- aioboto3
- frozendict
- semver
- anyio
- zipp
- click
- httpx
- jsonpath-ng
- textual
- platformdirs
- boto3
- universal-pathlib
- mmh3
- numpy
- tenacity
- aiohttp
Releases
| Version | Released | Bullseye Python 3.9 |
Bookworm Python 3.11 |
Trixie Python 3.13 |
Files |
|---|---|---|---|---|---|
| 0.3.153 | 2025-12-06 | ||||
| 0.3.152 | 2025-12-05 | ||||
| 0.3.151 | 2025-12-01 | ||||
| 0.3.150 | 2025-11-25 | ||||
| 0.3.149 | 2025-11-23 | ||||
| 0.3.148 | 2025-11-21 | ||||
| 0.3.147 | 2025-11-21 | ||||
| 0.3.146 | 2025-11-15 | ||||
| 0.3.145 | 2025-11-09 | ||||
| 0.3.144 | 2025-11-05 | ||||
| 0.3.143 | 2025-10-30 | ||||
| 0.3.142 | 2025-10-27 | ||||
| 0.3.141 | 2025-10-27 | ||||
| 0.3.140 | 2025-10-20 | ||||
| 0.3.139 | 2025-10-18 | ||||
| 0.3.138 | 2025-10-16 | ||||
| 0.3.137 | 2025-10-07 | ||||
| 0.3.136 | 2025-10-03 | ||||
| 0.3.135 | 2025-09-30 | ||||
| 0.3.134 | 2025-09-27 | ||||
| 0.3.133 | 2025-09-22 | ||||
| 0.3.132 | 2025-09-12 | ||||
| 0.3.131 | 2025-09-09 | ||||
| 0.3.130 | 2025-09-07 | ||||
| 0.3.129 | 2025-09-03 | ||||
| 0.3.128 | 2025-09-02 | ||||
| 0.3.127 | 2025-09-01 | ||||
| 0.3.126 | 2025-09-01 | ||||
| 0.3.125 | 2025-08-25 | ||||
| 0.3.124 | 2025-08-24 | ||||
| 0.3.123 | 2025-08-16 | ||||
| 0.3.122 | 2025-08-11 | ||||
| 0.3.121 | 2025-08-10 | ||||
| 0.3.120 | 2025-08-07 | ||||
| 0.3.119 | 2025-08-04 | ||||
| 0.3.118 | 2025-08-02 | ||||
| 0.3.117 | 2025-07-31 | ||||
| 0.3.116 | 2025-07-27 | ||||
| 0.3.115 | 2025-07-26 | ||||
| 0.3.114 | 2025-07-17 | ||||
| 0.3.113 | 2025-07-16 | ||||
| 0.3.112 | 2025-07-03 | ||||
| 0.3.111 | 2025-06-29 | ||||
| 0.3.110 | 2025-06-28 | ||||
| 0.3.109 | 2025-06-27 | ||||
| 0.3.108 | 2025-06-25 | ||||
| 0.3.107 | 2025-06-24 | ||||
| 0.3.106 | 2025-06-21 | ||||
| 0.3.105 | 2025-06-17 | ||||
| 0.3.104 | 2025-06-12 | ||||
| 0.3.103 | 2025-06-06 | ||||
| 0.3.102 | 2025-06-06 | ||||
| 0.3.101 | 2025-06-05 | ||||
| 0.3.100 | 2025-06-01 | ||||
| 0.3.99 | 2025-05-22 | ||||
| 0.3.98 | 2025-05-18 | ||||
| 0.3.97 | 2025-05-16 | ||||
| 0.3.96 | 2025-05-13 | ||||
| 0.3.95 | 2025-05-10 | ||||
| 0.3.94 | 2025-05-06 | ||||
| 0.3.93 | 2025-05-01 | ||||
| 0.3.92 | 2025-04-26 | ||||
| 0.3.91 | 2025-04-26 | ||||
| 0.3.90 | 2025-04-21 | ||||
| 0.3.89 | 2025-04-17 | ||||
| 0.3.88 | 2025-04-11 | ||||
| 0.3.87 | 2025-04-10 | ||||
| 0.3.86 | 2025-04-09 | ||||
| 0.3.85 | 2025-04-08 | ||||
| 0.3.84 | 2025-04-07 | ||||
| 0.3.83 | 2025-04-07 | ||||
| 0.3.82 | 2025-04-02 | ||||
| 0.3.81 | 2025-03-30 | ||||
| 0.3.80 | 2025-03-30 | ||||
| 0.3.79 | 2025-03-26 | ||||
| 0.3.78 | 2025-03-25 | ||||
| 0.3.77 | 2025-03-25 | ||||
| 0.3.76 | 2025-03-23 | ||||
| 0.3.75 | 2025-03-18 | ||||
| 0.3.74 | 2025-03-15 | ||||
| 0.3.73 | 2025-03-14 | ||||
| 0.3.72 | 2025-03-03 | ||||
| 0.3.71 | 2025-03-01 | ||||
| 0.3.70 | 2025-02-25 | ||||
| 0.3.69 | 2025-02-20 | ||||
| 0.3.68 | 2025-02-19 | ||||
| 0.3.67 | 2025-02-18 | ||||
| 0.3.66 | 2025-02-17 | ||||
| 0.3.65 | 2025-02-16 | ||||
| 0.3.64 | 2025-02-14 | ||||
| 0.3.63 | 2025-02-07 | ||||
| 0.3.62 | 2025-02-03 | ||||
| 0.3.61 | 2025-01-31 | ||||
| 0.3.60 | 2025-01-29 | ||||
| 0.3.59 | 2025-01-24 | ||||
| 0.3.58 | 2025-01-16 | ||||
| 0.3.57 | 2025-01-09 | ||||
| 0.3.56 | 2025-01-02 | ||||
| 0.3.55 | 2024-12-29 | ||||
| 0.3.54 | 2024-12-26 | ||||
| 0.3.53 | 2024-12-20 | ||||
| 0.3.52 | 2024-12-13 | ||||
| 0.3.51 | 2024-12-13 | ||||
| 0.3.50 | 2024-12-12 | ||||
| 0.3.49 | 2024-12-03 | ||||
| 0.3.48 | 2024-12-01 | ||||
| 0.3.47 | 2024-11-18 | ||||
| 0.3.46 | 2024-11-12 | ||||
| 0.3.45 | 2024-11-11 | ||||
| 0.3.44 | 2024-11-04 | ||||
| 0.3.43 | 2024-11-04 | ||||
| 0.3.42 | 2024-10-23 | ||||
| 0.3.41 | 2024-10-11 | ||||
| 0.3.40 | 2024-10-06 | ||||
| 0.3.39 | 2024-10-03 | ||||
| 0.3.38 | 2024-10-03 | ||||
| 0.3.37 | 2024-10-02 | ||||
| 0.3.36 | 2024-10-02 | ||||
| 0.3.35 | 2024-10-01 | ||||
| 0.3.34 | 2024-09-30 | ||||
| 0.3.33 | 2024-09-30 | ||||
| 0.3.32 | 2024-09-25 | ||||
| 0.3.31 | 2024-09-24 | ||||
| 0.3.30 | 2024-09-18 | ||||
|
|||||
| 0.3.29 | 2024-09-16 | ||||
| 0.3.28 | 2024-09-14 | ||||
| 0.3.27 | 2024-09-06 | ||||
|
|||||
| 0.3.26 | 2024-09-06 | ||||
|
|||||
| 0.3.25 | 2024-08-25 | ||||
| 0.3.24 | 2024-08-18 | ||||
| 0.3.23 | 2024-08-16 | ||||
| 0.3.22 | 2024-08-07 | ||||
|
|||||
| 0.3.21 | 2024-08-07 | ||||
|
|||||
| 0.3.20 | 2024-08-03 | ||||
|
|||||
| 0.3.19 | 2024-08-02 | ||||
|
|||||
| 0.3.18 | 2024-07-14 | ||||
|
|||||
| 0.3.17 | 2024-06-25 | ||||
|
|||||
| 0.3.16 | 2024-06-24 | ||||
|
|||||
| 0.3.15 | 2024-06-16 | ||||
|
|||||
| 0.3.14 | 2024-06-04 | ||||
|
|||||
| 0.3.13 | 2024-05-31 | ||||
|
|||||
| 0.3.12 | 2024-05-31 | ||||
|
|||||
| 0.3.11 | 2024-05-30 | ||||
|
|||||
| 0.3.10 | 2024-05-29 | ||||
|
|||||
| 0.3.9 | 2024-05-14 | ||||
|
|||||
| 0.3.8 | 2024-05-07 | ||||
|
|||||
| 0.3.6 | 2024-05-06 | ||||
|
|||||
| 0.3.5 | 2024-05-04 | ||||
|
|||||
| 0.3.4 | 2024-05-01 | ||||
|
|||||
| 0.3.3 | 2024-04-28 | ||||
|
|||||
| 0.3.2 | 2024-04-21 | ||||
|
|||||
| 0.0.2 yanked | 2024-04-03 | ||||
| 0.0.1 yanked | 2024-04-03 | ||||
Issues with this package?
- Search issues for this package
- Package or version missing? Open a new issue
- Something else? Open a new issue