inspect-ai
Framework for large language model evaluations
Installation
In a virtualenv (see these instructions if you need to create one):
pip3 install inspect-ai
Dependencies
- typing-extensions
- fastapi
- tiktoken
- nest-asyncio2
- uvicorn
- ijson
- jsonlines
- docstring-parser
- zipp
- fsspec
- beautifulsoup4
- shortuuid
- anyio
- click
- mmh3
- jsonpatch
- exceptiongroup
- zipfile-zstd
- semver
- python-dotenv
- markdown-it-py
- jsonpath-ng
- platformdirs
- tenacity
- numpy
- boto3
- httpx
- textual
- pydantic
- rich
- jsonschema
- universal-pathlib
- pyyaml
- psutil
- sniffio
- agent-client-protocol
- s3fs
- debugpy
- jsonref
- aioboto3
- zstandard
Releases
| Version | Released | Bookworm Python 3.11 |
Trixie Python 3.13 |
Files |
|---|---|---|---|---|
| 0.3.263 | 2026-09-04 | |||
| 0.3.262 | 2026-09-03 | |||
| 0.3.261 | 2026-08-30 | |||
| 0.3.260 | 2026-08-21 | |||
| 0.3.259 | 2026-08-16 | |||
| 0.3.258 | 2026-08-12 | |||
| 0.3.257 | 2026-08-11 | |||
| 0.3.256 | 2026-08-11 | |||
| 0.3.255 | 2026-08-09 | |||
| 0.3.254 | 2026-08-09 | |||
| 0.3.253 | 2026-08-08 | |||
| 0.3.252 | 2026-08-04 | |||
| 0.3.251 | 2026-07-29 | |||
| 0.3.250 | 2026-07-28 | |||
| 0.3.249 | 2026-07-21 | |||
| 0.3.248 | 2026-07-18 | |||
| 0.3.247 | 2026-07-16 | |||
| 0.3.246 | 2026-07-10 | |||
| 0.3.245 | 2026-07-08 | |||
| 0.3.244 | 2026-07-01 | |||
| 0.3.243 | 2026-06-30 | |||
| 0.3.242 | 2026-06-29 | |||
| 0.3.241 | 2026-06-22 | |||
| 0.3.240 | 2026-06-15 | |||
| 0.3.239 | 2026-06-09 | |||
| 0.3.238 | 2026-06-08 | |||
| 0.3.237 | 2026-06-07 | |||
| 0.3.236 | 2026-06-06 | |||
| 0.3.235 | 2026-06-03 | |||
| 0.3.234 | 2026-06-02 | |||
| 0.3.233 | 2026-06-01 | |||
| 0.3.232 | 2026-05-31 | |||
| 0.3.231 | 2026-05-30 | |||
| 0.3.230 | 2026-05-30 | |||
| 0.3.229 | 2026-05-28 | |||
| 0.3.228 | 2026-05-27 | |||
| 0.3.227 | 2026-05-27 | |||
| 0.3.226 | 2026-05-25 | |||
| 0.3.225 | 2026-05-23 | |||
| 0.3.224 | 2026-05-20 | |||
| 0.3.223 | 2026-05-18 | |||
| 0.3.222 | 2026-05-16 | |||
| 0.3.221 | 2026-05-16 | |||
| 0.3.220 | 2026-05-08 | |||
| 0.3.219 | 2026-05-06 | |||
| 0.3.218 | 2026-05-06 | |||
| 0.3.217 | 2026-05-03 | |||
| 0.3.216 | 2026-05-01 | |||
| 0.3.215 | 2026-04-30 | |||
| 0.3.214 | 2026-04-29 | |||
| 0.3.213 | 2026-04-27 | |||
| 0.3.212 | 2026-04-25 | |||
| 0.3.211 | 2026-04-23 | |||
| 0.3.210 | 2026-04-22 | |||
| 0.3.209 | 2026-04-20 | |||
| 0.3.208 | 2026-04-19 | |||
| 0.3.207 | 2026-04-16 | |||
| 0.3.206 | 2026-04-15 | |||
| 0.3.205 | 2026-04-04 | |||
| 0.3.204 | 2026-04-02 | |||
| 0.3.203 | 2026-04-01 | |||
| 0.3.202 | 2026-03-31 | |||
| 0.3.201 | 2026-03-25 | |||
| 0.3.200 | 2026-03-20 | |||
| 0.3.199 | 2026-03-17 | |||
| 0.3.195 | 2026-03-15 | |||
| 0.3.193 | 2026-03-13 | |||
| 0.3.189 | 2026-03-07 | |||
|
|
||||
| 0.3.188 | 2026-03-05 | |||
| 0.3.186 | 2026-03-03 | |||
| 0.3.185 | 2026-03-01 | |||
| 0.3.183 | 2026-02-24 | |||
| 0.3.180 | 2026-02-20 | |||
| 0.3.179 | 2026-02-12 | |||
| 0.3.172 | 2026-02-07 | |||
| 0.3.170 | 2026-02-03 | |||
| 0.3.169 | 2026-02-01 | |||
| 0.3.167 | 2026-01-29 | |||
| 0.3.165 | 2026-01-26 | |||
| 0.3.164 | 2026-01-24 | |||
| 0.3.163 | 2026-01-21 | |||
| 0.3.162 | 2026-01-18 | |||
| 0.3.161 | 2026-01-14 | |||
| 0.3.160 | 2026-01-09 | |||
| 0.3.159 | 2026-01-03 | |||
| 0.3.158 | 2025-12-24 | |||
| 0.3.157 | 2025-12-22 | |||
| 0.3.156 | 2025-12-20 | |||
| 0.3.155 | 2025-12-16 | |||
| 0.3.154 | 2025-12-14 | |||
| 0.3.153 | 2025-12-06 | |||
| 0.3.152 | 2025-12-05 | |||
| 0.3.151 | 2025-12-01 | |||
| 0.3.150 | 2025-11-25 | |||
| 0.3.149 | 2025-11-23 | |||
| 0.3.148 | 2025-11-21 | |||
| 0.3.146 | 2025-11-15 | |||
| 0.3.145 | 2025-11-09 | |||
| 0.3.144 | 2025-11-05 | |||
| 0.3.143 | 2025-10-30 | |||
| 0.3.142 | 2025-10-27 | |||
| 0.3.140 | 2025-10-20 | |||
| 0.3.139 | 2025-10-18 | |||
| 0.3.138 | 2025-10-16 | |||
| 0.3.137 | 2025-10-07 | |||
| 0.3.136 | 2025-10-03 | |||
| 0.3.135 | 2025-09-30 | |||
| 0.3.134 | 2025-09-27 | |||
| 0.3.133 | 2025-09-22 | |||
| 0.3.132 | 2025-09-12 | |||
| 0.3.131 | 2025-09-09 | |||
| 0.3.130 | 2025-09-07 | |||
| 0.3.129 | 2025-09-03 | |||
| 0.3.128 | 2025-09-02 | |||
| 0.3.127 | 2025-09-01 | |||
| 0.3.126 | 2025-09-01 | |||
| 0.3.125 | 2025-08-25 | |||
| 0.3.124 | 2025-08-24 | |||
| 0.3.123 | 2025-08-16 | |||
|
|
||||
| 0.3.122 | 2025-08-11 | |||
|
|
||||
| 0.3.121 | 2025-08-10 | |||
|
|
||||
| 0.3.120 | 2025-08-07 | |||
|
|
||||
| 0.3.119 | 2025-08-04 | |||
|
|
||||
| 0.3.118 | 2025-08-02 | |||
|
|
||||
| 0.3.117 | 2025-07-31 | |||
|
|
||||
| 0.3.116 | 2025-07-27 | |||
|
|
||||
| 0.3.115 | 2025-07-26 | |||
|
|
||||
| 0.3.114 | 2025-07-17 | |||
| 0.3.113 | 2025-07-16 | |||
| 0.3.112 | 2025-07-03 | |||
| 0.3.111 | 2025-06-29 | |||
| 0.3.110 | 2025-06-28 | |||
| 0.3.109 | 2025-06-27 | |||
| 0.3.108 | 2025-06-25 | |||
| 0.3.107 | 2025-06-24 | |||
| 0.3.106 | 2025-06-21 | |||
| 0.3.105 | 2025-06-17 | |||
|
|
||||
| 0.3.104 | 2025-06-12 | |||
|
|
||||
| 0.3.103 | 2025-06-06 | |||
|
|
||||
| 0.3.102 | 2025-06-06 | |||
|
|
||||
| 0.3.101 | 2025-06-05 | |||
|
|
||||
| 0.3.100 | 2025-06-01 | |||
| 0.3.99 | 2025-05-22 | |||
| 0.3.98 | 2025-05-18 | |||
| 0.3.97 | 2025-05-16 | |||
| 0.3.96 | 2025-05-13 | |||
| 0.3.95 | 2025-05-10 | |||
| 0.3.94 | 2025-05-06 | |||
| 0.3.93 | 2025-05-01 | |||
| 0.3.92 | 2025-04-26 | |||
| 0.3.91 | 2025-04-26 | |||
| 0.3.90 | 2025-04-21 | |||
| 0.3.89 | 2025-04-17 | |||
| 0.3.88 | 2025-04-11 | |||
| 0.3.87 | 2025-04-10 | |||
|
|
||||
| 0.3.86 | 2025-04-09 | |||
| 0.3.85 | 2025-04-08 | |||
| 0.3.84 | 2025-04-07 | |||
|
|
||||
| 0.3.83 | 2025-04-07 | |||
| 0.3.82 | 2025-04-02 | |||
| 0.3.81 | 2025-03-30 | |||
| 0.3.80 | 2025-03-30 | |||
| 0.3.79 | 2025-03-26 | |||
| 0.3.78 | 2025-03-25 | |||
| 0.3.77 | 2025-03-25 | |||
| 0.3.76 | 2025-03-23 | |||
| 0.3.75 | 2025-03-18 | |||
| 0.3.74 | 2025-03-15 | |||
| 0.3.73 | 2025-03-14 | |||
| 0.3.72 | 2025-03-03 | |||
| 0.3.71 | 2025-03-01 | |||
| 0.3.70 | 2025-02-25 | |||
| 0.3.69 | 2025-02-20 | |||
| 0.3.68 | 2025-02-19 | |||
| 0.3.67 | 2025-02-18 | |||
| 0.3.66 | 2025-02-17 | |||
| 0.3.65 | 2025-02-16 | |||
| 0.3.64 | 2025-02-14 | |||
| 0.3.63 | 2025-02-07 | |||
| 0.3.62 | 2025-02-03 | |||
| 0.3.61 | 2025-01-31 | |||
| 0.3.60 | 2025-01-29 | |||
| 0.3.59 | 2025-01-24 | |||
| 0.3.58 | 2025-01-16 | |||
| 0.3.57 | 2025-01-09 | |||
| 0.3.56 | 2025-01-02 | |||
| 0.3.55 | 2024-12-29 | |||
| 0.3.54 | 2024-12-26 | |||
| 0.3.53 | 2024-12-20 | |||
| 0.3.52 | 2024-12-13 | |||
| 0.3.51 | 2024-12-13 | |||
| 0.3.50 | 2024-12-12 | |||
| 0.3.49 | 2024-12-03 | |||
| 0.3.48 | 2024-12-01 | |||
| 0.3.47 | 2024-11-18 | |||
| 0.3.46 | 2024-11-12 | |||
| 0.3.45 | 2024-11-11 | |||
| 0.3.44 | 2024-11-04 | |||
| 0.3.43 | 2024-11-04 | |||
| 0.3.42 | 2024-10-23 | |||
| 0.3.41 | 2024-10-11 | |||
| 0.3.40 | 2024-10-06 | |||
| 0.3.39 | 2024-10-03 | |||
| 0.3.38 | 2024-10-03 | |||
| 0.3.37 | 2024-10-02 | |||
| 0.3.36 | 2024-10-02 | |||
| 0.3.35 | 2024-10-01 | |||
| 0.3.34 | 2024-09-30 | |||
| 0.3.33 | 2024-09-30 | |||
| 0.3.32 | 2024-09-25 | |||
| 0.3.31 | 2024-09-24 | |||
| 0.3.30 | 2024-09-18 | |||
|
||||
| 0.3.29 | 2024-09-16 | |||
| 0.3.28 | 2024-09-14 | |||
| 0.3.27 | 2024-09-06 | |||
|
||||
| 0.3.26 | 2024-09-06 | |||
|
||||
| 0.3.25 | 2024-08-25 | |||
| 0.3.24 | 2024-08-18 | |||
| 0.3.23 | 2024-08-16 | |||
| 0.3.22 | 2024-08-07 | |||
|
||||
| 0.3.21 | 2024-08-07 | |||
|
||||
| 0.3.20 | 2024-08-03 | |||
|
||||
| 0.3.19 | 2024-08-02 | |||
|
||||
| 0.3.18 | 2024-07-14 | |||
|
||||
| 0.3.17 | 2024-06-25 | |||
|
||||
| 0.3.16 | 2024-06-24 | |||
|
||||
| 0.3.15 | 2024-06-16 | |||
|
||||
| 0.3.14 | 2024-06-04 | |||
|
||||
| 0.3.13 | 2024-05-31 | |||
|
||||
| 0.3.12 | 2024-05-31 | |||
|
||||
| 0.3.11 | 2024-05-30 | |||
|
||||
| 0.3.10 | 2024-05-29 | |||
|
||||
| 0.3.9 | 2024-05-14 | |||
|
||||
| 0.3.8 | 2024-05-07 | |||
|
||||
| 0.3.6 | 2024-05-06 | |||
|
||||
| 0.3.5 | 2024-05-04 | |||
|
||||
| 0.3.4 | 2024-05-01 | |||
|
||||
| 0.3.3 | 2024-04-28 | |||
|
||||
| 0.3.2 | 2024-04-21 | |||
|
||||
| 0.0.2 yanked | 2024-04-03 | |||
| 0.0.1 yanked | 2024-04-03 | |||
Issues with this package?
- Search issues for this package
- Package or version missing? Open a new issue
- Something else? Open a new issue