piwheels

coder-eval

Evaluate, benchmark, and A/B-test AI coding agents (Claude Code, Codex, Gemini/Antigravity) with sandboxed, reproducible YAML task suites.

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install coder-eval

Dependencies

• python-dotenv
• anyio
• typer
• radon
• pydantic-settings
• jmespath
• tqdm
• azure-monitor-opentelemetry-exporter
• jsonschema
• opentelemetry-sdk
• claude-agent-sdk
• pyyaml
• pydantic
• anthropic
• starlette
• rich

Releases

Version	Released	Bullseye Python 3.9	Bookworm Python 3.11	Trixie Python 3.13	Files
0.8.4	2026-07-13
0.8.3	2026-07-09
coder_eval-0.8.3-py3-none-any.whl (465 KB)
0.8.2	2026-07-09
coder_eval-0.8.2-py3-none-any.whl (465 KB)

Issues with this package?

• Search issues for this package
• Package or version missing? Open a new issue
• Something else? Open a new issue