bfcl-eval
Berkeley Function Calling Leaderboard (BFCL)
Installation
In a virtualenv (see these instructions if you need to create one):
pip3 install bfcl-eval
Dependencies
- tree-sitter-javascript
- google-genai
- overrides
- tree-sitter-java
- beautifulsoup4
- boto3
- anthropic
- datamodel-code-generator
- google-search-results
- tabulate
- sentence-transformers
- typer
- requests
- mistralai
- tqdm
- html2text
- huggingface-hub
- openai
- pandas
- pydantic
- mpmath
- faiss-cpu
- python-dotenv
- tree-sitter
- cohere
- qwen-agent
- writer-sdk
- networkx
- rank-bm25
- numpy
- filelock
- tenacity
Releases
| Version | Released | Bullseye Python 3.9 |
Bookworm Python 3.11 |
Trixie Python 3.13 |
Files |
|---|---|---|---|---|---|
| 2026.3.23 | 2026-03-23 | ||||
| 2026.3.11 | 2026-03-11 | ||||
| 2026.3.3 | 2026-03-03 | ||||
| 2026.2.9 | 2026-02-09 | ||||
| 2026.1.17 | 2026-01-17 | ||||
| 2026.1.16.1 | 2026-01-16 | ||||
| 2026.1.16 | 2026-01-16 | ||||
| 2026.1.3.1 | 2026-01-03 | ||||
| 2026.1.3 | 2026-01-03 | ||||
| 2025.12.17.1 | 2025-12-17 | ||||
| 2025.12.17 | 2025-12-17 | ||||
| 2025.12.12 | 2025-12-12 | ||||
| 2025.12.11 | 2025-12-11 | ||||
| 2025.12.5 | 2025-12-05 | ||||
| 2025.11.19.1 | 2025-11-19 | ||||
| 2025.11.19 | 2025-11-19 | ||||
| 2025.11.10 | 2025-11-10 | ||||
| 2025.11.7.1 | 2025-11-07 | ||||
| 2025.11.7 | 2025-11-07 | ||||
| 2025.11.3.4 | 2025-11-03 | ||||
| 2025.11.3.3 | 2025-11-03 | ||||
| 2025.11.3.2 | 2025-11-03 | ||||
| 2025.11.3.1 | 2025-11-03 | ||||
| 2025.11.3 | 2025-11-03 | ||||
| 2025.11.2 | 2025-11-02 | ||||
| 2025.10.30 | 2025-10-30 | ||||
| 2025.10.27.1 | 2025-10-27 | ||||
| 2025.10.27 | 2025-10-27 | ||||
| 2025.10.25 | 2025-10-25 | ||||
| 2025.10.22 | 2025-10-22 | ||||
| 2025.10.20.1 | 2025-10-20 | ||||
| 2025.10.20 | 2025-10-20 | ||||
| 2025.10.13 | 2025-10-13 | ||||
| 2025.10.2.2 | 2025-10-02 | ||||
| 2025.10.2.1 | 2025-10-02 | ||||
| 2025.10.2 | 2025-10-02 | ||||
| 2025.10.1 | 2025-10-01 | ||||
| 2025.9.29 | 2025-09-29 | ||||
| 2025.9.27.1 | 2025-09-27 | ||||
| 2025.9.27 | 2025-09-27 | ||||
| 2025.9.18.2 | 2025-09-18 | ||||
| 2025.9.18.1 | 2025-09-18 | ||||
| 2025.9.18 | 2025-09-18 | ||||
| 2025.8.25 | 2025-08-25 | ||||
| 2025.8.6.2 | 2025-08-06 | ||||
| 2025.8.6.1 | 2025-08-06 | ||||
| 2025.8.6 | 2025-08-06 | ||||
| 2025.8.5 | 2025-08-05 | ||||
| 2025.7.17 | 2025-07-17 | ||||
| 2025.7.9 | 2025-07-09 | ||||
| 2025.7.8 | 2025-07-08 | ||||
| 2025.7.7 | 2025-07-07 | ||||
| 2025.7.6.1 | 2025-07-06 | ||||
| 2025.7.6 | 2025-07-06 | ||||
| 2025.7.2.3 | 2025-07-02 | ||||
| 2025.7.2.2 | 2025-07-02 | ||||
| 2025.7.2.1 | 2025-07-02 | ||||
| 2025.7.2 | 2025-07-02 | ||||
| 2025.6.30.4 | 2025-06-30 | ||||
| 2025.6.30.3 | 2025-06-30 | ||||
| 2025.6.30.2 | 2025-06-30 | ||||
| 2025.6.30.1 | 2025-06-30 | ||||
| 2025.6.30 | 2025-06-30 | ||||
| 2025.6.29.3 | 2025-06-29 | ||||
| 2025.6.29.2 | 2025-06-29 | ||||
| 2025.6.29.1 | 2025-06-29 | ||||
| 2025.6.29 | 2025-06-29 | ||||
| 2025.6.27.1 | 2025-06-27 | ||||
| 2025.6.27 | 2025-06-27 | ||||
| 2025.6.23 | 2025-06-23 | ||||
| 2025.6.21 | 2025-06-21 | ||||
| 2025.6.19 | 2025-06-19 | ||||
| 2025.6.16 | 2025-06-16 | ||||
| 2025.6.15 | 2025-06-15 | ||||
| 2025.6.14 | 2025-06-14 | ||||
| 2025.6.13.2 | 2025-06-13 | ||||
| 2025.6.13.1 | 2025-06-13 | ||||
| 2025.6.13 | 2025-06-13 | ||||
| 2025.6.12 | 2025-06-12 | ||||
| 2025.6.11 | 2025-06-11 | ||||
| 2025.6.9.2 | 2025-06-09 | ||||
| 2025.6.9.1 | 2025-06-09 | ||||
| 2025.6.8 | 2025-06-09 | ||||
| 3.0.0 yanked | 2025-06-08 | ||||
| 1.0.0 yanked | 2025-06-08 | ||||
|
|||||
Issues with this package?
- Search issues for this package
- Package or version missing? Open a new issue
- Something else? Open a new issue