2025-11-04T13:51:45,269 Created temporary directory: /tmp/pip-ephem-wheel-cache-ehkapi9p 2025-11-04T13:51:45,271 Created temporary directory: /tmp/pip-build-tracker-pp4w0rbi 2025-11-04T13:51:45,272 Initialized build tracking at /tmp/pip-build-tracker-pp4w0rbi 2025-11-04T13:51:45,272 Created build tracker: /tmp/pip-build-tracker-pp4w0rbi 2025-11-04T13:51:45,273 Entered build tracker: /tmp/pip-build-tracker-pp4w0rbi 2025-11-04T13:51:45,273 Created temporary directory: /tmp/pip-wheel-zosj2kn7 2025-11-04T13:51:45,277 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2025-11-04T13:51:45,279 Created temporary directory: /tmp/pip-ephem-wheel-cache-wzfa_hrn 2025-11-04T13:51:45,304 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-11-04T13:51:45,307 2 location(s) to search for versions of lighteval: 2025-11-04T13:51:45,307 * https://pypi.org/simple/lighteval/ 2025-11-04T13:51:45,307 * https://www.piwheels.org/simple/lighteval/ 2025-11-04T13:51:45,308 Fetching project page and analyzing links: https://pypi.org/simple/lighteval/ 2025-11-04T13:51:45,309 Getting page https://pypi.org/simple/lighteval/ 2025-11-04T13:51:45,310 Found index url https://pypi.org/simple 2025-11-04T13:51:45,528 Fetched page https://pypi.org/simple/lighteval/ as application/vnd.pypi.simple.v1+json 2025-11-04T13:51:45,535 Found link https://files.pythonhosted.org/packages/91/70/3a0c520287b432278921dafe9b4b20e4d639ecb62a1cdb8dfc14a7cf1122/lighteval-0.0.1.tar.gz (from https://pypi.org/simple/lighteval/), version: 0.0.1 2025-11-04T13:51:45,536 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/83/b0/7dbdeffab3e2d3a0791f1747818c65c3e76e4c343593712aaaee990bea93/lighteval-0.0.2-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,537 Found link https://files.pythonhosted.org/packages/b5/e9/30eaccb5bfb4ca9802bbc3b105b7c8888bdd9bff72d7a7b85ffcb6cd4ad1/lighteval-0.0.2.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.0.2 2025-11-04T13:51:45,538 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/ce/22/8e9fb7ef899f757df0eafed9e29fd8db9d4c694a3ba7e276bedc5c8a4dc3/lighteval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,539 Found link https://files.pythonhosted.org/packages/72/c3/07b4cb157f8fa1c0465c32f505418de1df659c67b2bbfa543c5bc9ff9dde/lighteval-0.1.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.1.0 2025-11-04T13:51:45,540 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/af/d8/92cee84f102f5c801240e90e6380a1f2958aa8ae977fe3f7a6b9804214a0/lighteval-0.1.1.dev0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,541 Found link https://files.pythonhosted.org/packages/73/b2/0b510938a01164061a56b871af8b138f4ade7fdea6bb96ed5180e345ba2a/lighteval-0.1.1.dev0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.1.1.dev0 2025-11-04T13:51:45,541 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/a4/f7/9385103352347eaa2500b3060929a2242143db19c937eb56e488753a4d99/lighteval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,543 Found link https://files.pythonhosted.org/packages/aa/10/97c3a28e599d930aefaa173edc596980df23dc593883a5b0a3ad00c0e2f5/lighteval-0.1.1.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.1.1 2025-11-04T13:51:45,543 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/51/0b/304021094a01fbc94a98b7729b2044106475b23286031083fa9217fea981/lighteval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,544 Found link https://files.pythonhosted.org/packages/c2/b3/dc97dfbdd406d8ce4a7f50d86ef5a24d561e4bfb649783da0807f7cc6cb8/lighteval-0.2.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.2.0 2025-11-04T13:51:45,545 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/14/e2/4c1dc89e6a6c71c6d4745ffd1657e57ca4381dfc48d2c2af6d38215f9f01/lighteval-0.3.0a0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,546 Found link https://files.pythonhosted.org/packages/e9/5f/9bff4b2f649b9838411bf5a3e29b8eaef0287baee2af56419c7845f43a25/lighteval-0.3.0a0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.3.0a0 2025-11-04T13:51:45,547 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/f5/e7/33f933d80fe537dacdf2677df18437ba8b90e6228936564dd246c295809a/lighteval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,548 Found link https://files.pythonhosted.org/packages/02/d7/8c52ae664c106385547c5e895b8614b58eb97e1a721ccee0e278739bd0ff/lighteval-0.3.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.3.0 2025-11-04T13:51:45,548 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/e9/b4/27c6f424b053b66cec7c66dd57823089d5349164dcc82a965f1b230831c5/lighteval-0.4.0a0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,549 Found link https://files.pythonhosted.org/packages/a1/9d/52971d034e2fda19bee1f31bbc8e8683eee2a4807b530e3d2fc50215ef37/lighteval-0.4.0a0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.4.0a0 2025-11-04T13:51:45,550 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/c5/3e/ceea138f6702f5dd010544b75606ba2f51a48ae0bbcb3fb1051216beb68e/lighteval-0.5.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,551 Found link https://files.pythonhosted.org/packages/b9/72/2cbd211318e1dd4ab6653cfe96672dfd68d17a02e762f09b14e8cd7bb6f3/lighteval-0.5.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.5.0 2025-11-04T13:51:45,551 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/ba/f8/c3f757064572b62ef63cb8e45e093245b0327e9f8e1c93f2aa57e227a33e/lighteval-0.6.2-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,552 Found link https://files.pythonhosted.org/packages/65/dd/547f2af88bc4c56ce19123f66701cdc5762f33cc9b49bedb19ae03b26fcd/lighteval-0.6.2.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.6.2 2025-11-04T13:51:45,553 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/86/d8/655d36dcee8f56dae06321448da2d19c8c780051fa5b171f35fae91f7e18/lighteval-0.7.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,554 Found link https://files.pythonhosted.org/packages/65/e1/bd70449c07c6b4259cc8395ab3c8cc6e433a920084bbe12fe651bc3480d0/lighteval-0.7.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.7.0 2025-11-04T13:51:45,555 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/52/88/8c120913b07a1a828b7c2874055a022e2ce098327736ca7602d14d323ad7/lighteval-0.8.1-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,556 Found link https://files.pythonhosted.org/packages/11/4d/9387d49759cc02c9f546ec7e9975a19e88ff573170823153375e58a34c4a/lighteval-0.8.1.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.8.1 2025-11-04T13:51:45,556 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/34/fe/4a5ddcc73f9a8f320c47a1c65f497f8c2d8733730e621407536bba612e6f/lighteval-0.9.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,558 Found link https://files.pythonhosted.org/packages/a3/0c/1d849e968023263f4b96952aa04a11c522eb8ad241262c1705e9a13f1762/lighteval-0.9.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.9.0 2025-11-04T13:51:45,558 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/7a/1c/3bbd71a3c2402661eeda4417202cccd832105d92454c1fa531ef07b4d7ec/lighteval-0.9.1-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,559 Found link https://files.pythonhosted.org/packages/2d/dc/6a41ed7d2eb4c09c607138c97fae2fdb64db5d1b9e9e198da061e8894051/lighteval-0.9.1.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.9.1 2025-11-04T13:51:45,560 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/ae/d6/ee335f2524642a7443cc113da0101d350273d42ba4eac7f637bd44db5d0e/lighteval-0.9.2-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,561 Found link https://files.pythonhosted.org/packages/2e/2c/822126ca365cde3cedc91e9e5beaf6d33168ce18261f982686d1c4447670/lighteval-0.9.2.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.9.2 2025-11-04T13:51:45,561 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/7c/8e/d48315622c38086b94d8274edc5c3630be03befcce36a5ef318e0d278f0b/lighteval-0.10.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,562 Found link https://files.pythonhosted.org/packages/e9/2c/8232d77ba5c22342a21ed313556a8cc998e63c5ff10b2f87947527822d8b/lighteval-0.10.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.10.0 2025-11-04T13:51:45,563 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/d3/ba/bf0a54eb1969cae565703addcecb923d19aa7d2bccc6182f388c66b6980b/lighteval-0.11.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,564 Found link https://files.pythonhosted.org/packages/e6/a2/50e2251012de8587442d39485946bc2e579bb63551757389c60cd20ce6cd/lighteval-0.11.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.11.0 2025-11-04T13:51:45,565 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/d6/34/4b438b81badd48672b8e72e721d0bdcdee0a6c8620f74362d8f26228571f/lighteval-0.12.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,566 Found link https://files.pythonhosted.org/packages/f8/1a/e0546a2e5786d0d1c5477361202dba01762de51dbfb4569ef438bb291fe5/lighteval-0.12.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.12.0 2025-11-04T13:51:45,566 Fetching project page and analyzing links: https://www.piwheels.org/simple/lighteval/ 2025-11-04T13:51:45,567 Getting page https://www.piwheels.org/simple/lighteval/ 2025-11-04T13:51:45,568 Found index url https://www.piwheels.org/simple 2025-11-04T13:51:45,847 Fetched page https://www.piwheels.org/simple/lighteval/ as text/html 2025-11-04T13:51:45,853 Skipping link: No binaries permitted for lighteval: https://www.piwheels.org/simple/lighteval/lighteval-0.11.0-py3-none-any.whl#sha256=6ce0c089e9d8bb70a3a9567692de9197b27f7de1f867ca89ebc209225fe3fa86 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,854 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.10.0-py3-none-any.whl#sha256=984e54961dfab22f14490603e818bd5fc52f7a9cb7325167cd4c722cd3a617c8 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,854 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.9.2-py3-none-any.whl#sha256=524551d8382e05b833a815efaa0c3d72e6f8394f779f7d0996c6bd32480c8bb3 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,855 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.9.1-py3-none-any.whl#sha256=547617dc5562604712e54b11110df507fc7bb93dbe003d95bd5d8f1b619fc5e5 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,856 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.9.0-py3-none-any.whl#sha256=f08fa34420204de0e093b908f9993b7857a704f1ea3ed352eb09ef2c821e7205 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,856 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.8.1-py3-none-any.whl#sha256=fc457974bc07ba6ec3f5f1c3ad74772add7907118d341df8bbf833064d9d1546 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,857 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.7.0-py3-none-any.whl#sha256=c2a51aca3df46874ddc37983dabd50cc525b25fb2b3c7eab15e445a9f0b9b712 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,857 Skipping link: No binaries permitted for lighteval: https://www.piwheels.org/simple/lighteval/lighteval-0.6.2-py3-none-any.whl#sha256=dbbe93471a2dd20cdc138ee008b29e05bb7011af99679649aee415fdc38374e4 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,858 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.5.0-py3-none-any.whl#sha256=62bf9ced8a1139ca7c79da092c98d6b4d70d27a4007d8cdfde70f64eb9b98da2 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,858 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.4.0a0-py3-none-any.whl#sha256=8694039d9a42ffe2c54d5bc4d72d4a7ab3bf1b4032c970eb52fa05455da4d6a1 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,859 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.3.0-py3-none-any.whl#sha256=278613752d9402caf51c2a009228c2c91bb801a71dadc88586c41a764477da7a (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,859 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.3.0a0-py3-none-any.whl#sha256=ca834b38d37c41993d1573606b9f64d28e1218494118389f552f4fbc5c7fe4fd (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,860 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.2.0-py3-none-any.whl#sha256=f4dfdbe773e3f0a3958dddfd65b958a347095d693191d5c453d00de9f30344ae (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,861 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.1.1-py3-none-any.whl#sha256=296c95ef71b3014c30e8fe406bb95469a3d484c721fa61efbb1fe99dce67f950 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,861 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.1.1.dev0-py3-none-any.whl#sha256=e96ff26cffee66313bad7d96cc3522f90457ccc3fa292862034af2db96f4ef73 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,862 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.1.0-py3-none-any.whl#sha256=780a9fdd33d3b41060347f899486cd3ffab6f44f46af6c5d9a18ff10e725731d (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,863 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.0.2-py3-none-any.whl#sha256=08472d569e00511c2d1803932a9b21c03e4424d68970bf1e67d0ab490ef59019 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-04T13:51:45,863 Skipping link: not a file: https://www.piwheels.org/simple/lighteval/ 2025-11-04T13:51:45,864 Skipping link: not a file: https://pypi.org/simple/lighteval/ 2025-11-04T13:51:45,885 Given no hashes to check 1 links for project 'lighteval': discarding no candidates 2025-11-04T13:51:45,903 Collecting lighteval==0.12.0 2025-11-04T13:51:45,905 Created temporary directory: /tmp/pip-unpack-7ecsocus 2025-11-04T13:51:46,043 Downloading lighteval-0.12.0.tar.gz (425 kB) 2025-11-04T13:51:46,749 Added lighteval==0.12.0 from https://files.pythonhosted.org/packages/f8/1a/e0546a2e5786d0d1c5477361202dba01762de51dbfb4569ef438bb291fe5/lighteval-0.12.0.tar.gz to build tracker '/tmp/pip-build-tracker-pp4w0rbi' 2025-11-04T13:51:46,755 Created temporary directory: /tmp/pip-build-env-xvb1l0ej 2025-11-04T13:51:46,759 Installing build dependencies: started 2025-11-04T13:51:46,761 Running command pip subprocess to install build dependencies 2025-11-04T13:51:47,905 Using pip 23.0.1 from /usr/lib/python3/dist-packages/pip (python 3.11) 2025-11-04T13:51:48,509 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2025-11-04T13:51:48,531 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-11-04T13:51:50,267 Collecting setuptools>=61.0 2025-11-04T13:51:50,372 Using cached https://www.piwheels.org/simple/setuptools/setuptools-80.9.0-py3-none-any.whl (1.2 MB) 2025-11-04T13:51:53,287 Installing collected packages: setuptools 2025-11-04T13:51:56,920 Successfully installed setuptools-80.9.0 2025-11-04T13:51:57,185 Installing build dependencies: finished with status 'done' 2025-11-04T13:51:57,192 Getting requirements to build wheel: started 2025-11-04T13:51:57,193 Running command Getting requirements to build wheel 2025-11-04T13:51:57,825 /tmp/pip-build-env-xvb1l0ej/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2025-11-04T13:51:57,825 !! 2025-11-04T13:51:57,827 ******************************************************************************** 2025-11-04T13:51:57,827 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2025-11-04T13:51:57,828 By 2026-Feb-18, you need to update your project and remove deprecated calls 2025-11-04T13:51:57,829 or your builds will no longer be supported. 2025-11-04T13:51:57,830 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-04T13:51:57,831 ******************************************************************************** 2025-11-04T13:51:57,832 !! 2025-11-04T13:51:57,832 corresp(dist, value, root_dir) 2025-11-04T13:51:57,921 /tmp/pip-build-env-xvb1l0ej/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:61: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-04T13:51:57,922 !! 2025-11-04T13:51:57,923 ******************************************************************************** 2025-11-04T13:51:57,923 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-04T13:51:57,924 License :: OSI Approved :: MIT License 2025-11-04T13:51:57,925 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-04T13:51:57,926 ******************************************************************************** 2025-11-04T13:51:57,927 !! 2025-11-04T13:51:57,927 dist._finalize_license_expression() 2025-11-04T13:51:57,928 /tmp/pip-build-env-xvb1l0ej/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-04T13:51:57,928 !! 2025-11-04T13:51:57,929 ******************************************************************************** 2025-11-04T13:51:57,930 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-04T13:51:57,931 License :: OSI Approved :: MIT License 2025-11-04T13:51:57,932 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-04T13:51:57,932 ******************************************************************************** 2025-11-04T13:51:57,933 !! 2025-11-04T13:51:57,934 self._finalize_license_expression() 2025-11-04T13:51:57,934 running egg_info 2025-11-04T13:51:57,941 writing src/lighteval.egg-info/PKG-INFO 2025-11-04T13:51:57,958 writing dependency_links to src/lighteval.egg-info/dependency_links.txt 2025-11-04T13:51:57,960 writing entry points to src/lighteval.egg-info/entry_points.txt 2025-11-04T13:51:57,970 writing requirements to src/lighteval.egg-info/requires.txt 2025-11-04T13:51:57,972 writing top-level names to src/lighteval.egg-info/top_level.txt 2025-11-04T13:51:58,037 reading manifest file 'src/lighteval.egg-info/SOURCES.txt' 2025-11-04T13:51:58,053 reading manifest template 'MANIFEST.in' 2025-11-04T13:51:58,055 warning: no files found matching 'src/lighteval/tasks/tasks_table.jsonl' 2025-11-04T13:51:58,056 warning: no files found matching 'src/lighteval/metrics/*.jsonl' 2025-11-04T13:51:58,056 adding license file 'LICENSE' 2025-11-04T13:51:58,071 writing manifest file 'src/lighteval.egg-info/SOURCES.txt' 2025-11-04T13:51:58,169 Getting requirements to build wheel: finished with status 'done' 2025-11-04T13:51:58,173 Created temporary directory: /tmp/pip-modern-metadata-yyr3obs1 2025-11-04T13:51:58,175 Preparing metadata (pyproject.toml): started 2025-11-04T13:51:58,176 Running command Preparing metadata (pyproject.toml) 2025-11-04T13:51:58,782 /tmp/pip-build-env-xvb1l0ej/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2025-11-04T13:51:58,782 !! 2025-11-04T13:51:58,783 ******************************************************************************** 2025-11-04T13:51:58,784 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2025-11-04T13:51:58,785 By 2026-Feb-18, you need to update your project and remove deprecated calls 2025-11-04T13:51:58,786 or your builds will no longer be supported. 2025-11-04T13:51:58,787 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-04T13:51:58,787 ******************************************************************************** 2025-11-04T13:51:58,789 !! 2025-11-04T13:51:58,789 corresp(dist, value, root_dir) 2025-11-04T13:51:58,875 /tmp/pip-build-env-xvb1l0ej/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:61: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-04T13:51:58,876 !! 2025-11-04T13:51:58,877 ******************************************************************************** 2025-11-04T13:51:58,877 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-04T13:51:58,878 License :: OSI Approved :: MIT License 2025-11-04T13:51:58,879 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-04T13:51:58,880 ******************************************************************************** 2025-11-04T13:51:58,881 !! 2025-11-04T13:51:58,881 dist._finalize_license_expression() 2025-11-04T13:51:58,883 /tmp/pip-build-env-xvb1l0ej/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-04T13:51:58,884 !! 2025-11-04T13:51:58,885 ******************************************************************************** 2025-11-04T13:51:58,885 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-04T13:51:58,886 License :: OSI Approved :: MIT License 2025-11-04T13:51:58,887 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-04T13:51:58,887 ******************************************************************************** 2025-11-04T13:51:58,888 !! 2025-11-04T13:51:58,889 self._finalize_license_expression() 2025-11-04T13:51:58,892 running dist_info 2025-11-04T13:51:58,904 creating /tmp/pip-modern-metadata-yyr3obs1/lighteval.egg-info 2025-11-04T13:51:58,905 writing /tmp/pip-modern-metadata-yyr3obs1/lighteval.egg-info/PKG-INFO 2025-11-04T13:51:58,923 writing dependency_links to /tmp/pip-modern-metadata-yyr3obs1/lighteval.egg-info/dependency_links.txt 2025-11-04T13:51:58,924 writing entry points to /tmp/pip-modern-metadata-yyr3obs1/lighteval.egg-info/entry_points.txt 2025-11-04T13:51:58,934 writing requirements to /tmp/pip-modern-metadata-yyr3obs1/lighteval.egg-info/requires.txt 2025-11-04T13:51:58,936 writing top-level names to /tmp/pip-modern-metadata-yyr3obs1/lighteval.egg-info/top_level.txt 2025-11-04T13:51:58,937 writing manifest file '/tmp/pip-modern-metadata-yyr3obs1/lighteval.egg-info/SOURCES.txt' 2025-11-04T13:51:58,993 reading manifest file '/tmp/pip-modern-metadata-yyr3obs1/lighteval.egg-info/SOURCES.txt' 2025-11-04T13:51:58,995 reading manifest template 'MANIFEST.in' 2025-11-04T13:51:58,996 warning: no files found matching 'src/lighteval/tasks/tasks_table.jsonl' 2025-11-04T13:51:58,997 warning: no files found matching 'src/lighteval/metrics/*.jsonl' 2025-11-04T13:51:58,998 adding license file 'LICENSE' 2025-11-04T13:51:59,009 writing manifest file '/tmp/pip-modern-metadata-yyr3obs1/lighteval.egg-info/SOURCES.txt' 2025-11-04T13:51:59,010 creating '/tmp/pip-modern-metadata-yyr3obs1/lighteval-0.12.0.dist-info' 2025-11-04T13:51:59,137 Preparing metadata (pyproject.toml): finished with status 'done' 2025-11-04T13:51:59,143 Source in /tmp/pip-wheel-zosj2kn7/lighteval_9c34d58740a84912a10ff4f85701406f has version 0.12.0, which satisfies requirement lighteval==0.12.0 from https://files.pythonhosted.org/packages/f8/1a/e0546a2e5786d0d1c5477361202dba01762de51dbfb4569ef438bb291fe5/lighteval-0.12.0.tar.gz 2025-11-04T13:51:59,144 Removed lighteval==0.12.0 from https://files.pythonhosted.org/packages/f8/1a/e0546a2e5786d0d1c5477361202dba01762de51dbfb4569ef438bb291fe5/lighteval-0.12.0.tar.gz from build tracker '/tmp/pip-build-tracker-pp4w0rbi' 2025-11-04T13:51:59,152 Created temporary directory: /tmp/pip-unpack-eddw3_g7 2025-11-04T13:51:59,153 Building wheels for collected packages: lighteval 2025-11-04T13:51:59,157 Created temporary directory: /tmp/pip-wheel-u0plmmw5 2025-11-04T13:51:59,158 Destination directory: /tmp/pip-wheel-u0plmmw5 2025-11-04T13:51:59,160 Building wheel for lighteval (pyproject.toml): started 2025-11-04T13:51:59,162 Running command Building wheel for lighteval (pyproject.toml) 2025-11-04T13:51:59,728 /tmp/pip-build-env-xvb1l0ej/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2025-11-04T13:51:59,729 !! 2025-11-04T13:51:59,730 ******************************************************************************** 2025-11-04T13:51:59,730 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2025-11-04T13:51:59,731 By 2026-Feb-18, you need to update your project and remove deprecated calls 2025-11-04T13:51:59,732 or your builds will no longer be supported. 2025-11-04T13:51:59,733 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-04T13:51:59,733 ******************************************************************************** 2025-11-04T13:51:59,734 !! 2025-11-04T13:51:59,735 corresp(dist, value, root_dir) 2025-11-04T13:51:59,814 /tmp/pip-build-env-xvb1l0ej/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:61: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-04T13:51:59,815 !! 2025-11-04T13:51:59,816 ******************************************************************************** 2025-11-04T13:51:59,817 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-04T13:51:59,818 License :: OSI Approved :: MIT License 2025-11-04T13:51:59,819 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-04T13:51:59,820 ******************************************************************************** 2025-11-04T13:51:59,821 !! 2025-11-04T13:51:59,821 dist._finalize_license_expression() 2025-11-04T13:51:59,822 /tmp/pip-build-env-xvb1l0ej/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-04T13:51:59,823 !! 2025-11-04T13:51:59,824 ******************************************************************************** 2025-11-04T13:51:59,825 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-04T13:51:59,826 License :: OSI Approved :: MIT License 2025-11-04T13:51:59,827 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-04T13:51:59,828 ******************************************************************************** 2025-11-04T13:51:59,829 !! 2025-11-04T13:51:59,830 self._finalize_license_expression() 2025-11-04T13:51:59,830 running bdist_wheel 2025-11-04T13:51:59,844 running build 2025-11-04T13:51:59,844 running build_py 2025-11-04T13:51:59,851 creating build/lib/lighteval 2025-11-04T13:51:59,854 copying src/lighteval/main_nanotron.py -> build/lib/lighteval 2025-11-04T13:51:59,856 copying src/lighteval/pipeline.py -> build/lib/lighteval 2025-11-04T13:51:59,859 copying src/lighteval/main_inspect.py -> build/lib/lighteval 2025-11-04T13:51:59,861 copying src/lighteval/main_sglang.py -> build/lib/lighteval 2025-11-04T13:51:59,864 copying src/lighteval/main_custom.py -> build/lib/lighteval 2025-11-04T13:51:59,866 copying src/lighteval/__init__.py -> build/lib/lighteval 2025-11-04T13:51:59,868 copying src/lighteval/cli_args.py -> build/lib/lighteval 2025-11-04T13:51:59,871 copying src/lighteval/__main__.py -> build/lib/lighteval 2025-11-04T13:51:59,873 copying src/lighteval/main_accelerate.py -> build/lib/lighteval 2025-11-04T13:51:59,875 copying src/lighteval/data.py -> build/lib/lighteval 2025-11-04T13:51:59,878 copying src/lighteval/main_vllm.py -> build/lib/lighteval 2025-11-04T13:51:59,880 copying src/lighteval/main_endpoint.py -> build/lib/lighteval 2025-11-04T13:51:59,883 copying src/lighteval/main_baseline.py -> build/lib/lighteval 2025-11-04T13:51:59,885 copying src/lighteval/check_logs.py -> build/lib/lighteval 2025-11-04T13:51:59,887 copying src/lighteval/main_tasks.py -> build/lib/lighteval 2025-11-04T13:51:59,889 creating build/lib/lighteval/utils 2025-11-04T13:51:59,890 copying src/lighteval/utils/utils.py -> build/lib/lighteval/utils 2025-11-04T13:51:59,893 copying src/lighteval/utils/__init__.py -> build/lib/lighteval/utils 2025-11-04T13:51:59,895 copying src/lighteval/utils/parallelism.py -> build/lib/lighteval/utils 2025-11-04T13:51:59,897 copying src/lighteval/utils/imports.py -> build/lib/lighteval/utils 2025-11-04T13:51:59,899 copying src/lighteval/utils/language.py -> build/lib/lighteval/utils 2025-11-04T13:51:59,901 copying src/lighteval/utils/cache_management.py -> build/lib/lighteval/utils 2025-11-04T13:51:59,904 copying src/lighteval/utils/timeout.py -> build/lib/lighteval/utils 2025-11-04T13:51:59,906 creating build/lib/lighteval/tasks 2025-11-04T13:51:59,907 copying src/lighteval/tasks/__init__.py -> build/lib/lighteval/tasks 2025-11-04T13:51:59,909 copying src/lighteval/tasks/prompt_manager.py -> build/lib/lighteval/tasks 2025-11-04T13:51:59,912 copying src/lighteval/tasks/default_prompts.py -> build/lib/lighteval/tasks 2025-11-04T13:51:59,916 copying src/lighteval/tasks/registry.py -> build/lib/lighteval/tasks 2025-11-04T13:51:59,918 copying src/lighteval/tasks/lighteval_task.py -> build/lib/lighteval/tasks 2025-11-04T13:51:59,921 copying src/lighteval/tasks/requests.py -> build/lib/lighteval/tasks 2025-11-04T13:51:59,924 creating build/lib/lighteval/metrics 2025-11-04T13:51:59,925 copying src/lighteval/metrics/sample_preparator.py -> build/lib/lighteval/metrics 2025-11-04T13:51:59,927 copying src/lighteval/metrics/__init__.py -> build/lib/lighteval/metrics 2025-11-04T13:51:59,929 copying src/lighteval/metrics/dynamic_metrics.py -> build/lib/lighteval/metrics 2025-11-04T13:51:59,932 copying src/lighteval/metrics/normalizations.py -> build/lib/lighteval/metrics 2025-11-04T13:51:59,934 copying src/lighteval/metrics/metrics.py -> build/lib/lighteval/metrics 2025-11-04T13:51:59,937 copying src/lighteval/metrics/metrics_sample.py -> build/lib/lighteval/metrics 2025-11-04T13:51:59,941 copying src/lighteval/metrics/metrics_corpus.py -> build/lib/lighteval/metrics 2025-11-04T13:51:59,944 creating build/lib/lighteval/models 2025-11-04T13:51:59,945 copying src/lighteval/models/model_input.py -> build/lib/lighteval/models 2025-11-04T13:51:59,947 copying src/lighteval/models/abstract_model.py -> build/lib/lighteval/models 2025-11-04T13:51:59,950 copying src/lighteval/models/model_output.py -> build/lib/lighteval/models 2025-11-04T13:51:59,952 copying src/lighteval/models/utils.py -> build/lib/lighteval/models 2025-11-04T13:51:59,954 copying src/lighteval/models/model_loader.py -> build/lib/lighteval/models 2025-11-04T13:51:59,957 creating build/lib/lighteval/logging 2025-11-04T13:51:59,958 copying src/lighteval/logging/info_loggers.py -> build/lib/lighteval/logging 2025-11-04T13:51:59,961 copying src/lighteval/logging/evaluation_tracker.py -> build/lib/lighteval/logging 2025-11-04T13:51:59,964 creating build/lib/lighteval/tasks/multilingual 2025-11-04T13:51:59,965 copying src/lighteval/tasks/multilingual/__init__.py -> build/lib/lighteval/tasks/multilingual 2025-11-04T13:51:59,967 copying src/lighteval/tasks/multilingual/adapters.py -> build/lib/lighteval/tasks/multilingual 2025-11-04T13:51:59,972 creating build/lib/lighteval/tasks/tasks 2025-11-04T13:51:59,973 copying src/lighteval/tasks/tasks/synthetic_reasoning.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:51:59,976 copying src/lighteval/tasks/tasks/aimo.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:51:59,977 copying src/lighteval/tasks/tasks/arithmetic.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:51:59,980 copying src/lighteval/tasks/tasks/mmmu_pro.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:51:59,982 copying src/lighteval/tasks/tasks/aime.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:51:59,984 copying src/lighteval/tasks/tasks/summarization.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:51:59,986 copying src/lighteval/tasks/tasks/bigbench_hard.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:51:59,988 copying src/lighteval/tasks/tasks/musr.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:51:59,990 copying src/lighteval/tasks/tasks/jeopardy.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:51:59,992 copying src/lighteval/tasks/tasks/legalsupport.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:51:59,993 copying src/lighteval/tasks/tasks/mgsm.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:51:59,996 copying src/lighteval/tasks/tasks/imdb.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:51:59,998 copying src/lighteval/tasks/tasks/pubmedqa.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:51:59,999 copying src/lighteval/tasks/tasks/real_toxicity_prompts.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,001 copying src/lighteval/tasks/tasks/hellaswag.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,003 copying src/lighteval/tasks/tasks/drop_qa.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,005 copying src/lighteval/tasks/tasks/narrativeqa.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,007 copying src/lighteval/tasks/tasks/bigbench.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,010 copying src/lighteval/tasks/tasks/mmlu_redux.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,012 copying src/lighteval/tasks/tasks/qa4mre.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,014 copying src/lighteval/tasks/tasks/babi_qa.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,016 copying src/lighteval/tasks/tasks/squad_v2.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,017 copying src/lighteval/tasks/tasks/anli.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,019 copying src/lighteval/tasks/tasks/agieval.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,022 copying src/lighteval/tasks/tasks/gpqa.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,024 copying src/lighteval/tasks/tasks/gsm8k.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,026 copying src/lighteval/tasks/tasks/mathqa.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,028 copying src/lighteval/tasks/tasks/asdiv.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,029 copying src/lighteval/tasks/tasks/sciq.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,031 copying src/lighteval/tasks/tasks/med_dialog.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,033 copying src/lighteval/tasks/tasks/math_500.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,035 copying src/lighteval/tasks/tasks/the_pile.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,037 copying src/lighteval/tasks/tasks/arc.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,039 copying src/lighteval/tasks/tasks/dyck_language.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,041 copying src/lighteval/tasks/tasks/triviaqa.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,043 copying src/lighteval/tasks/tasks/glue.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,046 copying src/lighteval/tasks/tasks/logiqa.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,048 copying src/lighteval/tasks/tasks/arc_agi_2.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,050 copying src/lighteval/tasks/tasks/entity_data_imputation.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,052 copying src/lighteval/tasks/tasks/toxigen.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,053 copying src/lighteval/tasks/tasks/gsm_plus.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,055 copying src/lighteval/tasks/tasks/xstory_cloze.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,058 copying src/lighteval/tasks/tasks/quac.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,059 copying src/lighteval/tasks/tasks/lsat_qa.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,061 copying src/lighteval/tasks/tasks/entitymatching.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,063 copying src/lighteval/tasks/tasks/piqa.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,065 copying src/lighteval/tasks/tasks/math.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,068 copying src/lighteval/tasks/tasks/race_high.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,069 copying src/lighteval/tasks/tasks/legal_summarization.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,071 copying src/lighteval/tasks/tasks/twitterAAE.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,073 copying src/lighteval/tasks/tasks/raft.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,075 copying src/lighteval/tasks/tasks/bold.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,078 copying src/lighteval/tasks/tasks/covid_dialogue.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,080 copying src/lighteval/tasks/tasks/lambada.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,082 copying src/lighteval/tasks/tasks/mmlu.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,084 copying src/lighteval/tasks/tasks/xwinograd.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,086 copying src/lighteval/tasks/tasks/webqs.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,088 copying src/lighteval/tasks/tasks/unscramble.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,090 copying src/lighteval/tasks/tasks/sacrebleu.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,093 copying src/lighteval/tasks/tasks/xcopa.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,096 copying src/lighteval/tasks/tasks/ethics.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,098 copying src/lighteval/tasks/tasks/wikitext.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,100 copying src/lighteval/tasks/tasks/wikifact.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,103 copying src/lighteval/tasks/tasks/lextreme.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,105 copying src/lighteval/tasks/tasks/boolq.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,107 copying src/lighteval/tasks/tasks/custom_task_classification_grammar_task.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,110 copying src/lighteval/tasks/tasks/swag.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,112 copying src/lighteval/tasks/tasks/civil_comments.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,114 copying src/lighteval/tasks/tasks/bbq.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,117 copying src/lighteval/tasks/tasks/lexglue.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,119 copying src/lighteval/tasks/tasks/truthfulqa.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,121 copying src/lighteval/tasks/tasks/winogrande.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,122 copying src/lighteval/tasks/tasks/blimp.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,125 copying src/lighteval/tasks/tasks/headqa.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,127 copying src/lighteval/tasks/tasks/numeracy.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,130 copying src/lighteval/tasks/tasks/qasper.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,131 copying src/lighteval/tasks/tasks/prost.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,133 copying src/lighteval/tasks/tasks/mmlu_pro.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,135 copying src/lighteval/tasks/tasks/commonsenseqa.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,137 copying src/lighteval/tasks/tasks/openbookqa.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,139 copying src/lighteval/tasks/tasks/coqa.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,141 copying src/lighteval/tasks/tasks/med.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,143 copying src/lighteval/tasks/tasks/simpleqa.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,144 copying src/lighteval/tasks/tasks/storycloze.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,146 copying src/lighteval/tasks/tasks/siqa.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,148 copying src/lighteval/tasks/tasks/slr_bench.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,150 copying src/lighteval/tasks/tasks/natural_questions.py -> build/lib/lighteval/tasks/tasks 2025-11-04T13:52:00,152 creating build/lib/lighteval/tasks/templates 2025-11-04T13:52:00,153 copying src/lighteval/tasks/templates/multichoice.py -> build/lib/lighteval/tasks/templates 2025-11-04T13:52:00,156 copying src/lighteval/tasks/templates/continuation.py -> build/lib/lighteval/tasks/templates 2025-11-04T13:52:00,158 copying src/lighteval/tasks/templates/hellaswag.py -> build/lib/lighteval/tasks/templates 2025-11-04T13:52:00,160 copying src/lighteval/tasks/templates/__init__.py -> build/lib/lighteval/tasks/templates 2025-11-04T13:52:00,162 copying src/lighteval/tasks/templates/copa.py -> build/lib/lighteval/tasks/templates 2025-11-04T13:52:00,164 copying src/lighteval/tasks/templates/nli.py -> build/lib/lighteval/tasks/templates 2025-11-04T13:52:00,167 copying src/lighteval/tasks/templates/boolq.py -> build/lib/lighteval/tasks/templates 2025-11-04T13:52:00,169 copying src/lighteval/tasks/templates/translation.py -> build/lib/lighteval/tasks/templates 2025-11-04T13:52:00,171 copying src/lighteval/tasks/templates/qa.py -> build/lib/lighteval/tasks/templates 2025-11-04T13:52:00,173 creating build/lib/lighteval/tasks/multilingual/utils 2025-11-04T13:52:00,175 copying src/lighteval/tasks/multilingual/utils/__init__.py -> build/lib/lighteval/tasks/multilingual/utils 2025-11-04T13:52:00,176 copying src/lighteval/tasks/multilingual/utils/task_utils.py -> build/lib/lighteval/tasks/multilingual/utils 2025-11-04T13:52:00,178 copying src/lighteval/tasks/multilingual/utils/adapters_utils.py -> build/lib/lighteval/tasks/multilingual/utils 2025-11-04T13:52:00,183 creating build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,184 copying src/lighteval/tasks/multilingual/tasks/turkish_arc.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,187 copying src/lighteval/tasks/multilingual/tasks/thaiqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,189 copying src/lighteval/tasks/multilingual/tasks/german_rag.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,191 copying src/lighteval/tasks/multilingual/tasks/turkic.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,193 copying src/lighteval/tasks/multilingual/tasks/meta_mmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,196 copying src/lighteval/tasks/multilingual/tasks/cmrc2018.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,198 copying src/lighteval/tasks/multilingual/tasks/mgsm.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,200 copying src/lighteval/tasks/multilingual/tasks/germanquad.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,202 copying src/lighteval/tasks/multilingual/tasks/acva.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,204 copying src/lighteval/tasks/multilingual/tasks/cmnli.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,206 copying src/lighteval/tasks/multilingual/tasks/hindi_arc.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,208 copying src/lighteval/tasks/multilingual/tasks/exams.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,210 copying src/lighteval/tasks/multilingual/tasks/xcsqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,212 copying src/lighteval/tasks/multilingual/tasks/tquad_v2.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,214 copying src/lighteval/tasks/multilingual/tasks/soqal.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,216 copying src/lighteval/tasks/multilingual/tasks/rcb.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,218 copying src/lighteval/tasks/multilingual/tasks/worldtree_rus.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,220 copying src/lighteval/tasks/multilingual/tasks/mlqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,221 copying src/lighteval/tasks/multilingual/tasks/mlmm_hellaswag.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,223 copying src/lighteval/tasks/multilingual/tasks/mathlogicqa_rus.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,225 copying src/lighteval/tasks/multilingual/tasks/indicqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,227 copying src/lighteval/tasks/multilingual/tasks/hellaswag_tha.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,229 copying src/lighteval/tasks/multilingual/tasks/mlmm_mmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,231 copying src/lighteval/tasks/multilingual/tasks/xnli_indic.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,233 copying src/lighteval/tasks/multilingual/tasks/turkish_mmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,235 copying src/lighteval/tasks/multilingual/tasks/global_mmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,237 copying src/lighteval/tasks/multilingual/tasks/cmath.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,239 copying src/lighteval/tasks/multilingual/tasks/hellaswag_hin.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,241 copying src/lighteval/tasks/multilingual/tasks/mlmm_truthfulqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,243 copying src/lighteval/tasks/multilingual/tasks/openbook_rus.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,245 copying src/lighteval/tasks/multilingual/tasks/xcodah.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,247 copying src/lighteval/tasks/multilingual/tasks/thai_exams.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,249 copying src/lighteval/tasks/multilingual/tasks/mkqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,251 copying src/lighteval/tasks/multilingual/tasks/chinese_squad.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,253 copying src/lighteval/tasks/multilingual/tasks/xnli.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,255 copying src/lighteval/tasks/multilingual/tasks/hellaswag_tur.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,257 copying src/lighteval/tasks/multilingual/tasks/xstory.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,259 copying src/lighteval/tasks/multilingual/tasks/belebele.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,261 copying src/lighteval/tasks/multilingual/tasks/copa_indic.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,263 copying src/lighteval/tasks/multilingual/tasks/faquad.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,265 copying src/lighteval/tasks/multilingual/tasks/squad_it.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,267 copying src/lighteval/tasks/multilingual/tasks/french.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,269 copying src/lighteval/tasks/multilingual/tasks/paws_x.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,271 copying src/lighteval/tasks/multilingual/tasks/filipino.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,274 copying src/lighteval/tasks/multilingual/tasks/arabic_arc.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,276 copying src/lighteval/tasks/multilingual/tasks/xwinograd.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,278 copying src/lighteval/tasks/multilingual/tasks/hindi_boolq.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,280 copying src/lighteval/tasks/multilingual/tasks/chegeka.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,282 copying src/lighteval/tasks/multilingual/tasks/arabic_mmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,283 copying src/lighteval/tasks/multilingual/tasks/afri_mmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,286 copying src/lighteval/tasks/multilingual/tasks/kenswquad.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,287 copying src/lighteval/tasks/multilingual/tasks/parus.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,289 copying src/lighteval/tasks/multilingual/tasks/serbian_eval.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,292 copying src/lighteval/tasks/multilingual/tasks/french_triviqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,294 copying src/lighteval/tasks/multilingual/tasks/hellaswag_tel.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,296 copying src/lighteval/tasks/multilingual/tasks/xcopa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,298 copying src/lighteval/tasks/multilingual/tasks/flores200.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,300 copying src/lighteval/tasks/multilingual/tasks/xquad.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,302 copying src/lighteval/tasks/multilingual/tasks/m3exams.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,304 copying src/lighteval/tasks/multilingual/tasks/openbook_ara.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,306 copying src/lighteval/tasks/multilingual/tasks/afri_xnli.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,308 copying src/lighteval/tasks/multilingual/tasks/swahili_arc.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,310 copying src/lighteval/tasks/multilingual/tasks/ceval.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,312 copying src/lighteval/tasks/multilingual/tasks/squad_es.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,314 copying src/lighteval/tasks/multilingual/tasks/sber_squad.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,316 copying src/lighteval/tasks/multilingual/tasks/enem.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,318 copying src/lighteval/tasks/multilingual/tasks/cmmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,320 copying src/lighteval/tasks/multilingual/tasks/tydiqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,322 copying src/lighteval/tasks/multilingual/tasks/oab_exams.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,324 copying src/lighteval/tasks/multilingual/tasks/xnli2.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,326 copying src/lighteval/tasks/multilingual/tasks/openbook_es.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,328 copying src/lighteval/tasks/multilingual/tasks/arabic.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,331 copying src/lighteval/tasks/multilingual/tasks/mintaka.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,333 copying src/lighteval/tasks/multilingual/tasks/arcd.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,335 copying src/lighteval/tasks/multilingual/tasks/mlmm_arc_challenge.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,337 copying src/lighteval/tasks/multilingual/tasks/fquad_v2.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,339 copying src/lighteval/tasks/multilingual/tasks/french_boolq.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,340 copying src/lighteval/tasks/multilingual/tasks/oz.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,342 copying src/lighteval/tasks/multilingual/tasks/afri_mgsm.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,344 copying src/lighteval/tasks/multilingual/tasks/piqa_ar.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,346 copying src/lighteval/tasks/multilingual/tasks/openai_mmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,348 copying src/lighteval/tasks/multilingual/tasks/c3.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,350 copying src/lighteval/tasks/multilingual/tasks/ocnli.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,352 creating build/lib/lighteval/tasks/tasks/tiny_benchmarks 2025-11-04T13:52:00,353 copying src/lighteval/tasks/tasks/tiny_benchmarks/main.py -> build/lib/lighteval/tasks/tasks/tiny_benchmarks 2025-11-04T13:52:00,356 creating build/lib/lighteval/tasks/tasks/olympiade_bench 2025-11-04T13:52:00,357 copying src/lighteval/tasks/tasks/olympiade_bench/main.py -> build/lib/lighteval/tasks/tasks/olympiade_bench 2025-11-04T13:52:00,359 creating build/lib/lighteval/tasks/tasks/lcb 2025-11-04T13:52:00,360 copying src/lighteval/tasks/tasks/lcb/codegen_metrics.py -> build/lib/lighteval/tasks/tasks/lcb 2025-11-04T13:52:00,363 copying src/lighteval/tasks/tasks/lcb/main.py -> build/lib/lighteval/tasks/tasks/lcb 2025-11-04T13:52:00,366 creating build/lib/lighteval/tasks/tasks/ifeval 2025-11-04T13:52:00,367 copying src/lighteval/tasks/tasks/ifeval/instructions_utils.py -> build/lib/lighteval/tasks/tasks/ifeval 2025-11-04T13:52:00,370 copying src/lighteval/tasks/tasks/ifeval/instructions.py -> build/lib/lighteval/tasks/tasks/ifeval 2025-11-04T13:52:00,373 copying src/lighteval/tasks/tasks/ifeval/instructions_registry.py -> build/lib/lighteval/tasks/tasks/ifeval 2025-11-04T13:52:00,375 copying src/lighteval/tasks/tasks/ifeval/main.py -> build/lib/lighteval/tasks/tasks/ifeval 2025-11-04T13:52:00,377 creating build/lib/lighteval/tasks/tasks/hle 2025-11-04T13:52:00,378 copying src/lighteval/tasks/tasks/hle/main.py -> build/lib/lighteval/tasks/tasks/hle 2025-11-04T13:52:00,381 creating build/lib/lighteval/tasks/tasks/ifbench 2025-11-04T13:52:00,382 copying src/lighteval/tasks/tasks/ifbench/instructions.py -> build/lib/lighteval/tasks/tasks/ifbench 2025-11-04T13:52:00,386 copying src/lighteval/tasks/tasks/ifbench/instructions_registry.py -> build/lib/lighteval/tasks/tasks/ifbench 2025-11-04T13:52:00,388 copying src/lighteval/tasks/tasks/ifbench/evaluation_lib.py -> build/lib/lighteval/tasks/tasks/ifbench 2025-11-04T13:52:00,391 copying src/lighteval/tasks/tasks/ifbench/main.py -> build/lib/lighteval/tasks/tasks/ifbench 2025-11-04T13:52:00,393 creating build/lib/lighteval/tasks/tasks/mix_eval 2025-11-04T13:52:00,395 copying src/lighteval/tasks/tasks/mix_eval/judge_prompts.py -> build/lib/lighteval/tasks/tasks/mix_eval 2025-11-04T13:52:00,397 copying src/lighteval/tasks/tasks/mix_eval/main.py -> build/lib/lighteval/tasks/tasks/mix_eval 2025-11-04T13:52:00,400 copying src/lighteval/tasks/tasks/mix_eval/prompts.py -> build/lib/lighteval/tasks/tasks/mix_eval 2025-11-04T13:52:00,402 creating build/lib/lighteval/tasks/tasks/mt_bench 2025-11-04T13:52:00,403 copying src/lighteval/tasks/tasks/mt_bench/main.py -> build/lib/lighteval/tasks/tasks/mt_bench 2025-11-04T13:52:00,405 copying src/lighteval/tasks/tasks/mt_bench/judge_prompt_templates.py -> build/lib/lighteval/tasks/tasks/mt_bench 2025-11-04T13:52:00,408 creating build/lib/lighteval/tasks/templates/utils 2025-11-04T13:52:00,409 copying src/lighteval/tasks/templates/utils/__init__.py -> build/lib/lighteval/tasks/templates/utils 2025-11-04T13:52:00,411 copying src/lighteval/tasks/templates/utils/formatting_utils.py -> build/lib/lighteval/tasks/templates/utils 2025-11-04T13:52:00,414 copying src/lighteval/tasks/templates/utils/adapter_utils.py -> build/lib/lighteval/tasks/templates/utils 2025-11-04T13:52:00,416 copying src/lighteval/tasks/templates/utils/translation_literals.py -> build/lib/lighteval/tasks/templates/utils 2025-11-04T13:52:00,419 copying src/lighteval/tasks/templates/utils/formulation.py -> build/lib/lighteval/tasks/templates/utils 2025-11-04T13:52:00,422 creating build/lib/lighteval/metrics/harness_compatibility 2025-11-04T13:52:00,423 copying src/lighteval/metrics/harness_compatibility/drop.py -> build/lib/lighteval/metrics/harness_compatibility 2025-11-04T13:52:00,425 copying src/lighteval/metrics/harness_compatibility/truthful_qa.py -> build/lib/lighteval/metrics/harness_compatibility 2025-11-04T13:52:00,428 creating build/lib/lighteval/metrics/utils 2025-11-04T13:52:00,429 copying src/lighteval/metrics/utils/stderr.py -> build/lib/lighteval/metrics/utils 2025-11-04T13:52:00,431 copying src/lighteval/metrics/utils/llm_as_judge.py -> build/lib/lighteval/metrics/utils 2025-11-04T13:52:00,434 copying src/lighteval/metrics/utils/metric_utils.py -> build/lib/lighteval/metrics/utils 2025-11-04T13:52:00,436 copying src/lighteval/metrics/utils/linguistic_tokenizers.py -> build/lib/lighteval/metrics/utils 2025-11-04T13:52:00,438 copying src/lighteval/metrics/utils/extractive_match_utils.py -> build/lib/lighteval/metrics/utils 2025-11-04T13:52:00,441 copying src/lighteval/metrics/utils/math_comparison.py -> build/lib/lighteval/metrics/utils 2025-11-04T13:52:00,443 copying src/lighteval/metrics/utils/judge_utils.py -> build/lib/lighteval/metrics/utils 2025-11-04T13:52:00,446 creating build/lib/lighteval/metrics/imports 2025-11-04T13:52:00,447 copying src/lighteval/metrics/imports/__init__.py -> build/lib/lighteval/metrics/imports 2025-11-04T13:52:00,449 copying src/lighteval/metrics/imports/data_stats_metric.py -> build/lib/lighteval/metrics/imports 2025-11-04T13:52:00,451 copying src/lighteval/metrics/imports/bert_scorer.py -> build/lib/lighteval/metrics/imports 2025-11-04T13:52:00,454 copying src/lighteval/metrics/imports/data_stats_utils.py -> build/lib/lighteval/metrics/imports 2025-11-04T13:52:00,456 copying src/lighteval/metrics/imports/summac.py -> build/lib/lighteval/metrics/imports 2025-11-04T13:52:00,458 creating build/lib/lighteval/models/custom 2025-11-04T13:52:00,460 copying src/lighteval/models/custom/custom_model.py -> build/lib/lighteval/models/custom 2025-11-04T13:52:00,462 creating build/lib/lighteval/models/vllm 2025-11-04T13:52:00,463 copying src/lighteval/models/vllm/vllm_model.py -> build/lib/lighteval/models/vllm 2025-11-04T13:52:00,466 creating build/lib/lighteval/models/transformers 2025-11-04T13:52:00,467 copying src/lighteval/models/transformers/vlm_transformers_model.py -> build/lib/lighteval/models/transformers 2025-11-04T13:52:00,470 copying src/lighteval/models/transformers/transformers_model.py -> build/lib/lighteval/models/transformers 2025-11-04T13:52:00,474 copying src/lighteval/models/transformers/delta_model.py -> build/lib/lighteval/models/transformers 2025-11-04T13:52:00,476 copying src/lighteval/models/transformers/adapter_model.py -> build/lib/lighteval/models/transformers 2025-11-04T13:52:00,479 creating build/lib/lighteval/models/endpoints 2025-11-04T13:52:00,480 copying src/lighteval/models/endpoints/endpoint_model.py -> build/lib/lighteval/models/endpoints 2025-11-04T13:52:00,483 copying src/lighteval/models/endpoints/tgi_model.py -> build/lib/lighteval/models/endpoints 2025-11-04T13:52:00,486 copying src/lighteval/models/endpoints/inference_providers_model.py -> build/lib/lighteval/models/endpoints 2025-11-04T13:52:00,488 copying src/lighteval/models/endpoints/litellm_model.py -> build/lib/lighteval/models/endpoints 2025-11-04T13:52:00,491 creating build/lib/lighteval/models/sglang 2025-11-04T13:52:00,492 copying src/lighteval/models/sglang/sglang_model.py -> build/lib/lighteval/models/sglang 2025-11-04T13:52:00,495 creating build/lib/lighteval/models/nanotron 2025-11-04T13:52:00,496 copying src/lighteval/models/nanotron/nanotron_model.py -> build/lib/lighteval/models/nanotron 2025-11-04T13:52:00,500 creating build/lib/lighteval/models/dummy 2025-11-04T13:52:00,501 copying src/lighteval/models/dummy/dummy_model.py -> build/lib/lighteval/models/dummy 2025-11-04T13:52:00,504 running egg_info 2025-11-04T13:52:00,515 writing src/lighteval.egg-info/PKG-INFO 2025-11-04T13:52:00,533 writing dependency_links to src/lighteval.egg-info/dependency_links.txt 2025-11-04T13:52:00,535 writing entry points to src/lighteval.egg-info/entry_points.txt 2025-11-04T13:52:00,544 writing requirements to src/lighteval.egg-info/requires.txt 2025-11-04T13:52:00,546 writing top-level names to src/lighteval.egg-info/top_level.txt 2025-11-04T13:52:00,588 reading manifest file 'src/lighteval.egg-info/SOURCES.txt' 2025-11-04T13:52:00,605 reading manifest template 'MANIFEST.in' 2025-11-04T13:52:00,606 warning: no files found matching 'src/lighteval/tasks/tasks_table.jsonl' 2025-11-04T13:52:00,607 warning: no files found matching 'src/lighteval/metrics/*.jsonl' 2025-11-04T13:52:00,607 adding license file 'LICENSE' 2025-11-04T13:52:00,621 writing manifest file 'src/lighteval.egg-info/SOURCES.txt' 2025-11-04T13:52:00,668 installing to build/bdist.linux-armv7l/wheel 2025-11-04T13:52:00,669 running install 2025-11-04T13:52:00,692 running install_lib 2025-11-04T13:52:00,698 creating build/bdist.linux-armv7l/wheel 2025-11-04T13:52:00,701 creating build/bdist.linux-armv7l/wheel/lighteval 2025-11-04T13:52:00,702 copying build/lib/lighteval/main_nanotron.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-04T13:52:00,704 copying build/lib/lighteval/pipeline.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-04T13:52:00,707 copying build/lib/lighteval/main_inspect.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-04T13:52:00,709 copying build/lib/lighteval/main_sglang.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-04T13:52:00,712 creating build/bdist.linux-armv7l/wheel/lighteval/utils 2025-11-04T13:52:00,713 copying build/lib/lighteval/utils/utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/utils 2025-11-04T13:52:00,716 copying build/lib/lighteval/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/utils 2025-11-04T13:52:00,718 copying build/lib/lighteval/utils/parallelism.py -> build/bdist.linux-armv7l/wheel/./lighteval/utils 2025-11-04T13:52:00,720 copying build/lib/lighteval/utils/imports.py -> build/bdist.linux-armv7l/wheel/./lighteval/utils 2025-11-04T13:52:00,723 copying build/lib/lighteval/utils/language.py -> build/bdist.linux-armv7l/wheel/./lighteval/utils 2025-11-04T13:52:00,725 copying build/lib/lighteval/utils/cache_management.py -> build/bdist.linux-armv7l/wheel/./lighteval/utils 2025-11-04T13:52:00,728 copying build/lib/lighteval/utils/timeout.py -> build/bdist.linux-armv7l/wheel/./lighteval/utils 2025-11-04T13:52:00,730 copying build/lib/lighteval/main_custom.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-04T13:52:00,732 copying build/lib/lighteval/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-04T13:52:00,734 copying build/lib/lighteval/cli_args.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-04T13:52:00,737 copying build/lib/lighteval/__main__.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-04T13:52:00,739 creating build/bdist.linux-armv7l/wheel/lighteval/tasks 2025-11-04T13:52:00,741 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/multilingual 2025-11-04T13:52:00,743 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/multilingual/utils 2025-11-04T13:52:00,744 copying build/lib/lighteval/tasks/multilingual/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/utils 2025-11-04T13:52:00,746 copying build/lib/lighteval/tasks/multilingual/utils/task_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/utils 2025-11-04T13:52:00,748 copying build/lib/lighteval/tasks/multilingual/utils/adapters_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/utils 2025-11-04T13:52:00,750 copying build/lib/lighteval/tasks/multilingual/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual 2025-11-04T13:52:00,754 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,755 copying build/lib/lighteval/tasks/multilingual/tasks/turkish_arc.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,757 copying build/lib/lighteval/tasks/multilingual/tasks/thaiqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,760 copying build/lib/lighteval/tasks/multilingual/tasks/german_rag.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,762 copying build/lib/lighteval/tasks/multilingual/tasks/turkic.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,764 copying build/lib/lighteval/tasks/multilingual/tasks/meta_mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,767 copying build/lib/lighteval/tasks/multilingual/tasks/cmrc2018.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,769 copying build/lib/lighteval/tasks/multilingual/tasks/mgsm.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,772 copying build/lib/lighteval/tasks/multilingual/tasks/germanquad.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,774 copying build/lib/lighteval/tasks/multilingual/tasks/acva.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,776 copying build/lib/lighteval/tasks/multilingual/tasks/cmnli.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,779 copying build/lib/lighteval/tasks/multilingual/tasks/hindi_arc.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,781 copying build/lib/lighteval/tasks/multilingual/tasks/exams.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,784 copying build/lib/lighteval/tasks/multilingual/tasks/xcsqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,786 copying build/lib/lighteval/tasks/multilingual/tasks/tquad_v2.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,789 copying build/lib/lighteval/tasks/multilingual/tasks/soqal.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,792 copying build/lib/lighteval/tasks/multilingual/tasks/rcb.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,794 copying build/lib/lighteval/tasks/multilingual/tasks/worldtree_rus.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,797 copying build/lib/lighteval/tasks/multilingual/tasks/mlqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,799 copying build/lib/lighteval/tasks/multilingual/tasks/mlmm_hellaswag.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,802 copying build/lib/lighteval/tasks/multilingual/tasks/mathlogicqa_rus.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,804 copying build/lib/lighteval/tasks/multilingual/tasks/indicqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,807 copying build/lib/lighteval/tasks/multilingual/tasks/hellaswag_tha.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,809 copying build/lib/lighteval/tasks/multilingual/tasks/mlmm_mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,812 copying build/lib/lighteval/tasks/multilingual/tasks/xnli_indic.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,815 copying build/lib/lighteval/tasks/multilingual/tasks/turkish_mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,817 copying build/lib/lighteval/tasks/multilingual/tasks/global_mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,820 copying build/lib/lighteval/tasks/multilingual/tasks/cmath.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,823 copying build/lib/lighteval/tasks/multilingual/tasks/hellaswag_hin.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,825 copying build/lib/lighteval/tasks/multilingual/tasks/mlmm_truthfulqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,828 copying build/lib/lighteval/tasks/multilingual/tasks/openbook_rus.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,830 copying build/lib/lighteval/tasks/multilingual/tasks/xcodah.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,833 copying build/lib/lighteval/tasks/multilingual/tasks/thai_exams.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,835 copying build/lib/lighteval/tasks/multilingual/tasks/mkqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,838 copying build/lib/lighteval/tasks/multilingual/tasks/chinese_squad.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,840 copying build/lib/lighteval/tasks/multilingual/tasks/xnli.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,843 copying build/lib/lighteval/tasks/multilingual/tasks/hellaswag_tur.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,845 copying build/lib/lighteval/tasks/multilingual/tasks/xstory.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,848 copying build/lib/lighteval/tasks/multilingual/tasks/belebele.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,851 copying build/lib/lighteval/tasks/multilingual/tasks/copa_indic.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,853 copying build/lib/lighteval/tasks/multilingual/tasks/faquad.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,856 copying build/lib/lighteval/tasks/multilingual/tasks/squad_it.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,858 copying build/lib/lighteval/tasks/multilingual/tasks/french.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,861 copying build/lib/lighteval/tasks/multilingual/tasks/paws_x.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,863 copying build/lib/lighteval/tasks/multilingual/tasks/filipino.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,867 copying build/lib/lighteval/tasks/multilingual/tasks/arabic_arc.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,869 copying build/lib/lighteval/tasks/multilingual/tasks/xwinograd.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,871 copying build/lib/lighteval/tasks/multilingual/tasks/hindi_boolq.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,873 copying build/lib/lighteval/tasks/multilingual/tasks/chegeka.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,875 copying build/lib/lighteval/tasks/multilingual/tasks/arabic_mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,877 copying build/lib/lighteval/tasks/multilingual/tasks/afri_mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,879 copying build/lib/lighteval/tasks/multilingual/tasks/kenswquad.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,880 copying build/lib/lighteval/tasks/multilingual/tasks/parus.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,882 copying build/lib/lighteval/tasks/multilingual/tasks/serbian_eval.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,885 copying build/lib/lighteval/tasks/multilingual/tasks/french_triviqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,887 copying build/lib/lighteval/tasks/multilingual/tasks/hellaswag_tel.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,889 copying build/lib/lighteval/tasks/multilingual/tasks/xcopa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,891 copying build/lib/lighteval/tasks/multilingual/tasks/flores200.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,893 copying build/lib/lighteval/tasks/multilingual/tasks/xquad.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,895 copying build/lib/lighteval/tasks/multilingual/tasks/m3exams.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,897 copying build/lib/lighteval/tasks/multilingual/tasks/openbook_ara.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,899 copying build/lib/lighteval/tasks/multilingual/tasks/afri_xnli.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,901 copying build/lib/lighteval/tasks/multilingual/tasks/swahili_arc.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,903 copying build/lib/lighteval/tasks/multilingual/tasks/ceval.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,905 copying build/lib/lighteval/tasks/multilingual/tasks/squad_es.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,907 copying build/lib/lighteval/tasks/multilingual/tasks/sber_squad.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,909 copying build/lib/lighteval/tasks/multilingual/tasks/enem.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,911 copying build/lib/lighteval/tasks/multilingual/tasks/cmmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,913 copying build/lib/lighteval/tasks/multilingual/tasks/tydiqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,915 copying build/lib/lighteval/tasks/multilingual/tasks/oab_exams.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,917 copying build/lib/lighteval/tasks/multilingual/tasks/xnli2.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,919 copying build/lib/lighteval/tasks/multilingual/tasks/openbook_es.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,921 copying build/lib/lighteval/tasks/multilingual/tasks/arabic.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,924 copying build/lib/lighteval/tasks/multilingual/tasks/mintaka.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,926 copying build/lib/lighteval/tasks/multilingual/tasks/arcd.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,928 copying build/lib/lighteval/tasks/multilingual/tasks/mlmm_arc_challenge.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,929 copying build/lib/lighteval/tasks/multilingual/tasks/fquad_v2.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,931 copying build/lib/lighteval/tasks/multilingual/tasks/french_boolq.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,933 copying build/lib/lighteval/tasks/multilingual/tasks/oz.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,935 copying build/lib/lighteval/tasks/multilingual/tasks/afri_mgsm.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,937 copying build/lib/lighteval/tasks/multilingual/tasks/piqa_ar.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,939 copying build/lib/lighteval/tasks/multilingual/tasks/openai_mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,941 copying build/lib/lighteval/tasks/multilingual/tasks/c3.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,943 copying build/lib/lighteval/tasks/multilingual/tasks/ocnli.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-04T13:52:00,945 copying build/lib/lighteval/tasks/multilingual/adapters.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual 2025-11-04T13:52:00,947 copying build/lib/lighteval/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks 2025-11-04T13:52:00,949 copying build/lib/lighteval/tasks/prompt_manager.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks 2025-11-04T13:52:00,953 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks 2025-11-04T13:52:00,954 copying build/lib/lighteval/tasks/tasks/synthetic_reasoning.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:00,956 copying build/lib/lighteval/tasks/tasks/aimo.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:00,958 copying build/lib/lighteval/tasks/tasks/arithmetic.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:00,960 copying build/lib/lighteval/tasks/tasks/mmmu_pro.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:00,962 copying build/lib/lighteval/tasks/tasks/aime.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:00,965 copying build/lib/lighteval/tasks/tasks/summarization.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:00,966 copying build/lib/lighteval/tasks/tasks/bigbench_hard.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:00,969 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks/tiny_benchmarks 2025-11-04T13:52:00,970 copying build/lib/lighteval/tasks/tasks/tiny_benchmarks/main.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/tiny_benchmarks 2025-11-04T13:52:00,973 copying build/lib/lighteval/tasks/tasks/musr.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:00,975 copying build/lib/lighteval/tasks/tasks/jeopardy.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:00,976 copying build/lib/lighteval/tasks/tasks/legalsupport.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:00,978 copying build/lib/lighteval/tasks/tasks/mgsm.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:00,981 copying build/lib/lighteval/tasks/tasks/imdb.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:00,982 copying build/lib/lighteval/tasks/tasks/pubmedqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:00,984 copying build/lib/lighteval/tasks/tasks/real_toxicity_prompts.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:00,986 copying build/lib/lighteval/tasks/tasks/hellaswag.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:00,987 copying build/lib/lighteval/tasks/tasks/drop_qa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:00,989 copying build/lib/lighteval/tasks/tasks/narrativeqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:00,991 copying build/lib/lighteval/tasks/tasks/bigbench.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:00,995 copying build/lib/lighteval/tasks/tasks/mmlu_redux.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:00,997 copying build/lib/lighteval/tasks/tasks/qa4mre.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:00,999 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks/olympiade_bench 2025-11-04T13:52:01,000 copying build/lib/lighteval/tasks/tasks/olympiade_bench/main.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/olympiade_bench 2025-11-04T13:52:01,002 copying build/lib/lighteval/tasks/tasks/babi_qa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,004 copying build/lib/lighteval/tasks/tasks/squad_v2.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,006 copying build/lib/lighteval/tasks/tasks/anli.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,008 copying build/lib/lighteval/tasks/tasks/agieval.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,010 copying build/lib/lighteval/tasks/tasks/gpqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,012 copying build/lib/lighteval/tasks/tasks/gsm8k.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,014 copying build/lib/lighteval/tasks/tasks/mathqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,016 copying build/lib/lighteval/tasks/tasks/asdiv.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,018 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks/lcb 2025-11-04T13:52:01,019 copying build/lib/lighteval/tasks/tasks/lcb/codegen_metrics.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/lcb 2025-11-04T13:52:01,022 copying build/lib/lighteval/tasks/tasks/lcb/main.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/lcb 2025-11-04T13:52:01,024 copying build/lib/lighteval/tasks/tasks/sciq.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,026 copying build/lib/lighteval/tasks/tasks/med_dialog.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,027 copying build/lib/lighteval/tasks/tasks/math_500.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,029 copying build/lib/lighteval/tasks/tasks/the_pile.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,031 copying build/lib/lighteval/tasks/tasks/arc.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,033 copying build/lib/lighteval/tasks/tasks/dyck_language.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,035 copying build/lib/lighteval/tasks/tasks/triviaqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,037 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks/ifeval 2025-11-04T13:52:01,038 copying build/lib/lighteval/tasks/tasks/ifeval/instructions_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifeval 2025-11-04T13:52:01,041 copying build/lib/lighteval/tasks/tasks/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifeval 2025-11-04T13:52:01,044 copying build/lib/lighteval/tasks/tasks/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifeval 2025-11-04T13:52:01,046 copying build/lib/lighteval/tasks/tasks/ifeval/main.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifeval 2025-11-04T13:52:01,048 copying build/lib/lighteval/tasks/tasks/glue.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,050 copying build/lib/lighteval/tasks/tasks/logiqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,052 copying build/lib/lighteval/tasks/tasks/arc_agi_2.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,054 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks/hle 2025-11-04T13:52:01,055 copying build/lib/lighteval/tasks/tasks/hle/main.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/hle 2025-11-04T13:52:01,057 copying build/lib/lighteval/tasks/tasks/entity_data_imputation.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,059 copying build/lib/lighteval/tasks/tasks/toxigen.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,061 copying build/lib/lighteval/tasks/tasks/gsm_plus.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,062 copying build/lib/lighteval/tasks/tasks/xstory_cloze.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,065 copying build/lib/lighteval/tasks/tasks/quac.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,067 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks/ifbench 2025-11-04T13:52:01,068 copying build/lib/lighteval/tasks/tasks/ifbench/instructions.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifbench 2025-11-04T13:52:01,071 copying build/lib/lighteval/tasks/tasks/ifbench/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifbench 2025-11-04T13:52:01,074 copying build/lib/lighteval/tasks/tasks/ifbench/evaluation_lib.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifbench 2025-11-04T13:52:01,076 copying build/lib/lighteval/tasks/tasks/ifbench/main.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifbench 2025-11-04T13:52:01,078 copying build/lib/lighteval/tasks/tasks/lsat_qa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,080 copying build/lib/lighteval/tasks/tasks/entitymatching.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,082 copying build/lib/lighteval/tasks/tasks/piqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,084 copying build/lib/lighteval/tasks/tasks/math.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,086 copying build/lib/lighteval/tasks/tasks/race_high.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,088 copying build/lib/lighteval/tasks/tasks/legal_summarization.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,090 copying build/lib/lighteval/tasks/tasks/twitterAAE.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,092 copying build/lib/lighteval/tasks/tasks/raft.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,094 copying build/lib/lighteval/tasks/tasks/bold.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,096 copying build/lib/lighteval/tasks/tasks/covid_dialogue.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,098 copying build/lib/lighteval/tasks/tasks/lambada.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,099 copying build/lib/lighteval/tasks/tasks/mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,102 copying build/lib/lighteval/tasks/tasks/xwinograd.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,104 copying build/lib/lighteval/tasks/tasks/webqs.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,106 copying build/lib/lighteval/tasks/tasks/unscramble.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,107 copying build/lib/lighteval/tasks/tasks/sacrebleu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,111 copying build/lib/lighteval/tasks/tasks/xcopa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,113 copying build/lib/lighteval/tasks/tasks/ethics.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,115 copying build/lib/lighteval/tasks/tasks/wikitext.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,116 copying build/lib/lighteval/tasks/tasks/wikifact.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,120 copying build/lib/lighteval/tasks/tasks/lextreme.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,122 copying build/lib/lighteval/tasks/tasks/boolq.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,124 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks/mix_eval 2025-11-04T13:52:01,125 copying build/lib/lighteval/tasks/tasks/mix_eval/judge_prompts.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/mix_eval 2025-11-04T13:52:01,128 copying build/lib/lighteval/tasks/tasks/mix_eval/main.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/mix_eval 2025-11-04T13:52:01,131 copying build/lib/lighteval/tasks/tasks/mix_eval/prompts.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/mix_eval 2025-11-04T13:52:01,133 copying build/lib/lighteval/tasks/tasks/custom_task_classification_grammar_task.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,136 copying build/lib/lighteval/tasks/tasks/swag.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,138 copying build/lib/lighteval/tasks/tasks/civil_comments.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,140 copying build/lib/lighteval/tasks/tasks/bbq.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,142 copying build/lib/lighteval/tasks/tasks/lexglue.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,144 copying build/lib/lighteval/tasks/tasks/truthfulqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,146 copying build/lib/lighteval/tasks/tasks/winogrande.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,148 copying build/lib/lighteval/tasks/tasks/blimp.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,151 copying build/lib/lighteval/tasks/tasks/headqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,153 copying build/lib/lighteval/tasks/tasks/numeracy.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,155 copying build/lib/lighteval/tasks/tasks/qasper.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,157 copying build/lib/lighteval/tasks/tasks/prost.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,159 copying build/lib/lighteval/tasks/tasks/mmlu_pro.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,161 copying build/lib/lighteval/tasks/tasks/commonsenseqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,162 copying build/lib/lighteval/tasks/tasks/openbookqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,164 copying build/lib/lighteval/tasks/tasks/coqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,166 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks/mt_bench 2025-11-04T13:52:01,167 copying build/lib/lighteval/tasks/tasks/mt_bench/main.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/mt_bench 2025-11-04T13:52:01,169 copying build/lib/lighteval/tasks/tasks/mt_bench/judge_prompt_templates.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/mt_bench 2025-11-04T13:52:01,172 copying build/lib/lighteval/tasks/tasks/med.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,173 copying build/lib/lighteval/tasks/tasks/simpleqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,175 copying build/lib/lighteval/tasks/tasks/storycloze.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,177 copying build/lib/lighteval/tasks/tasks/siqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,178 copying build/lib/lighteval/tasks/tasks/slr_bench.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,180 copying build/lib/lighteval/tasks/tasks/natural_questions.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-04T13:52:01,182 copying build/lib/lighteval/tasks/default_prompts.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks 2025-11-04T13:52:01,186 copying build/lib/lighteval/tasks/registry.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks 2025-11-04T13:52:01,189 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/templates 2025-11-04T13:52:01,190 copying build/lib/lighteval/tasks/templates/multichoice.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-04T13:52:01,192 copying build/lib/lighteval/tasks/templates/continuation.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-04T13:52:01,195 copying build/lib/lighteval/tasks/templates/hellaswag.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-04T13:52:01,197 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/templates/utils 2025-11-04T13:52:01,198 copying build/lib/lighteval/tasks/templates/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates/utils 2025-11-04T13:52:01,200 copying build/lib/lighteval/tasks/templates/utils/formatting_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates/utils 2025-11-04T13:52:01,202 copying build/lib/lighteval/tasks/templates/utils/adapter_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates/utils 2025-11-04T13:52:01,204 copying build/lib/lighteval/tasks/templates/utils/translation_literals.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates/utils 2025-11-04T13:52:01,208 copying build/lib/lighteval/tasks/templates/utils/formulation.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates/utils 2025-11-04T13:52:01,210 copying build/lib/lighteval/tasks/templates/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-04T13:52:01,211 copying build/lib/lighteval/tasks/templates/copa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-04T13:52:01,214 copying build/lib/lighteval/tasks/templates/nli.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-04T13:52:01,216 copying build/lib/lighteval/tasks/templates/boolq.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-04T13:52:01,218 copying build/lib/lighteval/tasks/templates/translation.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-04T13:52:01,220 copying build/lib/lighteval/tasks/templates/qa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-04T13:52:01,222 copying build/lib/lighteval/tasks/lighteval_task.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks 2025-11-04T13:52:01,225 copying build/lib/lighteval/tasks/requests.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks 2025-11-04T13:52:01,228 copying build/lib/lighteval/main_accelerate.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-04T13:52:01,230 copying build/lib/lighteval/data.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-04T13:52:01,232 copying build/lib/lighteval/main_vllm.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-04T13:52:01,235 creating build/bdist.linux-armv7l/wheel/lighteval/metrics 2025-11-04T13:52:01,236 creating build/bdist.linux-armv7l/wheel/lighteval/metrics/harness_compatibility 2025-11-04T13:52:01,237 copying build/lib/lighteval/metrics/harness_compatibility/drop.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/harness_compatibility 2025-11-04T13:52:01,240 copying build/lib/lighteval/metrics/harness_compatibility/truthful_qa.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/harness_compatibility 2025-11-04T13:52:01,241 copying build/lib/lighteval/metrics/sample_preparator.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics 2025-11-04T13:52:01,244 creating build/bdist.linux-armv7l/wheel/lighteval/metrics/utils 2025-11-04T13:52:01,245 copying build/lib/lighteval/metrics/utils/stderr.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/utils 2025-11-04T13:52:01,248 copying build/lib/lighteval/metrics/utils/llm_as_judge.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/utils 2025-11-04T13:52:01,250 copying build/lib/lighteval/metrics/utils/metric_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/utils 2025-11-04T13:52:01,252 copying build/lib/lighteval/metrics/utils/linguistic_tokenizers.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/utils 2025-11-04T13:52:01,255 copying build/lib/lighteval/metrics/utils/extractive_match_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/utils 2025-11-04T13:52:01,257 copying build/lib/lighteval/metrics/utils/math_comparison.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/utils 2025-11-04T13:52:01,260 copying build/lib/lighteval/metrics/utils/judge_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/utils 2025-11-04T13:52:01,262 copying build/lib/lighteval/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics 2025-11-04T13:52:01,264 copying build/lib/lighteval/metrics/dynamic_metrics.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics 2025-11-04T13:52:01,266 copying build/lib/lighteval/metrics/normalizations.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics 2025-11-04T13:52:01,269 copying build/lib/lighteval/metrics/metrics.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics 2025-11-04T13:52:01,271 copying build/lib/lighteval/metrics/metrics_sample.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics 2025-11-04T13:52:01,274 copying build/lib/lighteval/metrics/metrics_corpus.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics 2025-11-04T13:52:01,277 creating build/bdist.linux-armv7l/wheel/lighteval/metrics/imports 2025-11-04T13:52:01,278 copying build/lib/lighteval/metrics/imports/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/imports 2025-11-04T13:52:01,280 copying build/lib/lighteval/metrics/imports/data_stats_metric.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/imports 2025-11-04T13:52:01,282 copying build/lib/lighteval/metrics/imports/bert_scorer.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/imports 2025-11-04T13:52:01,285 copying build/lib/lighteval/metrics/imports/data_stats_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/imports 2025-11-04T13:52:01,287 copying build/lib/lighteval/metrics/imports/summac.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/imports 2025-11-04T13:52:01,290 copying build/lib/lighteval/main_endpoint.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-04T13:52:01,293 copying build/lib/lighteval/main_baseline.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-04T13:52:01,296 creating build/bdist.linux-armv7l/wheel/lighteval/models 2025-11-04T13:52:01,298 creating build/bdist.linux-armv7l/wheel/lighteval/models/custom 2025-11-04T13:52:01,299 copying build/lib/lighteval/models/custom/custom_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/custom 2025-11-04T13:52:01,301 copying build/lib/lighteval/models/model_input.py -> build/bdist.linux-armv7l/wheel/./lighteval/models 2025-11-04T13:52:01,303 copying build/lib/lighteval/models/abstract_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models 2025-11-04T13:52:01,306 copying build/lib/lighteval/models/model_output.py -> build/bdist.linux-armv7l/wheel/./lighteval/models 2025-11-04T13:52:01,309 creating build/bdist.linux-armv7l/wheel/lighteval/models/vllm 2025-11-04T13:52:01,310 copying build/lib/lighteval/models/vllm/vllm_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/vllm 2025-11-04T13:52:01,314 copying build/lib/lighteval/models/utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/models 2025-11-04T13:52:01,317 creating build/bdist.linux-armv7l/wheel/lighteval/models/transformers 2025-11-04T13:52:01,318 copying build/lib/lighteval/models/transformers/vlm_transformers_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/transformers 2025-11-04T13:52:01,321 copying build/lib/lighteval/models/transformers/transformers_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/transformers 2025-11-04T13:52:01,325 copying build/lib/lighteval/models/transformers/delta_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/transformers 2025-11-04T13:52:01,328 copying build/lib/lighteval/models/transformers/adapter_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/transformers 2025-11-04T13:52:01,331 creating build/bdist.linux-armv7l/wheel/lighteval/models/endpoints 2025-11-04T13:52:01,332 copying build/lib/lighteval/models/endpoints/endpoint_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/endpoints 2025-11-04T13:52:01,335 copying build/lib/lighteval/models/endpoints/tgi_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/endpoints 2025-11-04T13:52:01,338 copying build/lib/lighteval/models/endpoints/inference_providers_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/endpoints 2025-11-04T13:52:01,341 copying build/lib/lighteval/models/endpoints/litellm_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/endpoints 2025-11-04T13:52:01,344 copying build/lib/lighteval/models/model_loader.py -> build/bdist.linux-armv7l/wheel/./lighteval/models 2025-11-04T13:52:01,347 creating build/bdist.linux-armv7l/wheel/lighteval/models/sglang 2025-11-04T13:52:01,348 copying build/lib/lighteval/models/sglang/sglang_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/sglang 2025-11-04T13:52:01,351 creating build/bdist.linux-armv7l/wheel/lighteval/models/nanotron 2025-11-04T13:52:01,353 copying build/lib/lighteval/models/nanotron/nanotron_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/nanotron 2025-11-04T13:52:01,357 creating build/bdist.linux-armv7l/wheel/lighteval/models/dummy 2025-11-04T13:52:01,359 copying build/lib/lighteval/models/dummy/dummy_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/dummy 2025-11-04T13:52:01,361 copying build/lib/lighteval/check_logs.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-04T13:52:01,364 creating build/bdist.linux-armv7l/wheel/lighteval/logging 2025-11-04T13:52:01,365 copying build/lib/lighteval/logging/info_loggers.py -> build/bdist.linux-armv7l/wheel/./lighteval/logging 2025-11-04T13:52:01,368 copying build/lib/lighteval/logging/evaluation_tracker.py -> build/bdist.linux-armv7l/wheel/./lighteval/logging 2025-11-04T13:52:01,372 copying build/lib/lighteval/main_tasks.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-04T13:52:01,374 running install_egg_info 2025-11-04T13:52:01,380 Copying src/lighteval.egg-info to build/bdist.linux-armv7l/wheel/./lighteval-0.12.0-py3.11.egg-info 2025-11-04T13:52:01,392 running install_scripts 2025-11-04T13:52:01,404 creating build/bdist.linux-armv7l/wheel/lighteval-0.12.0.dist-info/WHEEL 2025-11-04T13:52:01,406 creating '/tmp/pip-wheel-u0plmmw5/.tmp-x2736mm0/lighteval-0.12.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-11-04T13:52:01,409 adding 'lighteval/__init__.py' 2025-11-04T13:52:01,410 adding 'lighteval/__main__.py' 2025-11-04T13:52:01,411 adding 'lighteval/check_logs.py' 2025-11-04T13:52:01,413 adding 'lighteval/cli_args.py' 2025-11-04T13:52:01,415 adding 'lighteval/data.py' 2025-11-04T13:52:01,417 adding 'lighteval/main_accelerate.py' 2025-11-04T13:52:01,418 adding 'lighteval/main_baseline.py' 2025-11-04T13:52:01,420 adding 'lighteval/main_custom.py' 2025-11-04T13:52:01,421 adding 'lighteval/main_endpoint.py' 2025-11-04T13:52:01,424 adding 'lighteval/main_inspect.py' 2025-11-04T13:52:01,426 adding 'lighteval/main_nanotron.py' 2025-11-04T13:52:01,427 adding 'lighteval/main_sglang.py' 2025-11-04T13:52:01,428 adding 'lighteval/main_tasks.py' 2025-11-04T13:52:01,430 adding 'lighteval/main_vllm.py' 2025-11-04T13:52:01,432 adding 'lighteval/pipeline.py' 2025-11-04T13:52:01,437 adding 'lighteval/logging/evaluation_tracker.py' 2025-11-04T13:52:01,440 adding 'lighteval/logging/info_loggers.py' 2025-11-04T13:52:01,442 adding 'lighteval/metrics/__init__.py' 2025-11-04T13:52:01,444 adding 'lighteval/metrics/dynamic_metrics.py' 2025-11-04T13:52:01,446 adding 'lighteval/metrics/metrics.py' 2025-11-04T13:52:01,448 adding 'lighteval/metrics/metrics_corpus.py' 2025-11-04T13:52:01,454 adding 'lighteval/metrics/metrics_sample.py' 2025-11-04T13:52:01,457 adding 'lighteval/metrics/normalizations.py' 2025-11-04T13:52:01,459 adding 'lighteval/metrics/sample_preparator.py' 2025-11-04T13:52:01,461 adding 'lighteval/metrics/harness_compatibility/drop.py' 2025-11-04T13:52:01,462 adding 'lighteval/metrics/harness_compatibility/truthful_qa.py' 2025-11-04T13:52:01,464 adding 'lighteval/metrics/imports/__init__.py' 2025-11-04T13:52:01,467 adding 'lighteval/metrics/imports/bert_scorer.py' 2025-11-04T13:52:01,469 adding 'lighteval/metrics/imports/data_stats_metric.py' 2025-11-04T13:52:01,470 adding 'lighteval/metrics/imports/data_stats_utils.py' 2025-11-04T13:52:01,472 adding 'lighteval/metrics/imports/summac.py' 2025-11-04T13:52:01,476 adding 'lighteval/metrics/utils/extractive_match_utils.py' 2025-11-04T13:52:01,478 adding 'lighteval/metrics/utils/judge_utils.py' 2025-11-04T13:52:01,480 adding 'lighteval/metrics/utils/linguistic_tokenizers.py' 2025-11-04T13:52:01,482 adding 'lighteval/metrics/utils/llm_as_judge.py' 2025-11-04T13:52:01,486 adding 'lighteval/metrics/utils/math_comparison.py' 2025-11-04T13:52:01,487 adding 'lighteval/metrics/utils/metric_utils.py' 2025-11-04T13:52:01,489 adding 'lighteval/metrics/utils/stderr.py' 2025-11-04T13:52:01,492 adding 'lighteval/models/abstract_model.py' 2025-11-04T13:52:01,493 adding 'lighteval/models/model_input.py' 2025-11-04T13:52:01,495 adding 'lighteval/models/model_loader.py' 2025-11-04T13:52:01,497 adding 'lighteval/models/model_output.py' 2025-11-04T13:52:01,498 adding 'lighteval/models/utils.py' 2025-11-04T13:52:01,500 adding 'lighteval/models/custom/custom_model.py' 2025-11-04T13:52:01,502 adding 'lighteval/models/dummy/dummy_model.py' 2025-11-04T13:52:01,506 adding 'lighteval/models/endpoints/endpoint_model.py' 2025-11-04T13:52:01,508 adding 'lighteval/models/endpoints/inference_providers_model.py' 2025-11-04T13:52:01,511 adding 'lighteval/models/endpoints/litellm_model.py' 2025-11-04T13:52:01,513 adding 'lighteval/models/endpoints/tgi_model.py' 2025-11-04T13:52:01,520 adding 'lighteval/models/nanotron/nanotron_model.py' 2025-11-04T13:52:01,523 adding 'lighteval/models/sglang/sglang_model.py' 2025-11-04T13:52:01,525 adding 'lighteval/models/transformers/adapter_model.py' 2025-11-04T13:52:01,527 adding 'lighteval/models/transformers/delta_model.py' 2025-11-04T13:52:01,533 adding 'lighteval/models/transformers/transformers_model.py' 2025-11-04T13:52:01,537 adding 'lighteval/models/transformers/vlm_transformers_model.py' 2025-11-04T13:52:01,541 adding 'lighteval/models/vllm/vllm_model.py' 2025-11-04T13:52:01,543 adding 'lighteval/tasks/__init__.py' 2025-11-04T13:52:01,554 adding 'lighteval/tasks/default_prompts.py' 2025-11-04T13:52:01,557 adding 'lighteval/tasks/lighteval_task.py' 2025-11-04T13:52:01,559 adding 'lighteval/tasks/prompt_manager.py' 2025-11-04T13:52:01,562 adding 'lighteval/tasks/registry.py' 2025-11-04T13:52:01,564 adding 'lighteval/tasks/requests.py' 2025-11-04T13:52:01,566 adding 'lighteval/tasks/multilingual/__init__.py' 2025-11-04T13:52:01,568 adding 'lighteval/tasks/multilingual/adapters.py' 2025-11-04T13:52:01,571 adding 'lighteval/tasks/multilingual/tasks/acva.py' 2025-11-04T13:52:01,572 adding 'lighteval/tasks/multilingual/tasks/afri_mgsm.py' 2025-11-04T13:52:01,574 adding 'lighteval/tasks/multilingual/tasks/afri_mmlu.py' 2025-11-04T13:52:01,575 adding 'lighteval/tasks/multilingual/tasks/afri_xnli.py' 2025-11-04T13:52:01,581 adding 'lighteval/tasks/multilingual/tasks/arabic.py' 2025-11-04T13:52:01,583 adding 'lighteval/tasks/multilingual/tasks/arabic_arc.py' 2025-11-04T13:52:01,585 adding 'lighteval/tasks/multilingual/tasks/arabic_mmlu.py' 2025-11-04T13:52:01,587 adding 'lighteval/tasks/multilingual/tasks/arcd.py' 2025-11-04T13:52:01,589 adding 'lighteval/tasks/multilingual/tasks/belebele.py' 2025-11-04T13:52:01,590 adding 'lighteval/tasks/multilingual/tasks/c3.py' 2025-11-04T13:52:01,592 adding 'lighteval/tasks/multilingual/tasks/ceval.py' 2025-11-04T13:52:01,594 adding 'lighteval/tasks/multilingual/tasks/chegeka.py' 2025-11-04T13:52:01,596 adding 'lighteval/tasks/multilingual/tasks/chinese_squad.py' 2025-11-04T13:52:01,597 adding 'lighteval/tasks/multilingual/tasks/cmath.py' 2025-11-04T13:52:01,599 adding 'lighteval/tasks/multilingual/tasks/cmmlu.py' 2025-11-04T13:52:01,601 adding 'lighteval/tasks/multilingual/tasks/cmnli.py' 2025-11-04T13:52:01,603 adding 'lighteval/tasks/multilingual/tasks/cmrc2018.py' 2025-11-04T13:52:01,604 adding 'lighteval/tasks/multilingual/tasks/copa_indic.py' 2025-11-04T13:52:01,606 adding 'lighteval/tasks/multilingual/tasks/enem.py' 2025-11-04T13:52:01,608 adding 'lighteval/tasks/multilingual/tasks/exams.py' 2025-11-04T13:52:01,610 adding 'lighteval/tasks/multilingual/tasks/faquad.py' 2025-11-04T13:52:01,614 adding 'lighteval/tasks/multilingual/tasks/filipino.py' 2025-11-04T13:52:01,617 adding 'lighteval/tasks/multilingual/tasks/flores200.py' 2025-11-04T13:52:01,618 adding 'lighteval/tasks/multilingual/tasks/fquad_v2.py' 2025-11-04T13:52:01,620 adding 'lighteval/tasks/multilingual/tasks/french.py' 2025-11-04T13:52:01,622 adding 'lighteval/tasks/multilingual/tasks/french_boolq.py' 2025-11-04T13:52:01,624 adding 'lighteval/tasks/multilingual/tasks/french_triviqa.py' 2025-11-04T13:52:01,626 adding 'lighteval/tasks/multilingual/tasks/german_rag.py' 2025-11-04T13:52:01,628 adding 'lighteval/tasks/multilingual/tasks/germanquad.py' 2025-11-04T13:52:01,630 adding 'lighteval/tasks/multilingual/tasks/global_mmlu.py' 2025-11-04T13:52:01,632 adding 'lighteval/tasks/multilingual/tasks/hellaswag_hin.py' 2025-11-04T13:52:01,633 adding 'lighteval/tasks/multilingual/tasks/hellaswag_tel.py' 2025-11-04T13:52:01,635 adding 'lighteval/tasks/multilingual/tasks/hellaswag_tha.py' 2025-11-04T13:52:01,637 adding 'lighteval/tasks/multilingual/tasks/hellaswag_tur.py' 2025-11-04T13:52:01,639 adding 'lighteval/tasks/multilingual/tasks/hindi_arc.py' 2025-11-04T13:52:01,641 adding 'lighteval/tasks/multilingual/tasks/hindi_boolq.py' 2025-11-04T13:52:01,643 adding 'lighteval/tasks/multilingual/tasks/indicqa.py' 2025-11-04T13:52:01,644 adding 'lighteval/tasks/multilingual/tasks/kenswquad.py' 2025-11-04T13:52:01,646 adding 'lighteval/tasks/multilingual/tasks/m3exams.py' 2025-11-04T13:52:01,648 adding 'lighteval/tasks/multilingual/tasks/mathlogicqa_rus.py' 2025-11-04T13:52:01,650 adding 'lighteval/tasks/multilingual/tasks/meta_mmlu.py' 2025-11-04T13:52:01,652 adding 'lighteval/tasks/multilingual/tasks/mgsm.py' 2025-11-04T13:52:01,654 adding 'lighteval/tasks/multilingual/tasks/mintaka.py' 2025-11-04T13:52:01,656 adding 'lighteval/tasks/multilingual/tasks/mkqa.py' 2025-11-04T13:52:01,657 adding 'lighteval/tasks/multilingual/tasks/mlmm_arc_challenge.py' 2025-11-04T13:52:01,659 adding 'lighteval/tasks/multilingual/tasks/mlmm_hellaswag.py' 2025-11-04T13:52:01,661 adding 'lighteval/tasks/multilingual/tasks/mlmm_mmlu.py' 2025-11-04T13:52:01,663 adding 'lighteval/tasks/multilingual/tasks/mlmm_truthfulqa.py' 2025-11-04T13:52:01,665 adding 'lighteval/tasks/multilingual/tasks/mlqa.py' 2025-11-04T13:52:01,667 adding 'lighteval/tasks/multilingual/tasks/oab_exams.py' 2025-11-04T13:52:01,668 adding 'lighteval/tasks/multilingual/tasks/ocnli.py' 2025-11-04T13:52:01,670 adding 'lighteval/tasks/multilingual/tasks/openai_mmlu.py' 2025-11-04T13:52:01,672 adding 'lighteval/tasks/multilingual/tasks/openbook_ara.py' 2025-11-04T13:52:01,674 adding 'lighteval/tasks/multilingual/tasks/openbook_es.py' 2025-11-04T13:52:01,675 adding 'lighteval/tasks/multilingual/tasks/openbook_rus.py' 2025-11-04T13:52:01,676 adding 'lighteval/tasks/multilingual/tasks/oz.py' 2025-11-04T13:52:01,678 adding 'lighteval/tasks/multilingual/tasks/parus.py' 2025-11-04T13:52:01,679 adding 'lighteval/tasks/multilingual/tasks/paws_x.py' 2025-11-04T13:52:01,680 adding 'lighteval/tasks/multilingual/tasks/piqa_ar.py' 2025-11-04T13:52:01,681 adding 'lighteval/tasks/multilingual/tasks/rcb.py' 2025-11-04T13:52:01,682 adding 'lighteval/tasks/multilingual/tasks/sber_squad.py' 2025-11-04T13:52:01,685 adding 'lighteval/tasks/multilingual/tasks/serbian_eval.py' 2025-11-04T13:52:01,687 adding 'lighteval/tasks/multilingual/tasks/soqal.py' 2025-11-04T13:52:01,688 adding 'lighteval/tasks/multilingual/tasks/squad_es.py' 2025-11-04T13:52:01,689 adding 'lighteval/tasks/multilingual/tasks/squad_it.py' 2025-11-04T13:52:01,690 adding 'lighteval/tasks/multilingual/tasks/swahili_arc.py' 2025-11-04T13:52:01,692 adding 'lighteval/tasks/multilingual/tasks/thai_exams.py' 2025-11-04T13:52:01,693 adding 'lighteval/tasks/multilingual/tasks/thaiqa.py' 2025-11-04T13:52:01,694 adding 'lighteval/tasks/multilingual/tasks/tquad_v2.py' 2025-11-04T13:52:01,696 adding 'lighteval/tasks/multilingual/tasks/turkic.py' 2025-11-04T13:52:01,697 adding 'lighteval/tasks/multilingual/tasks/turkish_arc.py' 2025-11-04T13:52:01,699 adding 'lighteval/tasks/multilingual/tasks/turkish_mmlu.py' 2025-11-04T13:52:01,700 adding 'lighteval/tasks/multilingual/tasks/tydiqa.py' 2025-11-04T13:52:01,702 adding 'lighteval/tasks/multilingual/tasks/worldtree_rus.py' 2025-11-04T13:52:01,704 adding 'lighteval/tasks/multilingual/tasks/xcodah.py' 2025-11-04T13:52:01,705 adding 'lighteval/tasks/multilingual/tasks/xcopa.py' 2025-11-04T13:52:01,707 adding 'lighteval/tasks/multilingual/tasks/xcsqa.py' 2025-11-04T13:52:01,708 adding 'lighteval/tasks/multilingual/tasks/xnli.py' 2025-11-04T13:52:01,709 adding 'lighteval/tasks/multilingual/tasks/xnli2.py' 2025-11-04T13:52:01,711 adding 'lighteval/tasks/multilingual/tasks/xnli_indic.py' 2025-11-04T13:52:01,712 adding 'lighteval/tasks/multilingual/tasks/xquad.py' 2025-11-04T13:52:01,713 adding 'lighteval/tasks/multilingual/tasks/xstory.py' 2025-11-04T13:52:01,715 adding 'lighteval/tasks/multilingual/tasks/xwinograd.py' 2025-11-04T13:52:01,717 adding 'lighteval/tasks/multilingual/utils/__init__.py' 2025-11-04T13:52:01,718 adding 'lighteval/tasks/multilingual/utils/adapters_utils.py' 2025-11-04T13:52:01,720 adding 'lighteval/tasks/multilingual/utils/task_utils.py' 2025-11-04T13:52:01,723 adding 'lighteval/tasks/tasks/agieval.py' 2025-11-04T13:52:01,725 adding 'lighteval/tasks/tasks/aime.py' 2025-11-04T13:52:01,726 adding 'lighteval/tasks/tasks/aimo.py' 2025-11-04T13:52:01,727 adding 'lighteval/tasks/tasks/anli.py' 2025-11-04T13:52:01,729 adding 'lighteval/tasks/tasks/arc.py' 2025-11-04T13:52:01,730 adding 'lighteval/tasks/tasks/arc_agi_2.py' 2025-11-04T13:52:01,731 adding 'lighteval/tasks/tasks/arithmetic.py' 2025-11-04T13:52:01,732 adding 'lighteval/tasks/tasks/asdiv.py' 2025-11-04T13:52:01,733 adding 'lighteval/tasks/tasks/babi_qa.py' 2025-11-04T13:52:01,735 adding 'lighteval/tasks/tasks/bbq.py' 2025-11-04T13:52:01,739 adding 'lighteval/tasks/tasks/bigbench.py' 2025-11-04T13:52:01,742 adding 'lighteval/tasks/tasks/bigbench_hard.py' 2025-11-04T13:52:01,745 adding 'lighteval/tasks/tasks/blimp.py' 2025-11-04T13:52:01,746 adding 'lighteval/tasks/tasks/bold.py' 2025-11-04T13:52:01,748 adding 'lighteval/tasks/tasks/boolq.py' 2025-11-04T13:52:01,749 adding 'lighteval/tasks/tasks/civil_comments.py' 2025-11-04T13:52:01,750 adding 'lighteval/tasks/tasks/commonsenseqa.py' 2025-11-04T13:52:01,751 adding 'lighteval/tasks/tasks/coqa.py' 2025-11-04T13:52:01,752 adding 'lighteval/tasks/tasks/covid_dialogue.py' 2025-11-04T13:52:01,755 adding 'lighteval/tasks/tasks/custom_task_classification_grammar_task.py' 2025-11-04T13:52:01,757 adding 'lighteval/tasks/tasks/drop_qa.py' 2025-11-04T13:52:01,758 adding 'lighteval/tasks/tasks/dyck_language.py' 2025-11-04T13:52:01,759 adding 'lighteval/tasks/tasks/entity_data_imputation.py' 2025-11-04T13:52:01,760 adding 'lighteval/tasks/tasks/entitymatching.py' 2025-11-04T13:52:01,762 adding 'lighteval/tasks/tasks/ethics.py' 2025-11-04T13:52:01,763 adding 'lighteval/tasks/tasks/glue.py' 2025-11-04T13:52:01,764 adding 'lighteval/tasks/tasks/gpqa.py' 2025-11-04T13:52:01,766 adding 'lighteval/tasks/tasks/gsm8k.py' 2025-11-04T13:52:01,767 adding 'lighteval/tasks/tasks/gsm_plus.py' 2025-11-04T13:52:01,768 adding 'lighteval/tasks/tasks/headqa.py' 2025-11-04T13:52:01,769 adding 'lighteval/tasks/tasks/hellaswag.py' 2025-11-04T13:52:01,771 adding 'lighteval/tasks/tasks/imdb.py' 2025-11-04T13:52:01,772 adding 'lighteval/tasks/tasks/jeopardy.py' 2025-11-04T13:52:01,773 adding 'lighteval/tasks/tasks/lambada.py' 2025-11-04T13:52:01,774 adding 'lighteval/tasks/tasks/legal_summarization.py' 2025-11-04T13:52:01,776 adding 'lighteval/tasks/tasks/legalsupport.py' 2025-11-04T13:52:01,777 adding 'lighteval/tasks/tasks/lexglue.py' 2025-11-04T13:52:01,779 adding 'lighteval/tasks/tasks/lextreme.py' 2025-11-04T13:52:01,781 adding 'lighteval/tasks/tasks/logiqa.py' 2025-11-04T13:52:01,782 adding 'lighteval/tasks/tasks/lsat_qa.py' 2025-11-04T13:52:01,784 adding 'lighteval/tasks/tasks/math.py' 2025-11-04T13:52:01,785 adding 'lighteval/tasks/tasks/math_500.py' 2025-11-04T13:52:01,787 adding 'lighteval/tasks/tasks/mathqa.py' 2025-11-04T13:52:01,789 adding 'lighteval/tasks/tasks/med.py' 2025-11-04T13:52:01,790 adding 'lighteval/tasks/tasks/med_dialog.py' 2025-11-04T13:52:01,792 adding 'lighteval/tasks/tasks/mgsm.py' 2025-11-04T13:52:01,794 adding 'lighteval/tasks/tasks/mmlu.py' 2025-11-04T13:52:01,795 adding 'lighteval/tasks/tasks/mmlu_pro.py' 2025-11-04T13:52:01,797 adding 'lighteval/tasks/tasks/mmlu_redux.py' 2025-11-04T13:52:01,798 adding 'lighteval/tasks/tasks/mmmu_pro.py' 2025-11-04T13:52:01,799 adding 'lighteval/tasks/tasks/musr.py' 2025-11-04T13:52:01,800 adding 'lighteval/tasks/tasks/narrativeqa.py' 2025-11-04T13:52:01,802 adding 'lighteval/tasks/tasks/natural_questions.py' 2025-11-04T13:52:01,803 adding 'lighteval/tasks/tasks/numeracy.py' 2025-11-04T13:52:01,804 adding 'lighteval/tasks/tasks/openbookqa.py' 2025-11-04T13:52:01,806 adding 'lighteval/tasks/tasks/piqa.py' 2025-11-04T13:52:01,807 adding 'lighteval/tasks/tasks/prost.py' 2025-11-04T13:52:01,808 adding 'lighteval/tasks/tasks/pubmedqa.py' 2025-11-04T13:52:01,810 adding 'lighteval/tasks/tasks/qa4mre.py' 2025-11-04T13:52:01,811 adding 'lighteval/tasks/tasks/qasper.py' 2025-11-04T13:52:01,812 adding 'lighteval/tasks/tasks/quac.py' 2025-11-04T13:52:01,813 adding 'lighteval/tasks/tasks/race_high.py' 2025-11-04T13:52:01,815 adding 'lighteval/tasks/tasks/raft.py' 2025-11-04T13:52:01,816 adding 'lighteval/tasks/tasks/real_toxicity_prompts.py' 2025-11-04T13:52:01,819 adding 'lighteval/tasks/tasks/sacrebleu.py' 2025-11-04T13:52:01,821 adding 'lighteval/tasks/tasks/sciq.py' 2025-11-04T13:52:01,822 adding 'lighteval/tasks/tasks/simpleqa.py' 2025-11-04T13:52:01,823 adding 'lighteval/tasks/tasks/siqa.py' 2025-11-04T13:52:01,824 adding 'lighteval/tasks/tasks/slr_bench.py' 2025-11-04T13:52:01,826 adding 'lighteval/tasks/tasks/squad_v2.py' 2025-11-04T13:52:01,827 adding 'lighteval/tasks/tasks/storycloze.py' 2025-11-04T13:52:01,828 adding 'lighteval/tasks/tasks/summarization.py' 2025-11-04T13:52:01,829 adding 'lighteval/tasks/tasks/swag.py' 2025-11-04T13:52:01,830 adding 'lighteval/tasks/tasks/synthetic_reasoning.py' 2025-11-04T13:52:01,832 adding 'lighteval/tasks/tasks/the_pile.py' 2025-11-04T13:52:01,833 adding 'lighteval/tasks/tasks/toxigen.py' 2025-11-04T13:52:01,834 adding 'lighteval/tasks/tasks/triviaqa.py' 2025-11-04T13:52:01,835 adding 'lighteval/tasks/tasks/truthfulqa.py' 2025-11-04T13:52:01,837 adding 'lighteval/tasks/tasks/twitterAAE.py' 2025-11-04T13:52:01,838 adding 'lighteval/tasks/tasks/unscramble.py' 2025-11-04T13:52:01,839 adding 'lighteval/tasks/tasks/webqs.py' 2025-11-04T13:52:01,841 adding 'lighteval/tasks/tasks/wikifact.py' 2025-11-04T13:52:01,843 adding 'lighteval/tasks/tasks/wikitext.py' 2025-11-04T13:52:01,844 adding 'lighteval/tasks/tasks/winogrande.py' 2025-11-04T13:52:01,846 adding 'lighteval/tasks/tasks/xcopa.py' 2025-11-04T13:52:01,847 adding 'lighteval/tasks/tasks/xstory_cloze.py' 2025-11-04T13:52:01,848 adding 'lighteval/tasks/tasks/xwinograd.py' 2025-11-04T13:52:01,851 adding 'lighteval/tasks/tasks/hle/main.py' 2025-11-04T13:52:01,853 adding 'lighteval/tasks/tasks/ifbench/evaluation_lib.py' 2025-11-04T13:52:01,860 adding 'lighteval/tasks/tasks/ifbench/instructions.py' 2025-11-04T13:52:01,862 adding 'lighteval/tasks/tasks/ifbench/instructions_registry.py' 2025-11-04T13:52:01,864 adding 'lighteval/tasks/tasks/ifbench/main.py' 2025-11-04T13:52:01,869 adding 'lighteval/tasks/tasks/ifeval/instructions.py' 2025-11-04T13:52:01,871 adding 'lighteval/tasks/tasks/ifeval/instructions_registry.py' 2025-11-04T13:52:01,875 adding 'lighteval/tasks/tasks/ifeval/instructions_utils.py' 2025-11-04T13:52:01,877 adding 'lighteval/tasks/tasks/ifeval/main.py' 2025-11-04T13:52:01,880 adding 'lighteval/tasks/tasks/lcb/codegen_metrics.py' 2025-11-04T13:52:01,882 adding 'lighteval/tasks/tasks/lcb/main.py' 2025-11-04T13:52:01,884 adding 'lighteval/tasks/tasks/mix_eval/judge_prompts.py' 2025-11-04T13:52:01,886 adding 'lighteval/tasks/tasks/mix_eval/main.py' 2025-11-04T13:52:01,888 adding 'lighteval/tasks/tasks/mix_eval/prompts.py' 2025-11-04T13:52:01,890 adding 'lighteval/tasks/tasks/mt_bench/judge_prompt_templates.py' 2025-11-04T13:52:01,891 adding 'lighteval/tasks/tasks/mt_bench/main.py' 2025-11-04T13:52:01,893 adding 'lighteval/tasks/tasks/olympiade_bench/main.py' 2025-11-04T13:52:01,896 adding 'lighteval/tasks/tasks/tiny_benchmarks/main.py' 2025-11-04T13:52:01,898 adding 'lighteval/tasks/templates/__init__.py' 2025-11-04T13:52:01,899 adding 'lighteval/tasks/templates/boolq.py' 2025-11-04T13:52:01,901 adding 'lighteval/tasks/templates/continuation.py' 2025-11-04T13:52:01,903 adding 'lighteval/tasks/templates/copa.py' 2025-11-04T13:52:01,905 adding 'lighteval/tasks/templates/hellaswag.py' 2025-11-04T13:52:01,906 adding 'lighteval/tasks/templates/multichoice.py' 2025-11-04T13:52:01,908 adding 'lighteval/tasks/templates/nli.py' 2025-11-04T13:52:01,909 adding 'lighteval/tasks/templates/qa.py' 2025-11-04T13:52:01,911 adding 'lighteval/tasks/templates/translation.py' 2025-11-04T13:52:01,913 adding 'lighteval/tasks/templates/utils/__init__.py' 2025-11-04T13:52:01,914 adding 'lighteval/tasks/templates/utils/adapter_utils.py' 2025-11-04T13:52:01,916 adding 'lighteval/tasks/templates/utils/formatting_utils.py' 2025-11-04T13:52:01,917 adding 'lighteval/tasks/templates/utils/formulation.py' 2025-11-04T13:52:01,921 adding 'lighteval/tasks/templates/utils/translation_literals.py' 2025-11-04T13:52:01,923 adding 'lighteval/utils/__init__.py' 2025-11-04T13:52:01,926 adding 'lighteval/utils/cache_management.py' 2025-11-04T13:52:01,928 adding 'lighteval/utils/imports.py' 2025-11-04T13:52:01,930 adding 'lighteval/utils/language.py' 2025-11-04T13:52:01,931 adding 'lighteval/utils/parallelism.py' 2025-11-04T13:52:01,933 adding 'lighteval/utils/timeout.py' 2025-11-04T13:52:01,935 adding 'lighteval/utils/utils.py' 2025-11-04T13:52:01,937 adding 'lighteval-0.12.0.dist-info/licenses/LICENSE' 2025-11-04T13:52:01,939 adding 'lighteval-0.12.0.dist-info/METADATA' 2025-11-04T13:52:01,940 adding 'lighteval-0.12.0.dist-info/WHEEL' 2025-11-04T13:52:01,941 adding 'lighteval-0.12.0.dist-info/entry_points.txt' 2025-11-04T13:52:01,942 adding 'lighteval-0.12.0.dist-info/top_level.txt' 2025-11-04T13:52:01,946 adding 'lighteval-0.12.0.dist-info/RECORD' 2025-11-04T13:52:01,957 removing build/bdist.linux-armv7l/wheel 2025-11-04T13:52:02,119 Building wheel for lighteval (pyproject.toml): finished with status 'done' 2025-11-04T13:52:02,136 Created wheel for lighteval: filename=lighteval-0.12.0-py3-none-any.whl size=604761 sha256=9232b4db5aab006a51962753e95165ccb057407597936804be72bd24531b24b3 2025-11-04T13:52:02,138 Stored in directory: /tmp/pip-ephem-wheel-cache-wzfa_hrn/wheels/f2/c6/71/3df68c74fcacf2ebf4d6f3963a409998702937d662eae37de7 2025-11-04T13:52:02,160 Successfully built lighteval 2025-11-04T13:52:02,177 Removed build tracker: '/tmp/pip-build-tracker-pp4w0rbi'