2025-11-06T16:36:40,361 Created temporary directory: /tmp/pip-ephem-wheel-cache-s8m44m2n 2025-11-06T16:36:40,363 Created temporary directory: /tmp/pip-build-tracker-sfsplujq 2025-11-06T16:36:40,364 Initialized build tracking at /tmp/pip-build-tracker-sfsplujq 2025-11-06T16:36:40,364 Created build tracker: /tmp/pip-build-tracker-sfsplujq 2025-11-06T16:36:40,365 Entered build tracker: /tmp/pip-build-tracker-sfsplujq 2025-11-06T16:36:40,365 Created temporary directory: /tmp/pip-wheel-5vsft8_i 2025-11-06T16:36:40,369 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2025-11-06T16:36:40,371 Created temporary directory: /tmp/pip-ephem-wheel-cache-wbxx561l 2025-11-06T16:36:40,393 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-11-06T16:36:40,396 2 location(s) to search for versions of lighteval: 2025-11-06T16:36:40,396 * https://pypi.org/simple/lighteval/ 2025-11-06T16:36:40,396 * https://www.piwheels.org/simple/lighteval/ 2025-11-06T16:36:40,397 Fetching project page and analyzing links: https://pypi.org/simple/lighteval/ 2025-11-06T16:36:40,398 Getting page https://pypi.org/simple/lighteval/ 2025-11-06T16:36:40,399 Found index url https://pypi.org/simple 2025-11-06T16:36:40,621 Fetched page https://pypi.org/simple/lighteval/ as application/vnd.pypi.simple.v1+json 2025-11-06T16:36:40,630 Found link https://files.pythonhosted.org/packages/91/70/3a0c520287b432278921dafe9b4b20e4d639ecb62a1cdb8dfc14a7cf1122/lighteval-0.0.1.tar.gz (from https://pypi.org/simple/lighteval/), version: 0.0.1 2025-11-06T16:36:40,631 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/83/b0/7dbdeffab3e2d3a0791f1747818c65c3e76e4c343593712aaaee990bea93/lighteval-0.0.2-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,632 Found link https://files.pythonhosted.org/packages/b5/e9/30eaccb5bfb4ca9802bbc3b105b7c8888bdd9bff72d7a7b85ffcb6cd4ad1/lighteval-0.0.2.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.0.2 2025-11-06T16:36:40,633 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/ce/22/8e9fb7ef899f757df0eafed9e29fd8db9d4c694a3ba7e276bedc5c8a4dc3/lighteval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,634 Found link https://files.pythonhosted.org/packages/72/c3/07b4cb157f8fa1c0465c32f505418de1df659c67b2bbfa543c5bc9ff9dde/lighteval-0.1.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.1.0 2025-11-06T16:36:40,635 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/af/d8/92cee84f102f5c801240e90e6380a1f2958aa8ae977fe3f7a6b9804214a0/lighteval-0.1.1.dev0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,636 Found link https://files.pythonhosted.org/packages/73/b2/0b510938a01164061a56b871af8b138f4ade7fdea6bb96ed5180e345ba2a/lighteval-0.1.1.dev0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.1.1.dev0 2025-11-06T16:36:40,637 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/a4/f7/9385103352347eaa2500b3060929a2242143db19c937eb56e488753a4d99/lighteval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,638 Found link https://files.pythonhosted.org/packages/aa/10/97c3a28e599d930aefaa173edc596980df23dc593883a5b0a3ad00c0e2f5/lighteval-0.1.1.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.1.1 2025-11-06T16:36:40,639 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/51/0b/304021094a01fbc94a98b7729b2044106475b23286031083fa9217fea981/lighteval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,640 Found link https://files.pythonhosted.org/packages/c2/b3/dc97dfbdd406d8ce4a7f50d86ef5a24d561e4bfb649783da0807f7cc6cb8/lighteval-0.2.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.2.0 2025-11-06T16:36:40,641 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/14/e2/4c1dc89e6a6c71c6d4745ffd1657e57ca4381dfc48d2c2af6d38215f9f01/lighteval-0.3.0a0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,642 Found link https://files.pythonhosted.org/packages/e9/5f/9bff4b2f649b9838411bf5a3e29b8eaef0287baee2af56419c7845f43a25/lighteval-0.3.0a0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.3.0a0 2025-11-06T16:36:40,643 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/f5/e7/33f933d80fe537dacdf2677df18437ba8b90e6228936564dd246c295809a/lighteval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,644 Found link https://files.pythonhosted.org/packages/02/d7/8c52ae664c106385547c5e895b8614b58eb97e1a721ccee0e278739bd0ff/lighteval-0.3.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.3.0 2025-11-06T16:36:40,645 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/e9/b4/27c6f424b053b66cec7c66dd57823089d5349164dcc82a965f1b230831c5/lighteval-0.4.0a0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,646 Found link https://files.pythonhosted.org/packages/a1/9d/52971d034e2fda19bee1f31bbc8e8683eee2a4807b530e3d2fc50215ef37/lighteval-0.4.0a0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.4.0a0 2025-11-06T16:36:40,647 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/c5/3e/ceea138f6702f5dd010544b75606ba2f51a48ae0bbcb3fb1051216beb68e/lighteval-0.5.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,648 Found link https://files.pythonhosted.org/packages/b9/72/2cbd211318e1dd4ab6653cfe96672dfd68d17a02e762f09b14e8cd7bb6f3/lighteval-0.5.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.5.0 2025-11-06T16:36:40,649 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/ba/f8/c3f757064572b62ef63cb8e45e093245b0327e9f8e1c93f2aa57e227a33e/lighteval-0.6.2-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,650 Found link https://files.pythonhosted.org/packages/65/dd/547f2af88bc4c56ce19123f66701cdc5762f33cc9b49bedb19ae03b26fcd/lighteval-0.6.2.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.6.2 2025-11-06T16:36:40,651 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/86/d8/655d36dcee8f56dae06321448da2d19c8c780051fa5b171f35fae91f7e18/lighteval-0.7.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,652 Found link https://files.pythonhosted.org/packages/65/e1/bd70449c07c6b4259cc8395ab3c8cc6e433a920084bbe12fe651bc3480d0/lighteval-0.7.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.7.0 2025-11-06T16:36:40,652 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/52/88/8c120913b07a1a828b7c2874055a022e2ce098327736ca7602d14d323ad7/lighteval-0.8.1-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,654 Found link https://files.pythonhosted.org/packages/11/4d/9387d49759cc02c9f546ec7e9975a19e88ff573170823153375e58a34c4a/lighteval-0.8.1.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.8.1 2025-11-06T16:36:40,654 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/34/fe/4a5ddcc73f9a8f320c47a1c65f497f8c2d8733730e621407536bba612e6f/lighteval-0.9.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,656 Found link https://files.pythonhosted.org/packages/a3/0c/1d849e968023263f4b96952aa04a11c522eb8ad241262c1705e9a13f1762/lighteval-0.9.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.9.0 2025-11-06T16:36:40,656 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/7a/1c/3bbd71a3c2402661eeda4417202cccd832105d92454c1fa531ef07b4d7ec/lighteval-0.9.1-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,657 Found link https://files.pythonhosted.org/packages/2d/dc/6a41ed7d2eb4c09c607138c97fae2fdb64db5d1b9e9e198da061e8894051/lighteval-0.9.1.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.9.1 2025-11-06T16:36:40,658 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/ae/d6/ee335f2524642a7443cc113da0101d350273d42ba4eac7f637bd44db5d0e/lighteval-0.9.2-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,659 Found link https://files.pythonhosted.org/packages/2e/2c/822126ca365cde3cedc91e9e5beaf6d33168ce18261f982686d1c4447670/lighteval-0.9.2.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.9.2 2025-11-06T16:36:40,660 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/7c/8e/d48315622c38086b94d8274edc5c3630be03befcce36a5ef318e0d278f0b/lighteval-0.10.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,661 Found link https://files.pythonhosted.org/packages/e9/2c/8232d77ba5c22342a21ed313556a8cc998e63c5ff10b2f87947527822d8b/lighteval-0.10.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.10.0 2025-11-06T16:36:40,662 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/d3/ba/bf0a54eb1969cae565703addcecb923d19aa7d2bccc6182f388c66b6980b/lighteval-0.11.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,663 Found link https://files.pythonhosted.org/packages/e6/a2/50e2251012de8587442d39485946bc2e579bb63551757389c60cd20ce6cd/lighteval-0.11.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.11.0 2025-11-06T16:36:40,663 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/d6/34/4b438b81badd48672b8e72e721d0bdcdee0a6c8620f74362d8f26228571f/lighteval-0.12.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,665 Found link https://files.pythonhosted.org/packages/f8/1a/e0546a2e5786d0d1c5477361202dba01762de51dbfb4569ef438bb291fe5/lighteval-0.12.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.12.0 2025-11-06T16:36:40,665 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/0c/6b/65e23781dd936db292c9b558978ca57e873b206254af1d3fcd60a78ca1b4/lighteval-0.12.1-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,666 Found link https://files.pythonhosted.org/packages/08/25/196b6b4e3b1358faa79aca54100e107824c9bb3ee09aa234b1da4b83843b/lighteval-0.12.1.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.12.1 2025-11-06T16:36:40,667 Fetching project page and analyzing links: https://www.piwheels.org/simple/lighteval/ 2025-11-06T16:36:40,668 Getting page https://www.piwheels.org/simple/lighteval/ 2025-11-06T16:36:40,670 Found index url https://www.piwheels.org/simple 2025-11-06T16:36:40,855 Fetched page https://www.piwheels.org/simple/lighteval/ as text/html 2025-11-06T16:36:40,861 Skipping link: No binaries permitted for lighteval: https://www.piwheels.org/simple/lighteval/lighteval-0.12.0-py3-none-any.whl#sha256=9232b4db5aab006a51962753e95165ccb057407597936804be72bd24531b24b3 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,862 Skipping link: No binaries permitted for lighteval: https://www.piwheels.org/simple/lighteval/lighteval-0.11.0-py3-none-any.whl#sha256=6ce0c089e9d8bb70a3a9567692de9197b27f7de1f867ca89ebc209225fe3fa86 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,862 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.10.0-py3-none-any.whl#sha256=984e54961dfab22f14490603e818bd5fc52f7a9cb7325167cd4c722cd3a617c8 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,863 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.9.2-py3-none-any.whl#sha256=524551d8382e05b833a815efaa0c3d72e6f8394f779f7d0996c6bd32480c8bb3 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,863 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.9.1-py3-none-any.whl#sha256=547617dc5562604712e54b11110df507fc7bb93dbe003d95bd5d8f1b619fc5e5 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,864 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.9.0-py3-none-any.whl#sha256=f08fa34420204de0e093b908f9993b7857a704f1ea3ed352eb09ef2c821e7205 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,864 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.8.1-py3-none-any.whl#sha256=fc457974bc07ba6ec3f5f1c3ad74772add7907118d341df8bbf833064d9d1546 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,865 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.7.0-py3-none-any.whl#sha256=c2a51aca3df46874ddc37983dabd50cc525b25fb2b3c7eab15e445a9f0b9b712 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,865 Skipping link: No binaries permitted for lighteval: https://www.piwheels.org/simple/lighteval/lighteval-0.6.2-py3-none-any.whl#sha256=dbbe93471a2dd20cdc138ee008b29e05bb7011af99679649aee415fdc38374e4 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,866 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.5.0-py3-none-any.whl#sha256=62bf9ced8a1139ca7c79da092c98d6b4d70d27a4007d8cdfde70f64eb9b98da2 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,866 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.4.0a0-py3-none-any.whl#sha256=8694039d9a42ffe2c54d5bc4d72d4a7ab3bf1b4032c970eb52fa05455da4d6a1 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,867 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.3.0-py3-none-any.whl#sha256=278613752d9402caf51c2a009228c2c91bb801a71dadc88586c41a764477da7a (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,867 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.3.0a0-py3-none-any.whl#sha256=ca834b38d37c41993d1573606b9f64d28e1218494118389f552f4fbc5c7fe4fd (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,868 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.2.0-py3-none-any.whl#sha256=f4dfdbe773e3f0a3958dddfd65b958a347095d693191d5c453d00de9f30344ae (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,868 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.1.1-py3-none-any.whl#sha256=296c95ef71b3014c30e8fe406bb95469a3d484c721fa61efbb1fe99dce67f950 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,869 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.1.1.dev0-py3-none-any.whl#sha256=e96ff26cffee66313bad7d96cc3522f90457ccc3fa292862034af2db96f4ef73 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,869 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.1.0-py3-none-any.whl#sha256=780a9fdd33d3b41060347f899486cd3ffab6f44f46af6c5d9a18ff10e725731d (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,870 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.0.2-py3-none-any.whl#sha256=08472d569e00511c2d1803932a9b21c03e4424d68970bf1e67d0ab490ef59019 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-06T16:36:40,870 Skipping link: not a file: https://www.piwheels.org/simple/lighteval/ 2025-11-06T16:36:40,871 Skipping link: not a file: https://pypi.org/simple/lighteval/ 2025-11-06T16:36:40,892 Given no hashes to check 1 links for project 'lighteval': discarding no candidates 2025-11-06T16:36:40,909 Collecting lighteval==0.12.1 2025-11-06T16:36:40,912 Created temporary directory: /tmp/pip-unpack-v8663epn 2025-11-06T16:36:41,130 Downloading lighteval-0.12.1.tar.gz (425 kB) 2025-11-06T16:36:41,844 Added lighteval==0.12.1 from https://files.pythonhosted.org/packages/08/25/196b6b4e3b1358faa79aca54100e107824c9bb3ee09aa234b1da4b83843b/lighteval-0.12.1.tar.gz to build tracker '/tmp/pip-build-tracker-sfsplujq' 2025-11-06T16:36:41,850 Created temporary directory: /tmp/pip-build-env-nc2dr5jt 2025-11-06T16:36:41,854 Installing build dependencies: started 2025-11-06T16:36:41,856 Running command pip subprocess to install build dependencies 2025-11-06T16:36:43,015 Using pip 23.0.1 from /usr/lib/python3/dist-packages/pip (python 3.11) 2025-11-06T16:36:43,615 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2025-11-06T16:36:43,638 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-11-06T16:36:45,363 Collecting setuptools>=61.0 2025-11-06T16:36:45,455 Using cached https://www.piwheels.org/simple/setuptools/setuptools-80.9.0-py3-none-any.whl (1.2 MB) 2025-11-06T16:36:48,345 Installing collected packages: setuptools 2025-11-06T16:36:52,475 Successfully installed setuptools-80.9.0 2025-11-06T16:36:52,741 Installing build dependencies: finished with status 'done' 2025-11-06T16:36:52,748 Getting requirements to build wheel: started 2025-11-06T16:36:52,749 Running command Getting requirements to build wheel 2025-11-06T16:36:53,382 /tmp/pip-build-env-nc2dr5jt/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2025-11-06T16:36:53,382 !! 2025-11-06T16:36:53,383 ******************************************************************************** 2025-11-06T16:36:53,384 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2025-11-06T16:36:53,385 By 2026-Feb-18, you need to update your project and remove deprecated calls 2025-11-06T16:36:53,385 or your builds will no longer be supported. 2025-11-06T16:36:53,386 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-06T16:36:53,387 ******************************************************************************** 2025-11-06T16:36:53,388 !! 2025-11-06T16:36:53,388 corresp(dist, value, root_dir) 2025-11-06T16:36:53,480 /tmp/pip-build-env-nc2dr5jt/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:61: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-06T16:36:53,480 !! 2025-11-06T16:36:53,481 ******************************************************************************** 2025-11-06T16:36:53,481 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-06T16:36:53,482 License :: OSI Approved :: MIT License 2025-11-06T16:36:53,483 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-06T16:36:53,484 ******************************************************************************** 2025-11-06T16:36:53,485 !! 2025-11-06T16:36:53,485 dist._finalize_license_expression() 2025-11-06T16:36:53,486 /tmp/pip-build-env-nc2dr5jt/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-06T16:36:53,486 !! 2025-11-06T16:36:53,487 ******************************************************************************** 2025-11-06T16:36:53,488 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-06T16:36:53,489 License :: OSI Approved :: MIT License 2025-11-06T16:36:53,490 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-06T16:36:53,490 ******************************************************************************** 2025-11-06T16:36:53,491 !! 2025-11-06T16:36:53,492 self._finalize_license_expression() 2025-11-06T16:36:53,494 running egg_info 2025-11-06T16:36:53,501 writing src/lighteval.egg-info/PKG-INFO 2025-11-06T16:36:53,520 writing dependency_links to src/lighteval.egg-info/dependency_links.txt 2025-11-06T16:36:53,522 writing entry points to src/lighteval.egg-info/entry_points.txt 2025-11-06T16:36:53,533 writing requirements to src/lighteval.egg-info/requires.txt 2025-11-06T16:36:53,534 writing top-level names to src/lighteval.egg-info/top_level.txt 2025-11-06T16:36:53,603 reading manifest file 'src/lighteval.egg-info/SOURCES.txt' 2025-11-06T16:36:53,621 reading manifest template 'MANIFEST.in' 2025-11-06T16:36:53,622 warning: no files found matching 'src/lighteval/tasks/tasks_table.jsonl' 2025-11-06T16:36:53,623 warning: no files found matching 'src/lighteval/metrics/*.jsonl' 2025-11-06T16:36:53,623 adding license file 'LICENSE' 2025-11-06T16:36:53,638 writing manifest file 'src/lighteval.egg-info/SOURCES.txt' 2025-11-06T16:36:53,737 Getting requirements to build wheel: finished with status 'done' 2025-11-06T16:36:53,740 Created temporary directory: /tmp/pip-modern-metadata-x27vguwc 2025-11-06T16:36:53,743 Preparing metadata (pyproject.toml): started 2025-11-06T16:36:53,744 Running command Preparing metadata (pyproject.toml) 2025-11-06T16:36:54,328 /tmp/pip-build-env-nc2dr5jt/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2025-11-06T16:36:54,328 !! 2025-11-06T16:36:54,329 ******************************************************************************** 2025-11-06T16:36:54,330 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2025-11-06T16:36:54,331 By 2026-Feb-18, you need to update your project and remove deprecated calls 2025-11-06T16:36:54,332 or your builds will no longer be supported. 2025-11-06T16:36:54,332 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-06T16:36:54,333 ******************************************************************************** 2025-11-06T16:36:54,334 !! 2025-11-06T16:36:54,334 corresp(dist, value, root_dir) 2025-11-06T16:36:54,423 /tmp/pip-build-env-nc2dr5jt/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:61: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-06T16:36:54,423 !! 2025-11-06T16:36:54,424 ******************************************************************************** 2025-11-06T16:36:54,425 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-06T16:36:54,426 License :: OSI Approved :: MIT License 2025-11-06T16:36:54,427 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-06T16:36:54,427 ******************************************************************************** 2025-11-06T16:36:54,428 !! 2025-11-06T16:36:54,429 dist._finalize_license_expression() 2025-11-06T16:36:54,431 /tmp/pip-build-env-nc2dr5jt/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-06T16:36:54,431 !! 2025-11-06T16:36:54,432 ******************************************************************************** 2025-11-06T16:36:54,433 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-06T16:36:54,434 License :: OSI Approved :: MIT License 2025-11-06T16:36:54,435 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-06T16:36:54,436 ******************************************************************************** 2025-11-06T16:36:54,437 !! 2025-11-06T16:36:54,437 self._finalize_license_expression() 2025-11-06T16:36:54,438 running dist_info 2025-11-06T16:36:54,451 creating /tmp/pip-modern-metadata-x27vguwc/lighteval.egg-info 2025-11-06T16:36:54,452 writing /tmp/pip-modern-metadata-x27vguwc/lighteval.egg-info/PKG-INFO 2025-11-06T16:36:54,470 writing dependency_links to /tmp/pip-modern-metadata-x27vguwc/lighteval.egg-info/dependency_links.txt 2025-11-06T16:36:54,472 writing entry points to /tmp/pip-modern-metadata-x27vguwc/lighteval.egg-info/entry_points.txt 2025-11-06T16:36:54,482 writing requirements to /tmp/pip-modern-metadata-x27vguwc/lighteval.egg-info/requires.txt 2025-11-06T16:36:54,483 writing top-level names to /tmp/pip-modern-metadata-x27vguwc/lighteval.egg-info/top_level.txt 2025-11-06T16:36:54,484 writing manifest file '/tmp/pip-modern-metadata-x27vguwc/lighteval.egg-info/SOURCES.txt' 2025-11-06T16:36:54,541 reading manifest file '/tmp/pip-modern-metadata-x27vguwc/lighteval.egg-info/SOURCES.txt' 2025-11-06T16:36:54,543 reading manifest template 'MANIFEST.in' 2025-11-06T16:36:54,544 warning: no files found matching 'src/lighteval/tasks/tasks_table.jsonl' 2025-11-06T16:36:54,545 warning: no files found matching 'src/lighteval/metrics/*.jsonl' 2025-11-06T16:36:54,545 adding license file 'LICENSE' 2025-11-06T16:36:54,556 writing manifest file '/tmp/pip-modern-metadata-x27vguwc/lighteval.egg-info/SOURCES.txt' 2025-11-06T16:36:54,558 creating '/tmp/pip-modern-metadata-x27vguwc/lighteval-0.12.1.dist-info' 2025-11-06T16:36:54,688 Preparing metadata (pyproject.toml): finished with status 'done' 2025-11-06T16:36:54,695 Source in /tmp/pip-wheel-5vsft8_i/lighteval_3c42cae8c7c4488195a9076f5c2d7346 has version 0.12.1, which satisfies requirement lighteval==0.12.1 from https://files.pythonhosted.org/packages/08/25/196b6b4e3b1358faa79aca54100e107824c9bb3ee09aa234b1da4b83843b/lighteval-0.12.1.tar.gz 2025-11-06T16:36:54,696 Removed lighteval==0.12.1 from https://files.pythonhosted.org/packages/08/25/196b6b4e3b1358faa79aca54100e107824c9bb3ee09aa234b1da4b83843b/lighteval-0.12.1.tar.gz from build tracker '/tmp/pip-build-tracker-sfsplujq' 2025-11-06T16:36:54,704 Created temporary directory: /tmp/pip-unpack-om2k74di 2025-11-06T16:36:54,705 Building wheels for collected packages: lighteval 2025-11-06T16:36:54,709 Created temporary directory: /tmp/pip-wheel-gqlvpdln 2025-11-06T16:36:54,710 Destination directory: /tmp/pip-wheel-gqlvpdln 2025-11-06T16:36:54,712 Building wheel for lighteval (pyproject.toml): started 2025-11-06T16:36:54,713 Running command Building wheel for lighteval (pyproject.toml) 2025-11-06T16:36:55,310 /tmp/pip-build-env-nc2dr5jt/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2025-11-06T16:36:55,310 !! 2025-11-06T16:36:55,311 ******************************************************************************** 2025-11-06T16:36:55,312 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2025-11-06T16:36:55,313 By 2026-Feb-18, you need to update your project and remove deprecated calls 2025-11-06T16:36:55,313 or your builds will no longer be supported. 2025-11-06T16:36:55,314 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-06T16:36:55,315 ******************************************************************************** 2025-11-06T16:36:55,316 !! 2025-11-06T16:36:55,316 corresp(dist, value, root_dir) 2025-11-06T16:36:55,397 /tmp/pip-build-env-nc2dr5jt/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:61: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-06T16:36:55,397 !! 2025-11-06T16:36:55,398 ******************************************************************************** 2025-11-06T16:36:55,399 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-06T16:36:55,400 License :: OSI Approved :: MIT License 2025-11-06T16:36:55,401 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-06T16:36:55,402 ******************************************************************************** 2025-11-06T16:36:55,403 !! 2025-11-06T16:36:55,403 dist._finalize_license_expression() 2025-11-06T16:36:55,404 /tmp/pip-build-env-nc2dr5jt/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-06T16:36:55,405 !! 2025-11-06T16:36:55,406 ******************************************************************************** 2025-11-06T16:36:55,406 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-06T16:36:55,407 License :: OSI Approved :: MIT License 2025-11-06T16:36:55,409 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-06T16:36:55,409 ******************************************************************************** 2025-11-06T16:36:55,410 !! 2025-11-06T16:36:55,411 self._finalize_license_expression() 2025-11-06T16:36:55,411 running bdist_wheel 2025-11-06T16:36:55,427 running build 2025-11-06T16:36:55,427 running build_py 2025-11-06T16:36:55,434 creating build/lib/lighteval 2025-11-06T16:36:55,437 copying src/lighteval/cli_args.py -> build/lib/lighteval 2025-11-06T16:36:55,440 copying src/lighteval/main_accelerate.py -> build/lib/lighteval 2025-11-06T16:36:55,442 copying src/lighteval/main_sglang.py -> build/lib/lighteval 2025-11-06T16:36:55,444 copying src/lighteval/data.py -> build/lib/lighteval 2025-11-06T16:36:55,447 copying src/lighteval/main_nanotron.py -> build/lib/lighteval 2025-11-06T16:36:55,449 copying src/lighteval/main_inspect.py -> build/lib/lighteval 2025-11-06T16:36:55,452 copying src/lighteval/__main__.py -> build/lib/lighteval 2025-11-06T16:36:55,454 copying src/lighteval/main_custom.py -> build/lib/lighteval 2025-11-06T16:36:55,456 copying src/lighteval/__init__.py -> build/lib/lighteval 2025-11-06T16:36:55,458 copying src/lighteval/main_vllm.py -> build/lib/lighteval 2025-11-06T16:36:55,461 copying src/lighteval/check_logs.py -> build/lib/lighteval 2025-11-06T16:36:55,462 copying src/lighteval/main_endpoint.py -> build/lib/lighteval 2025-11-06T16:36:55,465 copying src/lighteval/main_tasks.py -> build/lib/lighteval 2025-11-06T16:36:55,467 copying src/lighteval/main_baseline.py -> build/lib/lighteval 2025-11-06T16:36:55,469 copying src/lighteval/pipeline.py -> build/lib/lighteval 2025-11-06T16:36:55,473 creating build/lib/lighteval/models 2025-11-06T16:36:55,474 copying src/lighteval/models/model_output.py -> build/lib/lighteval/models 2025-11-06T16:36:55,476 copying src/lighteval/models/utils.py -> build/lib/lighteval/models 2025-11-06T16:36:55,478 copying src/lighteval/models/model_loader.py -> build/lib/lighteval/models 2025-11-06T16:36:55,481 copying src/lighteval/models/model_input.py -> build/lib/lighteval/models 2025-11-06T16:36:55,483 copying src/lighteval/models/abstract_model.py -> build/lib/lighteval/models 2025-11-06T16:36:55,487 creating build/lib/lighteval/tasks 2025-11-06T16:36:55,488 copying src/lighteval/tasks/lighteval_task.py -> build/lib/lighteval/tasks 2025-11-06T16:36:55,490 copying src/lighteval/tasks/requests.py -> build/lib/lighteval/tasks 2025-11-06T16:36:55,493 copying src/lighteval/tasks/default_prompts.py -> build/lib/lighteval/tasks 2025-11-06T16:36:55,497 copying src/lighteval/tasks/registry.py -> build/lib/lighteval/tasks 2025-11-06T16:36:55,500 copying src/lighteval/tasks/prompt_manager.py -> build/lib/lighteval/tasks 2025-11-06T16:36:55,503 copying src/lighteval/tasks/__init__.py -> build/lib/lighteval/tasks 2025-11-06T16:36:55,505 creating build/lib/lighteval/utils 2025-11-06T16:36:55,506 copying src/lighteval/utils/cache_management.py -> build/lib/lighteval/utils 2025-11-06T16:36:55,509 copying src/lighteval/utils/parallelism.py -> build/lib/lighteval/utils 2025-11-06T16:36:55,511 copying src/lighteval/utils/timeout.py -> build/lib/lighteval/utils 2025-11-06T16:36:55,514 copying src/lighteval/utils/language.py -> build/lib/lighteval/utils 2025-11-06T16:36:55,516 copying src/lighteval/utils/utils.py -> build/lib/lighteval/utils 2025-11-06T16:36:55,518 copying src/lighteval/utils/imports.py -> build/lib/lighteval/utils 2025-11-06T16:36:55,521 copying src/lighteval/utils/__init__.py -> build/lib/lighteval/utils 2025-11-06T16:36:55,524 creating build/lib/lighteval/metrics 2025-11-06T16:36:55,525 copying src/lighteval/metrics/metrics_sample.py -> build/lib/lighteval/metrics 2025-11-06T16:36:55,528 copying src/lighteval/metrics/metrics.py -> build/lib/lighteval/metrics 2025-11-06T16:36:55,531 copying src/lighteval/metrics/sample_preparator.py -> build/lib/lighteval/metrics 2025-11-06T16:36:55,534 copying src/lighteval/metrics/metrics_corpus.py -> build/lib/lighteval/metrics 2025-11-06T16:36:55,536 copying src/lighteval/metrics/normalizations.py -> build/lib/lighteval/metrics 2025-11-06T16:36:55,539 copying src/lighteval/metrics/dynamic_metrics.py -> build/lib/lighteval/metrics 2025-11-06T16:36:55,541 copying src/lighteval/metrics/__init__.py -> build/lib/lighteval/metrics 2025-11-06T16:36:55,544 creating build/lib/lighteval/logging 2025-11-06T16:36:55,545 copying src/lighteval/logging/evaluation_tracker.py -> build/lib/lighteval/logging 2025-11-06T16:36:55,548 copying src/lighteval/logging/info_loggers.py -> build/lib/lighteval/logging 2025-11-06T16:36:55,551 creating build/lib/lighteval/models/dummy 2025-11-06T16:36:55,552 copying src/lighteval/models/dummy/dummy_model.py -> build/lib/lighteval/models/dummy 2025-11-06T16:36:55,556 creating build/lib/lighteval/models/custom 2025-11-06T16:36:55,557 copying src/lighteval/models/custom/custom_model.py -> build/lib/lighteval/models/custom 2025-11-06T16:36:55,560 creating build/lib/lighteval/models/endpoints 2025-11-06T16:36:55,561 copying src/lighteval/models/endpoints/tgi_model.py -> build/lib/lighteval/models/endpoints 2025-11-06T16:36:55,564 copying src/lighteval/models/endpoints/inference_providers_model.py -> build/lib/lighteval/models/endpoints 2025-11-06T16:36:55,567 copying src/lighteval/models/endpoints/litellm_model.py -> build/lib/lighteval/models/endpoints 2025-11-06T16:36:55,571 copying src/lighteval/models/endpoints/endpoint_model.py -> build/lib/lighteval/models/endpoints 2025-11-06T16:36:55,576 creating build/lib/lighteval/models/transformers 2025-11-06T16:36:55,578 copying src/lighteval/models/transformers/transformers_model.py -> build/lib/lighteval/models/transformers 2025-11-06T16:36:55,583 copying src/lighteval/models/transformers/vlm_transformers_model.py -> build/lib/lighteval/models/transformers 2025-11-06T16:36:55,587 copying src/lighteval/models/transformers/adapter_model.py -> build/lib/lighteval/models/transformers 2025-11-06T16:36:55,590 copying src/lighteval/models/transformers/delta_model.py -> build/lib/lighteval/models/transformers 2025-11-06T16:36:55,594 creating build/lib/lighteval/models/vllm 2025-11-06T16:36:55,595 copying src/lighteval/models/vllm/vllm_model.py -> build/lib/lighteval/models/vllm 2025-11-06T16:36:55,599 creating build/lib/lighteval/models/sglang 2025-11-06T16:36:55,601 copying src/lighteval/models/sglang/sglang_model.py -> build/lib/lighteval/models/sglang 2025-11-06T16:36:55,605 creating build/lib/lighteval/models/nanotron 2025-11-06T16:36:55,606 copying src/lighteval/models/nanotron/nanotron_model.py -> build/lib/lighteval/models/nanotron 2025-11-06T16:36:55,610 creating build/lib/lighteval/tasks/templates 2025-11-06T16:36:55,612 copying src/lighteval/tasks/templates/nli.py -> build/lib/lighteval/tasks/templates 2025-11-06T16:36:55,615 copying src/lighteval/tasks/templates/continuation.py -> build/lib/lighteval/tasks/templates 2025-11-06T16:36:55,618 copying src/lighteval/tasks/templates/hellaswag.py -> build/lib/lighteval/tasks/templates 2025-11-06T16:36:55,620 copying src/lighteval/tasks/templates/copa.py -> build/lib/lighteval/tasks/templates 2025-11-06T16:36:55,623 copying src/lighteval/tasks/templates/multichoice.py -> build/lib/lighteval/tasks/templates 2025-11-06T16:36:55,626 copying src/lighteval/tasks/templates/boolq.py -> build/lib/lighteval/tasks/templates 2025-11-06T16:36:55,629 copying src/lighteval/tasks/templates/translation.py -> build/lib/lighteval/tasks/templates 2025-11-06T16:36:55,632 copying src/lighteval/tasks/templates/__init__.py -> build/lib/lighteval/tasks/templates 2025-11-06T16:36:55,634 copying src/lighteval/tasks/templates/qa.py -> build/lib/lighteval/tasks/templates 2025-11-06T16:36:55,637 creating build/lib/lighteval/tasks/multilingual 2025-11-06T16:36:55,638 copying src/lighteval/tasks/multilingual/adapters.py -> build/lib/lighteval/tasks/multilingual 2025-11-06T16:36:55,642 copying src/lighteval/tasks/multilingual/__init__.py -> build/lib/lighteval/tasks/multilingual 2025-11-06T16:36:55,646 creating build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,648 copying src/lighteval/tasks/tasks/legal_summarization.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,650 copying src/lighteval/tasks/tasks/lsat_qa.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,653 copying src/lighteval/tasks/tasks/aimo.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,655 copying src/lighteval/tasks/tasks/mmmu_pro.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,657 copying src/lighteval/tasks/tasks/hellaswag.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,659 copying src/lighteval/tasks/tasks/xcopa.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,662 copying src/lighteval/tasks/tasks/babi_qa.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,664 copying src/lighteval/tasks/tasks/winogrande.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,666 copying src/lighteval/tasks/tasks/storycloze.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,668 copying src/lighteval/tasks/tasks/blimp.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,670 copying src/lighteval/tasks/tasks/arc_agi_2.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,672 copying src/lighteval/tasks/tasks/mmlu_redux.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,674 copying src/lighteval/tasks/tasks/race_high.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,676 copying src/lighteval/tasks/tasks/legalsupport.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,678 copying src/lighteval/tasks/tasks/mgsm.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,681 copying src/lighteval/tasks/tasks/med.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,683 copying src/lighteval/tasks/tasks/headqa.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,685 copying src/lighteval/tasks/tasks/arithmetic.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,687 copying src/lighteval/tasks/tasks/slr_bench.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,689 copying src/lighteval/tasks/tasks/commonsenseqa.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,691 copying src/lighteval/tasks/tasks/simpleqa.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,693 copying src/lighteval/tasks/tasks/triviaqa.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,695 copying src/lighteval/tasks/tasks/drop_qa.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,697 copying src/lighteval/tasks/tasks/mmlu.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,699 copying src/lighteval/tasks/tasks/civil_comments.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,701 copying src/lighteval/tasks/tasks/asdiv.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,703 copying src/lighteval/tasks/tasks/toxigen.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,705 copying src/lighteval/tasks/tasks/numeracy.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,707 copying src/lighteval/tasks/tasks/lextreme.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,710 copying src/lighteval/tasks/tasks/math_500.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,712 copying src/lighteval/tasks/tasks/musr.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,714 copying src/lighteval/tasks/tasks/siqa.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,715 copying src/lighteval/tasks/tasks/narrativeqa.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,717 copying src/lighteval/tasks/tasks/ethics.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,720 copying src/lighteval/tasks/tasks/boolq.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,721 copying src/lighteval/tasks/tasks/entity_data_imputation.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,723 copying src/lighteval/tasks/tasks/imdb.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,725 copying src/lighteval/tasks/tasks/gpqa.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,728 copying src/lighteval/tasks/tasks/swag.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,729 copying src/lighteval/tasks/tasks/jeopardy.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,731 copying src/lighteval/tasks/tasks/dyck_language.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,733 copying src/lighteval/tasks/tasks/xstory_cloze.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,735 copying src/lighteval/tasks/tasks/sciq.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,737 copying src/lighteval/tasks/tasks/sacrebleu.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,741 copying src/lighteval/tasks/tasks/arc.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,742 copying src/lighteval/tasks/tasks/natural_questions.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,744 copying src/lighteval/tasks/tasks/logiqa.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,746 copying src/lighteval/tasks/tasks/entitymatching.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,748 copying src/lighteval/tasks/tasks/bbq.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,750 copying src/lighteval/tasks/tasks/webqs.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,753 copying src/lighteval/tasks/tasks/glue.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,755 copying src/lighteval/tasks/tasks/anli.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,757 copying src/lighteval/tasks/tasks/squad_v2.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,759 copying src/lighteval/tasks/tasks/gsm8k.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,761 copying src/lighteval/tasks/tasks/bold.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,762 copying src/lighteval/tasks/tasks/pubmedqa.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,764 copying src/lighteval/tasks/tasks/math.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,766 copying src/lighteval/tasks/tasks/lexglue.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,768 copying src/lighteval/tasks/tasks/gsm_plus.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,770 copying src/lighteval/tasks/tasks/bigbench.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,775 copying src/lighteval/tasks/tasks/prost.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,779 copying src/lighteval/tasks/tasks/lambada.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,781 copying src/lighteval/tasks/tasks/quac.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,783 copying src/lighteval/tasks/tasks/xwinograd.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,785 copying src/lighteval/tasks/tasks/covid_dialogue.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,787 copying src/lighteval/tasks/tasks/qasper.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,789 copying src/lighteval/tasks/tasks/unscramble.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,791 copying src/lighteval/tasks/tasks/coqa.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,792 copying src/lighteval/tasks/tasks/aime.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,794 copying src/lighteval/tasks/tasks/summarization.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,796 copying src/lighteval/tasks/tasks/mmlu_pro.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,799 copying src/lighteval/tasks/tasks/the_pile.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,801 copying src/lighteval/tasks/tasks/openbookqa.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,803 copying src/lighteval/tasks/tasks/raft.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,806 copying src/lighteval/tasks/tasks/real_toxicity_prompts.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,808 copying src/lighteval/tasks/tasks/wikifact.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,810 copying src/lighteval/tasks/tasks/twitterAAE.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,812 copying src/lighteval/tasks/tasks/bigbench_hard.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,815 copying src/lighteval/tasks/tasks/piqa.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,817 copying src/lighteval/tasks/tasks/truthfulqa.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,819 copying src/lighteval/tasks/tasks/custom_task_classification_grammar_task.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,821 copying src/lighteval/tasks/tasks/qa4mre.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,824 copying src/lighteval/tasks/tasks/med_dialog.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,826 copying src/lighteval/tasks/tasks/mathqa.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,828 copying src/lighteval/tasks/tasks/agieval.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,830 copying src/lighteval/tasks/tasks/wikitext.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,833 copying src/lighteval/tasks/tasks/synthetic_reasoning.py -> build/lib/lighteval/tasks/tasks 2025-11-06T16:36:55,837 creating build/lib/lighteval/tasks/templates/utils 2025-11-06T16:36:55,838 copying src/lighteval/tasks/templates/utils/translation_literals.py -> build/lib/lighteval/tasks/templates/utils 2025-11-06T16:36:55,841 copying src/lighteval/tasks/templates/utils/adapter_utils.py -> build/lib/lighteval/tasks/templates/utils 2025-11-06T16:36:55,843 copying src/lighteval/tasks/templates/utils/formatting_utils.py -> build/lib/lighteval/tasks/templates/utils 2025-11-06T16:36:55,845 copying src/lighteval/tasks/templates/utils/formulation.py -> build/lib/lighteval/tasks/templates/utils 2025-11-06T16:36:55,847 copying src/lighteval/tasks/templates/utils/__init__.py -> build/lib/lighteval/tasks/templates/utils 2025-11-06T16:36:55,851 creating build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,852 copying src/lighteval/tasks/multilingual/tasks/filipino.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,855 copying src/lighteval/tasks/multilingual/tasks/paws_x.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,857 copying src/lighteval/tasks/multilingual/tasks/parus.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,859 copying src/lighteval/tasks/multilingual/tasks/hellaswag_tha.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,861 copying src/lighteval/tasks/multilingual/tasks/mlqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,863 copying src/lighteval/tasks/multilingual/tasks/xnli.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,865 copying src/lighteval/tasks/multilingual/tasks/belebele.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,867 copying src/lighteval/tasks/multilingual/tasks/global_mmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,869 copying src/lighteval/tasks/multilingual/tasks/openbook_rus.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,871 copying src/lighteval/tasks/multilingual/tasks/french.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,873 copying src/lighteval/tasks/multilingual/tasks/mathlogicqa_rus.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,875 copying src/lighteval/tasks/multilingual/tasks/tydiqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,877 copying src/lighteval/tasks/multilingual/tasks/soqal.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,880 copying src/lighteval/tasks/multilingual/tasks/xcopa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,882 copying src/lighteval/tasks/multilingual/tasks/arabic_arc.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,884 copying src/lighteval/tasks/multilingual/tasks/mkqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,887 copying src/lighteval/tasks/multilingual/tasks/afri_mmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,889 copying src/lighteval/tasks/multilingual/tasks/meta_mmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,892 copying src/lighteval/tasks/multilingual/tasks/ceval.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,895 copying src/lighteval/tasks/multilingual/tasks/sber_squad.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,898 copying src/lighteval/tasks/multilingual/tasks/chinese_squad.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,900 copying src/lighteval/tasks/multilingual/tasks/mlmm_arc_challenge.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,902 copying src/lighteval/tasks/multilingual/tasks/mgsm.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,905 copying src/lighteval/tasks/multilingual/tasks/arabic.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,908 copying src/lighteval/tasks/multilingual/tasks/mlmm_hellaswag.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,910 copying src/lighteval/tasks/multilingual/tasks/arabic_mmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,912 copying src/lighteval/tasks/multilingual/tasks/squad_it.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,915 copying src/lighteval/tasks/multilingual/tasks/hellaswag_tur.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,917 copying src/lighteval/tasks/multilingual/tasks/tquad_v2.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,919 copying src/lighteval/tasks/multilingual/tasks/hindi_arc.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,922 copying src/lighteval/tasks/multilingual/tasks/turkic.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,924 copying src/lighteval/tasks/multilingual/tasks/thai_exams.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,927 copying src/lighteval/tasks/multilingual/tasks/cmath.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,929 copying src/lighteval/tasks/multilingual/tasks/serbian_eval.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,933 copying src/lighteval/tasks/multilingual/tasks/openai_mmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,935 copying src/lighteval/tasks/multilingual/tasks/arcd.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,938 copying src/lighteval/tasks/multilingual/tasks/squad_es.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,940 copying src/lighteval/tasks/multilingual/tasks/indicqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,943 copying src/lighteval/tasks/multilingual/tasks/french_triviqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,945 copying src/lighteval/tasks/multilingual/tasks/mintaka.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,947 copying src/lighteval/tasks/multilingual/tasks/afri_xnli.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,950 copying src/lighteval/tasks/multilingual/tasks/cmmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,952 copying src/lighteval/tasks/multilingual/tasks/french_boolq.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,954 copying src/lighteval/tasks/multilingual/tasks/turkish_arc.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,957 copying src/lighteval/tasks/multilingual/tasks/acva.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,960 copying src/lighteval/tasks/multilingual/tasks/germanquad.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,962 copying src/lighteval/tasks/multilingual/tasks/copa_indic.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,965 copying src/lighteval/tasks/multilingual/tasks/hindi_boolq.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,968 copying src/lighteval/tasks/multilingual/tasks/openbook_es.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,970 copying src/lighteval/tasks/multilingual/tasks/hellaswag_tel.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,972 copying src/lighteval/tasks/multilingual/tasks/worldtree_rus.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,975 copying src/lighteval/tasks/multilingual/tasks/mlmm_truthfulqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,977 copying src/lighteval/tasks/multilingual/tasks/xcodah.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,979 copying src/lighteval/tasks/multilingual/tasks/kenswquad.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,981 copying src/lighteval/tasks/multilingual/tasks/m3exams.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,983 copying src/lighteval/tasks/multilingual/tasks/piqa_ar.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,984 copying src/lighteval/tasks/multilingual/tasks/flores200.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,987 copying src/lighteval/tasks/multilingual/tasks/swahili_arc.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,989 copying src/lighteval/tasks/multilingual/tasks/xnli_indic.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,991 copying src/lighteval/tasks/multilingual/tasks/enem.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,993 copying src/lighteval/tasks/multilingual/tasks/rcb.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,994 copying src/lighteval/tasks/multilingual/tasks/fquad_v2.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,996 copying src/lighteval/tasks/multilingual/tasks/xwinograd.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:55,998 copying src/lighteval/tasks/multilingual/tasks/afri_mgsm.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,000 copying src/lighteval/tasks/multilingual/tasks/hellaswag_hin.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,002 copying src/lighteval/tasks/multilingual/tasks/oz.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,004 copying src/lighteval/tasks/multilingual/tasks/xstory.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,006 copying src/lighteval/tasks/multilingual/tasks/xcsqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,008 copying src/lighteval/tasks/multilingual/tasks/exams.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,011 copying src/lighteval/tasks/multilingual/tasks/turkish_mmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,013 copying src/lighteval/tasks/multilingual/tasks/oab_exams.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,015 copying src/lighteval/tasks/multilingual/tasks/faquad.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,017 copying src/lighteval/tasks/multilingual/tasks/ocnli.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,018 copying src/lighteval/tasks/multilingual/tasks/mlmm_mmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,021 copying src/lighteval/tasks/multilingual/tasks/cmnli.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,023 copying src/lighteval/tasks/multilingual/tasks/cmrc2018.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,024 copying src/lighteval/tasks/multilingual/tasks/c3.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,026 copying src/lighteval/tasks/multilingual/tasks/xnli2.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,028 copying src/lighteval/tasks/multilingual/tasks/chegeka.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,030 copying src/lighteval/tasks/multilingual/tasks/xquad.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,032 copying src/lighteval/tasks/multilingual/tasks/thaiqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,034 copying src/lighteval/tasks/multilingual/tasks/german_rag.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,037 copying src/lighteval/tasks/multilingual/tasks/openbook_ara.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,039 creating build/lib/lighteval/tasks/multilingual/utils 2025-11-06T16:36:56,040 copying src/lighteval/tasks/multilingual/utils/adapters_utils.py -> build/lib/lighteval/tasks/multilingual/utils 2025-11-06T16:36:56,043 copying src/lighteval/tasks/multilingual/utils/__init__.py -> build/lib/lighteval/tasks/multilingual/utils 2025-11-06T16:36:56,044 copying src/lighteval/tasks/multilingual/utils/task_utils.py -> build/lib/lighteval/tasks/multilingual/utils 2025-11-06T16:36:56,047 creating build/lib/lighteval/tasks/tasks/intercode_ctf 2025-11-06T16:36:56,048 copying src/lighteval/tasks/tasks/intercode_ctf/main.py -> build/lib/lighteval/tasks/tasks/intercode_ctf 2025-11-06T16:36:56,050 creating build/lib/lighteval/tasks/tasks/tiny_benchmarks 2025-11-06T16:36:56,051 copying src/lighteval/tasks/tasks/tiny_benchmarks/main.py -> build/lib/lighteval/tasks/tasks/tiny_benchmarks 2025-11-06T16:36:56,054 creating build/lib/lighteval/tasks/tasks/ifbench 2025-11-06T16:36:56,055 copying src/lighteval/tasks/tasks/ifbench/main.py -> build/lib/lighteval/tasks/tasks/ifbench 2025-11-06T16:36:56,057 copying src/lighteval/tasks/tasks/ifbench/instructions.py -> build/lib/lighteval/tasks/tasks/ifbench 2025-11-06T16:36:56,061 copying src/lighteval/tasks/tasks/ifbench/evaluation_lib.py -> build/lib/lighteval/tasks/tasks/ifbench 2025-11-06T16:36:56,063 copying src/lighteval/tasks/tasks/ifbench/instructions_registry.py -> build/lib/lighteval/tasks/tasks/ifbench 2025-11-06T16:36:56,066 creating build/lib/lighteval/tasks/tasks/lcb 2025-11-06T16:36:56,067 copying src/lighteval/tasks/tasks/lcb/main.py -> build/lib/lighteval/tasks/tasks/lcb 2025-11-06T16:36:56,070 copying src/lighteval/tasks/tasks/lcb/codegen_metrics.py -> build/lib/lighteval/tasks/tasks/lcb 2025-11-06T16:36:56,073 creating build/lib/lighteval/tasks/tasks/olympiade_bench 2025-11-06T16:36:56,074 copying src/lighteval/tasks/tasks/olympiade_bench/main.py -> build/lib/lighteval/tasks/tasks/olympiade_bench 2025-11-06T16:36:56,077 creating build/lib/lighteval/tasks/tasks/mt_bench 2025-11-06T16:36:56,078 copying src/lighteval/tasks/tasks/mt_bench/main.py -> build/lib/lighteval/tasks/tasks/mt_bench 2025-11-06T16:36:56,080 copying src/lighteval/tasks/tasks/mt_bench/judge_prompt_templates.py -> build/lib/lighteval/tasks/tasks/mt_bench 2025-11-06T16:36:56,082 creating build/lib/lighteval/tasks/tasks/mix_eval 2025-11-06T16:36:56,083 copying src/lighteval/tasks/tasks/mix_eval/main.py -> build/lib/lighteval/tasks/tasks/mix_eval 2025-11-06T16:36:56,086 copying src/lighteval/tasks/tasks/mix_eval/judge_prompts.py -> build/lib/lighteval/tasks/tasks/mix_eval 2025-11-06T16:36:56,089 copying src/lighteval/tasks/tasks/mix_eval/prompts.py -> build/lib/lighteval/tasks/tasks/mix_eval 2025-11-06T16:36:56,091 creating build/lib/lighteval/tasks/tasks/ifeval 2025-11-06T16:36:56,092 copying src/lighteval/tasks/tasks/ifeval/main.py -> build/lib/lighteval/tasks/tasks/ifeval 2025-11-06T16:36:56,095 copying src/lighteval/tasks/tasks/ifeval/instructions_utils.py -> build/lib/lighteval/tasks/tasks/ifeval 2025-11-06T16:36:56,098 copying src/lighteval/tasks/tasks/ifeval/instructions.py -> build/lib/lighteval/tasks/tasks/ifeval 2025-11-06T16:36:56,101 copying src/lighteval/tasks/tasks/ifeval/instructions_registry.py -> build/lib/lighteval/tasks/tasks/ifeval 2025-11-06T16:36:56,103 creating build/lib/lighteval/tasks/tasks/hle 2025-11-06T16:36:56,104 copying src/lighteval/tasks/tasks/hle/main.py -> build/lib/lighteval/tasks/tasks/hle 2025-11-06T16:36:56,107 creating build/lib/lighteval/metrics/utils 2025-11-06T16:36:56,108 copying src/lighteval/metrics/utils/judge_utils.py -> build/lib/lighteval/metrics/utils 2025-11-06T16:36:56,111 copying src/lighteval/metrics/utils/math_comparison.py -> build/lib/lighteval/metrics/utils 2025-11-06T16:36:56,114 copying src/lighteval/metrics/utils/metric_utils.py -> build/lib/lighteval/metrics/utils 2025-11-06T16:36:56,116 copying src/lighteval/metrics/utils/linguistic_tokenizers.py -> build/lib/lighteval/metrics/utils 2025-11-06T16:36:56,118 copying src/lighteval/metrics/utils/stderr.py -> build/lib/lighteval/metrics/utils 2025-11-06T16:36:56,120 copying src/lighteval/metrics/utils/llm_as_judge.py -> build/lib/lighteval/metrics/utils 2025-11-06T16:36:56,123 copying src/lighteval/metrics/utils/extractive_match_utils.py -> build/lib/lighteval/metrics/utils 2025-11-06T16:36:56,126 creating build/lib/lighteval/metrics/harness_compatibility 2025-11-06T16:36:56,127 copying src/lighteval/metrics/harness_compatibility/truthful_qa.py -> build/lib/lighteval/metrics/harness_compatibility 2025-11-06T16:36:56,129 copying src/lighteval/metrics/harness_compatibility/drop.py -> build/lib/lighteval/metrics/harness_compatibility 2025-11-06T16:36:56,131 creating build/lib/lighteval/metrics/imports 2025-11-06T16:36:56,132 copying src/lighteval/metrics/imports/bert_scorer.py -> build/lib/lighteval/metrics/imports 2025-11-06T16:36:56,135 copying src/lighteval/metrics/imports/data_stats_metric.py -> build/lib/lighteval/metrics/imports 2025-11-06T16:36:56,138 copying src/lighteval/metrics/imports/data_stats_utils.py -> build/lib/lighteval/metrics/imports 2025-11-06T16:36:56,140 copying src/lighteval/metrics/imports/summac.py -> build/lib/lighteval/metrics/imports 2025-11-06T16:36:56,142 copying src/lighteval/metrics/imports/__init__.py -> build/lib/lighteval/metrics/imports 2025-11-06T16:36:56,144 running egg_info 2025-11-06T16:36:56,156 writing src/lighteval.egg-info/PKG-INFO 2025-11-06T16:36:56,173 writing dependency_links to src/lighteval.egg-info/dependency_links.txt 2025-11-06T16:36:56,175 writing entry points to src/lighteval.egg-info/entry_points.txt 2025-11-06T16:36:56,184 writing requirements to src/lighteval.egg-info/requires.txt 2025-11-06T16:36:56,186 writing top-level names to src/lighteval.egg-info/top_level.txt 2025-11-06T16:36:56,229 reading manifest file 'src/lighteval.egg-info/SOURCES.txt' 2025-11-06T16:36:56,246 reading manifest template 'MANIFEST.in' 2025-11-06T16:36:56,247 warning: no files found matching 'src/lighteval/tasks/tasks_table.jsonl' 2025-11-06T16:36:56,248 warning: no files found matching 'src/lighteval/metrics/*.jsonl' 2025-11-06T16:36:56,248 adding license file 'LICENSE' 2025-11-06T16:36:56,263 writing manifest file 'src/lighteval.egg-info/SOURCES.txt' 2025-11-06T16:36:56,310 installing to build/bdist.linux-armv7l/wheel 2025-11-06T16:36:56,311 running install 2025-11-06T16:36:56,334 running install_lib 2025-11-06T16:36:56,341 creating build/bdist.linux-armv7l/wheel 2025-11-06T16:36:56,343 creating build/bdist.linux-armv7l/wheel/lighteval 2025-11-06T16:36:56,344 copying build/lib/lighteval/cli_args.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-06T16:36:56,347 copying build/lib/lighteval/main_accelerate.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-06T16:36:56,349 copying build/lib/lighteval/main_sglang.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-06T16:36:56,351 copying build/lib/lighteval/data.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-06T16:36:56,354 copying build/lib/lighteval/main_nanotron.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-06T16:36:56,357 creating build/bdist.linux-armv7l/wheel/lighteval/models 2025-11-06T16:36:56,358 copying build/lib/lighteval/models/model_output.py -> build/bdist.linux-armv7l/wheel/./lighteval/models 2025-11-06T16:36:56,361 creating build/bdist.linux-armv7l/wheel/lighteval/models/dummy 2025-11-06T16:36:56,362 copying build/lib/lighteval/models/dummy/dummy_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/dummy 2025-11-06T16:36:56,365 creating build/bdist.linux-armv7l/wheel/lighteval/models/custom 2025-11-06T16:36:56,366 copying build/lib/lighteval/models/custom/custom_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/custom 2025-11-06T16:36:56,368 copying build/lib/lighteval/models/utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/models 2025-11-06T16:36:56,370 copying build/lib/lighteval/models/model_loader.py -> build/bdist.linux-armv7l/wheel/./lighteval/models 2025-11-06T16:36:56,373 creating build/bdist.linux-armv7l/wheel/lighteval/models/endpoints 2025-11-06T16:36:56,374 copying build/lib/lighteval/models/endpoints/tgi_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/endpoints 2025-11-06T16:36:56,376 copying build/lib/lighteval/models/endpoints/inference_providers_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/endpoints 2025-11-06T16:36:56,378 copying build/lib/lighteval/models/endpoints/litellm_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/endpoints 2025-11-06T16:36:56,381 copying build/lib/lighteval/models/endpoints/endpoint_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/endpoints 2025-11-06T16:36:56,384 creating build/bdist.linux-armv7l/wheel/lighteval/models/transformers 2025-11-06T16:36:56,385 copying build/lib/lighteval/models/transformers/transformers_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/transformers 2025-11-06T16:36:56,388 copying build/lib/lighteval/models/transformers/vlm_transformers_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/transformers 2025-11-06T16:36:56,391 copying build/lib/lighteval/models/transformers/adapter_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/transformers 2025-11-06T16:36:56,393 copying build/lib/lighteval/models/transformers/delta_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/transformers 2025-11-06T16:36:56,395 copying build/lib/lighteval/models/model_input.py -> build/bdist.linux-armv7l/wheel/./lighteval/models 2025-11-06T16:36:56,398 creating build/bdist.linux-armv7l/wheel/lighteval/models/vllm 2025-11-06T16:36:56,399 copying build/lib/lighteval/models/vllm/vllm_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/vllm 2025-11-06T16:36:56,403 copying build/lib/lighteval/models/abstract_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models 2025-11-06T16:36:56,406 creating build/bdist.linux-armv7l/wheel/lighteval/models/sglang 2025-11-06T16:36:56,407 copying build/lib/lighteval/models/sglang/sglang_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/sglang 2025-11-06T16:36:56,410 creating build/bdist.linux-armv7l/wheel/lighteval/models/nanotron 2025-11-06T16:36:56,411 copying build/lib/lighteval/models/nanotron/nanotron_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/nanotron 2025-11-06T16:36:56,414 copying build/lib/lighteval/main_inspect.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-06T16:36:56,418 creating build/bdist.linux-armv7l/wheel/lighteval/tasks 2025-11-06T16:36:56,419 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/templates 2025-11-06T16:36:56,420 copying build/lib/lighteval/tasks/templates/nli.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-06T16:36:56,423 copying build/lib/lighteval/tasks/templates/continuation.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-06T16:36:56,425 copying build/lib/lighteval/tasks/templates/hellaswag.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-06T16:36:56,427 copying build/lib/lighteval/tasks/templates/copa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-06T16:36:56,430 copying build/lib/lighteval/tasks/templates/multichoice.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-06T16:36:56,433 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/templates/utils 2025-11-06T16:36:56,434 copying build/lib/lighteval/tasks/templates/utils/translation_literals.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates/utils 2025-11-06T16:36:56,437 copying build/lib/lighteval/tasks/templates/utils/adapter_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates/utils 2025-11-06T16:36:56,439 copying build/lib/lighteval/tasks/templates/utils/formatting_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates/utils 2025-11-06T16:36:56,441 copying build/lib/lighteval/tasks/templates/utils/formulation.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates/utils 2025-11-06T16:36:56,443 copying build/lib/lighteval/tasks/templates/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates/utils 2025-11-06T16:36:56,445 copying build/lib/lighteval/tasks/templates/boolq.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-06T16:36:56,448 copying build/lib/lighteval/tasks/templates/translation.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-06T16:36:56,450 copying build/lib/lighteval/tasks/templates/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-06T16:36:56,452 copying build/lib/lighteval/tasks/templates/qa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-06T16:36:56,454 copying build/lib/lighteval/tasks/lighteval_task.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks 2025-11-06T16:36:56,457 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/multilingual 2025-11-06T16:36:56,460 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,461 copying build/lib/lighteval/tasks/multilingual/tasks/filipino.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,464 copying build/lib/lighteval/tasks/multilingual/tasks/paws_x.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,465 copying build/lib/lighteval/tasks/multilingual/tasks/parus.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,468 copying build/lib/lighteval/tasks/multilingual/tasks/hellaswag_tha.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,469 copying build/lib/lighteval/tasks/multilingual/tasks/mlqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,471 copying build/lib/lighteval/tasks/multilingual/tasks/xnli.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,473 copying build/lib/lighteval/tasks/multilingual/tasks/belebele.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,476 copying build/lib/lighteval/tasks/multilingual/tasks/global_mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,478 copying build/lib/lighteval/tasks/multilingual/tasks/openbook_rus.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,480 copying build/lib/lighteval/tasks/multilingual/tasks/french.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,482 copying build/lib/lighteval/tasks/multilingual/tasks/mathlogicqa_rus.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,484 copying build/lib/lighteval/tasks/multilingual/tasks/tydiqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,486 copying build/lib/lighteval/tasks/multilingual/tasks/soqal.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,488 copying build/lib/lighteval/tasks/multilingual/tasks/xcopa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,490 copying build/lib/lighteval/tasks/multilingual/tasks/arabic_arc.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,492 copying build/lib/lighteval/tasks/multilingual/tasks/mkqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,494 copying build/lib/lighteval/tasks/multilingual/tasks/afri_mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,496 copying build/lib/lighteval/tasks/multilingual/tasks/meta_mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,498 copying build/lib/lighteval/tasks/multilingual/tasks/ceval.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,499 copying build/lib/lighteval/tasks/multilingual/tasks/sber_squad.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,501 copying build/lib/lighteval/tasks/multilingual/tasks/chinese_squad.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,503 copying build/lib/lighteval/tasks/multilingual/tasks/mlmm_arc_challenge.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,505 copying build/lib/lighteval/tasks/multilingual/tasks/mgsm.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,506 copying build/lib/lighteval/tasks/multilingual/tasks/arabic.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,509 copying build/lib/lighteval/tasks/multilingual/tasks/mlmm_hellaswag.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,511 copying build/lib/lighteval/tasks/multilingual/tasks/arabic_mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,513 copying build/lib/lighteval/tasks/multilingual/tasks/squad_it.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,515 copying build/lib/lighteval/tasks/multilingual/tasks/hellaswag_tur.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,517 copying build/lib/lighteval/tasks/multilingual/tasks/tquad_v2.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,519 copying build/lib/lighteval/tasks/multilingual/tasks/hindi_arc.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,521 copying build/lib/lighteval/tasks/multilingual/tasks/turkic.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,522 copying build/lib/lighteval/tasks/multilingual/tasks/thai_exams.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,524 copying build/lib/lighteval/tasks/multilingual/tasks/cmath.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,526 copying build/lib/lighteval/tasks/multilingual/tasks/serbian_eval.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,529 copying build/lib/lighteval/tasks/multilingual/tasks/openai_mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,531 copying build/lib/lighteval/tasks/multilingual/tasks/arcd.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,533 copying build/lib/lighteval/tasks/multilingual/tasks/squad_es.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,535 copying build/lib/lighteval/tasks/multilingual/tasks/indicqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,537 copying build/lib/lighteval/tasks/multilingual/tasks/french_triviqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,539 copying build/lib/lighteval/tasks/multilingual/tasks/mintaka.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,541 copying build/lib/lighteval/tasks/multilingual/tasks/afri_xnli.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,543 copying build/lib/lighteval/tasks/multilingual/tasks/cmmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,545 copying build/lib/lighteval/tasks/multilingual/tasks/french_boolq.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,546 copying build/lib/lighteval/tasks/multilingual/tasks/turkish_arc.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,548 copying build/lib/lighteval/tasks/multilingual/tasks/acva.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,550 copying build/lib/lighteval/tasks/multilingual/tasks/germanquad.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,552 copying build/lib/lighteval/tasks/multilingual/tasks/copa_indic.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,554 copying build/lib/lighteval/tasks/multilingual/tasks/hindi_boolq.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,556 copying build/lib/lighteval/tasks/multilingual/tasks/openbook_es.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,558 copying build/lib/lighteval/tasks/multilingual/tasks/hellaswag_tel.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,560 copying build/lib/lighteval/tasks/multilingual/tasks/worldtree_rus.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,561 copying build/lib/lighteval/tasks/multilingual/tasks/mlmm_truthfulqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,563 copying build/lib/lighteval/tasks/multilingual/tasks/xcodah.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,565 copying build/lib/lighteval/tasks/multilingual/tasks/kenswquad.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,567 copying build/lib/lighteval/tasks/multilingual/tasks/m3exams.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,569 copying build/lib/lighteval/tasks/multilingual/tasks/piqa_ar.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,571 copying build/lib/lighteval/tasks/multilingual/tasks/flores200.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,573 copying build/lib/lighteval/tasks/multilingual/tasks/swahili_arc.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,575 copying build/lib/lighteval/tasks/multilingual/tasks/xnli_indic.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,577 copying build/lib/lighteval/tasks/multilingual/tasks/enem.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,579 copying build/lib/lighteval/tasks/multilingual/tasks/rcb.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,581 copying build/lib/lighteval/tasks/multilingual/tasks/fquad_v2.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,583 copying build/lib/lighteval/tasks/multilingual/tasks/xwinograd.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,585 copying build/lib/lighteval/tasks/multilingual/tasks/afri_mgsm.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,587 copying build/lib/lighteval/tasks/multilingual/tasks/hellaswag_hin.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,589 copying build/lib/lighteval/tasks/multilingual/tasks/oz.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,591 copying build/lib/lighteval/tasks/multilingual/tasks/xstory.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,593 copying build/lib/lighteval/tasks/multilingual/tasks/xcsqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,595 copying build/lib/lighteval/tasks/multilingual/tasks/exams.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,598 copying build/lib/lighteval/tasks/multilingual/tasks/turkish_mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,599 copying build/lib/lighteval/tasks/multilingual/tasks/oab_exams.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,601 copying build/lib/lighteval/tasks/multilingual/tasks/faquad.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,603 copying build/lib/lighteval/tasks/multilingual/tasks/ocnli.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,605 copying build/lib/lighteval/tasks/multilingual/tasks/mlmm_mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,607 copying build/lib/lighteval/tasks/multilingual/tasks/cmnli.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,609 copying build/lib/lighteval/tasks/multilingual/tasks/cmrc2018.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,611 copying build/lib/lighteval/tasks/multilingual/tasks/c3.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,613 copying build/lib/lighteval/tasks/multilingual/tasks/xnli2.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,615 copying build/lib/lighteval/tasks/multilingual/tasks/chegeka.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,617 copying build/lib/lighteval/tasks/multilingual/tasks/xquad.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,619 copying build/lib/lighteval/tasks/multilingual/tasks/thaiqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,621 copying build/lib/lighteval/tasks/multilingual/tasks/german_rag.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,624 copying build/lib/lighteval/tasks/multilingual/tasks/openbook_ara.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-06T16:36:56,626 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/multilingual/utils 2025-11-06T16:36:56,627 copying build/lib/lighteval/tasks/multilingual/utils/adapters_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/utils 2025-11-06T16:36:56,629 copying build/lib/lighteval/tasks/multilingual/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/utils 2025-11-06T16:36:56,631 copying build/lib/lighteval/tasks/multilingual/utils/task_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/utils 2025-11-06T16:36:56,633 copying build/lib/lighteval/tasks/multilingual/adapters.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual 2025-11-06T16:36:56,636 copying build/lib/lighteval/tasks/multilingual/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual 2025-11-06T16:36:56,639 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks 2025-11-06T16:36:56,640 copying build/lib/lighteval/tasks/tasks/legal_summarization.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,643 copying build/lib/lighteval/tasks/tasks/lsat_qa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,645 copying build/lib/lighteval/tasks/tasks/aimo.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,648 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks/intercode_ctf 2025-11-06T16:36:56,649 copying build/lib/lighteval/tasks/tasks/intercode_ctf/main.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/intercode_ctf 2025-11-06T16:36:56,651 copying build/lib/lighteval/tasks/tasks/mmmu_pro.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,653 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks/tiny_benchmarks 2025-11-06T16:36:56,654 copying build/lib/lighteval/tasks/tasks/tiny_benchmarks/main.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/tiny_benchmarks 2025-11-06T16:36:56,657 copying build/lib/lighteval/tasks/tasks/hellaswag.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,659 copying build/lib/lighteval/tasks/tasks/xcopa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,661 copying build/lib/lighteval/tasks/tasks/babi_qa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,663 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks/ifbench 2025-11-06T16:36:56,665 copying build/lib/lighteval/tasks/tasks/ifbench/main.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifbench 2025-11-06T16:36:56,667 copying build/lib/lighteval/tasks/tasks/ifbench/instructions.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifbench 2025-11-06T16:36:56,671 copying build/lib/lighteval/tasks/tasks/ifbench/evaluation_lib.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifbench 2025-11-06T16:36:56,673 copying build/lib/lighteval/tasks/tasks/ifbench/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifbench 2025-11-06T16:36:56,676 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks/lcb 2025-11-06T16:36:56,677 copying build/lib/lighteval/tasks/tasks/lcb/main.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/lcb 2025-11-06T16:36:56,679 copying build/lib/lighteval/tasks/tasks/lcb/codegen_metrics.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/lcb 2025-11-06T16:36:56,681 copying build/lib/lighteval/tasks/tasks/winogrande.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,683 copying build/lib/lighteval/tasks/tasks/storycloze.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,685 copying build/lib/lighteval/tasks/tasks/blimp.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,688 copying build/lib/lighteval/tasks/tasks/arc_agi_2.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,690 copying build/lib/lighteval/tasks/tasks/mmlu_redux.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,692 copying build/lib/lighteval/tasks/tasks/race_high.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,694 copying build/lib/lighteval/tasks/tasks/legalsupport.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,695 copying build/lib/lighteval/tasks/tasks/mgsm.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,698 copying build/lib/lighteval/tasks/tasks/med.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,700 copying build/lib/lighteval/tasks/tasks/headqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,701 copying build/lib/lighteval/tasks/tasks/arithmetic.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,704 copying build/lib/lighteval/tasks/tasks/slr_bench.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,706 copying build/lib/lighteval/tasks/tasks/commonsenseqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,707 copying build/lib/lighteval/tasks/tasks/simpleqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,709 copying build/lib/lighteval/tasks/tasks/triviaqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,711 copying build/lib/lighteval/tasks/tasks/drop_qa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,713 copying build/lib/lighteval/tasks/tasks/mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,716 copying build/lib/lighteval/tasks/tasks/civil_comments.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,718 copying build/lib/lighteval/tasks/tasks/asdiv.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,719 copying build/lib/lighteval/tasks/tasks/toxigen.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,721 copying build/lib/lighteval/tasks/tasks/numeracy.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,724 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks/olympiade_bench 2025-11-06T16:36:56,725 copying build/lib/lighteval/tasks/tasks/olympiade_bench/main.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/olympiade_bench 2025-11-06T16:36:56,728 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks/mt_bench 2025-11-06T16:36:56,729 copying build/lib/lighteval/tasks/tasks/mt_bench/main.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/mt_bench 2025-11-06T16:36:56,730 copying build/lib/lighteval/tasks/tasks/mt_bench/judge_prompt_templates.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/mt_bench 2025-11-06T16:36:56,733 copying build/lib/lighteval/tasks/tasks/lextreme.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,735 copying build/lib/lighteval/tasks/tasks/math_500.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,737 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks/mix_eval 2025-11-06T16:36:56,738 copying build/lib/lighteval/tasks/tasks/mix_eval/main.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/mix_eval 2025-11-06T16:36:56,740 copying build/lib/lighteval/tasks/tasks/mix_eval/judge_prompts.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/mix_eval 2025-11-06T16:36:56,743 copying build/lib/lighteval/tasks/tasks/mix_eval/prompts.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/mix_eval 2025-11-06T16:36:56,745 copying build/lib/lighteval/tasks/tasks/musr.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,747 copying build/lib/lighteval/tasks/tasks/siqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,749 copying build/lib/lighteval/tasks/tasks/narrativeqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,751 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks/ifeval 2025-11-06T16:36:56,752 copying build/lib/lighteval/tasks/tasks/ifeval/main.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifeval 2025-11-06T16:36:56,755 copying build/lib/lighteval/tasks/tasks/ifeval/instructions_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifeval 2025-11-06T16:36:56,757 copying build/lib/lighteval/tasks/tasks/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifeval 2025-11-06T16:36:56,760 copying build/lib/lighteval/tasks/tasks/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifeval 2025-11-06T16:36:56,762 copying build/lib/lighteval/tasks/tasks/ethics.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,765 copying build/lib/lighteval/tasks/tasks/boolq.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,766 copying build/lib/lighteval/tasks/tasks/entity_data_imputation.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,768 copying build/lib/lighteval/tasks/tasks/imdb.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,770 copying build/lib/lighteval/tasks/tasks/gpqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,772 copying build/lib/lighteval/tasks/tasks/swag.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,774 copying build/lib/lighteval/tasks/tasks/jeopardy.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,776 copying build/lib/lighteval/tasks/tasks/dyck_language.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,778 copying build/lib/lighteval/tasks/tasks/xstory_cloze.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,780 copying build/lib/lighteval/tasks/tasks/sciq.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,782 copying build/lib/lighteval/tasks/tasks/sacrebleu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,785 copying build/lib/lighteval/tasks/tasks/arc.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,786 copying build/lib/lighteval/tasks/tasks/natural_questions.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,788 copying build/lib/lighteval/tasks/tasks/logiqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,790 copying build/lib/lighteval/tasks/tasks/entitymatching.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,792 copying build/lib/lighteval/tasks/tasks/bbq.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,794 copying build/lib/lighteval/tasks/tasks/webqs.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,796 copying build/lib/lighteval/tasks/tasks/glue.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,798 copying build/lib/lighteval/tasks/tasks/anli.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,800 copying build/lib/lighteval/tasks/tasks/squad_v2.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,802 copying build/lib/lighteval/tasks/tasks/gsm8k.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,804 copying build/lib/lighteval/tasks/tasks/bold.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,806 copying build/lib/lighteval/tasks/tasks/pubmedqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,807 copying build/lib/lighteval/tasks/tasks/math.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,810 copying build/lib/lighteval/tasks/tasks/lexglue.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,812 copying build/lib/lighteval/tasks/tasks/gsm_plus.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,814 copying build/lib/lighteval/tasks/tasks/bigbench.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,817 copying build/lib/lighteval/tasks/tasks/prost.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,819 copying build/lib/lighteval/tasks/tasks/lambada.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,821 copying build/lib/lighteval/tasks/tasks/quac.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,823 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks/hle 2025-11-06T16:36:56,824 copying build/lib/lighteval/tasks/tasks/hle/main.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/hle 2025-11-06T16:36:56,827 copying build/lib/lighteval/tasks/tasks/xwinograd.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,829 copying build/lib/lighteval/tasks/tasks/covid_dialogue.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,831 copying build/lib/lighteval/tasks/tasks/qasper.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,832 copying build/lib/lighteval/tasks/tasks/unscramble.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,834 copying build/lib/lighteval/tasks/tasks/coqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,836 copying build/lib/lighteval/tasks/tasks/aime.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,838 copying build/lib/lighteval/tasks/tasks/summarization.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,840 copying build/lib/lighteval/tasks/tasks/mmlu_pro.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,842 copying build/lib/lighteval/tasks/tasks/the_pile.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,844 copying build/lib/lighteval/tasks/tasks/openbookqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,846 copying build/lib/lighteval/tasks/tasks/raft.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,848 copying build/lib/lighteval/tasks/tasks/real_toxicity_prompts.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,850 copying build/lib/lighteval/tasks/tasks/wikifact.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,853 copying build/lib/lighteval/tasks/tasks/twitterAAE.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,855 copying build/lib/lighteval/tasks/tasks/bigbench_hard.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,857 copying build/lib/lighteval/tasks/tasks/piqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,858 copying build/lib/lighteval/tasks/tasks/truthfulqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,860 copying build/lib/lighteval/tasks/tasks/custom_task_classification_grammar_task.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,863 copying build/lib/lighteval/tasks/tasks/qa4mre.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,865 copying build/lib/lighteval/tasks/tasks/med_dialog.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,867 copying build/lib/lighteval/tasks/tasks/mathqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,869 copying build/lib/lighteval/tasks/tasks/agieval.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,871 copying build/lib/lighteval/tasks/tasks/wikitext.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,873 copying build/lib/lighteval/tasks/tasks/synthetic_reasoning.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-06T16:36:56,875 copying build/lib/lighteval/tasks/requests.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks 2025-11-06T16:36:56,878 copying build/lib/lighteval/tasks/default_prompts.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks 2025-11-06T16:36:56,882 copying build/lib/lighteval/tasks/registry.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks 2025-11-06T16:36:56,885 copying build/lib/lighteval/tasks/prompt_manager.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks 2025-11-06T16:36:56,887 copying build/lib/lighteval/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks 2025-11-06T16:36:56,889 creating build/bdist.linux-armv7l/wheel/lighteval/utils 2025-11-06T16:36:56,890 copying build/lib/lighteval/utils/cache_management.py -> build/bdist.linux-armv7l/wheel/./lighteval/utils 2025-11-06T16:36:56,893 copying build/lib/lighteval/utils/parallelism.py -> build/bdist.linux-armv7l/wheel/./lighteval/utils 2025-11-06T16:36:56,895 copying build/lib/lighteval/utils/timeout.py -> build/bdist.linux-armv7l/wheel/./lighteval/utils 2025-11-06T16:36:56,897 copying build/lib/lighteval/utils/language.py -> build/bdist.linux-armv7l/wheel/./lighteval/utils 2025-11-06T16:36:56,900 copying build/lib/lighteval/utils/utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/utils 2025-11-06T16:36:56,902 copying build/lib/lighteval/utils/imports.py -> build/bdist.linux-armv7l/wheel/./lighteval/utils 2025-11-06T16:36:56,904 copying build/lib/lighteval/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/utils 2025-11-06T16:36:56,906 creating build/bdist.linux-armv7l/wheel/lighteval/metrics 2025-11-06T16:36:56,907 copying build/lib/lighteval/metrics/metrics_sample.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics 2025-11-06T16:36:56,910 copying build/lib/lighteval/metrics/metrics.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics 2025-11-06T16:36:56,913 copying build/lib/lighteval/metrics/sample_preparator.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics 2025-11-06T16:36:56,916 creating build/bdist.linux-armv7l/wheel/lighteval/metrics/utils 2025-11-06T16:36:56,917 copying build/lib/lighteval/metrics/utils/judge_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/utils 2025-11-06T16:36:56,919 copying build/lib/lighteval/metrics/utils/math_comparison.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/utils 2025-11-06T16:36:56,922 copying build/lib/lighteval/metrics/utils/metric_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/utils 2025-11-06T16:36:56,924 copying build/lib/lighteval/metrics/utils/linguistic_tokenizers.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/utils 2025-11-06T16:36:56,926 copying build/lib/lighteval/metrics/utils/stderr.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/utils 2025-11-06T16:36:56,929 copying build/lib/lighteval/metrics/utils/llm_as_judge.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/utils 2025-11-06T16:36:56,931 copying build/lib/lighteval/metrics/utils/extractive_match_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/utils 2025-11-06T16:36:56,934 creating build/bdist.linux-armv7l/wheel/lighteval/metrics/harness_compatibility 2025-11-06T16:36:56,935 copying build/lib/lighteval/metrics/harness_compatibility/truthful_qa.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/harness_compatibility 2025-11-06T16:36:56,937 copying build/lib/lighteval/metrics/harness_compatibility/drop.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/harness_compatibility 2025-11-06T16:36:56,940 copying build/lib/lighteval/metrics/metrics_corpus.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics 2025-11-06T16:36:56,942 copying build/lib/lighteval/metrics/normalizations.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics 2025-11-06T16:36:56,945 copying build/lib/lighteval/metrics/dynamic_metrics.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics 2025-11-06T16:36:56,947 copying build/lib/lighteval/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics 2025-11-06T16:36:56,949 creating build/bdist.linux-armv7l/wheel/lighteval/metrics/imports 2025-11-06T16:36:56,950 copying build/lib/lighteval/metrics/imports/bert_scorer.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/imports 2025-11-06T16:36:56,953 copying build/lib/lighteval/metrics/imports/data_stats_metric.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/imports 2025-11-06T16:36:56,955 copying build/lib/lighteval/metrics/imports/data_stats_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/imports 2025-11-06T16:36:56,958 copying build/lib/lighteval/metrics/imports/summac.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/imports 2025-11-06T16:36:56,960 copying build/lib/lighteval/metrics/imports/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/imports 2025-11-06T16:36:56,962 copying build/lib/lighteval/__main__.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-06T16:36:56,964 copying build/lib/lighteval/main_custom.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-06T16:36:56,966 copying build/lib/lighteval/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-06T16:36:56,968 creating build/bdist.linux-armv7l/wheel/lighteval/logging 2025-11-06T16:36:56,969 copying build/lib/lighteval/logging/evaluation_tracker.py -> build/bdist.linux-armv7l/wheel/./lighteval/logging 2025-11-06T16:36:56,972 copying build/lib/lighteval/logging/info_loggers.py -> build/bdist.linux-armv7l/wheel/./lighteval/logging 2025-11-06T16:36:56,975 copying build/lib/lighteval/main_vllm.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-06T16:36:56,977 copying build/lib/lighteval/check_logs.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-06T16:36:56,978 copying build/lib/lighteval/main_endpoint.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-06T16:36:56,981 copying build/lib/lighteval/main_tasks.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-06T16:36:56,982 copying build/lib/lighteval/main_baseline.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-06T16:36:56,984 copying build/lib/lighteval/pipeline.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-06T16:36:56,987 running install_egg_info 2025-11-06T16:36:56,992 Copying src/lighteval.egg-info to build/bdist.linux-armv7l/wheel/./lighteval-0.12.1-py3.11.egg-info 2025-11-06T16:36:57,005 running install_scripts 2025-11-06T16:36:57,017 creating build/bdist.linux-armv7l/wheel/lighteval-0.12.1.dist-info/WHEEL 2025-11-06T16:36:57,020 creating '/tmp/pip-wheel-gqlvpdln/.tmp-64g92hp1/lighteval-0.12.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-11-06T16:36:57,022 adding 'lighteval/__init__.py' 2025-11-06T16:36:57,024 adding 'lighteval/__main__.py' 2025-11-06T16:36:57,025 adding 'lighteval/check_logs.py' 2025-11-06T16:36:57,027 adding 'lighteval/cli_args.py' 2025-11-06T16:36:57,029 adding 'lighteval/data.py' 2025-11-06T16:36:57,031 adding 'lighteval/main_accelerate.py' 2025-11-06T16:36:57,032 adding 'lighteval/main_baseline.py' 2025-11-06T16:36:57,034 adding 'lighteval/main_custom.py' 2025-11-06T16:36:57,036 adding 'lighteval/main_endpoint.py' 2025-11-06T16:36:57,039 adding 'lighteval/main_inspect.py' 2025-11-06T16:36:57,040 adding 'lighteval/main_nanotron.py' 2025-11-06T16:36:57,042 adding 'lighteval/main_sglang.py' 2025-11-06T16:36:57,043 adding 'lighteval/main_tasks.py' 2025-11-06T16:36:57,045 adding 'lighteval/main_vllm.py' 2025-11-06T16:36:57,047 adding 'lighteval/pipeline.py' 2025-11-06T16:36:57,052 adding 'lighteval/logging/evaluation_tracker.py' 2025-11-06T16:36:57,055 adding 'lighteval/logging/info_loggers.py' 2025-11-06T16:36:57,057 adding 'lighteval/metrics/__init__.py' 2025-11-06T16:36:57,059 adding 'lighteval/metrics/dynamic_metrics.py' 2025-11-06T16:36:57,062 adding 'lighteval/metrics/metrics.py' 2025-11-06T16:36:57,064 adding 'lighteval/metrics/metrics_corpus.py' 2025-11-06T16:36:57,070 adding 'lighteval/metrics/metrics_sample.py' 2025-11-06T16:36:57,073 adding 'lighteval/metrics/normalizations.py' 2025-11-06T16:36:57,075 adding 'lighteval/metrics/sample_preparator.py' 2025-11-06T16:36:57,077 adding 'lighteval/metrics/harness_compatibility/drop.py' 2025-11-06T16:36:57,079 adding 'lighteval/metrics/harness_compatibility/truthful_qa.py' 2025-11-06T16:36:57,081 adding 'lighteval/metrics/imports/__init__.py' 2025-11-06T16:36:57,083 adding 'lighteval/metrics/imports/bert_scorer.py' 2025-11-06T16:36:57,085 adding 'lighteval/metrics/imports/data_stats_metric.py' 2025-11-06T16:36:57,087 adding 'lighteval/metrics/imports/data_stats_utils.py' 2025-11-06T16:36:57,089 adding 'lighteval/metrics/imports/summac.py' 2025-11-06T16:36:57,093 adding 'lighteval/metrics/utils/extractive_match_utils.py' 2025-11-06T16:36:57,095 adding 'lighteval/metrics/utils/judge_utils.py' 2025-11-06T16:36:57,097 adding 'lighteval/metrics/utils/linguistic_tokenizers.py' 2025-11-06T16:36:57,100 adding 'lighteval/metrics/utils/llm_as_judge.py' 2025-11-06T16:36:57,103 adding 'lighteval/metrics/utils/math_comparison.py' 2025-11-06T16:36:57,105 adding 'lighteval/metrics/utils/metric_utils.py' 2025-11-06T16:36:57,107 adding 'lighteval/metrics/utils/stderr.py' 2025-11-06T16:36:57,109 adding 'lighteval/models/abstract_model.py' 2025-11-06T16:36:57,111 adding 'lighteval/models/model_input.py' 2025-11-06T16:36:57,112 adding 'lighteval/models/model_loader.py' 2025-11-06T16:36:57,114 adding 'lighteval/models/model_output.py' 2025-11-06T16:36:57,116 adding 'lighteval/models/utils.py' 2025-11-06T16:36:57,118 adding 'lighteval/models/custom/custom_model.py' 2025-11-06T16:36:57,120 adding 'lighteval/models/dummy/dummy_model.py' 2025-11-06T16:36:57,124 adding 'lighteval/models/endpoints/endpoint_model.py' 2025-11-06T16:36:57,126 adding 'lighteval/models/endpoints/inference_providers_model.py' 2025-11-06T16:36:57,129 adding 'lighteval/models/endpoints/litellm_model.py' 2025-11-06T16:36:57,131 adding 'lighteval/models/endpoints/tgi_model.py' 2025-11-06T16:36:57,137 adding 'lighteval/models/nanotron/nanotron_model.py' 2025-11-06T16:36:57,141 adding 'lighteval/models/sglang/sglang_model.py' 2025-11-06T16:36:57,143 adding 'lighteval/models/transformers/adapter_model.py' 2025-11-06T16:36:57,144 adding 'lighteval/models/transformers/delta_model.py' 2025-11-06T16:36:57,151 adding 'lighteval/models/transformers/transformers_model.py' 2025-11-06T16:36:57,154 adding 'lighteval/models/transformers/vlm_transformers_model.py' 2025-11-06T16:36:57,159 adding 'lighteval/models/vllm/vllm_model.py' 2025-11-06T16:36:57,161 adding 'lighteval/tasks/__init__.py' 2025-11-06T16:36:57,173 adding 'lighteval/tasks/default_prompts.py' 2025-11-06T16:36:57,176 adding 'lighteval/tasks/lighteval_task.py' 2025-11-06T16:36:57,178 adding 'lighteval/tasks/prompt_manager.py' 2025-11-06T16:36:57,181 adding 'lighteval/tasks/registry.py' 2025-11-06T16:36:57,183 adding 'lighteval/tasks/requests.py' 2025-11-06T16:36:57,185 adding 'lighteval/tasks/multilingual/__init__.py' 2025-11-06T16:36:57,187 adding 'lighteval/tasks/multilingual/adapters.py' 2025-11-06T16:36:57,191 adding 'lighteval/tasks/multilingual/tasks/acva.py' 2025-11-06T16:36:57,192 adding 'lighteval/tasks/multilingual/tasks/afri_mgsm.py' 2025-11-06T16:36:57,193 adding 'lighteval/tasks/multilingual/tasks/afri_mmlu.py' 2025-11-06T16:36:57,195 adding 'lighteval/tasks/multilingual/tasks/afri_xnli.py' 2025-11-06T16:36:57,198 adding 'lighteval/tasks/multilingual/tasks/arabic.py' 2025-11-06T16:36:57,200 adding 'lighteval/tasks/multilingual/tasks/arabic_arc.py' 2025-11-06T16:36:57,202 adding 'lighteval/tasks/multilingual/tasks/arabic_mmlu.py' 2025-11-06T16:36:57,203 adding 'lighteval/tasks/multilingual/tasks/arcd.py' 2025-11-06T16:36:57,205 adding 'lighteval/tasks/multilingual/tasks/belebele.py' 2025-11-06T16:36:57,206 adding 'lighteval/tasks/multilingual/tasks/c3.py' 2025-11-06T16:36:57,208 adding 'lighteval/tasks/multilingual/tasks/ceval.py' 2025-11-06T16:36:57,209 adding 'lighteval/tasks/multilingual/tasks/chegeka.py' 2025-11-06T16:36:57,211 adding 'lighteval/tasks/multilingual/tasks/chinese_squad.py' 2025-11-06T16:36:57,212 adding 'lighteval/tasks/multilingual/tasks/cmath.py' 2025-11-06T16:36:57,214 adding 'lighteval/tasks/multilingual/tasks/cmmlu.py' 2025-11-06T16:36:57,215 adding 'lighteval/tasks/multilingual/tasks/cmnli.py' 2025-11-06T16:36:57,217 adding 'lighteval/tasks/multilingual/tasks/cmrc2018.py' 2025-11-06T16:36:57,218 adding 'lighteval/tasks/multilingual/tasks/copa_indic.py' 2025-11-06T16:36:57,219 adding 'lighteval/tasks/multilingual/tasks/enem.py' 2025-11-06T16:36:57,221 adding 'lighteval/tasks/multilingual/tasks/exams.py' 2025-11-06T16:36:57,222 adding 'lighteval/tasks/multilingual/tasks/faquad.py' 2025-11-06T16:36:57,224 adding 'lighteval/tasks/multilingual/tasks/filipino.py' 2025-11-06T16:36:57,226 adding 'lighteval/tasks/multilingual/tasks/flores200.py' 2025-11-06T16:36:57,228 adding 'lighteval/tasks/multilingual/tasks/fquad_v2.py' 2025-11-06T16:36:57,229 adding 'lighteval/tasks/multilingual/tasks/french.py' 2025-11-06T16:36:57,230 adding 'lighteval/tasks/multilingual/tasks/french_boolq.py' 2025-11-06T16:36:57,232 adding 'lighteval/tasks/multilingual/tasks/french_triviqa.py' 2025-11-06T16:36:57,233 adding 'lighteval/tasks/multilingual/tasks/german_rag.py' 2025-11-06T16:36:57,234 adding 'lighteval/tasks/multilingual/tasks/germanquad.py' 2025-11-06T16:36:57,236 adding 'lighteval/tasks/multilingual/tasks/global_mmlu.py' 2025-11-06T16:36:57,237 adding 'lighteval/tasks/multilingual/tasks/hellaswag_hin.py' 2025-11-06T16:36:57,239 adding 'lighteval/tasks/multilingual/tasks/hellaswag_tel.py' 2025-11-06T16:36:57,240 adding 'lighteval/tasks/multilingual/tasks/hellaswag_tha.py' 2025-11-06T16:36:57,241 adding 'lighteval/tasks/multilingual/tasks/hellaswag_tur.py' 2025-11-06T16:36:57,242 adding 'lighteval/tasks/multilingual/tasks/hindi_arc.py' 2025-11-06T16:36:57,244 adding 'lighteval/tasks/multilingual/tasks/hindi_boolq.py' 2025-11-06T16:36:57,245 adding 'lighteval/tasks/multilingual/tasks/indicqa.py' 2025-11-06T16:36:57,246 adding 'lighteval/tasks/multilingual/tasks/kenswquad.py' 2025-11-06T16:36:57,248 adding 'lighteval/tasks/multilingual/tasks/m3exams.py' 2025-11-06T16:36:57,249 adding 'lighteval/tasks/multilingual/tasks/mathlogicqa_rus.py' 2025-11-06T16:36:57,251 adding 'lighteval/tasks/multilingual/tasks/meta_mmlu.py' 2025-11-06T16:36:57,252 adding 'lighteval/tasks/multilingual/tasks/mgsm.py' 2025-11-06T16:36:57,253 adding 'lighteval/tasks/multilingual/tasks/mintaka.py' 2025-11-06T16:36:57,255 adding 'lighteval/tasks/multilingual/tasks/mkqa.py' 2025-11-06T16:36:57,256 adding 'lighteval/tasks/multilingual/tasks/mlmm_arc_challenge.py' 2025-11-06T16:36:57,257 adding 'lighteval/tasks/multilingual/tasks/mlmm_hellaswag.py' 2025-11-06T16:36:57,259 adding 'lighteval/tasks/multilingual/tasks/mlmm_mmlu.py' 2025-11-06T16:36:57,260 adding 'lighteval/tasks/multilingual/tasks/mlmm_truthfulqa.py' 2025-11-06T16:36:57,261 adding 'lighteval/tasks/multilingual/tasks/mlqa.py' 2025-11-06T16:36:57,263 adding 'lighteval/tasks/multilingual/tasks/oab_exams.py' 2025-11-06T16:36:57,264 adding 'lighteval/tasks/multilingual/tasks/ocnli.py' 2025-11-06T16:36:57,265 adding 'lighteval/tasks/multilingual/tasks/openai_mmlu.py' 2025-11-06T16:36:57,267 adding 'lighteval/tasks/multilingual/tasks/openbook_ara.py' 2025-11-06T16:36:57,268 adding 'lighteval/tasks/multilingual/tasks/openbook_es.py' 2025-11-06T16:36:57,269 adding 'lighteval/tasks/multilingual/tasks/openbook_rus.py' 2025-11-06T16:36:57,271 adding 'lighteval/tasks/multilingual/tasks/oz.py' 2025-11-06T16:36:57,272 adding 'lighteval/tasks/multilingual/tasks/parus.py' 2025-11-06T16:36:57,273 adding 'lighteval/tasks/multilingual/tasks/paws_x.py' 2025-11-06T16:36:57,275 adding 'lighteval/tasks/multilingual/tasks/piqa_ar.py' 2025-11-06T16:36:57,276 adding 'lighteval/tasks/multilingual/tasks/rcb.py' 2025-11-06T16:36:57,277 adding 'lighteval/tasks/multilingual/tasks/sber_squad.py' 2025-11-06T16:36:57,280 adding 'lighteval/tasks/multilingual/tasks/serbian_eval.py' 2025-11-06T16:36:57,281 adding 'lighteval/tasks/multilingual/tasks/soqal.py' 2025-11-06T16:36:57,283 adding 'lighteval/tasks/multilingual/tasks/squad_es.py' 2025-11-06T16:36:57,284 adding 'lighteval/tasks/multilingual/tasks/squad_it.py' 2025-11-06T16:36:57,285 adding 'lighteval/tasks/multilingual/tasks/swahili_arc.py' 2025-11-06T16:36:57,287 adding 'lighteval/tasks/multilingual/tasks/thai_exams.py' 2025-11-06T16:36:57,288 adding 'lighteval/tasks/multilingual/tasks/thaiqa.py' 2025-11-06T16:36:57,289 adding 'lighteval/tasks/multilingual/tasks/tquad_v2.py' 2025-11-06T16:36:57,291 adding 'lighteval/tasks/multilingual/tasks/turkic.py' 2025-11-06T16:36:57,292 adding 'lighteval/tasks/multilingual/tasks/turkish_arc.py' 2025-11-06T16:36:57,294 adding 'lighteval/tasks/multilingual/tasks/turkish_mmlu.py' 2025-11-06T16:36:57,295 adding 'lighteval/tasks/multilingual/tasks/tydiqa.py' 2025-11-06T16:36:57,296 adding 'lighteval/tasks/multilingual/tasks/worldtree_rus.py' 2025-11-06T16:36:57,298 adding 'lighteval/tasks/multilingual/tasks/xcodah.py' 2025-11-06T16:36:57,299 adding 'lighteval/tasks/multilingual/tasks/xcopa.py' 2025-11-06T16:36:57,300 adding 'lighteval/tasks/multilingual/tasks/xcsqa.py' 2025-11-06T16:36:57,302 adding 'lighteval/tasks/multilingual/tasks/xnli.py' 2025-11-06T16:36:57,303 adding 'lighteval/tasks/multilingual/tasks/xnli2.py' 2025-11-06T16:36:57,304 adding 'lighteval/tasks/multilingual/tasks/xnli_indic.py' 2025-11-06T16:36:57,305 adding 'lighteval/tasks/multilingual/tasks/xquad.py' 2025-11-06T16:36:57,307 adding 'lighteval/tasks/multilingual/tasks/xstory.py' 2025-11-06T16:36:57,308 adding 'lighteval/tasks/multilingual/tasks/xwinograd.py' 2025-11-06T16:36:57,309 adding 'lighteval/tasks/multilingual/utils/__init__.py' 2025-11-06T16:36:57,311 adding 'lighteval/tasks/multilingual/utils/adapters_utils.py' 2025-11-06T16:36:57,312 adding 'lighteval/tasks/multilingual/utils/task_utils.py' 2025-11-06T16:36:57,315 adding 'lighteval/tasks/tasks/agieval.py' 2025-11-06T16:36:57,317 adding 'lighteval/tasks/tasks/aime.py' 2025-11-06T16:36:57,318 adding 'lighteval/tasks/tasks/aimo.py' 2025-11-06T16:36:57,319 adding 'lighteval/tasks/tasks/anli.py' 2025-11-06T16:36:57,321 adding 'lighteval/tasks/tasks/arc.py' 2025-11-06T16:36:57,322 adding 'lighteval/tasks/tasks/arc_agi_2.py' 2025-11-06T16:36:57,323 adding 'lighteval/tasks/tasks/arithmetic.py' 2025-11-06T16:36:57,324 adding 'lighteval/tasks/tasks/asdiv.py' 2025-11-06T16:36:57,326 adding 'lighteval/tasks/tasks/babi_qa.py' 2025-11-06T16:36:57,327 adding 'lighteval/tasks/tasks/bbq.py' 2025-11-06T16:36:57,331 adding 'lighteval/tasks/tasks/bigbench.py' 2025-11-06T16:36:57,333 adding 'lighteval/tasks/tasks/bigbench_hard.py' 2025-11-06T16:36:57,335 adding 'lighteval/tasks/tasks/blimp.py' 2025-11-06T16:36:57,336 adding 'lighteval/tasks/tasks/bold.py' 2025-11-06T16:36:57,337 adding 'lighteval/tasks/tasks/boolq.py' 2025-11-06T16:36:57,339 adding 'lighteval/tasks/tasks/civil_comments.py' 2025-11-06T16:36:57,340 adding 'lighteval/tasks/tasks/commonsenseqa.py' 2025-11-06T16:36:57,341 adding 'lighteval/tasks/tasks/coqa.py' 2025-11-06T16:36:57,343 adding 'lighteval/tasks/tasks/covid_dialogue.py' 2025-11-06T16:36:57,345 adding 'lighteval/tasks/tasks/custom_task_classification_grammar_task.py' 2025-11-06T16:36:57,346 adding 'lighteval/tasks/tasks/drop_qa.py' 2025-11-06T16:36:57,348 adding 'lighteval/tasks/tasks/dyck_language.py' 2025-11-06T16:36:57,349 adding 'lighteval/tasks/tasks/entity_data_imputation.py' 2025-11-06T16:36:57,350 adding 'lighteval/tasks/tasks/entitymatching.py' 2025-11-06T16:36:57,352 adding 'lighteval/tasks/tasks/ethics.py' 2025-11-06T16:36:57,353 adding 'lighteval/tasks/tasks/glue.py' 2025-11-06T16:36:57,354 adding 'lighteval/tasks/tasks/gpqa.py' 2025-11-06T16:36:57,356 adding 'lighteval/tasks/tasks/gsm8k.py' 2025-11-06T16:36:57,357 adding 'lighteval/tasks/tasks/gsm_plus.py' 2025-11-06T16:36:57,358 adding 'lighteval/tasks/tasks/headqa.py' 2025-11-06T16:36:57,360 adding 'lighteval/tasks/tasks/hellaswag.py' 2025-11-06T16:36:57,361 adding 'lighteval/tasks/tasks/imdb.py' 2025-11-06T16:36:57,362 adding 'lighteval/tasks/tasks/jeopardy.py' 2025-11-06T16:36:57,363 adding 'lighteval/tasks/tasks/lambada.py' 2025-11-06T16:36:57,365 adding 'lighteval/tasks/tasks/legal_summarization.py' 2025-11-06T16:36:57,366 adding 'lighteval/tasks/tasks/legalsupport.py' 2025-11-06T16:36:57,368 adding 'lighteval/tasks/tasks/lexglue.py' 2025-11-06T16:36:57,370 adding 'lighteval/tasks/tasks/lextreme.py' 2025-11-06T16:36:57,371 adding 'lighteval/tasks/tasks/logiqa.py' 2025-11-06T16:36:57,372 adding 'lighteval/tasks/tasks/lsat_qa.py' 2025-11-06T16:36:57,374 adding 'lighteval/tasks/tasks/math.py' 2025-11-06T16:36:57,375 adding 'lighteval/tasks/tasks/math_500.py' 2025-11-06T16:36:57,376 adding 'lighteval/tasks/tasks/mathqa.py' 2025-11-06T16:36:57,377 adding 'lighteval/tasks/tasks/med.py' 2025-11-06T16:36:57,379 adding 'lighteval/tasks/tasks/med_dialog.py' 2025-11-06T16:36:57,380 adding 'lighteval/tasks/tasks/mgsm.py' 2025-11-06T16:36:57,382 adding 'lighteval/tasks/tasks/mmlu.py' 2025-11-06T16:36:57,384 adding 'lighteval/tasks/tasks/mmlu_pro.py' 2025-11-06T16:36:57,385 adding 'lighteval/tasks/tasks/mmlu_redux.py' 2025-11-06T16:36:57,386 adding 'lighteval/tasks/tasks/mmmu_pro.py' 2025-11-06T16:36:57,387 adding 'lighteval/tasks/tasks/musr.py' 2025-11-06T16:36:57,389 adding 'lighteval/tasks/tasks/narrativeqa.py' 2025-11-06T16:36:57,390 adding 'lighteval/tasks/tasks/natural_questions.py' 2025-11-06T16:36:57,391 adding 'lighteval/tasks/tasks/numeracy.py' 2025-11-06T16:36:57,392 adding 'lighteval/tasks/tasks/openbookqa.py' 2025-11-06T16:36:57,393 adding 'lighteval/tasks/tasks/piqa.py' 2025-11-06T16:36:57,395 adding 'lighteval/tasks/tasks/prost.py' 2025-11-06T16:36:57,396 adding 'lighteval/tasks/tasks/pubmedqa.py' 2025-11-06T16:36:57,397 adding 'lighteval/tasks/tasks/qa4mre.py' 2025-11-06T16:36:57,398 adding 'lighteval/tasks/tasks/qasper.py' 2025-11-06T16:36:57,400 adding 'lighteval/tasks/tasks/quac.py' 2025-11-06T16:36:57,401 adding 'lighteval/tasks/tasks/race_high.py' 2025-11-06T16:36:57,402 adding 'lighteval/tasks/tasks/raft.py' 2025-11-06T16:36:57,403 adding 'lighteval/tasks/tasks/real_toxicity_prompts.py' 2025-11-06T16:36:57,407 adding 'lighteval/tasks/tasks/sacrebleu.py' 2025-11-06T16:36:57,409 adding 'lighteval/tasks/tasks/sciq.py' 2025-11-06T16:36:57,410 adding 'lighteval/tasks/tasks/simpleqa.py' 2025-11-06T16:36:57,411 adding 'lighteval/tasks/tasks/siqa.py' 2025-11-06T16:36:57,413 adding 'lighteval/tasks/tasks/slr_bench.py' 2025-11-06T16:36:57,414 adding 'lighteval/tasks/tasks/squad_v2.py' 2025-11-06T16:36:57,415 adding 'lighteval/tasks/tasks/storycloze.py' 2025-11-06T16:36:57,416 adding 'lighteval/tasks/tasks/summarization.py' 2025-11-06T16:36:57,418 adding 'lighteval/tasks/tasks/swag.py' 2025-11-06T16:36:57,419 adding 'lighteval/tasks/tasks/synthetic_reasoning.py' 2025-11-06T16:36:57,420 adding 'lighteval/tasks/tasks/the_pile.py' 2025-11-06T16:36:57,422 adding 'lighteval/tasks/tasks/toxigen.py' 2025-11-06T16:36:57,423 adding 'lighteval/tasks/tasks/triviaqa.py' 2025-11-06T16:36:57,424 adding 'lighteval/tasks/tasks/truthfulqa.py' 2025-11-06T16:36:57,426 adding 'lighteval/tasks/tasks/twitterAAE.py' 2025-11-06T16:36:57,427 adding 'lighteval/tasks/tasks/unscramble.py' 2025-11-06T16:36:57,428 adding 'lighteval/tasks/tasks/webqs.py' 2025-11-06T16:36:57,430 adding 'lighteval/tasks/tasks/wikifact.py' 2025-11-06T16:36:57,432 adding 'lighteval/tasks/tasks/wikitext.py' 2025-11-06T16:36:57,433 adding 'lighteval/tasks/tasks/winogrande.py' 2025-11-06T16:36:57,434 adding 'lighteval/tasks/tasks/xcopa.py' 2025-11-06T16:36:57,436 adding 'lighteval/tasks/tasks/xstory_cloze.py' 2025-11-06T16:36:57,437 adding 'lighteval/tasks/tasks/xwinograd.py' 2025-11-06T16:36:57,439 adding 'lighteval/tasks/tasks/hle/main.py' 2025-11-06T16:36:57,442 adding 'lighteval/tasks/tasks/ifbench/evaluation_lib.py' 2025-11-06T16:36:57,450 adding 'lighteval/tasks/tasks/ifbench/instructions.py' 2025-11-06T16:36:57,452 adding 'lighteval/tasks/tasks/ifbench/instructions_registry.py' 2025-11-06T16:36:57,453 adding 'lighteval/tasks/tasks/ifbench/main.py' 2025-11-06T16:36:57,459 adding 'lighteval/tasks/tasks/ifeval/instructions.py' 2025-11-06T16:36:57,461 adding 'lighteval/tasks/tasks/ifeval/instructions_registry.py' 2025-11-06T16:36:57,464 adding 'lighteval/tasks/tasks/ifeval/instructions_utils.py' 2025-11-06T16:36:57,466 adding 'lighteval/tasks/tasks/ifeval/main.py' 2025-11-06T16:36:57,468 adding 'lighteval/tasks/tasks/intercode_ctf/main.py' 2025-11-06T16:36:57,471 adding 'lighteval/tasks/tasks/lcb/codegen_metrics.py' 2025-11-06T16:36:57,473 adding 'lighteval/tasks/tasks/lcb/main.py' 2025-11-06T16:36:57,476 adding 'lighteval/tasks/tasks/mix_eval/judge_prompts.py' 2025-11-06T16:36:57,477 adding 'lighteval/tasks/tasks/mix_eval/main.py' 2025-11-06T16:36:57,479 adding 'lighteval/tasks/tasks/mix_eval/prompts.py' 2025-11-06T16:36:57,482 adding 'lighteval/tasks/tasks/mt_bench/judge_prompt_templates.py' 2025-11-06T16:36:57,483 adding 'lighteval/tasks/tasks/mt_bench/main.py' 2025-11-06T16:36:57,485 adding 'lighteval/tasks/tasks/olympiade_bench/main.py' 2025-11-06T16:36:57,487 adding 'lighteval/tasks/tasks/tiny_benchmarks/main.py' 2025-11-06T16:36:57,489 adding 'lighteval/tasks/templates/__init__.py' 2025-11-06T16:36:57,491 adding 'lighteval/tasks/templates/boolq.py' 2025-11-06T16:36:57,492 adding 'lighteval/tasks/templates/continuation.py' 2025-11-06T16:36:57,494 adding 'lighteval/tasks/templates/copa.py' 2025-11-06T16:36:57,495 adding 'lighteval/tasks/templates/hellaswag.py' 2025-11-06T16:36:57,497 adding 'lighteval/tasks/templates/multichoice.py' 2025-11-06T16:36:57,499 adding 'lighteval/tasks/templates/nli.py' 2025-11-06T16:36:57,500 adding 'lighteval/tasks/templates/qa.py' 2025-11-06T16:36:57,502 adding 'lighteval/tasks/templates/translation.py' 2025-11-06T16:36:57,503 adding 'lighteval/tasks/templates/utils/__init__.py' 2025-11-06T16:36:57,505 adding 'lighteval/tasks/templates/utils/adapter_utils.py' 2025-11-06T16:36:57,506 adding 'lighteval/tasks/templates/utils/formatting_utils.py' 2025-11-06T16:36:57,508 adding 'lighteval/tasks/templates/utils/formulation.py' 2025-11-06T16:36:57,512 adding 'lighteval/tasks/templates/utils/translation_literals.py' 2025-11-06T16:36:57,514 adding 'lighteval/utils/__init__.py' 2025-11-06T16:36:57,516 adding 'lighteval/utils/cache_management.py' 2025-11-06T16:36:57,518 adding 'lighteval/utils/imports.py' 2025-11-06T16:36:57,520 adding 'lighteval/utils/language.py' 2025-11-06T16:36:57,522 adding 'lighteval/utils/parallelism.py' 2025-11-06T16:36:57,523 adding 'lighteval/utils/timeout.py' 2025-11-06T16:36:57,525 adding 'lighteval/utils/utils.py' 2025-11-06T16:36:57,528 adding 'lighteval-0.12.1.dist-info/licenses/LICENSE' 2025-11-06T16:36:57,530 adding 'lighteval-0.12.1.dist-info/METADATA' 2025-11-06T16:36:57,531 adding 'lighteval-0.12.1.dist-info/WHEEL' 2025-11-06T16:36:57,532 adding 'lighteval-0.12.1.dist-info/entry_points.txt' 2025-11-06T16:36:57,533 adding 'lighteval-0.12.1.dist-info/top_level.txt' 2025-11-06T16:36:57,537 adding 'lighteval-0.12.1.dist-info/RECORD' 2025-11-06T16:36:57,550 removing build/bdist.linux-armv7l/wheel 2025-11-06T16:36:57,719 Building wheel for lighteval (pyproject.toml): finished with status 'done' 2025-11-06T16:36:57,738 Created wheel for lighteval: filename=lighteval-0.12.1-py3-none-any.whl size=604030 sha256=a489e86789e9c16786dc62dce35176be38b722dc05cbde1b9570456958fb8395 2025-11-06T16:36:57,739 Stored in directory: /tmp/pip-ephem-wheel-cache-wbxx561l/wheels/75/70/bf/fde298ba611d605de2f389249c7eb812e18547f730ae95f854 2025-11-06T16:36:57,763 Successfully built lighteval 2025-11-06T16:36:57,780 Removed build tracker: '/tmp/pip-build-tracker-sfsplujq'