2025-11-24T17:02:31,288 Created temporary directory: /tmp/pip-ephem-wheel-cache-8vcqimkv 2025-11-24T17:02:31,290 Created temporary directory: /tmp/pip-build-tracker-d45nussh 2025-11-24T17:02:31,291 Initialized build tracking at /tmp/pip-build-tracker-d45nussh 2025-11-24T17:02:31,291 Created build tracker: /tmp/pip-build-tracker-d45nussh 2025-11-24T17:02:31,291 Entered build tracker: /tmp/pip-build-tracker-d45nussh 2025-11-24T17:02:31,292 Created temporary directory: /tmp/pip-wheel-873hg87t 2025-11-24T17:02:31,295 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2025-11-24T17:02:31,298 Created temporary directory: /tmp/pip-ephem-wheel-cache-q08jr1wv 2025-11-24T17:02:31,323 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-11-24T17:02:31,326 2 location(s) to search for versions of lighteval: 2025-11-24T17:02:31,326 * https://pypi.org/simple/lighteval/ 2025-11-24T17:02:31,326 * https://www.piwheels.org/simple/lighteval/ 2025-11-24T17:02:31,327 Fetching project page and analyzing links: https://pypi.org/simple/lighteval/ 2025-11-24T17:02:31,328 Getting page https://pypi.org/simple/lighteval/ 2025-11-24T17:02:31,329 Found index url https://pypi.org/simple 2025-11-24T17:02:31,548 Fetched page https://pypi.org/simple/lighteval/ as application/vnd.pypi.simple.v1+json 2025-11-24T17:02:31,556 Found link https://files.pythonhosted.org/packages/91/70/3a0c520287b432278921dafe9b4b20e4d639ecb62a1cdb8dfc14a7cf1122/lighteval-0.0.1.tar.gz (from https://pypi.org/simple/lighteval/), version: 0.0.1 2025-11-24T17:02:31,557 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/83/b0/7dbdeffab3e2d3a0791f1747818c65c3e76e4c343593712aaaee990bea93/lighteval-0.0.2-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,558 Found link https://files.pythonhosted.org/packages/b5/e9/30eaccb5bfb4ca9802bbc3b105b7c8888bdd9bff72d7a7b85ffcb6cd4ad1/lighteval-0.0.2.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.0.2 2025-11-24T17:02:31,559 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/ce/22/8e9fb7ef899f757df0eafed9e29fd8db9d4c694a3ba7e276bedc5c8a4dc3/lighteval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,560 Found link https://files.pythonhosted.org/packages/72/c3/07b4cb157f8fa1c0465c32f505418de1df659c67b2bbfa543c5bc9ff9dde/lighteval-0.1.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.1.0 2025-11-24T17:02:31,561 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/af/d8/92cee84f102f5c801240e90e6380a1f2958aa8ae977fe3f7a6b9804214a0/lighteval-0.1.1.dev0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,562 Found link https://files.pythonhosted.org/packages/73/b2/0b510938a01164061a56b871af8b138f4ade7fdea6bb96ed5180e345ba2a/lighteval-0.1.1.dev0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.1.1.dev0 2025-11-24T17:02:31,563 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/a4/f7/9385103352347eaa2500b3060929a2242143db19c937eb56e488753a4d99/lighteval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,564 Found link https://files.pythonhosted.org/packages/aa/10/97c3a28e599d930aefaa173edc596980df23dc593883a5b0a3ad00c0e2f5/lighteval-0.1.1.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.1.1 2025-11-24T17:02:31,565 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/51/0b/304021094a01fbc94a98b7729b2044106475b23286031083fa9217fea981/lighteval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,566 Found link https://files.pythonhosted.org/packages/c2/b3/dc97dfbdd406d8ce4a7f50d86ef5a24d561e4bfb649783da0807f7cc6cb8/lighteval-0.2.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.2.0 2025-11-24T17:02:31,567 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/14/e2/4c1dc89e6a6c71c6d4745ffd1657e57ca4381dfc48d2c2af6d38215f9f01/lighteval-0.3.0a0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,568 Found link https://files.pythonhosted.org/packages/e9/5f/9bff4b2f649b9838411bf5a3e29b8eaef0287baee2af56419c7845f43a25/lighteval-0.3.0a0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.3.0a0 2025-11-24T17:02:31,568 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/f5/e7/33f933d80fe537dacdf2677df18437ba8b90e6228936564dd246c295809a/lighteval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,569 Found link https://files.pythonhosted.org/packages/02/d7/8c52ae664c106385547c5e895b8614b58eb97e1a721ccee0e278739bd0ff/lighteval-0.3.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.3.0 2025-11-24T17:02:31,570 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/e9/b4/27c6f424b053b66cec7c66dd57823089d5349164dcc82a965f1b230831c5/lighteval-0.4.0a0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,571 Found link https://files.pythonhosted.org/packages/a1/9d/52971d034e2fda19bee1f31bbc8e8683eee2a4807b530e3d2fc50215ef37/lighteval-0.4.0a0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.4.0a0 2025-11-24T17:02:31,572 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/c5/3e/ceea138f6702f5dd010544b75606ba2f51a48ae0bbcb3fb1051216beb68e/lighteval-0.5.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,573 Found link https://files.pythonhosted.org/packages/b9/72/2cbd211318e1dd4ab6653cfe96672dfd68d17a02e762f09b14e8cd7bb6f3/lighteval-0.5.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.5.0 2025-11-24T17:02:31,573 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/ba/f8/c3f757064572b62ef63cb8e45e093245b0327e9f8e1c93f2aa57e227a33e/lighteval-0.6.2-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,574 Found link https://files.pythonhosted.org/packages/65/dd/547f2af88bc4c56ce19123f66701cdc5762f33cc9b49bedb19ae03b26fcd/lighteval-0.6.2.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.6.2 2025-11-24T17:02:31,575 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/86/d8/655d36dcee8f56dae06321448da2d19c8c780051fa5b171f35fae91f7e18/lighteval-0.7.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,576 Found link https://files.pythonhosted.org/packages/65/e1/bd70449c07c6b4259cc8395ab3c8cc6e433a920084bbe12fe651bc3480d0/lighteval-0.7.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.7.0 2025-11-24T17:02:31,577 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/52/88/8c120913b07a1a828b7c2874055a022e2ce098327736ca7602d14d323ad7/lighteval-0.8.1-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,578 Found link https://files.pythonhosted.org/packages/11/4d/9387d49759cc02c9f546ec7e9975a19e88ff573170823153375e58a34c4a/lighteval-0.8.1.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.8.1 2025-11-24T17:02:31,578 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/34/fe/4a5ddcc73f9a8f320c47a1c65f497f8c2d8733730e621407536bba612e6f/lighteval-0.9.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,580 Found link https://files.pythonhosted.org/packages/a3/0c/1d849e968023263f4b96952aa04a11c522eb8ad241262c1705e9a13f1762/lighteval-0.9.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.9.0 2025-11-24T17:02:31,580 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/7a/1c/3bbd71a3c2402661eeda4417202cccd832105d92454c1fa531ef07b4d7ec/lighteval-0.9.1-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,581 Found link https://files.pythonhosted.org/packages/2d/dc/6a41ed7d2eb4c09c607138c97fae2fdb64db5d1b9e9e198da061e8894051/lighteval-0.9.1.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.9.1 2025-11-24T17:02:31,582 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/ae/d6/ee335f2524642a7443cc113da0101d350273d42ba4eac7f637bd44db5d0e/lighteval-0.9.2-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,583 Found link https://files.pythonhosted.org/packages/2e/2c/822126ca365cde3cedc91e9e5beaf6d33168ce18261f982686d1c4447670/lighteval-0.9.2.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.9.2 2025-11-24T17:02:31,583 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/7c/8e/d48315622c38086b94d8274edc5c3630be03befcce36a5ef318e0d278f0b/lighteval-0.10.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,584 Found link https://files.pythonhosted.org/packages/e9/2c/8232d77ba5c22342a21ed313556a8cc998e63c5ff10b2f87947527822d8b/lighteval-0.10.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.10.0 2025-11-24T17:02:31,585 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/d3/ba/bf0a54eb1969cae565703addcecb923d19aa7d2bccc6182f388c66b6980b/lighteval-0.11.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,586 Found link https://files.pythonhosted.org/packages/e6/a2/50e2251012de8587442d39485946bc2e579bb63551757389c60cd20ce6cd/lighteval-0.11.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.11.0 2025-11-24T17:02:31,587 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/d6/34/4b438b81badd48672b8e72e721d0bdcdee0a6c8620f74362d8f26228571f/lighteval-0.12.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,588 Found link https://files.pythonhosted.org/packages/f8/1a/e0546a2e5786d0d1c5477361202dba01762de51dbfb4569ef438bb291fe5/lighteval-0.12.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.12.0 2025-11-24T17:02:31,589 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/0c/6b/65e23781dd936db292c9b558978ca57e873b206254af1d3fcd60a78ca1b4/lighteval-0.12.1-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,590 Found link https://files.pythonhosted.org/packages/08/25/196b6b4e3b1358faa79aca54100e107824c9bb3ee09aa234b1da4b83843b/lighteval-0.12.1.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.12.1 2025-11-24T17:02:31,590 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/8e/4f/5efe2fdfd4a39c3654136748bdb229393e2a39f44421ef6c16b634be8f10/lighteval-0.12.2-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,591 Found link https://files.pythonhosted.org/packages/23/ee/8a24f8c29aa5d06eb175089b3815cd8cac251ae5c3ce5f622c7ff8548a4b/lighteval-0.12.2.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.12.2 2025-11-24T17:02:31,592 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/d0/3d/7b56fe26973d2e914bd9bd4fbf6278a10c063ed809c6da6164dd2962d4da/lighteval-0.13.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,593 Found link https://files.pythonhosted.org/packages/e1/65/c3963c69296ea622c05c131e95732a7c206db478fdaf1cb59b211f21531b/lighteval-0.13.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.13.0 2025-11-24T17:02:31,594 Fetching project page and analyzing links: https://www.piwheels.org/simple/lighteval/ 2025-11-24T17:02:31,594 Getting page https://www.piwheels.org/simple/lighteval/ 2025-11-24T17:02:31,596 Found index url https://www.piwheels.org/simple 2025-11-24T17:02:31,761 Fetched page https://www.piwheels.org/simple/lighteval/ as text/html 2025-11-24T17:02:31,768 Skipping link: No binaries permitted for lighteval: https://www.piwheels.org/simple/lighteval/lighteval-0.12.2-py3-none-any.whl#sha256=2b3c24acb37b2e37accfc179105c0df325914fc7a3d2c732f510e935e9766789 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,769 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.12.1-py3-none-any.whl#sha256=a489e86789e9c16786dc62dce35176be38b722dc05cbde1b9570456958fb8395 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,769 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.12.0-py3-none-any.whl#sha256=9232b4db5aab006a51962753e95165ccb057407597936804be72bd24531b24b3 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,770 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.11.0-py3-none-any.whl#sha256=6ce0c089e9d8bb70a3a9567692de9197b27f7de1f867ca89ebc209225fe3fa86 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,770 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.10.0-py3-none-any.whl#sha256=984e54961dfab22f14490603e818bd5fc52f7a9cb7325167cd4c722cd3a617c8 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,771 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.9.2-py3-none-any.whl#sha256=524551d8382e05b833a815efaa0c3d72e6f8394f779f7d0996c6bd32480c8bb3 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,772 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.9.1-py3-none-any.whl#sha256=547617dc5562604712e54b11110df507fc7bb93dbe003d95bd5d8f1b619fc5e5 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,772 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.9.0-py3-none-any.whl#sha256=f08fa34420204de0e093b908f9993b7857a704f1ea3ed352eb09ef2c821e7205 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,773 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.8.1-py3-none-any.whl#sha256=fc457974bc07ba6ec3f5f1c3ad74772add7907118d341df8bbf833064d9d1546 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,774 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.7.0-py3-none-any.whl#sha256=c2a51aca3df46874ddc37983dabd50cc525b25fb2b3c7eab15e445a9f0b9b712 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,774 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.6.2-py3-none-any.whl#sha256=dbbe93471a2dd20cdc138ee008b29e05bb7011af99679649aee415fdc38374e4 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,775 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.5.0-py3-none-any.whl#sha256=62bf9ced8a1139ca7c79da092c98d6b4d70d27a4007d8cdfde70f64eb9b98da2 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,776 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.4.0a0-py3-none-any.whl#sha256=8694039d9a42ffe2c54d5bc4d72d4a7ab3bf1b4032c970eb52fa05455da4d6a1 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,776 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.3.0-py3-none-any.whl#sha256=278613752d9402caf51c2a009228c2c91bb801a71dadc88586c41a764477da7a (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,777 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.3.0a0-py3-none-any.whl#sha256=ca834b38d37c41993d1573606b9f64d28e1218494118389f552f4fbc5c7fe4fd (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,777 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.2.0-py3-none-any.whl#sha256=f4dfdbe773e3f0a3958dddfd65b958a347095d693191d5c453d00de9f30344ae (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,778 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.1.1-py3-none-any.whl#sha256=296c95ef71b3014c30e8fe406bb95469a3d484c721fa61efbb1fe99dce67f950 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,778 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.1.1.dev0-py3-none-any.whl#sha256=e96ff26cffee66313bad7d96cc3522f90457ccc3fa292862034af2db96f4ef73 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,779 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.1.0-py3-none-any.whl#sha256=780a9fdd33d3b41060347f899486cd3ffab6f44f46af6c5d9a18ff10e725731d (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,780 Skipping link: No binaries permitted for lighteval: https://archive1.piwheels.org/simple/lighteval/lighteval-0.0.2-py3-none-any.whl#sha256=08472d569e00511c2d1803932a9b21c03e4424d68970bf1e67d0ab490ef59019 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2025-11-24T17:02:31,780 Skipping link: not a file: https://www.piwheels.org/simple/lighteval/ 2025-11-24T17:02:31,781 Skipping link: not a file: https://pypi.org/simple/lighteval/ 2025-11-24T17:02:31,802 Given no hashes to check 1 links for project 'lighteval': discarding no candidates 2025-11-24T17:02:31,820 Collecting lighteval==0.13.0 2025-11-24T17:02:31,823 Created temporary directory: /tmp/pip-unpack-99_v46ug 2025-11-24T17:02:32,036 Downloading lighteval-0.13.0.tar.gz (425 kB) 2025-11-24T17:02:32,745 Added lighteval==0.13.0 from https://files.pythonhosted.org/packages/e1/65/c3963c69296ea622c05c131e95732a7c206db478fdaf1cb59b211f21531b/lighteval-0.13.0.tar.gz to build tracker '/tmp/pip-build-tracker-d45nussh' 2025-11-24T17:02:32,751 Created temporary directory: /tmp/pip-build-env-kq1o4so7 2025-11-24T17:02:32,756 Installing build dependencies: started 2025-11-24T17:02:32,757 Running command pip subprocess to install build dependencies 2025-11-24T17:02:33,883 Using pip 23.0.1 from /usr/lib/python3/dist-packages/pip (python 3.11) 2025-11-24T17:02:34,528 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2025-11-24T17:02:34,550 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-11-24T17:02:36,269 Collecting setuptools>=61.0 2025-11-24T17:02:36,358 Using cached https://www.piwheels.org/simple/setuptools/setuptools-80.9.0-py3-none-any.whl (1.2 MB) 2025-11-24T17:02:39,243 Installing collected packages: setuptools 2025-11-24T17:02:42,848 Successfully installed setuptools-80.9.0 2025-11-24T17:02:43,114 Installing build dependencies: finished with status 'done' 2025-11-24T17:02:43,121 Getting requirements to build wheel: started 2025-11-24T17:02:43,122 Running command Getting requirements to build wheel 2025-11-24T17:02:43,756 /tmp/pip-build-env-kq1o4so7/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2025-11-24T17:02:43,756 !! 2025-11-24T17:02:43,757 ******************************************************************************** 2025-11-24T17:02:43,758 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2025-11-24T17:02:43,759 By 2026-Feb-18, you need to update your project and remove deprecated calls 2025-11-24T17:02:43,759 or your builds will no longer be supported. 2025-11-24T17:02:43,761 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-24T17:02:43,761 ******************************************************************************** 2025-11-24T17:02:43,762 !! 2025-11-24T17:02:43,763 corresp(dist, value, root_dir) 2025-11-24T17:02:43,855 /tmp/pip-build-env-kq1o4so7/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:61: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-24T17:02:43,856 !! 2025-11-24T17:02:43,857 ******************************************************************************** 2025-11-24T17:02:43,857 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-24T17:02:43,858 License :: OSI Approved :: MIT License 2025-11-24T17:02:43,859 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-24T17:02:43,860 ******************************************************************************** 2025-11-24T17:02:43,861 !! 2025-11-24T17:02:43,862 dist._finalize_license_expression() 2025-11-24T17:02:43,863 /tmp/pip-build-env-kq1o4so7/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-24T17:02:43,863 !! 2025-11-24T17:02:43,865 ******************************************************************************** 2025-11-24T17:02:43,865 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-24T17:02:43,866 License :: OSI Approved :: MIT License 2025-11-24T17:02:43,868 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-24T17:02:43,868 ******************************************************************************** 2025-11-24T17:02:43,870 !! 2025-11-24T17:02:43,870 self._finalize_license_expression() 2025-11-24T17:02:43,872 running egg_info 2025-11-24T17:02:43,879 writing src/lighteval.egg-info/PKG-INFO 2025-11-24T17:02:43,897 writing dependency_links to src/lighteval.egg-info/dependency_links.txt 2025-11-24T17:02:43,899 writing entry points to src/lighteval.egg-info/entry_points.txt 2025-11-24T17:02:43,909 writing requirements to src/lighteval.egg-info/requires.txt 2025-11-24T17:02:43,911 writing top-level names to src/lighteval.egg-info/top_level.txt 2025-11-24T17:02:43,973 reading manifest file 'src/lighteval.egg-info/SOURCES.txt' 2025-11-24T17:02:43,989 reading manifest template 'MANIFEST.in' 2025-11-24T17:02:43,991 warning: no files found matching 'src/lighteval/tasks/tasks_table.jsonl' 2025-11-24T17:02:43,992 warning: no files found matching 'src/lighteval/metrics/*.jsonl' 2025-11-24T17:02:43,992 adding license file 'LICENSE' 2025-11-24T17:02:44,007 writing manifest file 'src/lighteval.egg-info/SOURCES.txt' 2025-11-24T17:02:44,106 Getting requirements to build wheel: finished with status 'done' 2025-11-24T17:02:44,109 Created temporary directory: /tmp/pip-modern-metadata-53vlcbyc 2025-11-24T17:02:44,112 Preparing metadata (pyproject.toml): started 2025-11-24T17:02:44,113 Running command Preparing metadata (pyproject.toml) 2025-11-24T17:02:44,695 /tmp/pip-build-env-kq1o4so7/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2025-11-24T17:02:44,695 !! 2025-11-24T17:02:44,697 ******************************************************************************** 2025-11-24T17:02:44,697 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2025-11-24T17:02:44,698 By 2026-Feb-18, you need to update your project and remove deprecated calls 2025-11-24T17:02:44,699 or your builds will no longer be supported. 2025-11-24T17:02:44,700 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-24T17:02:44,700 ******************************************************************************** 2025-11-24T17:02:44,701 !! 2025-11-24T17:02:44,702 corresp(dist, value, root_dir) 2025-11-24T17:02:44,792 /tmp/pip-build-env-kq1o4so7/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:61: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-24T17:02:44,792 !! 2025-11-24T17:02:44,793 ******************************************************************************** 2025-11-24T17:02:44,794 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-24T17:02:44,795 License :: OSI Approved :: MIT License 2025-11-24T17:02:44,796 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-24T17:02:44,797 ******************************************************************************** 2025-11-24T17:02:44,798 !! 2025-11-24T17:02:44,799 dist._finalize_license_expression() 2025-11-24T17:02:44,800 /tmp/pip-build-env-kq1o4so7/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-24T17:02:44,801 !! 2025-11-24T17:02:44,802 ******************************************************************************** 2025-11-24T17:02:44,803 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-24T17:02:44,804 License :: OSI Approved :: MIT License 2025-11-24T17:02:44,805 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-24T17:02:44,806 ******************************************************************************** 2025-11-24T17:02:44,807 !! 2025-11-24T17:02:44,808 self._finalize_license_expression() 2025-11-24T17:02:44,809 running dist_info 2025-11-24T17:02:44,820 creating /tmp/pip-modern-metadata-53vlcbyc/lighteval.egg-info 2025-11-24T17:02:44,821 writing /tmp/pip-modern-metadata-53vlcbyc/lighteval.egg-info/PKG-INFO 2025-11-24T17:02:44,840 writing dependency_links to /tmp/pip-modern-metadata-53vlcbyc/lighteval.egg-info/dependency_links.txt 2025-11-24T17:02:44,841 writing entry points to /tmp/pip-modern-metadata-53vlcbyc/lighteval.egg-info/entry_points.txt 2025-11-24T17:02:44,851 writing requirements to /tmp/pip-modern-metadata-53vlcbyc/lighteval.egg-info/requires.txt 2025-11-24T17:02:44,852 writing top-level names to /tmp/pip-modern-metadata-53vlcbyc/lighteval.egg-info/top_level.txt 2025-11-24T17:02:44,854 writing manifest file '/tmp/pip-modern-metadata-53vlcbyc/lighteval.egg-info/SOURCES.txt' 2025-11-24T17:02:44,906 reading manifest file '/tmp/pip-modern-metadata-53vlcbyc/lighteval.egg-info/SOURCES.txt' 2025-11-24T17:02:44,908 reading manifest template 'MANIFEST.in' 2025-11-24T17:02:44,909 warning: no files found matching 'src/lighteval/tasks/tasks_table.jsonl' 2025-11-24T17:02:44,910 warning: no files found matching 'src/lighteval/metrics/*.jsonl' 2025-11-24T17:02:44,911 adding license file 'LICENSE' 2025-11-24T17:02:44,921 writing manifest file '/tmp/pip-modern-metadata-53vlcbyc/lighteval.egg-info/SOURCES.txt' 2025-11-24T17:02:44,923 creating '/tmp/pip-modern-metadata-53vlcbyc/lighteval-0.13.0.dist-info' 2025-11-24T17:02:45,052 Preparing metadata (pyproject.toml): finished with status 'done' 2025-11-24T17:02:45,058 Source in /tmp/pip-wheel-873hg87t/lighteval_c7e8294aec1a4275ac8f851d81c6d562 has version 0.13.0, which satisfies requirement lighteval==0.13.0 from https://files.pythonhosted.org/packages/e1/65/c3963c69296ea622c05c131e95732a7c206db478fdaf1cb59b211f21531b/lighteval-0.13.0.tar.gz 2025-11-24T17:02:45,059 Removed lighteval==0.13.0 from https://files.pythonhosted.org/packages/e1/65/c3963c69296ea622c05c131e95732a7c206db478fdaf1cb59b211f21531b/lighteval-0.13.0.tar.gz from build tracker '/tmp/pip-build-tracker-d45nussh' 2025-11-24T17:02:45,068 Created temporary directory: /tmp/pip-unpack-5s4gdm4a 2025-11-24T17:02:45,068 Building wheels for collected packages: lighteval 2025-11-24T17:02:45,073 Created temporary directory: /tmp/pip-wheel-hgu30u0h 2025-11-24T17:02:45,074 Destination directory: /tmp/pip-wheel-hgu30u0h 2025-11-24T17:02:45,076 Building wheel for lighteval (pyproject.toml): started 2025-11-24T17:02:45,077 Running command Building wheel for lighteval (pyproject.toml) 2025-11-24T17:02:45,680 /tmp/pip-build-env-kq1o4so7/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2025-11-24T17:02:45,681 !! 2025-11-24T17:02:45,682 ******************************************************************************** 2025-11-24T17:02:45,683 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2025-11-24T17:02:45,684 By 2026-Feb-18, you need to update your project and remove deprecated calls 2025-11-24T17:02:45,684 or your builds will no longer be supported. 2025-11-24T17:02:45,686 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-24T17:02:45,686 ******************************************************************************** 2025-11-24T17:02:45,687 !! 2025-11-24T17:02:45,688 corresp(dist, value, root_dir) 2025-11-24T17:02:45,769 /tmp/pip-build-env-kq1o4so7/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:61: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-24T17:02:45,770 !! 2025-11-24T17:02:45,771 ******************************************************************************** 2025-11-24T17:02:45,771 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-24T17:02:45,773 License :: OSI Approved :: MIT License 2025-11-24T17:02:45,774 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-24T17:02:45,774 ******************************************************************************** 2025-11-24T17:02:45,775 !! 2025-11-24T17:02:45,776 dist._finalize_license_expression() 2025-11-24T17:02:45,777 /tmp/pip-build-env-kq1o4so7/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-11-24T17:02:45,778 !! 2025-11-24T17:02:45,779 ******************************************************************************** 2025-11-24T17:02:45,779 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-11-24T17:02:45,780 License :: OSI Approved :: MIT License 2025-11-24T17:02:45,781 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-11-24T17:02:45,782 ******************************************************************************** 2025-11-24T17:02:45,783 !! 2025-11-24T17:02:45,783 self._finalize_license_expression() 2025-11-24T17:02:45,784 running bdist_wheel 2025-11-24T17:02:45,800 running build 2025-11-24T17:02:45,801 running build_py 2025-11-24T17:02:45,808 creating build/lib/lighteval 2025-11-24T17:02:45,810 copying src/lighteval/main_inspect.py -> build/lib/lighteval 2025-11-24T17:02:45,813 copying src/lighteval/main_accelerate.py -> build/lib/lighteval 2025-11-24T17:02:45,816 copying src/lighteval/main_custom.py -> build/lib/lighteval 2025-11-24T17:02:45,818 copying src/lighteval/main_baseline.py -> build/lib/lighteval 2025-11-24T17:02:45,820 copying src/lighteval/main_nanotron.py -> build/lib/lighteval 2025-11-24T17:02:45,823 copying src/lighteval/__main__.py -> build/lib/lighteval 2025-11-24T17:02:45,825 copying src/lighteval/main_endpoint.py -> build/lib/lighteval 2025-11-24T17:02:45,829 copying src/lighteval/main_sglang.py -> build/lib/lighteval 2025-11-24T17:02:45,832 copying src/lighteval/pipeline.py -> build/lib/lighteval 2025-11-24T17:02:45,834 copying src/lighteval/main_tasks.py -> build/lib/lighteval 2025-11-24T17:02:45,837 copying src/lighteval/cli_args.py -> build/lib/lighteval 2025-11-24T17:02:45,839 copying src/lighteval/data.py -> build/lib/lighteval 2025-11-24T17:02:45,841 copying src/lighteval/__init__.py -> build/lib/lighteval 2025-11-24T17:02:45,843 copying src/lighteval/main_vllm.py -> build/lib/lighteval 2025-11-24T17:02:45,847 creating build/lib/lighteval/models 2025-11-24T17:02:45,848 copying src/lighteval/models/abstract_model.py -> build/lib/lighteval/models 2025-11-24T17:02:45,850 copying src/lighteval/models/model_loader.py -> build/lib/lighteval/models 2025-11-24T17:02:45,853 copying src/lighteval/models/utils.py -> build/lib/lighteval/models 2025-11-24T17:02:45,855 copying src/lighteval/models/model_output.py -> build/lib/lighteval/models 2025-11-24T17:02:45,858 copying src/lighteval/models/model_input.py -> build/lib/lighteval/models 2025-11-24T17:02:45,861 creating build/lib/lighteval/logging 2025-11-24T17:02:45,862 copying src/lighteval/logging/evaluation_tracker.py -> build/lib/lighteval/logging 2025-11-24T17:02:45,866 copying src/lighteval/logging/info_loggers.py -> build/lib/lighteval/logging 2025-11-24T17:02:45,870 creating build/lib/lighteval/tasks 2025-11-24T17:02:45,871 copying src/lighteval/tasks/lighteval_task.py -> build/lib/lighteval/tasks 2025-11-24T17:02:45,874 copying src/lighteval/tasks/registry.py -> build/lib/lighteval/tasks 2025-11-24T17:02:45,878 copying src/lighteval/tasks/requests.py -> build/lib/lighteval/tasks 2025-11-24T17:02:45,880 copying src/lighteval/tasks/__init__.py -> build/lib/lighteval/tasks 2025-11-24T17:02:45,882 copying src/lighteval/tasks/prompt_manager.py -> build/lib/lighteval/tasks 2025-11-24T17:02:45,887 creating build/lib/lighteval/metrics 2025-11-24T17:02:45,888 copying src/lighteval/metrics/metrics_corpus.py -> build/lib/lighteval/metrics 2025-11-24T17:02:45,890 copying src/lighteval/metrics/sample_preparator.py -> build/lib/lighteval/metrics 2025-11-24T17:02:45,892 copying src/lighteval/metrics/metrics_sample.py -> build/lib/lighteval/metrics 2025-11-24T17:02:45,897 copying src/lighteval/metrics/metrics.py -> build/lib/lighteval/metrics 2025-11-24T17:02:45,900 copying src/lighteval/metrics/__init__.py -> build/lib/lighteval/metrics 2025-11-24T17:02:45,902 copying src/lighteval/metrics/normalizations.py -> build/lib/lighteval/metrics 2025-11-24T17:02:45,905 copying src/lighteval/metrics/dynamic_metrics.py -> build/lib/lighteval/metrics 2025-11-24T17:02:45,909 creating build/lib/lighteval/utils 2025-11-24T17:02:45,910 copying src/lighteval/utils/cache_management.py -> build/lib/lighteval/utils 2025-11-24T17:02:45,914 copying src/lighteval/utils/language.py -> build/lib/lighteval/utils 2025-11-24T17:02:45,917 copying src/lighteval/utils/imports.py -> build/lib/lighteval/utils 2025-11-24T17:02:45,919 copying src/lighteval/utils/parallelism.py -> build/lib/lighteval/utils 2025-11-24T17:02:45,922 copying src/lighteval/utils/utils.py -> build/lib/lighteval/utils 2025-11-24T17:02:45,924 copying src/lighteval/utils/timeout.py -> build/lib/lighteval/utils 2025-11-24T17:02:45,926 copying src/lighteval/utils/__init__.py -> build/lib/lighteval/utils 2025-11-24T17:02:45,928 creating build/lib/lighteval/models/dummy 2025-11-24T17:02:45,929 copying src/lighteval/models/dummy/dummy_model.py -> build/lib/lighteval/models/dummy 2025-11-24T17:02:45,932 creating build/lib/lighteval/models/nanotron 2025-11-24T17:02:45,933 copying src/lighteval/models/nanotron/nanotron_model.py -> build/lib/lighteval/models/nanotron 2025-11-24T17:02:45,938 creating build/lib/lighteval/models/transformers 2025-11-24T17:02:45,939 copying src/lighteval/models/transformers/delta_model.py -> build/lib/lighteval/models/transformers 2025-11-24T17:02:45,941 copying src/lighteval/models/transformers/adapter_model.py -> build/lib/lighteval/models/transformers 2025-11-24T17:02:45,944 copying src/lighteval/models/transformers/transformers_model.py -> build/lib/lighteval/models/transformers 2025-11-24T17:02:45,948 copying src/lighteval/models/transformers/vlm_transformers_model.py -> build/lib/lighteval/models/transformers 2025-11-24T17:02:45,952 creating build/lib/lighteval/models/custom 2025-11-24T17:02:45,953 copying src/lighteval/models/custom/custom_model.py -> build/lib/lighteval/models/custom 2025-11-24T17:02:45,955 creating build/lib/lighteval/models/vllm 2025-11-24T17:02:45,956 copying src/lighteval/models/vllm/vllm_model.py -> build/lib/lighteval/models/vllm 2025-11-24T17:02:45,960 creating build/lib/lighteval/models/sglang 2025-11-24T17:02:45,961 copying src/lighteval/models/sglang/sglang_model.py -> build/lib/lighteval/models/sglang 2025-11-24T17:02:45,965 creating build/lib/lighteval/models/endpoints 2025-11-24T17:02:45,966 copying src/lighteval/models/endpoints/inference_providers_model.py -> build/lib/lighteval/models/endpoints 2025-11-24T17:02:45,969 copying src/lighteval/models/endpoints/tgi_model.py -> build/lib/lighteval/models/endpoints 2025-11-24T17:02:45,972 copying src/lighteval/models/endpoints/endpoint_model.py -> build/lib/lighteval/models/endpoints 2025-11-24T17:02:45,975 copying src/lighteval/models/endpoints/litellm_model.py -> build/lib/lighteval/models/endpoints 2025-11-24T17:02:45,978 creating build/lib/lighteval/tasks/multilingual 2025-11-24T17:02:45,979 copying src/lighteval/tasks/multilingual/__init__.py -> build/lib/lighteval/tasks/multilingual 2025-11-24T17:02:45,982 copying src/lighteval/tasks/multilingual/adapters.py -> build/lib/lighteval/tasks/multilingual 2025-11-24T17:02:45,985 creating build/lib/lighteval/tasks/templates 2025-11-24T17:02:45,986 copying src/lighteval/tasks/templates/qa.py -> build/lib/lighteval/tasks/templates 2025-11-24T17:02:45,989 copying src/lighteval/tasks/templates/multichoice.py -> build/lib/lighteval/tasks/templates 2025-11-24T17:02:45,991 copying src/lighteval/tasks/templates/boolq.py -> build/lib/lighteval/tasks/templates 2025-11-24T17:02:45,993 copying src/lighteval/tasks/templates/continuation.py -> build/lib/lighteval/tasks/templates 2025-11-24T17:02:45,996 copying src/lighteval/tasks/templates/nli.py -> build/lib/lighteval/tasks/templates 2025-11-24T17:02:45,998 copying src/lighteval/tasks/templates/__init__.py -> build/lib/lighteval/tasks/templates 2025-11-24T17:02:46,000 copying src/lighteval/tasks/templates/translation.py -> build/lib/lighteval/tasks/templates 2025-11-24T17:02:46,003 copying src/lighteval/tasks/templates/hellaswag.py -> build/lib/lighteval/tasks/templates 2025-11-24T17:02:46,005 copying src/lighteval/tasks/templates/copa.py -> build/lib/lighteval/tasks/templates 2025-11-24T17:02:46,010 creating build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,011 copying src/lighteval/tasks/tasks/lsat_qa.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,013 copying src/lighteval/tasks/tasks/mathqa.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,015 copying src/lighteval/tasks/tasks/toxigen.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,017 copying src/lighteval/tasks/tasks/sacrebleu.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,022 copying src/lighteval/tasks/tasks/aime.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,024 copying src/lighteval/tasks/tasks/gsm_plus.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,026 copying src/lighteval/tasks/tasks/headqa.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,028 copying src/lighteval/tasks/tasks/med_dialog.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,030 copying src/lighteval/tasks/tasks/sciq.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,032 copying src/lighteval/tasks/tasks/tiny_benchmarks.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,035 copying src/lighteval/tasks/tasks/winogrande.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,037 copying src/lighteval/tasks/tasks/entitymatching.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,041 copying src/lighteval/tasks/tasks/arithmetic.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,043 copying src/lighteval/tasks/tasks/lexglue.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,046 copying src/lighteval/tasks/tasks/webqs.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,048 copying src/lighteval/tasks/tasks/bold.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,050 copying src/lighteval/tasks/tasks/triviaqa.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,053 copying src/lighteval/tasks/tasks/arc_agi_2.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,055 copying src/lighteval/tasks/tasks/mmlu.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,058 copying src/lighteval/tasks/tasks/quac.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,060 copying src/lighteval/tasks/tasks/lambada.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,063 copying src/lighteval/tasks/tasks/real_toxicity_prompts.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,065 copying src/lighteval/tasks/tasks/wikitext.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,067 copying src/lighteval/tasks/tasks/med.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,069 copying src/lighteval/tasks/tasks/boolq.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,071 copying src/lighteval/tasks/tasks/qasper.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,073 copying src/lighteval/tasks/tasks/the_pile.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,076 copying src/lighteval/tasks/tasks/aa_omniscience.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,079 copying src/lighteval/tasks/tasks/lextreme.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,083 copying src/lighteval/tasks/tasks/wikifact.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,086 copying src/lighteval/tasks/tasks/agieval.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,088 copying src/lighteval/tasks/tasks/dyck_language.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,090 copying src/lighteval/tasks/tasks/musr.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,092 copying src/lighteval/tasks/tasks/prost.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,094 copying src/lighteval/tasks/tasks/civil_comments.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,096 copying src/lighteval/tasks/tasks/piqa.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,098 copying src/lighteval/tasks/tasks/swag.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,100 copying src/lighteval/tasks/tasks/numeracy.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,102 copying src/lighteval/tasks/tasks/slr_bench.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,104 copying src/lighteval/tasks/tasks/race_high.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,106 copying src/lighteval/tasks/tasks/asdiv.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,108 copying src/lighteval/tasks/tasks/twitterAAE.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,110 copying src/lighteval/tasks/tasks/ethics.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,113 copying src/lighteval/tasks/tasks/synthetic_reasoning.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,115 copying src/lighteval/tasks/tasks/math_500.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,117 copying src/lighteval/tasks/tasks/coqa.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,119 copying src/lighteval/tasks/tasks/bigbench.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,123 copying src/lighteval/tasks/tasks/xwinograd.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,125 copying src/lighteval/tasks/tasks/narrativeqa.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,127 copying src/lighteval/tasks/tasks/simpleqa.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,129 copying src/lighteval/tasks/tasks/jeopardy.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,131 copying src/lighteval/tasks/tasks/gsm8k.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,134 copying src/lighteval/tasks/tasks/entity_data_imputation.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,136 copying src/lighteval/tasks/tasks/drop_qa.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,138 copying src/lighteval/tasks/tasks/natural_questions.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,140 copying src/lighteval/tasks/tasks/mgsm.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,143 copying src/lighteval/tasks/tasks/olympiade_bench.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,145 copying src/lighteval/tasks/tasks/siqa.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,148 copying src/lighteval/tasks/tasks/xcopa.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,150 copying src/lighteval/tasks/tasks/hle.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,153 copying src/lighteval/tasks/tasks/truthfulqa.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,155 copying src/lighteval/tasks/tasks/gpqa.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,157 copying src/lighteval/tasks/tasks/openbookqa.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,159 copying src/lighteval/tasks/tasks/xstory_cloze.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,161 copying src/lighteval/tasks/tasks/bbq.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,165 copying src/lighteval/tasks/tasks/raft.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,167 copying src/lighteval/tasks/tasks/blimp.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,173 copying src/lighteval/tasks/tasks/babi_qa.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,176 copying src/lighteval/tasks/tasks/glue.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,178 copying src/lighteval/tasks/tasks/covid_dialogue.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,180 copying src/lighteval/tasks/tasks/imdb.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,182 copying src/lighteval/tasks/tasks/custom_task_classification_grammar_task.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,185 copying src/lighteval/tasks/tasks/commonsenseqa.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,187 copying src/lighteval/tasks/tasks/storycloze.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,189 copying src/lighteval/tasks/tasks/logiqa.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,190 copying src/lighteval/tasks/tasks/mmmu_pro.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,192 copying src/lighteval/tasks/tasks/math.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,195 copying src/lighteval/tasks/tasks/legalsupport.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,197 copying src/lighteval/tasks/tasks/legal_summarization.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,199 copying src/lighteval/tasks/tasks/aimo.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,201 copying src/lighteval/tasks/tasks/anli.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,203 copying src/lighteval/tasks/tasks/unscramble.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,204 copying src/lighteval/tasks/tasks/arc.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,206 copying src/lighteval/tasks/tasks/mmlu_redux.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,208 copying src/lighteval/tasks/tasks/pubmedqa.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,210 copying src/lighteval/tasks/tasks/qa4mre.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,212 copying src/lighteval/tasks/tasks/mmlu_pro.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,214 copying src/lighteval/tasks/tasks/bigbench_hard.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,217 copying src/lighteval/tasks/tasks/hellaswag.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,219 copying src/lighteval/tasks/tasks/summarization.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,221 copying src/lighteval/tasks/tasks/squad_v2.py -> build/lib/lighteval/tasks/tasks 2025-11-24T17:02:46,225 creating build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,226 copying src/lighteval/tasks/multilingual/tasks/ceval.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,229 copying src/lighteval/tasks/multilingual/tasks/french_boolq.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,230 copying src/lighteval/tasks/multilingual/tasks/copa_indic.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,233 copying src/lighteval/tasks/multilingual/tasks/kenswquad.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,234 copying src/lighteval/tasks/multilingual/tasks/oz.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,236 copying src/lighteval/tasks/multilingual/tasks/cmnli.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,238 copying src/lighteval/tasks/multilingual/tasks/hellaswag_tel.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,240 copying src/lighteval/tasks/multilingual/tasks/enem.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,242 copying src/lighteval/tasks/multilingual/tasks/mathlogicqa_rus.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,244 copying src/lighteval/tasks/multilingual/tasks/piqa_ar.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,246 copying src/lighteval/tasks/multilingual/tasks/afri_xnli.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,248 copying src/lighteval/tasks/multilingual/tasks/filipino.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,251 copying src/lighteval/tasks/multilingual/tasks/cmmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,253 copying src/lighteval/tasks/multilingual/tasks/chinese_squad.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,255 copying src/lighteval/tasks/multilingual/tasks/hellaswag_tha.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,257 copying src/lighteval/tasks/multilingual/tasks/meta_mmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,259 copying src/lighteval/tasks/multilingual/tasks/global_mmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,261 copying src/lighteval/tasks/multilingual/tasks/c3.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,263 copying src/lighteval/tasks/multilingual/tasks/mlmm_hellaswag.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,265 copying src/lighteval/tasks/multilingual/tasks/xcsqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,267 copying src/lighteval/tasks/multilingual/tasks/thai_exams.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,269 copying src/lighteval/tasks/multilingual/tasks/exams.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,271 copying src/lighteval/tasks/multilingual/tasks/hindi_arc.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,273 copying src/lighteval/tasks/multilingual/tasks/xnli.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,275 copying src/lighteval/tasks/multilingual/tasks/worldtree_rus.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,277 copying src/lighteval/tasks/multilingual/tasks/arabic_mmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,279 copying src/lighteval/tasks/multilingual/tasks/oab_exams.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,281 copying src/lighteval/tasks/multilingual/tasks/cmrc2018.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,283 copying src/lighteval/tasks/multilingual/tasks/mlmm_arc_challenge.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,286 copying src/lighteval/tasks/multilingual/tasks/xnli_indic.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,288 copying src/lighteval/tasks/multilingual/tasks/rcb.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,290 copying src/lighteval/tasks/multilingual/tasks/mlmm_mmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,292 copying src/lighteval/tasks/multilingual/tasks/mlqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,294 copying src/lighteval/tasks/multilingual/tasks/belebele.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,296 copying src/lighteval/tasks/multilingual/tasks/xquad.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,298 copying src/lighteval/tasks/multilingual/tasks/afri_mgsm.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,300 copying src/lighteval/tasks/multilingual/tasks/arcd.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,302 copying src/lighteval/tasks/multilingual/tasks/tydiqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,304 copying src/lighteval/tasks/multilingual/tasks/hellaswag_hin.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,307 copying src/lighteval/tasks/multilingual/tasks/squad_it.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,309 copying src/lighteval/tasks/multilingual/tasks/thaiqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,311 copying src/lighteval/tasks/multilingual/tasks/germanquad.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,313 copying src/lighteval/tasks/multilingual/tasks/mkqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,315 copying src/lighteval/tasks/multilingual/tasks/serbian_eval.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,318 copying src/lighteval/tasks/multilingual/tasks/m3exams.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,320 copying src/lighteval/tasks/multilingual/tasks/faquad.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,322 copying src/lighteval/tasks/multilingual/tasks/arabic_arc.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,324 copying src/lighteval/tasks/multilingual/tasks/fquad_v2.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,326 copying src/lighteval/tasks/multilingual/tasks/mlmm_truthfulqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,327 copying src/lighteval/tasks/multilingual/tasks/squad_es.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,329 copying src/lighteval/tasks/multilingual/tasks/xwinograd.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,331 copying src/lighteval/tasks/multilingual/tasks/acva.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,333 copying src/lighteval/tasks/multilingual/tasks/arabic.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,336 copying src/lighteval/tasks/multilingual/tasks/turkish_mmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,338 copying src/lighteval/tasks/multilingual/tasks/french.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,340 copying src/lighteval/tasks/multilingual/tasks/french_triviqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,342 copying src/lighteval/tasks/multilingual/tasks/ocnli.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,344 copying src/lighteval/tasks/multilingual/tasks/turkish_arc.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,346 copying src/lighteval/tasks/multilingual/tasks/mgsm.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,347 copying src/lighteval/tasks/multilingual/tasks/indicqa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,349 copying src/lighteval/tasks/multilingual/tasks/xcopa.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,351 copying src/lighteval/tasks/multilingual/tasks/german_rag.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,354 copying src/lighteval/tasks/multilingual/tasks/xcodah.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,356 copying src/lighteval/tasks/multilingual/tasks/mintaka.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,358 copying src/lighteval/tasks/multilingual/tasks/openbook_ara.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,360 copying src/lighteval/tasks/multilingual/tasks/tquad_v2.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,362 copying src/lighteval/tasks/multilingual/tasks/openai_mmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,364 copying src/lighteval/tasks/multilingual/tasks/flores200.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,367 copying src/lighteval/tasks/multilingual/tasks/swahili_arc.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,369 copying src/lighteval/tasks/multilingual/tasks/soqal.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,371 copying src/lighteval/tasks/multilingual/tasks/turkic.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,373 copying src/lighteval/tasks/multilingual/tasks/hellaswag_tur.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,375 copying src/lighteval/tasks/multilingual/tasks/parus.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,377 copying src/lighteval/tasks/multilingual/tasks/xnli2.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,379 copying src/lighteval/tasks/multilingual/tasks/hindi_boolq.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,381 copying src/lighteval/tasks/multilingual/tasks/xstory.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,383 copying src/lighteval/tasks/multilingual/tasks/chegeka.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,385 copying src/lighteval/tasks/multilingual/tasks/sber_squad.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,387 copying src/lighteval/tasks/multilingual/tasks/afri_mmlu.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,389 copying src/lighteval/tasks/multilingual/tasks/paws_x.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,391 copying src/lighteval/tasks/multilingual/tasks/openbook_es.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,393 copying src/lighteval/tasks/multilingual/tasks/openbook_rus.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,395 copying src/lighteval/tasks/multilingual/tasks/cmath.py -> build/lib/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,398 creating build/lib/lighteval/tasks/multilingual/utils 2025-11-24T17:02:46,399 copying src/lighteval/tasks/multilingual/utils/adapters_utils.py -> build/lib/lighteval/tasks/multilingual/utils 2025-11-24T17:02:46,401 copying src/lighteval/tasks/multilingual/utils/task_utils.py -> build/lib/lighteval/tasks/multilingual/utils 2025-11-24T17:02:46,404 copying src/lighteval/tasks/multilingual/utils/__init__.py -> build/lib/lighteval/tasks/multilingual/utils 2025-11-24T17:02:46,406 creating build/lib/lighteval/tasks/templates/utils 2025-11-24T17:02:46,407 copying src/lighteval/tasks/templates/utils/formulation.py -> build/lib/lighteval/tasks/templates/utils 2025-11-24T17:02:46,410 copying src/lighteval/tasks/templates/utils/translation_literals.py -> build/lib/lighteval/tasks/templates/utils 2025-11-24T17:02:46,413 copying src/lighteval/tasks/templates/utils/adapter_utils.py -> build/lib/lighteval/tasks/templates/utils 2025-11-24T17:02:46,415 copying src/lighteval/tasks/templates/utils/formatting_utils.py -> build/lib/lighteval/tasks/templates/utils 2025-11-24T17:02:46,418 copying src/lighteval/tasks/templates/utils/__init__.py -> build/lib/lighteval/tasks/templates/utils 2025-11-24T17:02:46,420 creating build/lib/lighteval/tasks/tasks/ifbench 2025-11-24T17:02:46,421 copying src/lighteval/tasks/tasks/ifbench/instructions_registry.py -> build/lib/lighteval/tasks/tasks/ifbench 2025-11-24T17:02:46,423 copying src/lighteval/tasks/tasks/ifbench/evaluation_lib.py -> build/lib/lighteval/tasks/tasks/ifbench 2025-11-24T17:02:46,426 copying src/lighteval/tasks/tasks/ifbench/main.py -> build/lib/lighteval/tasks/tasks/ifbench 2025-11-24T17:02:46,428 copying src/lighteval/tasks/tasks/ifbench/instructions.py -> build/lib/lighteval/tasks/tasks/ifbench 2025-11-24T17:02:46,433 creating build/lib/lighteval/tasks/tasks/lcb 2025-11-24T17:02:46,434 copying src/lighteval/tasks/tasks/lcb/codegen_metrics.py -> build/lib/lighteval/tasks/tasks/lcb 2025-11-24T17:02:46,437 copying src/lighteval/tasks/tasks/lcb/main.py -> build/lib/lighteval/tasks/tasks/lcb 2025-11-24T17:02:46,440 creating build/lib/lighteval/tasks/tasks/mix_eval 2025-11-24T17:02:46,441 copying src/lighteval/tasks/tasks/mix_eval/prompts.py -> build/lib/lighteval/tasks/tasks/mix_eval 2025-11-24T17:02:46,444 copying src/lighteval/tasks/tasks/mix_eval/judge_prompts.py -> build/lib/lighteval/tasks/tasks/mix_eval 2025-11-24T17:02:46,446 copying src/lighteval/tasks/tasks/mix_eval/main.py -> build/lib/lighteval/tasks/tasks/mix_eval 2025-11-24T17:02:46,449 creating build/lib/lighteval/tasks/tasks/ifeval 2025-11-24T17:02:46,450 copying src/lighteval/tasks/tasks/ifeval/instructions_registry.py -> build/lib/lighteval/tasks/tasks/ifeval 2025-11-24T17:02:46,453 copying src/lighteval/tasks/tasks/ifeval/instructions_utils.py -> build/lib/lighteval/tasks/tasks/ifeval 2025-11-24T17:02:46,455 copying src/lighteval/tasks/tasks/ifeval/main.py -> build/lib/lighteval/tasks/tasks/ifeval 2025-11-24T17:02:46,458 copying src/lighteval/tasks/tasks/ifeval/instructions.py -> build/lib/lighteval/tasks/tasks/ifeval 2025-11-24T17:02:46,461 creating build/lib/lighteval/tasks/tasks/mt_bench 2025-11-24T17:02:46,462 copying src/lighteval/tasks/tasks/mt_bench/main.py -> build/lib/lighteval/tasks/tasks/mt_bench 2025-11-24T17:02:46,464 copying src/lighteval/tasks/tasks/mt_bench/judge_prompt_templates.py -> build/lib/lighteval/tasks/tasks/mt_bench 2025-11-24T17:02:46,467 creating build/lib/lighteval/metrics/imports 2025-11-24T17:02:46,468 copying src/lighteval/metrics/imports/summac.py -> build/lib/lighteval/metrics/imports 2025-11-24T17:02:46,471 copying src/lighteval/metrics/imports/data_stats_utils.py -> build/lib/lighteval/metrics/imports 2025-11-24T17:02:46,473 copying src/lighteval/metrics/imports/data_stats_metric.py -> build/lib/lighteval/metrics/imports 2025-11-24T17:02:46,476 copying src/lighteval/metrics/imports/bert_scorer.py -> build/lib/lighteval/metrics/imports 2025-11-24T17:02:46,478 copying src/lighteval/metrics/imports/__init__.py -> build/lib/lighteval/metrics/imports 2025-11-24T17:02:46,481 creating build/lib/lighteval/metrics/harness_compatibility 2025-11-24T17:02:46,482 copying src/lighteval/metrics/harness_compatibility/truthful_qa.py -> build/lib/lighteval/metrics/harness_compatibility 2025-11-24T17:02:46,484 copying src/lighteval/metrics/harness_compatibility/drop.py -> build/lib/lighteval/metrics/harness_compatibility 2025-11-24T17:02:46,488 creating build/lib/lighteval/metrics/utils 2025-11-24T17:02:46,489 copying src/lighteval/metrics/utils/math_comparison.py -> build/lib/lighteval/metrics/utils 2025-11-24T17:02:46,492 copying src/lighteval/metrics/utils/extractive_match_utils.py -> build/lib/lighteval/metrics/utils 2025-11-24T17:02:46,495 copying src/lighteval/metrics/utils/judge_utils.py -> build/lib/lighteval/metrics/utils 2025-11-24T17:02:46,497 copying src/lighteval/metrics/utils/llm_as_judge.py -> build/lib/lighteval/metrics/utils 2025-11-24T17:02:46,500 copying src/lighteval/metrics/utils/stderr.py -> build/lib/lighteval/metrics/utils 2025-11-24T17:02:46,502 copying src/lighteval/metrics/utils/metric_utils.py -> build/lib/lighteval/metrics/utils 2025-11-24T17:02:46,505 copying src/lighteval/metrics/utils/linguistic_tokenizers.py -> build/lib/lighteval/metrics/utils 2025-11-24T17:02:46,507 running egg_info 2025-11-24T17:02:46,519 writing src/lighteval.egg-info/PKG-INFO 2025-11-24T17:02:46,537 writing dependency_links to src/lighteval.egg-info/dependency_links.txt 2025-11-24T17:02:46,538 writing entry points to src/lighteval.egg-info/entry_points.txt 2025-11-24T17:02:46,548 writing requirements to src/lighteval.egg-info/requires.txt 2025-11-24T17:02:46,549 writing top-level names to src/lighteval.egg-info/top_level.txt 2025-11-24T17:02:46,590 reading manifest file 'src/lighteval.egg-info/SOURCES.txt' 2025-11-24T17:02:46,607 reading manifest template 'MANIFEST.in' 2025-11-24T17:02:46,608 warning: no files found matching 'src/lighteval/tasks/tasks_table.jsonl' 2025-11-24T17:02:46,609 warning: no files found matching 'src/lighteval/metrics/*.jsonl' 2025-11-24T17:02:46,609 adding license file 'LICENSE' 2025-11-24T17:02:46,624 writing manifest file 'src/lighteval.egg-info/SOURCES.txt' 2025-11-24T17:02:46,641 copying src/lighteval/py.typed -> build/lib/lighteval 2025-11-24T17:02:46,671 installing to build/bdist.linux-armv7l/wheel 2025-11-24T17:02:46,672 running install 2025-11-24T17:02:46,696 running install_lib 2025-11-24T17:02:46,702 creating build/bdist.linux-armv7l/wheel 2025-11-24T17:02:46,705 creating build/bdist.linux-armv7l/wheel/lighteval 2025-11-24T17:02:46,706 copying build/lib/lighteval/main_inspect.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-24T17:02:46,710 copying build/lib/lighteval/main_accelerate.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-24T17:02:46,712 copying build/lib/lighteval/main_custom.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-24T17:02:46,715 creating build/bdist.linux-armv7l/wheel/lighteval/models 2025-11-24T17:02:46,716 creating build/bdist.linux-armv7l/wheel/lighteval/models/dummy 2025-11-24T17:02:46,717 copying build/lib/lighteval/models/dummy/dummy_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/dummy 2025-11-24T17:02:46,720 creating build/bdist.linux-armv7l/wheel/lighteval/models/nanotron 2025-11-24T17:02:46,721 copying build/lib/lighteval/models/nanotron/nanotron_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/nanotron 2025-11-24T17:02:46,726 copying build/lib/lighteval/models/abstract_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models 2025-11-24T17:02:46,730 creating build/bdist.linux-armv7l/wheel/lighteval/models/transformers 2025-11-24T17:02:46,731 copying build/lib/lighteval/models/transformers/delta_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/transformers 2025-11-24T17:02:46,733 copying build/lib/lighteval/models/transformers/adapter_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/transformers 2025-11-24T17:02:46,735 copying build/lib/lighteval/models/transformers/transformers_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/transformers 2025-11-24T17:02:46,739 copying build/lib/lighteval/models/transformers/vlm_transformers_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/transformers 2025-11-24T17:02:46,742 creating build/bdist.linux-armv7l/wheel/lighteval/models/custom 2025-11-24T17:02:46,743 copying build/lib/lighteval/models/custom/custom_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/custom 2025-11-24T17:02:46,746 creating build/bdist.linux-armv7l/wheel/lighteval/models/vllm 2025-11-24T17:02:46,747 copying build/lib/lighteval/models/vllm/vllm_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/vllm 2025-11-24T17:02:46,750 copying build/lib/lighteval/models/model_loader.py -> build/bdist.linux-armv7l/wheel/./lighteval/models 2025-11-24T17:02:46,752 copying build/lib/lighteval/models/utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/models 2025-11-24T17:02:46,755 creating build/bdist.linux-armv7l/wheel/lighteval/models/sglang 2025-11-24T17:02:46,756 copying build/lib/lighteval/models/sglang/sglang_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/sglang 2025-11-24T17:02:46,759 copying build/lib/lighteval/models/model_output.py -> build/bdist.linux-armv7l/wheel/./lighteval/models 2025-11-24T17:02:46,762 creating build/bdist.linux-armv7l/wheel/lighteval/models/endpoints 2025-11-24T17:02:46,763 copying build/lib/lighteval/models/endpoints/inference_providers_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/endpoints 2025-11-24T17:02:46,765 copying build/lib/lighteval/models/endpoints/tgi_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/endpoints 2025-11-24T17:02:46,768 copying build/lib/lighteval/models/endpoints/endpoint_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/endpoints 2025-11-24T17:02:46,771 copying build/lib/lighteval/models/endpoints/litellm_model.py -> build/bdist.linux-armv7l/wheel/./lighteval/models/endpoints 2025-11-24T17:02:46,773 copying build/lib/lighteval/models/model_input.py -> build/bdist.linux-armv7l/wheel/./lighteval/models 2025-11-24T17:02:46,776 copying build/lib/lighteval/main_baseline.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-24T17:02:46,778 copying build/lib/lighteval/main_nanotron.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-24T17:02:46,780 copying build/lib/lighteval/__main__.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-24T17:02:46,782 copying build/lib/lighteval/main_endpoint.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-24T17:02:46,785 copying build/lib/lighteval/main_sglang.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-24T17:02:46,787 copying build/lib/lighteval/pipeline.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-24T17:02:46,789 copying build/lib/lighteval/main_tasks.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-24T17:02:46,792 creating build/bdist.linux-armv7l/wheel/lighteval/logging 2025-11-24T17:02:46,793 copying build/lib/lighteval/logging/evaluation_tracker.py -> build/bdist.linux-armv7l/wheel/./lighteval/logging 2025-11-24T17:02:46,796 copying build/lib/lighteval/logging/info_loggers.py -> build/bdist.linux-armv7l/wheel/./lighteval/logging 2025-11-24T17:02:46,799 creating build/bdist.linux-armv7l/wheel/lighteval/tasks 2025-11-24T17:02:46,801 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/multilingual 2025-11-24T17:02:46,804 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,805 copying build/lib/lighteval/tasks/multilingual/tasks/ceval.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,807 copying build/lib/lighteval/tasks/multilingual/tasks/french_boolq.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,809 copying build/lib/lighteval/tasks/multilingual/tasks/copa_indic.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,811 copying build/lib/lighteval/tasks/multilingual/tasks/kenswquad.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,812 copying build/lib/lighteval/tasks/multilingual/tasks/oz.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,814 copying build/lib/lighteval/tasks/multilingual/tasks/cmnli.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,816 copying build/lib/lighteval/tasks/multilingual/tasks/hellaswag_tel.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,818 copying build/lib/lighteval/tasks/multilingual/tasks/enem.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,820 copying build/lib/lighteval/tasks/multilingual/tasks/mathlogicqa_rus.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,822 copying build/lib/lighteval/tasks/multilingual/tasks/piqa_ar.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,824 copying build/lib/lighteval/tasks/multilingual/tasks/afri_xnli.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,826 copying build/lib/lighteval/tasks/multilingual/tasks/filipino.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,829 copying build/lib/lighteval/tasks/multilingual/tasks/cmmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,830 copying build/lib/lighteval/tasks/multilingual/tasks/chinese_squad.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,832 copying build/lib/lighteval/tasks/multilingual/tasks/hellaswag_tha.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,834 copying build/lib/lighteval/tasks/multilingual/tasks/meta_mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,837 copying build/lib/lighteval/tasks/multilingual/tasks/global_mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,839 copying build/lib/lighteval/tasks/multilingual/tasks/c3.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,841 copying build/lib/lighteval/tasks/multilingual/tasks/mlmm_hellaswag.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,843 copying build/lib/lighteval/tasks/multilingual/tasks/xcsqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,845 copying build/lib/lighteval/tasks/multilingual/tasks/thai_exams.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,847 copying build/lib/lighteval/tasks/multilingual/tasks/exams.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,849 copying build/lib/lighteval/tasks/multilingual/tasks/hindi_arc.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,850 copying build/lib/lighteval/tasks/multilingual/tasks/xnli.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,852 copying build/lib/lighteval/tasks/multilingual/tasks/worldtree_rus.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,854 copying build/lib/lighteval/tasks/multilingual/tasks/arabic_mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,856 copying build/lib/lighteval/tasks/multilingual/tasks/oab_exams.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,858 copying build/lib/lighteval/tasks/multilingual/tasks/cmrc2018.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,860 copying build/lib/lighteval/tasks/multilingual/tasks/mlmm_arc_challenge.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,861 copying build/lib/lighteval/tasks/multilingual/tasks/xnli_indic.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,863 copying build/lib/lighteval/tasks/multilingual/tasks/rcb.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,865 copying build/lib/lighteval/tasks/multilingual/tasks/mlmm_mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,867 copying build/lib/lighteval/tasks/multilingual/tasks/mlqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,869 copying build/lib/lighteval/tasks/multilingual/tasks/belebele.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,872 copying build/lib/lighteval/tasks/multilingual/tasks/xquad.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,874 copying build/lib/lighteval/tasks/multilingual/tasks/afri_mgsm.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,876 copying build/lib/lighteval/tasks/multilingual/tasks/arcd.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,878 copying build/lib/lighteval/tasks/multilingual/tasks/tydiqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,880 copying build/lib/lighteval/tasks/multilingual/tasks/hellaswag_hin.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,882 copying build/lib/lighteval/tasks/multilingual/tasks/squad_it.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,883 copying build/lib/lighteval/tasks/multilingual/tasks/thaiqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,885 copying build/lib/lighteval/tasks/multilingual/tasks/germanquad.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,887 copying build/lib/lighteval/tasks/multilingual/tasks/mkqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,889 copying build/lib/lighteval/tasks/multilingual/tasks/serbian_eval.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,892 copying build/lib/lighteval/tasks/multilingual/tasks/m3exams.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,894 copying build/lib/lighteval/tasks/multilingual/tasks/faquad.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,896 copying build/lib/lighteval/tasks/multilingual/tasks/arabic_arc.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,898 copying build/lib/lighteval/tasks/multilingual/tasks/fquad_v2.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,900 copying build/lib/lighteval/tasks/multilingual/tasks/mlmm_truthfulqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,902 copying build/lib/lighteval/tasks/multilingual/tasks/squad_es.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,903 copying build/lib/lighteval/tasks/multilingual/tasks/xwinograd.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,906 copying build/lib/lighteval/tasks/multilingual/tasks/acva.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,907 copying build/lib/lighteval/tasks/multilingual/tasks/arabic.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,910 copying build/lib/lighteval/tasks/multilingual/tasks/turkish_mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,912 copying build/lib/lighteval/tasks/multilingual/tasks/french.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,915 copying build/lib/lighteval/tasks/multilingual/tasks/french_triviqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,916 copying build/lib/lighteval/tasks/multilingual/tasks/ocnli.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,918 copying build/lib/lighteval/tasks/multilingual/tasks/turkish_arc.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,920 copying build/lib/lighteval/tasks/multilingual/tasks/mgsm.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,922 copying build/lib/lighteval/tasks/multilingual/tasks/indicqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,924 copying build/lib/lighteval/tasks/multilingual/tasks/xcopa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,926 copying build/lib/lighteval/tasks/multilingual/tasks/german_rag.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,929 copying build/lib/lighteval/tasks/multilingual/tasks/xcodah.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,931 copying build/lib/lighteval/tasks/multilingual/tasks/mintaka.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,933 copying build/lib/lighteval/tasks/multilingual/tasks/openbook_ara.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,935 copying build/lib/lighteval/tasks/multilingual/tasks/tquad_v2.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,937 copying build/lib/lighteval/tasks/multilingual/tasks/openai_mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,939 copying build/lib/lighteval/tasks/multilingual/tasks/flores200.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,941 copying build/lib/lighteval/tasks/multilingual/tasks/swahili_arc.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,944 copying build/lib/lighteval/tasks/multilingual/tasks/soqal.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,946 copying build/lib/lighteval/tasks/multilingual/tasks/turkic.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,947 copying build/lib/lighteval/tasks/multilingual/tasks/hellaswag_tur.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,949 copying build/lib/lighteval/tasks/multilingual/tasks/parus.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,951 copying build/lib/lighteval/tasks/multilingual/tasks/xnli2.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,953 copying build/lib/lighteval/tasks/multilingual/tasks/hindi_boolq.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,955 copying build/lib/lighteval/tasks/multilingual/tasks/xstory.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,957 copying build/lib/lighteval/tasks/multilingual/tasks/chegeka.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,959 copying build/lib/lighteval/tasks/multilingual/tasks/sber_squad.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,961 copying build/lib/lighteval/tasks/multilingual/tasks/afri_mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,963 copying build/lib/lighteval/tasks/multilingual/tasks/paws_x.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,965 copying build/lib/lighteval/tasks/multilingual/tasks/openbook_es.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,967 copying build/lib/lighteval/tasks/multilingual/tasks/openbook_rus.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,968 copying build/lib/lighteval/tasks/multilingual/tasks/cmath.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/tasks 2025-11-24T17:02:46,970 copying build/lib/lighteval/tasks/multilingual/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual 2025-11-24T17:02:46,973 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/multilingual/utils 2025-11-24T17:02:46,974 copying build/lib/lighteval/tasks/multilingual/utils/adapters_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/utils 2025-11-24T17:02:46,976 copying build/lib/lighteval/tasks/multilingual/utils/task_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/utils 2025-11-24T17:02:46,978 copying build/lib/lighteval/tasks/multilingual/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual/utils 2025-11-24T17:02:46,980 copying build/lib/lighteval/tasks/multilingual/adapters.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/multilingual 2025-11-24T17:02:46,984 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/templates 2025-11-24T17:02:46,985 copying build/lib/lighteval/tasks/templates/qa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-24T17:02:46,987 copying build/lib/lighteval/tasks/templates/multichoice.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-24T17:02:46,989 copying build/lib/lighteval/tasks/templates/boolq.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-24T17:02:46,992 copying build/lib/lighteval/tasks/templates/continuation.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-24T17:02:46,994 copying build/lib/lighteval/tasks/templates/nli.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-24T17:02:46,997 copying build/lib/lighteval/tasks/templates/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-24T17:02:46,999 copying build/lib/lighteval/tasks/templates/translation.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-24T17:02:47,002 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/templates/utils 2025-11-24T17:02:47,003 copying build/lib/lighteval/tasks/templates/utils/formulation.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates/utils 2025-11-24T17:02:47,006 copying build/lib/lighteval/tasks/templates/utils/translation_literals.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates/utils 2025-11-24T17:02:47,009 copying build/lib/lighteval/tasks/templates/utils/adapter_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates/utils 2025-11-24T17:02:47,011 copying build/lib/lighteval/tasks/templates/utils/formatting_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates/utils 2025-11-24T17:02:47,013 copying build/lib/lighteval/tasks/templates/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates/utils 2025-11-24T17:02:47,015 copying build/lib/lighteval/tasks/templates/hellaswag.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-24T17:02:47,017 copying build/lib/lighteval/tasks/templates/copa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/templates 2025-11-24T17:02:47,019 copying build/lib/lighteval/tasks/lighteval_task.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks 2025-11-24T17:02:47,022 copying build/lib/lighteval/tasks/registry.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks 2025-11-24T17:02:47,027 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks 2025-11-24T17:02:47,028 copying build/lib/lighteval/tasks/tasks/lsat_qa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,030 copying build/lib/lighteval/tasks/tasks/mathqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,032 copying build/lib/lighteval/tasks/tasks/toxigen.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,034 copying build/lib/lighteval/tasks/tasks/sacrebleu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,038 copying build/lib/lighteval/tasks/tasks/aime.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,040 copying build/lib/lighteval/tasks/tasks/gsm_plus.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,042 copying build/lib/lighteval/tasks/tasks/headqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,044 copying build/lib/lighteval/tasks/tasks/med_dialog.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,046 copying build/lib/lighteval/tasks/tasks/sciq.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,048 copying build/lib/lighteval/tasks/tasks/tiny_benchmarks.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,051 copying build/lib/lighteval/tasks/tasks/winogrande.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,053 copying build/lib/lighteval/tasks/tasks/entitymatching.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,055 copying build/lib/lighteval/tasks/tasks/arithmetic.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,058 copying build/lib/lighteval/tasks/tasks/lexglue.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,060 copying build/lib/lighteval/tasks/tasks/webqs.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,062 copying build/lib/lighteval/tasks/tasks/bold.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,064 copying build/lib/lighteval/tasks/tasks/triviaqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,066 copying build/lib/lighteval/tasks/tasks/arc_agi_2.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,068 copying build/lib/lighteval/tasks/tasks/mmlu.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,071 copying build/lib/lighteval/tasks/tasks/quac.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,073 copying build/lib/lighteval/tasks/tasks/lambada.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,075 copying build/lib/lighteval/tasks/tasks/real_toxicity_prompts.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,076 copying build/lib/lighteval/tasks/tasks/wikitext.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,079 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks/ifbench 2025-11-24T17:02:47,080 copying build/lib/lighteval/tasks/tasks/ifbench/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifbench 2025-11-24T17:02:47,082 copying build/lib/lighteval/tasks/tasks/ifbench/evaluation_lib.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifbench 2025-11-24T17:02:47,084 copying build/lib/lighteval/tasks/tasks/ifbench/main.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifbench 2025-11-24T17:02:47,087 copying build/lib/lighteval/tasks/tasks/ifbench/instructions.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifbench 2025-11-24T17:02:47,090 copying build/lib/lighteval/tasks/tasks/med.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,092 copying build/lib/lighteval/tasks/tasks/boolq.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,094 copying build/lib/lighteval/tasks/tasks/qasper.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,096 copying build/lib/lighteval/tasks/tasks/the_pile.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,099 copying build/lib/lighteval/tasks/tasks/aa_omniscience.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,101 copying build/lib/lighteval/tasks/tasks/lextreme.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,104 copying build/lib/lighteval/tasks/tasks/wikifact.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,107 copying build/lib/lighteval/tasks/tasks/agieval.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,109 copying build/lib/lighteval/tasks/tasks/dyck_language.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,111 copying build/lib/lighteval/tasks/tasks/musr.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,113 copying build/lib/lighteval/tasks/tasks/prost.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,115 copying build/lib/lighteval/tasks/tasks/civil_comments.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,117 copying build/lib/lighteval/tasks/tasks/piqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,119 copying build/lib/lighteval/tasks/tasks/swag.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,121 copying build/lib/lighteval/tasks/tasks/numeracy.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,124 copying build/lib/lighteval/tasks/tasks/slr_bench.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,126 copying build/lib/lighteval/tasks/tasks/race_high.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,128 copying build/lib/lighteval/tasks/tasks/asdiv.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,130 copying build/lib/lighteval/tasks/tasks/twitterAAE.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,132 copying build/lib/lighteval/tasks/tasks/ethics.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,134 copying build/lib/lighteval/tasks/tasks/synthetic_reasoning.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,136 copying build/lib/lighteval/tasks/tasks/math_500.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,138 copying build/lib/lighteval/tasks/tasks/coqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,140 copying build/lib/lighteval/tasks/tasks/bigbench.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,144 copying build/lib/lighteval/tasks/tasks/xwinograd.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,146 copying build/lib/lighteval/tasks/tasks/narrativeqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,147 copying build/lib/lighteval/tasks/tasks/simpleqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,149 copying build/lib/lighteval/tasks/tasks/jeopardy.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,151 copying build/lib/lighteval/tasks/tasks/gsm8k.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,154 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks/lcb 2025-11-24T17:02:47,154 copying build/lib/lighteval/tasks/tasks/lcb/codegen_metrics.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/lcb 2025-11-24T17:02:47,157 copying build/lib/lighteval/tasks/tasks/lcb/main.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/lcb 2025-11-24T17:02:47,160 copying build/lib/lighteval/tasks/tasks/entity_data_imputation.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,162 copying build/lib/lighteval/tasks/tasks/drop_qa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,164 copying build/lib/lighteval/tasks/tasks/natural_questions.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,166 copying build/lib/lighteval/tasks/tasks/mgsm.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,168 copying build/lib/lighteval/tasks/tasks/olympiade_bench.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,171 copying build/lib/lighteval/tasks/tasks/siqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,173 copying build/lib/lighteval/tasks/tasks/xcopa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,175 copying build/lib/lighteval/tasks/tasks/hle.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,178 copying build/lib/lighteval/tasks/tasks/truthfulqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,180 copying build/lib/lighteval/tasks/tasks/gpqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,182 copying build/lib/lighteval/tasks/tasks/openbookqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,185 copying build/lib/lighteval/tasks/tasks/xstory_cloze.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,187 copying build/lib/lighteval/tasks/tasks/bbq.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,189 copying build/lib/lighteval/tasks/tasks/raft.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,192 copying build/lib/lighteval/tasks/tasks/blimp.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,195 copying build/lib/lighteval/tasks/tasks/babi_qa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,197 copying build/lib/lighteval/tasks/tasks/glue.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,199 copying build/lib/lighteval/tasks/tasks/covid_dialogue.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,201 copying build/lib/lighteval/tasks/tasks/imdb.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,204 copying build/lib/lighteval/tasks/tasks/custom_task_classification_grammar_task.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,207 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks/mix_eval 2025-11-24T17:02:47,208 copying build/lib/lighteval/tasks/tasks/mix_eval/prompts.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/mix_eval 2025-11-24T17:02:47,210 copying build/lib/lighteval/tasks/tasks/mix_eval/judge_prompts.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/mix_eval 2025-11-24T17:02:47,213 copying build/lib/lighteval/tasks/tasks/mix_eval/main.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/mix_eval 2025-11-24T17:02:47,215 copying build/lib/lighteval/tasks/tasks/commonsenseqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,217 copying build/lib/lighteval/tasks/tasks/storycloze.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,219 copying build/lib/lighteval/tasks/tasks/logiqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,221 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks/ifeval 2025-11-24T17:02:47,222 copying build/lib/lighteval/tasks/tasks/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifeval 2025-11-24T17:02:47,225 copying build/lib/lighteval/tasks/tasks/ifeval/instructions_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifeval 2025-11-24T17:02:47,228 copying build/lib/lighteval/tasks/tasks/ifeval/main.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifeval 2025-11-24T17:02:47,230 copying build/lib/lighteval/tasks/tasks/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/ifeval 2025-11-24T17:02:47,233 copying build/lib/lighteval/tasks/tasks/mmmu_pro.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,235 copying build/lib/lighteval/tasks/tasks/math.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,238 copying build/lib/lighteval/tasks/tasks/legalsupport.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,240 copying build/lib/lighteval/tasks/tasks/legal_summarization.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,242 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/tasks/mt_bench 2025-11-24T17:02:47,243 copying build/lib/lighteval/tasks/tasks/mt_bench/main.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/mt_bench 2025-11-24T17:02:47,246 copying build/lib/lighteval/tasks/tasks/mt_bench/judge_prompt_templates.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks/mt_bench 2025-11-24T17:02:47,248 copying build/lib/lighteval/tasks/tasks/aimo.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,250 copying build/lib/lighteval/tasks/tasks/anli.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,252 copying build/lib/lighteval/tasks/tasks/unscramble.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,254 copying build/lib/lighteval/tasks/tasks/arc.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,257 copying build/lib/lighteval/tasks/tasks/mmlu_redux.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,259 copying build/lib/lighteval/tasks/tasks/pubmedqa.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,261 copying build/lib/lighteval/tasks/tasks/qa4mre.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,263 copying build/lib/lighteval/tasks/tasks/mmlu_pro.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,265 copying build/lib/lighteval/tasks/tasks/bigbench_hard.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,267 copying build/lib/lighteval/tasks/tasks/hellaswag.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,269 copying build/lib/lighteval/tasks/tasks/summarization.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,271 copying build/lib/lighteval/tasks/tasks/squad_v2.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks/tasks 2025-11-24T17:02:47,273 copying build/lib/lighteval/tasks/requests.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks 2025-11-24T17:02:47,276 copying build/lib/lighteval/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks 2025-11-24T17:02:47,278 copying build/lib/lighteval/tasks/prompt_manager.py -> build/bdist.linux-armv7l/wheel/./lighteval/tasks 2025-11-24T17:02:47,281 copying build/lib/lighteval/cli_args.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-24T17:02:47,283 copying build/lib/lighteval/data.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-24T17:02:47,286 copying build/lib/lighteval/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-24T17:02:47,289 creating build/bdist.linux-armv7l/wheel/lighteval/metrics 2025-11-24T17:02:47,290 creating build/bdist.linux-armv7l/wheel/lighteval/metrics/imports 2025-11-24T17:02:47,291 copying build/lib/lighteval/metrics/imports/summac.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/imports 2025-11-24T17:02:47,294 copying build/lib/lighteval/metrics/imports/data_stats_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/imports 2025-11-24T17:02:47,297 copying build/lib/lighteval/metrics/imports/data_stats_metric.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/imports 2025-11-24T17:02:47,299 copying build/lib/lighteval/metrics/imports/bert_scorer.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/imports 2025-11-24T17:02:47,302 copying build/lib/lighteval/metrics/imports/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/imports 2025-11-24T17:02:47,304 creating build/bdist.linux-armv7l/wheel/lighteval/metrics/harness_compatibility 2025-11-24T17:02:47,306 copying build/lib/lighteval/metrics/harness_compatibility/truthful_qa.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/harness_compatibility 2025-11-24T17:02:47,308 copying build/lib/lighteval/metrics/harness_compatibility/drop.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/harness_compatibility 2025-11-24T17:02:47,311 copying build/lib/lighteval/metrics/metrics_corpus.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics 2025-11-24T17:02:47,313 copying build/lib/lighteval/metrics/sample_preparator.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics 2025-11-24T17:02:47,315 copying build/lib/lighteval/metrics/metrics_sample.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics 2025-11-24T17:02:47,319 copying build/lib/lighteval/metrics/metrics.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics 2025-11-24T17:02:47,322 copying build/lib/lighteval/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics 2025-11-24T17:02:47,325 creating build/bdist.linux-armv7l/wheel/lighteval/metrics/utils 2025-11-24T17:02:47,327 copying build/lib/lighteval/metrics/utils/math_comparison.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/utils 2025-11-24T17:02:47,331 copying build/lib/lighteval/metrics/utils/extractive_match_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/utils 2025-11-24T17:02:47,334 copying build/lib/lighteval/metrics/utils/judge_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/utils 2025-11-24T17:02:47,336 copying build/lib/lighteval/metrics/utils/llm_as_judge.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/utils 2025-11-24T17:02:47,340 copying build/lib/lighteval/metrics/utils/stderr.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/utils 2025-11-24T17:02:47,342 copying build/lib/lighteval/metrics/utils/metric_utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/utils 2025-11-24T17:02:47,345 copying build/lib/lighteval/metrics/utils/linguistic_tokenizers.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics/utils 2025-11-24T17:02:47,348 copying build/lib/lighteval/metrics/normalizations.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics 2025-11-24T17:02:47,351 copying build/lib/lighteval/metrics/dynamic_metrics.py -> build/bdist.linux-armv7l/wheel/./lighteval/metrics 2025-11-24T17:02:47,354 creating build/bdist.linux-armv7l/wheel/lighteval/utils 2025-11-24T17:02:47,355 copying build/lib/lighteval/utils/cache_management.py -> build/bdist.linux-armv7l/wheel/./lighteval/utils 2025-11-24T17:02:47,358 copying build/lib/lighteval/utils/language.py -> build/bdist.linux-armv7l/wheel/./lighteval/utils 2025-11-24T17:02:47,361 copying build/lib/lighteval/utils/imports.py -> build/bdist.linux-armv7l/wheel/./lighteval/utils 2025-11-24T17:02:47,364 copying build/lib/lighteval/utils/parallelism.py -> build/bdist.linux-armv7l/wheel/./lighteval/utils 2025-11-24T17:02:47,366 copying build/lib/lighteval/utils/utils.py -> build/bdist.linux-armv7l/wheel/./lighteval/utils 2025-11-24T17:02:47,369 copying build/lib/lighteval/utils/timeout.py -> build/bdist.linux-armv7l/wheel/./lighteval/utils 2025-11-24T17:02:47,371 copying build/lib/lighteval/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./lighteval/utils 2025-11-24T17:02:47,373 copying build/lib/lighteval/main_vllm.py -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-24T17:02:47,376 copying build/lib/lighteval/py.typed -> build/bdist.linux-armv7l/wheel/./lighteval 2025-11-24T17:02:47,378 running install_egg_info 2025-11-24T17:02:47,384 Copying src/lighteval.egg-info to build/bdist.linux-armv7l/wheel/./lighteval-0.13.0-py3.11.egg-info 2025-11-24T17:02:47,397 running install_scripts 2025-11-24T17:02:47,411 creating build/bdist.linux-armv7l/wheel/lighteval-0.13.0.dist-info/WHEEL 2025-11-24T17:02:47,414 creating '/tmp/pip-wheel-hgu30u0h/.tmp-_u1cc3mk/lighteval-0.13.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-11-24T17:02:47,418 adding 'lighteval/__init__.py' 2025-11-24T17:02:47,420 adding 'lighteval/__main__.py' 2025-11-24T17:02:47,422 adding 'lighteval/cli_args.py' 2025-11-24T17:02:47,424 adding 'lighteval/data.py' 2025-11-24T17:02:47,427 adding 'lighteval/main_accelerate.py' 2025-11-24T17:02:47,428 adding 'lighteval/main_baseline.py' 2025-11-24T17:02:47,430 adding 'lighteval/main_custom.py' 2025-11-24T17:02:47,432 adding 'lighteval/main_endpoint.py' 2025-11-24T17:02:47,435 adding 'lighteval/main_inspect.py' 2025-11-24T17:02:47,436 adding 'lighteval/main_nanotron.py' 2025-11-24T17:02:47,438 adding 'lighteval/main_sglang.py' 2025-11-24T17:02:47,440 adding 'lighteval/main_tasks.py' 2025-11-24T17:02:47,441 adding 'lighteval/main_vllm.py' 2025-11-24T17:02:47,444 adding 'lighteval/pipeline.py' 2025-11-24T17:02:47,445 adding 'lighteval/py.typed' 2025-11-24T17:02:47,450 adding 'lighteval/logging/evaluation_tracker.py' 2025-11-24T17:02:47,453 adding 'lighteval/logging/info_loggers.py' 2025-11-24T17:02:47,455 adding 'lighteval/metrics/__init__.py' 2025-11-24T17:02:47,457 adding 'lighteval/metrics/dynamic_metrics.py' 2025-11-24T17:02:47,459 adding 'lighteval/metrics/metrics.py' 2025-11-24T17:02:47,461 adding 'lighteval/metrics/metrics_corpus.py' 2025-11-24T17:02:47,467 adding 'lighteval/metrics/metrics_sample.py' 2025-11-24T17:02:47,470 adding 'lighteval/metrics/normalizations.py' 2025-11-24T17:02:47,471 adding 'lighteval/metrics/sample_preparator.py' 2025-11-24T17:02:47,474 adding 'lighteval/metrics/harness_compatibility/drop.py' 2025-11-24T17:02:47,475 adding 'lighteval/metrics/harness_compatibility/truthful_qa.py' 2025-11-24T17:02:47,477 adding 'lighteval/metrics/imports/__init__.py' 2025-11-24T17:02:47,480 adding 'lighteval/metrics/imports/bert_scorer.py' 2025-11-24T17:02:47,481 adding 'lighteval/metrics/imports/data_stats_metric.py' 2025-11-24T17:02:47,483 adding 'lighteval/metrics/imports/data_stats_utils.py' 2025-11-24T17:02:47,485 adding 'lighteval/metrics/imports/summac.py' 2025-11-24T17:02:47,489 adding 'lighteval/metrics/utils/extractive_match_utils.py' 2025-11-24T17:02:47,491 adding 'lighteval/metrics/utils/judge_utils.py' 2025-11-24T17:02:47,492 adding 'lighteval/metrics/utils/linguistic_tokenizers.py' 2025-11-24T17:02:47,495 adding 'lighteval/metrics/utils/llm_as_judge.py' 2025-11-24T17:02:47,498 adding 'lighteval/metrics/utils/math_comparison.py' 2025-11-24T17:02:47,499 adding 'lighteval/metrics/utils/metric_utils.py' 2025-11-24T17:02:47,501 adding 'lighteval/metrics/utils/stderr.py' 2025-11-24T17:02:47,503 adding 'lighteval/models/abstract_model.py' 2025-11-24T17:02:47,505 adding 'lighteval/models/model_input.py' 2025-11-24T17:02:47,506 adding 'lighteval/models/model_loader.py' 2025-11-24T17:02:47,508 adding 'lighteval/models/model_output.py' 2025-11-24T17:02:47,509 adding 'lighteval/models/utils.py' 2025-11-24T17:02:47,511 adding 'lighteval/models/custom/custom_model.py' 2025-11-24T17:02:47,513 adding 'lighteval/models/dummy/dummy_model.py' 2025-11-24T17:02:47,517 adding 'lighteval/models/endpoints/endpoint_model.py' 2025-11-24T17:02:47,519 adding 'lighteval/models/endpoints/inference_providers_model.py' 2025-11-24T17:02:47,521 adding 'lighteval/models/endpoints/litellm_model.py' 2025-11-24T17:02:47,523 adding 'lighteval/models/endpoints/tgi_model.py' 2025-11-24T17:02:47,530 adding 'lighteval/models/nanotron/nanotron_model.py' 2025-11-24T17:02:47,533 adding 'lighteval/models/sglang/sglang_model.py' 2025-11-24T17:02:47,535 adding 'lighteval/models/transformers/adapter_model.py' 2025-11-24T17:02:47,537 adding 'lighteval/models/transformers/delta_model.py' 2025-11-24T17:02:47,543 adding 'lighteval/models/transformers/transformers_model.py' 2025-11-24T17:02:47,546 adding 'lighteval/models/transformers/vlm_transformers_model.py' 2025-11-24T17:02:47,550 adding 'lighteval/models/vllm/vllm_model.py' 2025-11-24T17:02:47,552 adding 'lighteval/tasks/__init__.py' 2025-11-24T17:02:47,555 adding 'lighteval/tasks/lighteval_task.py' 2025-11-24T17:02:47,557 adding 'lighteval/tasks/prompt_manager.py' 2025-11-24T17:02:47,561 adding 'lighteval/tasks/registry.py' 2025-11-24T17:02:47,562 adding 'lighteval/tasks/requests.py' 2025-11-24T17:02:47,564 adding 'lighteval/tasks/multilingual/__init__.py' 2025-11-24T17:02:47,566 adding 'lighteval/tasks/multilingual/adapters.py' 2025-11-24T17:02:47,569 adding 'lighteval/tasks/multilingual/tasks/acva.py' 2025-11-24T17:02:47,571 adding 'lighteval/tasks/multilingual/tasks/afri_mgsm.py' 2025-11-24T17:02:47,572 adding 'lighteval/tasks/multilingual/tasks/afri_mmlu.py' 2025-11-24T17:02:47,573 adding 'lighteval/tasks/multilingual/tasks/afri_xnli.py' 2025-11-24T17:02:47,577 adding 'lighteval/tasks/multilingual/tasks/arabic.py' 2025-11-24T17:02:47,578 adding 'lighteval/tasks/multilingual/tasks/arabic_arc.py' 2025-11-24T17:02:47,580 adding 'lighteval/tasks/multilingual/tasks/arabic_mmlu.py' 2025-11-24T17:02:47,581 adding 'lighteval/tasks/multilingual/tasks/arcd.py' 2025-11-24T17:02:47,582 adding 'lighteval/tasks/multilingual/tasks/belebele.py' 2025-11-24T17:02:47,584 adding 'lighteval/tasks/multilingual/tasks/c3.py' 2025-11-24T17:02:47,585 adding 'lighteval/tasks/multilingual/tasks/ceval.py' 2025-11-24T17:02:47,586 adding 'lighteval/tasks/multilingual/tasks/chegeka.py' 2025-11-24T17:02:47,588 adding 'lighteval/tasks/multilingual/tasks/chinese_squad.py' 2025-11-24T17:02:47,589 adding 'lighteval/tasks/multilingual/tasks/cmath.py' 2025-11-24T17:02:47,590 adding 'lighteval/tasks/multilingual/tasks/cmmlu.py' 2025-11-24T17:02:47,591 adding 'lighteval/tasks/multilingual/tasks/cmnli.py' 2025-11-24T17:02:47,593 adding 'lighteval/tasks/multilingual/tasks/cmrc2018.py' 2025-11-24T17:02:47,594 adding 'lighteval/tasks/multilingual/tasks/copa_indic.py' 2025-11-24T17:02:47,595 adding 'lighteval/tasks/multilingual/tasks/enem.py' 2025-11-24T17:02:47,597 adding 'lighteval/tasks/multilingual/tasks/exams.py' 2025-11-24T17:02:47,598 adding 'lighteval/tasks/multilingual/tasks/faquad.py' 2025-11-24T17:02:47,601 adding 'lighteval/tasks/multilingual/tasks/filipino.py' 2025-11-24T17:02:47,602 adding 'lighteval/tasks/multilingual/tasks/flores200.py' 2025-11-24T17:02:47,603 adding 'lighteval/tasks/multilingual/tasks/fquad_v2.py' 2025-11-24T17:02:47,605 adding 'lighteval/tasks/multilingual/tasks/french.py' 2025-11-24T17:02:47,606 adding 'lighteval/tasks/multilingual/tasks/french_boolq.py' 2025-11-24T17:02:47,607 adding 'lighteval/tasks/multilingual/tasks/french_triviqa.py' 2025-11-24T17:02:47,609 adding 'lighteval/tasks/multilingual/tasks/german_rag.py' 2025-11-24T17:02:47,610 adding 'lighteval/tasks/multilingual/tasks/germanquad.py' 2025-11-24T17:02:47,611 adding 'lighteval/tasks/multilingual/tasks/global_mmlu.py' 2025-11-24T17:02:47,612 adding 'lighteval/tasks/multilingual/tasks/hellaswag_hin.py' 2025-11-24T17:02:47,614 adding 'lighteval/tasks/multilingual/tasks/hellaswag_tel.py' 2025-11-24T17:02:47,615 adding 'lighteval/tasks/multilingual/tasks/hellaswag_tha.py' 2025-11-24T17:02:47,616 adding 'lighteval/tasks/multilingual/tasks/hellaswag_tur.py' 2025-11-24T17:02:47,617 adding 'lighteval/tasks/multilingual/tasks/hindi_arc.py' 2025-11-24T17:02:47,619 adding 'lighteval/tasks/multilingual/tasks/hindi_boolq.py' 2025-11-24T17:02:47,620 adding 'lighteval/tasks/multilingual/tasks/indicqa.py' 2025-11-24T17:02:47,621 adding 'lighteval/tasks/multilingual/tasks/kenswquad.py' 2025-11-24T17:02:47,622 adding 'lighteval/tasks/multilingual/tasks/m3exams.py' 2025-11-24T17:02:47,624 adding 'lighteval/tasks/multilingual/tasks/mathlogicqa_rus.py' 2025-11-24T17:02:47,625 adding 'lighteval/tasks/multilingual/tasks/meta_mmlu.py' 2025-11-24T17:02:47,626 adding 'lighteval/tasks/multilingual/tasks/mgsm.py' 2025-11-24T17:02:47,628 adding 'lighteval/tasks/multilingual/tasks/mintaka.py' 2025-11-24T17:02:47,629 adding 'lighteval/tasks/multilingual/tasks/mkqa.py' 2025-11-24T17:02:47,630 adding 'lighteval/tasks/multilingual/tasks/mlmm_arc_challenge.py' 2025-11-24T17:02:47,632 adding 'lighteval/tasks/multilingual/tasks/mlmm_hellaswag.py' 2025-11-24T17:02:47,633 adding 'lighteval/tasks/multilingual/tasks/mlmm_mmlu.py' 2025-11-24T17:02:47,634 adding 'lighteval/tasks/multilingual/tasks/mlmm_truthfulqa.py' 2025-11-24T17:02:47,636 adding 'lighteval/tasks/multilingual/tasks/mlqa.py' 2025-11-24T17:02:47,637 adding 'lighteval/tasks/multilingual/tasks/oab_exams.py' 2025-11-24T17:02:47,638 adding 'lighteval/tasks/multilingual/tasks/ocnli.py' 2025-11-24T17:02:47,640 adding 'lighteval/tasks/multilingual/tasks/openai_mmlu.py' 2025-11-24T17:02:47,641 adding 'lighteval/tasks/multilingual/tasks/openbook_ara.py' 2025-11-24T17:02:47,642 adding 'lighteval/tasks/multilingual/tasks/openbook_es.py' 2025-11-24T17:02:47,644 adding 'lighteval/tasks/multilingual/tasks/openbook_rus.py' 2025-11-24T17:02:47,645 adding 'lighteval/tasks/multilingual/tasks/oz.py' 2025-11-24T17:02:47,646 adding 'lighteval/tasks/multilingual/tasks/parus.py' 2025-11-24T17:02:47,648 adding 'lighteval/tasks/multilingual/tasks/paws_x.py' 2025-11-24T17:02:47,649 adding 'lighteval/tasks/multilingual/tasks/piqa_ar.py' 2025-11-24T17:02:47,650 adding 'lighteval/tasks/multilingual/tasks/rcb.py' 2025-11-24T17:02:47,651 adding 'lighteval/tasks/multilingual/tasks/sber_squad.py' 2025-11-24T17:02:47,654 adding 'lighteval/tasks/multilingual/tasks/serbian_eval.py' 2025-11-24T17:02:47,656 adding 'lighteval/tasks/multilingual/tasks/soqal.py' 2025-11-24T17:02:47,657 adding 'lighteval/tasks/multilingual/tasks/squad_es.py' 2025-11-24T17:02:47,658 adding 'lighteval/tasks/multilingual/tasks/squad_it.py' 2025-11-24T17:02:47,660 adding 'lighteval/tasks/multilingual/tasks/swahili_arc.py' 2025-11-24T17:02:47,661 adding 'lighteval/tasks/multilingual/tasks/thai_exams.py' 2025-11-24T17:02:47,662 adding 'lighteval/tasks/multilingual/tasks/thaiqa.py' 2025-11-24T17:02:47,664 adding 'lighteval/tasks/multilingual/tasks/tquad_v2.py' 2025-11-24T17:02:47,665 adding 'lighteval/tasks/multilingual/tasks/turkic.py' 2025-11-24T17:02:47,667 adding 'lighteval/tasks/multilingual/tasks/turkish_arc.py' 2025-11-24T17:02:47,668 adding 'lighteval/tasks/multilingual/tasks/turkish_mmlu.py' 2025-11-24T17:02:47,669 adding 'lighteval/tasks/multilingual/tasks/tydiqa.py' 2025-11-24T17:02:47,670 adding 'lighteval/tasks/multilingual/tasks/worldtree_rus.py' 2025-11-24T17:02:47,672 adding 'lighteval/tasks/multilingual/tasks/xcodah.py' 2025-11-24T17:02:47,673 adding 'lighteval/tasks/multilingual/tasks/xcopa.py' 2025-11-24T17:02:47,674 adding 'lighteval/tasks/multilingual/tasks/xcsqa.py' 2025-11-24T17:02:47,676 adding 'lighteval/tasks/multilingual/tasks/xnli.py' 2025-11-24T17:02:47,677 adding 'lighteval/tasks/multilingual/tasks/xnli2.py' 2025-11-24T17:02:47,678 adding 'lighteval/tasks/multilingual/tasks/xnli_indic.py' 2025-11-24T17:02:47,680 adding 'lighteval/tasks/multilingual/tasks/xquad.py' 2025-11-24T17:02:47,681 adding 'lighteval/tasks/multilingual/tasks/xstory.py' 2025-11-24T17:02:47,682 adding 'lighteval/tasks/multilingual/tasks/xwinograd.py' 2025-11-24T17:02:47,684 adding 'lighteval/tasks/multilingual/utils/__init__.py' 2025-11-24T17:02:47,685 adding 'lighteval/tasks/multilingual/utils/adapters_utils.py' 2025-11-24T17:02:47,687 adding 'lighteval/tasks/multilingual/utils/task_utils.py' 2025-11-24T17:02:47,691 adding 'lighteval/tasks/tasks/aa_omniscience.py' 2025-11-24T17:02:47,692 adding 'lighteval/tasks/tasks/agieval.py' 2025-11-24T17:02:47,694 adding 'lighteval/tasks/tasks/aime.py' 2025-11-24T17:02:47,695 adding 'lighteval/tasks/tasks/aimo.py' 2025-11-24T17:02:47,696 adding 'lighteval/tasks/tasks/anli.py' 2025-11-24T17:02:47,698 adding 'lighteval/tasks/tasks/arc.py' 2025-11-24T17:02:47,699 adding 'lighteval/tasks/tasks/arc_agi_2.py' 2025-11-24T17:02:47,700 adding 'lighteval/tasks/tasks/arithmetic.py' 2025-11-24T17:02:47,702 adding 'lighteval/tasks/tasks/asdiv.py' 2025-11-24T17:02:47,703 adding 'lighteval/tasks/tasks/babi_qa.py' 2025-11-24T17:02:47,704 adding 'lighteval/tasks/tasks/bbq.py' 2025-11-24T17:02:47,709 adding 'lighteval/tasks/tasks/bigbench.py' 2025-11-24T17:02:47,711 adding 'lighteval/tasks/tasks/bigbench_hard.py' 2025-11-24T17:02:47,713 adding 'lighteval/tasks/tasks/blimp.py' 2025-11-24T17:02:47,714 adding 'lighteval/tasks/tasks/bold.py' 2025-11-24T17:02:47,716 adding 'lighteval/tasks/tasks/boolq.py' 2025-11-24T17:02:47,717 adding 'lighteval/tasks/tasks/civil_comments.py' 2025-11-24T17:02:47,718 adding 'lighteval/tasks/tasks/commonsenseqa.py' 2025-11-24T17:02:47,720 adding 'lighteval/tasks/tasks/coqa.py' 2025-11-24T17:02:47,721 adding 'lighteval/tasks/tasks/covid_dialogue.py' 2025-11-24T17:02:47,724 adding 'lighteval/tasks/tasks/custom_task_classification_grammar_task.py' 2025-11-24T17:02:47,725 adding 'lighteval/tasks/tasks/drop_qa.py' 2025-11-24T17:02:47,726 adding 'lighteval/tasks/tasks/dyck_language.py' 2025-11-24T17:02:47,728 adding 'lighteval/tasks/tasks/entity_data_imputation.py' 2025-11-24T17:02:47,729 adding 'lighteval/tasks/tasks/entitymatching.py' 2025-11-24T17:02:47,731 adding 'lighteval/tasks/tasks/ethics.py' 2025-11-24T17:02:47,732 adding 'lighteval/tasks/tasks/glue.py' 2025-11-24T17:02:47,734 adding 'lighteval/tasks/tasks/gpqa.py' 2025-11-24T17:02:47,735 adding 'lighteval/tasks/tasks/gsm8k.py' 2025-11-24T17:02:47,736 adding 'lighteval/tasks/tasks/gsm_plus.py' 2025-11-24T17:02:47,738 adding 'lighteval/tasks/tasks/headqa.py' 2025-11-24T17:02:47,739 adding 'lighteval/tasks/tasks/hellaswag.py' 2025-11-24T17:02:47,741 adding 'lighteval/tasks/tasks/hle.py' 2025-11-24T17:02:47,742 adding 'lighteval/tasks/tasks/imdb.py' 2025-11-24T17:02:47,744 adding 'lighteval/tasks/tasks/jeopardy.py' 2025-11-24T17:02:47,745 adding 'lighteval/tasks/tasks/lambada.py' 2025-11-24T17:02:47,746 adding 'lighteval/tasks/tasks/legal_summarization.py' 2025-11-24T17:02:47,747 adding 'lighteval/tasks/tasks/legalsupport.py' 2025-11-24T17:02:47,749 adding 'lighteval/tasks/tasks/lexglue.py' 2025-11-24T17:02:47,751 adding 'lighteval/tasks/tasks/lextreme.py' 2025-11-24T17:02:47,752 adding 'lighteval/tasks/tasks/logiqa.py' 2025-11-24T17:02:47,754 adding 'lighteval/tasks/tasks/lsat_qa.py' 2025-11-24T17:02:47,755 adding 'lighteval/tasks/tasks/math.py' 2025-11-24T17:02:47,756 adding 'lighteval/tasks/tasks/math_500.py' 2025-11-24T17:02:47,758 adding 'lighteval/tasks/tasks/mathqa.py' 2025-11-24T17:02:47,759 adding 'lighteval/tasks/tasks/med.py' 2025-11-24T17:02:47,760 adding 'lighteval/tasks/tasks/med_dialog.py' 2025-11-24T17:02:47,762 adding 'lighteval/tasks/tasks/mgsm.py' 2025-11-24T17:02:47,764 adding 'lighteval/tasks/tasks/mmlu.py' 2025-11-24T17:02:47,765 adding 'lighteval/tasks/tasks/mmlu_pro.py' 2025-11-24T17:02:47,766 adding 'lighteval/tasks/tasks/mmlu_redux.py' 2025-11-24T17:02:47,768 adding 'lighteval/tasks/tasks/mmmu_pro.py' 2025-11-24T17:02:47,769 adding 'lighteval/tasks/tasks/musr.py' 2025-11-24T17:02:47,770 adding 'lighteval/tasks/tasks/narrativeqa.py' 2025-11-24T17:02:47,772 adding 'lighteval/tasks/tasks/natural_questions.py' 2025-11-24T17:02:47,773 adding 'lighteval/tasks/tasks/numeracy.py' 2025-11-24T17:02:47,775 adding 'lighteval/tasks/tasks/olympiade_bench.py' 2025-11-24T17:02:47,776 adding 'lighteval/tasks/tasks/openbookqa.py' 2025-11-24T17:02:47,777 adding 'lighteval/tasks/tasks/piqa.py' 2025-11-24T17:02:47,779 adding 'lighteval/tasks/tasks/prost.py' 2025-11-24T17:02:47,780 adding 'lighteval/tasks/tasks/pubmedqa.py' 2025-11-24T17:02:47,781 adding 'lighteval/tasks/tasks/qa4mre.py' 2025-11-24T17:02:47,782 adding 'lighteval/tasks/tasks/qasper.py' 2025-11-24T17:02:47,783 adding 'lighteval/tasks/tasks/quac.py' 2025-11-24T17:02:47,785 adding 'lighteval/tasks/tasks/race_high.py' 2025-11-24T17:02:47,787 adding 'lighteval/tasks/tasks/raft.py' 2025-11-24T17:02:47,788 adding 'lighteval/tasks/tasks/real_toxicity_prompts.py' 2025-11-24T17:02:47,791 adding 'lighteval/tasks/tasks/sacrebleu.py' 2025-11-24T17:02:47,793 adding 'lighteval/tasks/tasks/sciq.py' 2025-11-24T17:02:47,794 adding 'lighteval/tasks/tasks/simpleqa.py' 2025-11-24T17:02:47,796 adding 'lighteval/tasks/tasks/siqa.py' 2025-11-24T17:02:47,797 adding 'lighteval/tasks/tasks/slr_bench.py' 2025-11-24T17:02:47,798 adding 'lighteval/tasks/tasks/squad_v2.py' 2025-11-24T17:02:47,800 adding 'lighteval/tasks/tasks/storycloze.py' 2025-11-24T17:02:47,801 adding 'lighteval/tasks/tasks/summarization.py' 2025-11-24T17:02:47,802 adding 'lighteval/tasks/tasks/swag.py' 2025-11-24T17:02:47,803 adding 'lighteval/tasks/tasks/synthetic_reasoning.py' 2025-11-24T17:02:47,805 adding 'lighteval/tasks/tasks/the_pile.py' 2025-11-24T17:02:47,807 adding 'lighteval/tasks/tasks/tiny_benchmarks.py' 2025-11-24T17:02:47,808 adding 'lighteval/tasks/tasks/toxigen.py' 2025-11-24T17:02:47,809 adding 'lighteval/tasks/tasks/triviaqa.py' 2025-11-24T17:02:47,811 adding 'lighteval/tasks/tasks/truthfulqa.py' 2025-11-24T17:02:47,812 adding 'lighteval/tasks/tasks/twitterAAE.py' 2025-11-24T17:02:47,813 adding 'lighteval/tasks/tasks/unscramble.py' 2025-11-24T17:02:47,815 adding 'lighteval/tasks/tasks/webqs.py' 2025-11-24T17:02:47,817 adding 'lighteval/tasks/tasks/wikifact.py' 2025-11-24T17:02:47,818 adding 'lighteval/tasks/tasks/wikitext.py' 2025-11-24T17:02:47,820 adding 'lighteval/tasks/tasks/winogrande.py' 2025-11-24T17:02:47,821 adding 'lighteval/tasks/tasks/xcopa.py' 2025-11-24T17:02:47,822 adding 'lighteval/tasks/tasks/xstory_cloze.py' 2025-11-24T17:02:47,824 adding 'lighteval/tasks/tasks/xwinograd.py' 2025-11-24T17:02:47,826 adding 'lighteval/tasks/tasks/ifbench/evaluation_lib.py' 2025-11-24T17:02:47,833 adding 'lighteval/tasks/tasks/ifbench/instructions.py' 2025-11-24T17:02:47,835 adding 'lighteval/tasks/tasks/ifbench/instructions_registry.py' 2025-11-24T17:02:47,837 adding 'lighteval/tasks/tasks/ifbench/main.py' 2025-11-24T17:02:47,842 adding 'lighteval/tasks/tasks/ifeval/instructions.py' 2025-11-24T17:02:47,844 adding 'lighteval/tasks/tasks/ifeval/instructions_registry.py' 2025-11-24T17:02:47,847 adding 'lighteval/tasks/tasks/ifeval/instructions_utils.py' 2025-11-24T17:02:47,849 adding 'lighteval/tasks/tasks/ifeval/main.py' 2025-11-24T17:02:47,852 adding 'lighteval/tasks/tasks/lcb/codegen_metrics.py' 2025-11-24T17:02:47,854 adding 'lighteval/tasks/tasks/lcb/main.py' 2025-11-24T17:02:47,857 adding 'lighteval/tasks/tasks/mix_eval/judge_prompts.py' 2025-11-24T17:02:47,858 adding 'lighteval/tasks/tasks/mix_eval/main.py' 2025-11-24T17:02:47,860 adding 'lighteval/tasks/tasks/mix_eval/prompts.py' 2025-11-24T17:02:47,862 adding 'lighteval/tasks/tasks/mt_bench/judge_prompt_templates.py' 2025-11-24T17:02:47,863 adding 'lighteval/tasks/tasks/mt_bench/main.py' 2025-11-24T17:02:47,865 adding 'lighteval/tasks/templates/__init__.py' 2025-11-24T17:02:47,866 adding 'lighteval/tasks/templates/boolq.py' 2025-11-24T17:02:47,868 adding 'lighteval/tasks/templates/continuation.py' 2025-11-24T17:02:47,869 adding 'lighteval/tasks/templates/copa.py' 2025-11-24T17:02:47,871 adding 'lighteval/tasks/templates/hellaswag.py' 2025-11-24T17:02:47,873 adding 'lighteval/tasks/templates/multichoice.py' 2025-11-24T17:02:47,875 adding 'lighteval/tasks/templates/nli.py' 2025-11-24T17:02:47,876 adding 'lighteval/tasks/templates/qa.py' 2025-11-24T17:02:47,877 adding 'lighteval/tasks/templates/translation.py' 2025-11-24T17:02:47,879 adding 'lighteval/tasks/templates/utils/__init__.py' 2025-11-24T17:02:47,880 adding 'lighteval/tasks/templates/utils/adapter_utils.py' 2025-11-24T17:02:47,882 adding 'lighteval/tasks/templates/utils/formatting_utils.py' 2025-11-24T17:02:47,883 adding 'lighteval/tasks/templates/utils/formulation.py' 2025-11-24T17:02:47,887 adding 'lighteval/tasks/templates/utils/translation_literals.py' 2025-11-24T17:02:47,889 adding 'lighteval/utils/__init__.py' 2025-11-24T17:02:47,892 adding 'lighteval/utils/cache_management.py' 2025-11-24T17:02:47,894 adding 'lighteval/utils/imports.py' 2025-11-24T17:02:47,896 adding 'lighteval/utils/language.py' 2025-11-24T17:02:47,898 adding 'lighteval/utils/parallelism.py' 2025-11-24T17:02:47,899 adding 'lighteval/utils/timeout.py' 2025-11-24T17:02:47,901 adding 'lighteval/utils/utils.py' 2025-11-24T17:02:47,904 adding 'lighteval-0.13.0.dist-info/licenses/LICENSE' 2025-11-24T17:02:47,906 adding 'lighteval-0.13.0.dist-info/METADATA' 2025-11-24T17:02:47,907 adding 'lighteval-0.13.0.dist-info/WHEEL' 2025-11-24T17:02:47,908 adding 'lighteval-0.13.0.dist-info/entry_points.txt' 2025-11-24T17:02:47,909 adding 'lighteval-0.13.0.dist-info/top_level.txt' 2025-11-24T17:02:47,914 adding 'lighteval-0.13.0.dist-info/RECORD' 2025-11-24T17:02:47,924 removing build/bdist.linux-armv7l/wheel 2025-11-24T17:02:48,094 Building wheel for lighteval (pyproject.toml): finished with status 'done' 2025-11-24T17:02:48,112 Created wheel for lighteval: filename=lighteval-0.13.0-py3-none-any.whl size=612660 sha256=7c2d6bb0bee2be9888effd9d10902cd1aaa47f5cfdaac0ca35848c3ebfc2319b 2025-11-24T17:02:48,114 Stored in directory: /tmp/pip-ephem-wheel-cache-q08jr1wv/wheels/98/c6/c9/e82d035fd009ad9e095a6644983fa65e5085302ad75b81da24 2025-11-24T17:02:48,137 Successfully built lighteval 2025-11-24T17:02:48,163 Removed build tracker: '/tmp/pip-build-tracker-d45nussh'