2025-08-31T08:26:46,623 Created temporary directory: /tmp/pip-build-tracker-7y_9rtrp
2025-08-31T08:26:46,624 Initialized build tracking at /tmp/pip-build-tracker-7y_9rtrp
2025-08-31T08:26:46,625 Created build tracker: /tmp/pip-build-tracker-7y_9rtrp
2025-08-31T08:26:46,625 Entered build tracker: /tmp/pip-build-tracker-7y_9rtrp
2025-08-31T08:26:46,626 Created temporary directory: /tmp/pip-wheel-y3v679ro
2025-08-31T08:26:46,630 Created temporary directory: /tmp/pip-ephem-wheel-cache-_p3hm_rz
2025-08-31T08:26:46,679 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2025-08-31T08:26:46,681 2 location(s) to search for versions of lm-eval:
2025-08-31T08:26:46,681 * https://pypi.org/simple/lm-eval/
2025-08-31T08:26:46,681 * https://www.piwheels.org/simple/lm-eval/
2025-08-31T08:26:46,682 Fetching project page and analyzing links: https://pypi.org/simple/lm-eval/
2025-08-31T08:26:46,683 Getting page https://pypi.org/simple/lm-eval/
2025-08-31T08:26:46,684 Found index url https://pypi.org/simple/
2025-08-31T08:26:46,904 Fetched page https://pypi.org/simple/lm-eval/ as application/vnd.pypi.simple.v1+json
2025-08-31T08:26:46,908   Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/1b/5f/7841febb99c12ffb453d33a67b9841e89dba18c388b644bf22b81d137fc4/lm_eval-0.0.1-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6)
2025-08-31T08:26:46,909   Found link https://files.pythonhosted.org/packages/21/5a/feb5ff3a1591ca963c54873d39116b0e6a4f80e493e961ac08569709c5d7/lm_eval-0.0.1.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6), version: 0.0.1
2025-08-31T08:26:46,910   Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/f3/a7/63cbce8b51de25fabb1c49f3a3fd1704faaacadb5ed816401f800e4d2dbd/lm_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6)
2025-08-31T08:26:46,910   Found link https://files.pythonhosted.org/packages/c5/fd/edd21b0f258b4ec0260f99f5b2ac3864f7cddc8fb7c83bbb2379a6aab975/lm_eval-0.2.0.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6), version: 0.2.0
2025-08-31T08:26:46,911   Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/61/c5/bff92e6b61fc2b0c1b7ac769633731910152e5176a404912ce7c07329ba0/lm_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6)
2025-08-31T08:26:46,912   Found link https://files.pythonhosted.org/packages/c4/f8/58abc65390a758c8c2e5f1d8bb9b58d7885d02535d5f48de27006453d07e/lm_eval-0.3.0.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6), version: 0.3.0
2025-08-31T08:26:46,913   Found link https://files.pythonhosted.org/packages/45/e0/05001c2e56e2f8f793189442176432ddb89a2f1f1ef00ea154d0bc00fe37/lm_eval-0.4.0.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.0
2025-08-31T08:26:46,913   Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/49/2d/39f7a25ab663cb45cfc7773b85980f01df44853cc427d00dce94c90b43e6/lm_eval-0.4.1-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8)
2025-08-31T08:26:46,914   Found link https://files.pythonhosted.org/packages/5a/02/1c7f1ac2f139f4c05af5b94e2c4f88a70404fa0b0c22a5fb04dec0216b03/lm_eval-0.4.1.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.1
2025-08-31T08:26:46,914   Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/0c/5a/64cf703b62ac7ada09a514c16c7136bb4ea7ef3030eb4c3d780900a5a634/lm_eval-0.4.2-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8)
2025-08-31T08:26:46,915   Found link https://files.pythonhosted.org/packages/75/ca/18814743ba3b42d19d8524a4f771e9c3a7aa02cd4c579747a0f513907205/lm_eval-0.4.2.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.2
2025-08-31T08:26:46,916   Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/39/2b/eb15fb57ba48b3cebfd302713d680d9917101867e2b5fbfd266e88b89ff3/lm_eval-0.4.3-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8)
2025-08-31T08:26:46,916   Found link https://files.pythonhosted.org/packages/2e/69/dbff28f17e17521735460b25645479e85b58d8ad7ea8488e4672ab52b58b/lm_eval-0.4.3.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.3
2025-08-31T08:26:46,917   Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/ad/e1/ac8d7d26b4d6a9eea8859d438691b5d8209a37be2117b3e61f247de2d9e7/lm_eval-0.4.4-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8)
2025-08-31T08:26:46,917   Found link https://files.pythonhosted.org/packages/c6/a8/4dcffd9ad0ddb6c479f93d8316a108a6f9b4d81756c892f150b6c307e8d4/lm_eval-0.4.4.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.4
2025-08-31T08:26:46,918   Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/c1/78/fb3ea82c77ccc4dbbd6cafceb15ca01c1cd4d778217d572d65c919b0643f/lm_eval-0.4.5-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8)
2025-08-31T08:26:46,918   Found link https://files.pythonhosted.org/packages/68/7a/cb1993a8d217a5b4c6e52f612a677c4f02c3412d2e3093ecbf6f6413136c/lm_eval-0.4.5.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.5
2025-08-31T08:26:46,919   Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/45/b9/1b4e3268b590d9ff16e087685d9526455bb677c3e4d0caeba4451f20c586/lm_eval-0.4.7-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8)
2025-08-31T08:26:46,919   Found link https://files.pythonhosted.org/packages/53/c9/b5d03d5b2bf6819008e377844999fbd04ab00dff0c43728957f1c90a53c5/lm_eval-0.4.7.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.7
2025-08-31T08:26:46,920   Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/c3/0b/36d6117f644f3685e6b87005ecd7051d01e9cdcf617e8e671102c1546de2/lm_eval-0.4.8-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9)
2025-08-31T08:26:46,921   Found link https://files.pythonhosted.org/packages/ba/b2/fe23d318c5f645636f9f776c373d1ba68aa55c998894660613a09b0fe2ec/lm_eval-0.4.8.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9), version: 0.4.8
2025-08-31T08:26:46,922   Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/b6/4f/3ab58de3dfee26f693d149824d9d62723f771392c4756becccbcbaaa4e03/lm_eval-0.4.9-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9)
2025-08-31T08:26:46,922   Found link https://files.pythonhosted.org/packages/e5/ab/866d8957cddbb26510e5cf5f7c5ec01e179f82d54d2dafd3a6c5c31fc200/lm_eval-0.4.9.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9), version: 0.4.9
2025-08-31T08:26:46,923   Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/18/ba/3a992d435deaf5461f50417bd7ba38a21831a04520941a9ecf1020dcf900/lm_eval-0.4.9.1-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9)
2025-08-31T08:26:46,924   Found link https://files.pythonhosted.org/packages/b9/81/943efd4d008080625ddb135d961fc40e78fa75c61f4ce1b4b1244c667571/lm_eval-0.4.9.1.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9), version: 0.4.9.1
2025-08-31T08:26:46,924 Fetching project page and analyzing links: https://www.piwheels.org/simple/lm-eval/
2025-08-31T08:26:46,925 Getting page https://www.piwheels.org/simple/lm-eval/
2025-08-31T08:26:46,926 Found index url https://www.piwheels.org/simple/
2025-08-31T08:26:47,089 Fetched page https://www.piwheels.org/simple/lm-eval/ as text/html
2025-08-31T08:26:47,093   Skipping link: No binaries permitted for lm-eval: https://www.piwheels.org/simple/lm-eval/lm_eval-0.4.9-py3-none-any.whl#sha256=aae7521fd8819d6dd3ae674c07816f449a70669bef1db6cdce2968c21ad1f7af (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.9)
2025-08-31T08:26:47,093   Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.8-py3-none-any.whl#sha256=1ed005366d8f0154fa200db6e0eb56cc5ef33df2bbd2705d19c742e4283593c8 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.9)
2025-08-31T08:26:47,094   Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.7-py3-none-any.whl#sha256=3b462a73021c5411e6b4491d07d5c4c009843435a2c9350ae5949fbf4a196ed9 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8)
2025-08-31T08:26:47,095   Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.5-py3-none-any.whl#sha256=c1292031153f79a22db4193ed91074a1c57ffaec3d9768215a455efd53ff5f02 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8)
2025-08-31T08:26:47,095   Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.4-py3-none-any.whl#sha256=1a6e6b514b470ad4c795439aa4cf9cb88b1360d915c7b3108ae5b47e3f7b36fc (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8)
2025-08-31T08:26:47,096   Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.3-py3-none-any.whl#sha256=7f4cb7cbd7ea20f2624f1315e69dfbc884cc187749c85760f9b4ec03e7efe491 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8)
2025-08-31T08:26:47,096   Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.2-py3-none-any.whl#sha256=a0bcaff492a09947d8a2b80400f224113b1e313da6a688084711130da18e1af7 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8)
2025-08-31T08:26:47,097   Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.1-py3-none-any.whl#sha256=796615edf52f5673187a884a9d77c7d755fe95ca2d16fe77a1f042730eb957b3 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8)
2025-08-31T08:26:47,097   Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.0-py3-none-any.whl#sha256=1a863b5f478f2e66e921dbbf2e4dcda06a923021763f01b59c5b03bdd3af01c2 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8)
2025-08-31T08:26:47,098   Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.3.0-py3-none-any.whl#sha256=498b8b8954c1f9c17f46e3ec096e9be6b9c96ee70560ee613a4eb9c7b9d31644 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.6)
2025-08-31T08:26:47,098   Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.2.0-py3-none-any.whl#sha256=e06d3d7b6016be832e6889cbc9c4787b99156ba57f8feb31d3aeb27304c6558c (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.6)
2025-08-31T08:26:47,099   Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.0.1-py3-none-any.whl#sha256=0afc289f69286f71017fb9811dfea6cda7c703bf693ad43106fbbff1f164cf14 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.6)
2025-08-31T08:26:47,099 Skipping link: not a file: https://www.piwheels.org/simple/lm-eval/
2025-08-31T08:26:47,100 Skipping link: not a file: https://pypi.org/simple/lm-eval/
2025-08-31T08:26:47,120 Given no hashes to check 1 links for project 'lm-eval': discarding no candidates
2025-08-31T08:26:47,122 Collecting lm-eval==0.4.9.1
2025-08-31T08:26:47,124   Created temporary directory: /tmp/pip-unpack-xa_3rlv_
2025-08-31T08:26:47,353   Downloading lm_eval-0.4.9.1.tar.gz (2.9 MB)
2025-08-31T08:27:08,161   Added lm-eval==0.4.9.1 from https://files.pythonhosted.org/packages/b9/81/943efd4d008080625ddb135d961fc40e78fa75c61f4ce1b4b1244c667571/lm_eval-0.4.9.1.tar.gz to build tracker '/tmp/pip-build-tracker-7y_9rtrp'
2025-08-31T08:27:08,168   Created temporary directory: /tmp/pip-build-env-mluu0onl
2025-08-31T08:27:08,173   Installing build dependencies: started
2025-08-31T08:27:08,175   Running command pip subprocess to install build dependencies
2025-08-31T08:27:09,404   Using pip 25.2 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11)
2025-08-31T08:27:09,404   Non-user install by explicit request
2025-08-31T08:27:09,881   Created build tracker: /tmp/pip-build-tracker-7y_9rtrp
2025-08-31T08:27:09,882   Entered build tracker: /tmp/pip-build-tracker-7y_9rtrp
2025-08-31T08:27:09,884   Created temporary directory: /tmp/pip-install-xsf7qosg
2025-08-31T08:27:09,890   Created temporary directory: /tmp/pip-ephem-wheel-cache-fkuusadu
2025-08-31T08:27:10,186   Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2025-08-31T08:27:10,190   2 location(s) to search for versions of setuptools:
2025-08-31T08:27:10,191   * https://pypi.org/simple/setuptools/
2025-08-31T08:27:10,192   * https://www.piwheels.org/simple/setuptools/
2025-08-31T08:27:10,192   Fetching project page and analyzing links: https://pypi.org/simple/setuptools/
2025-08-31T08:27:10,193   Getting page https://pypi.org/simple/setuptools/
2025-08-31T08:27:10,197   Found index url https://pypi.org/simple/
2025-08-31T08:27:10,201   Looking up "https://pypi.org/simple/setuptools/" in the cache
2025-08-31T08:27:10,202   Request header has "max_age" as 0, cache bypassed
2025-08-31T08:27:10,208   Starting new HTTPS connection (1): pypi.org:443
2025-08-31T08:27:10,364   https://pypi.org:443 "GET /simple/setuptools/ HTTP/1.1" 304 0
2025-08-31T08:27:10,383   Fetched page https://pypi.org/simple/setuptools/ as application/vnd.pypi.simple.v1+json
2025-08-31T08:27:10,538     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/77/38/90cae8fd99c5dc402d25930e1c91f5fcf6de5c8e982fd152a5a061e3df56/setuptools-0.6b1-py2.3.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,539     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/1f/ab/1ed6131b5112d1d47cb89e1cbea08f783f0ed49d6fc795ed2ff63f84d20c/setuptools-0.6b1-py2.4.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,540     Found link https://files.pythonhosted.org/packages/82/cb/906d051fdf1c8b7703d288d3cc44ff32746090378f7f8539c8476a21ce9a/setuptools-0.6b1.zip (from https://pypi.org/simple/setuptools/), version: 0.6b1
2025-08-31T08:27:10,541     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/61/52/c84d22f3669ea8d4e54126f6241d7ed9828e3a382596f170043dfdaddbcc/setuptools-0.6b2-py2.3.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,542     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/9b/87/48c155a10c4561fe9b8a83dcf9361ddb9cc9ab5c3ed1b504ac12ab11ed6a/setuptools-0.6b2-py2.4.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,543     Found link https://files.pythonhosted.org/packages/0e/3b/53daeaf6623a2bab3d3c40b19a35ff5bd7c4e1fbad2f537a61c1fe8c5069/setuptools-0.6b2.zip (from https://pypi.org/simple/setuptools/), version: 0.6b2
2025-08-31T08:27:10,544     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/c3/13/a3129905c118a7004e4bbc6db2c24d73de9e15960fd749a61e16fb114f30/setuptools-0.6b3-py2.3.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,544     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/10/b3/7166e400d3b953fa4714f97806f077a3f7791cd48ea71df708814234283a/setuptools-0.6b3-py2.4.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,545     Found link https://files.pythonhosted.org/packages/ff/33/635de67bf3010651ba8db9d8064721274bfb6fbb778a110089f34beabaf2/setuptools-0.6b3.zip (from https://pypi.org/simple/setuptools/), version: 0.6b3
2025-08-31T08:27:10,546     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/1c/d7/6927233caddaa4f466a8b957c94be00810e751edb2655283c04fc3b680f2/setuptools-0.6b4-py2.3.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,547     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/b3/79/8c94b6c99192df5f5d900ce17405cb5cfcdab8643d2e4aaf6ce1ee948576/setuptools-0.6b4-py2.4.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,548     Found link https://files.pythonhosted.org/packages/82/be/b2e51157a4debc4ebcab179aeb839948a0f02ce06cbc7749c8ab866c0aa9/setuptools-0.6b4.zip (from https://pypi.org/simple/setuptools/), version: 0.6b4
2025-08-31T08:27:10,549     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/54/f7/6f443db0df0a1706d8af3a8fa7d18528e5557f588cbddce7f7b47ff08ba5/setuptools-0.6c1-py2.3.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,550     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/59/61/1ab6a87cec11ffb403280338aacc2c7a1e44eff0d7e431076fba1e61895e/setuptools-0.6c1-py2.4.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,550     Found link https://files.pythonhosted.org/packages/4e/2d/555dc3106b42c977a2f7c7e6f28e5b3104c9bd9306005d304d2ddc1c6587/setuptools-0.6c1.zip (from https://pypi.org/simple/setuptools/), version: 0.6c1
2025-08-31T08:27:10,551     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/24/01/51f2d3ede491f51990b99ab0bfc5bad473c9b45fcf9b1c7b8c7bc3ff0e14/setuptools-0.6c2-py2.3.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,552     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/64/c4/cb2718f8851517aba754c4f25d79f2a65430d4a4979375d78ea51f217123/setuptools-0.6c2-py2.4.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,553     Found link https://files.pythonhosted.org/packages/e3/dd/5ccc0dd99d67675bda31bfb1e5be1460f908b9e3e475660bdcb98aea5f36/setuptools-0.6c2.zip (from https://pypi.org/simple/setuptools/), version: 0.6c2
2025-08-31T08:27:10,554     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/21/56/b48e6f7fa5a58e87a3b0761af2bedf2a6668c553ab4c39ee2646ef9597f7/setuptools-0.6c3-py2.3.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,555     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/73/0d/239e2877d84df3231b5da63ff7358871f66eeab89458574247ebe7c427c7/setuptools-0.6c3-py2.4.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,555     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/20/22/7e414402a50a263f15d1d7f0a469ba63aa1f2fb79e653a64732b3b18af48/setuptools-0.6c3-py2.5.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,556     Found link https://files.pythonhosted.org/packages/01/21/d4c5b856d702d0c6e3a615061d0b6e7101c375ceb664126583de863b4181/setuptools-0.6c3.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.6c3
2025-08-31T08:27:10,557     Found link https://files.pythonhosted.org/packages/69/d7/a22dd38ff4811beaaa7089825dc38a34f47818f25c7025b1caab4e67b54b/setuptools-0.6c3.zip (from https://pypi.org/simple/setuptools/), version: 0.6c3
2025-08-31T08:27:10,558     Skipping link: unsupported archive format: .rpm: https://files.pythonhosted.org/packages/4b/02/33240ac22d7dc895c5d18119a7a4b7b97ca45f7436c2633840287c2c7a4e/setuptools-0.6c4-1.src.rpm (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,559     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/35/b8/00453469271120ea64d3c4da218dd83565f5b1d3e848371c13afa43bb58c/setuptools-0.6c4-py2.3.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,560     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/00/5c/53f6b2cbe1f8344695eeb166e1906d573146fcb9f9f9ad116b7c4cf907ca/setuptools-0.6c4-py2.4.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,560     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/ad/67/6764874b7091d4b5902de113b30ffc40713c3176908177c53c0ae3129fb9/setuptools-0.6c4-py2.5.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,561     Found link https://files.pythonhosted.org/packages/73/57/a910b32ea2131b5d8f7a2ff106e5a1c47b0cad4baed171ca12ffa5613c39/setuptools-0.6c4.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.6c4
2025-08-31T08:27:10,562     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/f4/d2/2be204269d952f712b433e9c27dc76b54dd2c3fcc38a085b561614d4a0bd/setuptools-0.6c4.win32-py2.3.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,563     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/3f/ee/f64f590be21ae82c6de485751596c540c24b218804fe19c1a936109bfec5/setuptools-0.6c4.win32-py2.4.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,564     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/b3/ee/650a6df344eb5cba091c2729764f44c7fa9309f2421c9518c8509a0b76f8/setuptools-0.6c4.win32-py2.5.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,565     Found link https://files.pythonhosted.org/packages/7e/2d/926f4536e819fa93d7a4aeb0910849387c1234b865310aee40289e457012/setuptools-0.6c4.zip (from https://pypi.org/simple/setuptools/), version: 0.6c4
2025-08-31T08:27:10,565     Skipping link: unsupported archive format: .rpm: https://files.pythonhosted.org/packages/c1/11/efc7f5f5d5d0d7b77030753469ab3173b41d7e92de9de9c384f0f9a3e95d/setuptools-0.6c5-1.src.rpm (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,566     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/b9/32/3797469c91a78e329cb2f73bedddd3a70cf688a91f484f35f65553ae853f/setuptools-0.6c5-py2.3.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,567     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/e9/24/31abf427add2d867e16164ac0215f079f8d2a9a3f5fe9153906425b94fc2/setuptools-0.6c5-py2.4.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,568     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/73/df/f68a5c3acd5e7f813d56cd147d713720ceb4ef7a2064c927c9d77fba2d61/setuptools-0.6c5-py2.5.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,569     Found link https://files.pythonhosted.org/packages/ba/1b/1480b6fef57c0ac946942731467d4d0590b305c4808e0be1b17fd3f5a8c8/setuptools-0.6c5.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.6c5
2025-08-31T08:27:10,569     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/90/0a/43530fce7c099634d23b29735a590bb38635e97a069493b76d64ad476a7f/setuptools-0.6c5.win32-py2.3.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,570     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/84/cf/c588fd4bc0310edaf8e9a026447fa4a7210b5079f87aaf753cbe3be15b90/setuptools-0.6c5.win32-py2.4.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,571     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/06/5f/1f915846c47f2bdc62f96965af5ac5900e1280864c758f3cd64b1dcac58b/setuptools-0.6c5.win32-py2.5.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,572     Found link https://files.pythonhosted.org/packages/bb/55/371d4c3a5b9c696c93746f295dddf43a536c42b32f0df52ee0b2a67f9e1e/setuptools-0.6c5.zip (from https://pypi.org/simple/setuptools/), version: 0.6c5
2025-08-31T08:27:10,573     Skipping link: unsupported archive format: .rpm: https://files.pythonhosted.org/packages/5a/ee/8d3bbe7e760fa9759183ad8b56b8b92b573c5111639e0e740e0e1fd6e20f/setuptools-0.6c6-1.src.rpm (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,574     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/a1/d4/150ef1cb7fdf2f636e9c7847fd38a7704facb9216821bdd697c72573f065/setuptools-0.6c6-py2.3.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,574     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/8c/80/0fdac5b7b6c17c5b347250798689e600111895017e3855e0db7238bcb7bc/setuptools-0.6c6-py2.4.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,575     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/95/e6/98322b7ac8f1879196d4327a1a2d352802e6635d72496e6c4b4a2204f93e/setuptools-0.6c6-py2.5.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,576     Found link https://files.pythonhosted.org/packages/c8/d1/23a9b039d7962a211b759c48571d2ffe041fbc0ba6d8732d46ddd899beef/setuptools-0.6c6.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.6c6
2025-08-31T08:27:10,577     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/5b/13/459677b0ec718a3f5706d1e8175d4856f1bbadaa627628679d8a79e6db8c/setuptools-0.6c6.win32-py2.3.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,578     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/42/a9/dab94b4f97a399a4226414d48e4a39410c682578b97a3032bf9b81f079ce/setuptools-0.6c6.win32-py2.4.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,578     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/4c/c0/2ba74e7430d76ee173c9cda0711af98064a9fdbd558e14432f800e92e373/setuptools-0.6c6.win32-py2.5.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,579     Found link https://files.pythonhosted.org/packages/b0/8f/7fb7b87601dfd654e6d4dbe2dd2f61d029dc0037cc5b6fe6caebf3e5dac0/setuptools-0.6c6.zip (from https://pypi.org/simple/setuptools/), version: 0.6c6
2025-08-31T08:27:10,580     Skipping link: unsupported archive format: .rpm: https://files.pythonhosted.org/packages/16/47/b2f6126fc281f9822bf41a23f5dfbd8fc95d027ba5949ac2089e26ea2414/setuptools-0.6c7-1.src.rpm (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,581     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/99/7a/816dba79270f752523617b31f8d91d25df2a02ced79caa52a812e567817d/setuptools-0.6c7-py2.3.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,582     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/25/98/dbfc23715d073aa65014e219b078c885ee478ee8266f37cf5beef2220434/setuptools-0.6c7-py2.4.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,582     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/84/22/4aa617d74f0e3f320b651d04f0ea2468cac03daa5aab296888c5a36ed459/setuptools-0.6c7-py2.5.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,583     Found link https://files.pythonhosted.org/packages/74/4f/8f72fc07063c2a8c60821f69761cbca236af346bdbc61ec2f6cf30fe79e8/setuptools-0.6c7.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.6c7
2025-08-31T08:27:10,584     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/0b/1b/2298438741c10969a34ea3523e8a009dccb4cbf9ed16ed6678eaf0043303/setuptools-0.6c7.win32-py2.3.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,585     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/c4/48/fc36c7b5e987b989ec3af3c4f741a9c2927e68020d4a71d7cbafea414bd7/setuptools-0.6c7.win32-py2.4.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,586     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/9a/e1/4858e7839df23e373b3b39a45f17f01f3a41c35c034cd8059124641a2a23/setuptools-0.6c7.win32-py2.5.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,587     Found link https://files.pythonhosted.org/packages/55/10/c08016fc0855ebe88f6711e198e8e3ac9a1bae62effacc51bcb5c0b90d22/setuptools-0.6c7.zip (from https://pypi.org/simple/setuptools/), version: 0.6c7
2025-08-31T08:27:10,588     Skipping link: unsupported archive format: .rpm: https://files.pythonhosted.org/packages/b8/ac/75799ee665da8f826c4b494d46765f76a1c963fde9eb5dede05c2caccf38/setuptools-0.6c8-1.src.rpm (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,588     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/ae/d4/740611a1e12211e37eb235f8ff5913cd14e8573b2e1c2586a623ad405ad9/setuptools-0.6c8-py2.3.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,589     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/8e/6b/c1cd58d373ce4d3c8d4cb61e2185c0b0ec58911eb742c0dca026ff1450ed/setuptools-0.6c8-py2.4.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,590     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/b9/4c/1ccb5022fb94f3f8d5c90d2931e34d4208ea3aa0e7c4927d49c9e060e568/setuptools-0.6c8-py2.5.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,591     Found link https://files.pythonhosted.org/packages/29/17/f98a2cb39bb5b40357fd54fba1dd105e224a447a91867ac5c4ef6f8f0191/setuptools-0.6c8.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.6c8
2025-08-31T08:27:10,592     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/da/1d/ec8ecc71d817000bfc86eaafe2af7984fe8a5c61c86abaf663bbef1ac7fa/setuptools-0.6c8.win32-py2.3.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,592     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/fa/f1/c2553c8095a7d430b39669081acfa8afecff686682e9fec8df3403495cd3/setuptools-0.6c8.win32-py2.4.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,593     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/2a/f9/359b6a4b6eafa7323522dd89e3765e2ea191a37d3a349d8363e6f49205b8/setuptools-0.6c8.win32-py2.5.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,594     Found link https://files.pythonhosted.org/packages/65/99/1f95f6996022c7d5e00b18b5a47813c888b12d6837071f1978280801d9ad/setuptools-0.6c8.zip (from https://pypi.org/simple/setuptools/), version: 0.6c8
2025-08-31T08:27:10,595     Skipping link: unsupported archive format: .rpm: https://files.pythonhosted.org/packages/36/8a/c70262c0c8f1c0e321f626fec1865ad2714f28cc3302aaa2c0588e89d866/setuptools-0.6c9-1.src.rpm (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,596     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/aa/6f/8a4d13d6d98c6b66fb675282be930e0f742565f5972701ff74a321b5d190/setuptools-0.6c9-py2.3.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,596     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/fc/bf/4f539489c61c543752a4e738b818f8e8463c8d3771ad134e66f35c43d03f/setuptools-0.6c9-py2.4.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,597     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/04/53/b56373f85a56ddc68e0c9177fdd2a88e87b37d91e636e09dbdfb958cc858/setuptools-0.6c9-py2.5.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,598     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/0c/e8/10eed514d71c6f57d9d0eab2a8a7fc578fbcc4e8d464a19310857b93a97a/setuptools-0.6c9-py2.6.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,599     Found link https://files.pythonhosted.org/packages/5e/bc/70a3d8213cda12eac84c770895c54521d0d19847b512cef54d6c83b0ddcb/setuptools-0.6c9.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.6c9
2025-08-31T08:27:10,600     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/34/34/3fbaed52feeed2f3e50867d40826f1e3a2d6fe1cb57b5069e932153c8849/setuptools-0.6c9.win32-py2.3.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,600     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/e3/0c/c1d6f2f4784dd62e9dc725fd849bd2d66c147644b0713030a28b06351a0e/setuptools-0.6c9.win32-py2.4.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,601     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/e1/cd/d6bad589187cb0c95ce7e5471932004ed40d7001424db431b3ac950719d8/setuptools-0.6c9.win32-py2.5.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,602     Found link https://files.pythonhosted.org/packages/63/cd/163f3ecaf70c0c8406a6bccfea1b304e33b16a7e3dd1aac993561f0d0c9d/setuptools-0.6c9.zip (from https://pypi.org/simple/setuptools/), version: 0.6c9
2025-08-31T08:27:10,603     Skipping link: unsupported archive format: .rpm: https://files.pythonhosted.org/packages/58/24/429cfabb3bad49f4f4d4222de00767596449207d9a399dbd6377596f5c98/setuptools-0.6c10-1.src.rpm (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,604     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/d0/37/ec64b158f71fce356be64c9a4d72412035fd09d3454a45de9d43ce68a1eb/setuptools-0.6c10-py2.3.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,604     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/60/6c/ca66c3554907381fab74cad8d22d6d64d03da23322ad0b0b21c8c83cbabf/setuptools-0.6c10-py2.4.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,605     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/15/33/a63a84b00931607d96e0f383d2575e5826b18893ff19f1ab622f8f4e03e9/setuptools-0.6c10-py2.5.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,606     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/3c/93/52aa366f8341dbbcbf88f93bc253574ded15dfaec66fe9d5a5b57f0584b9/setuptools-0.6c10-py2.6.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,607     Found link https://files.pythonhosted.org/packages/c4/0c/aeca030b34c3db641ee5b9c82a06be9a9c2f683f7dc49a70603a3a61d758/setuptools-0.6c10.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.6c10
2025-08-31T08:27:10,608     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/09/a2/4d6d8597c939c46e5b5ad28c30cb555dea9fda539524116dbd7289cb37ec/setuptools-0.6c10.win32-py2.3.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,609     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/9d/e7/23646cf93d499043999e1847e7207623bea0faae8ffdf6cd4c0978622744/setuptools-0.6c10.win32-py2.4.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,609     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/63/41/a274e2ce80087f5a07bc48ea6dd3476d767c37fb9001f56400beb68c4ca2/setuptools-0.6c10.win32-py2.5.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,610     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/7f/ba/a094b22ecc74374f040d944aa770d74e81f835e5380b0b18898b7c0f995c/setuptools-0.6c10.win32-py2.6.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,611     Found link https://files.pythonhosted.org/packages/f9/71/ad34bdb9e742a8a78fc55acdc7904129d5865e765cbc3331e74e79db45f2/setuptools-0.6c10.zip (from https://pypi.org/simple/setuptools/), version: 0.6c10
2025-08-31T08:27:10,612     Skipping link: unsupported archive format: .rpm: https://files.pythonhosted.org/packages/1e/b7/a4639da3c762e3162b23b439ed8d91076499464dce2f35e4826d1e2b3559/setuptools-0.6c11-1.src.rpm (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,613     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/70/68/bbf97a2f73e8253a87ff7d1b73c94e1bf0bf1900ed8e5fd7bf98180f4483/setuptools-0.6c11-py2.3.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,613     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/f0/5d/2edc5f4af10151e80251678f7a7c5130578b16116e2f31e03bf75459bb7f/setuptools-0.6c11-py2.4.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,614     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/98/d3/ed3bc7e3f4b143092862dab99d984261ac4be6a40d4fb1e66d2a10e9ea99/setuptools-0.6c11-py2.5.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,615     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/53/36/970486f83d2fdcc1b5bac53f8aab5af71b81dcbf786d887e923a9962343f/setuptools-0.6c11-py2.6.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,616     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/25/5d/cc55d39ac39383dd6e04ae80501b9af3cc455be64740ad68a4e12ec81b00/setuptools-0.6c11-py2.7.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,617     Found link https://files.pythonhosted.org/packages/8b/62/baf1e2c2b02de7898dcacd1d1a41e323b79d25be5c88d2805c89fb424835/setuptools-0.6c11.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.6c11
2025-08-31T08:27:10,618     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/5a/2f/f77682b48b0b50274bd7ab826de90521c4b7e7d8479da06030d29e015205/setuptools-0.6c11.win32-py2.3.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,618     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/8c/28/f3ee69ca5cd4d243f592c6045f443743904e07e8f95d7d5948198149cbaa/setuptools-0.6c11.win32-py2.4.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,619     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/4c/29/23ecf8af775fa80bbc175c52e6bc4f79284579af37ac1692bbb5f8f2d61d/setuptools-0.6c11.win32-py2.5.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,620     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/69/dd/153cafc26d351949ca56ae0c9259b69eeeca8dac9a5aeabe7eef8f86a311/setuptools-0.6c11.win32-py2.6.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,621     Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/1c/cd/e68c430415ab4baefb97dea7ba14eaa68eeb47d778456ffbc1f437229660/setuptools-0.6c11.win32-py2.7.exe (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:10,621     Found link https://files.pythonhosted.org/packages/61/f0/0cb5db3d39676f5b240d7bbda27da857d75d5334fb29624c9e3d52076d44/setuptools-0.6c11.zip (from https://pypi.org/simple/setuptools/), version: 0.6c11
2025-08-31T08:27:10,622     Found link https://files.pythonhosted.org/packages/82/bc/48dbb17f35116a6348197e249a2780b66d5d5d9ded73d7e56cb939e04bd5/setuptools-0.7.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.7.2
2025-08-31T08:27:10,623     Found link https://files.pythonhosted.org/packages/53/9c/bbd954749f472632069dcc4d23783513c70e8c535b0eaeee3546bcccd0ca/setuptools-0.7.2.zip (from https://pypi.org/simple/setuptools/), version: 0.7.2
2025-08-31T08:27:10,624     Found link https://files.pythonhosted.org/packages/22/5e/22d01d802d230e5be2abc943a4fe00e07d9335e7ede51e46de424aacab77/setuptools-0.7.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.7.3
2025-08-31T08:27:10,625     Found link https://files.pythonhosted.org/packages/14/83/7dc02a7d21a462dec824fa4624f9de834721ac61499c326a09b0e1245cd6/setuptools-0.7.3.zip (from https://pypi.org/simple/setuptools/), version: 0.7.3
2025-08-31T08:27:10,626     Found link https://files.pythonhosted.org/packages/54/d4/cadd20d2b2cf30746a59fd7feaa7c4280b62fa8916f7b4d6558831e10c35/setuptools-0.7.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.7.4
2025-08-31T08:27:10,627     Found link https://files.pythonhosted.org/packages/b0/d4/105445cfd654f7f0841bc2281f501608827e098f01f9b4525221af109ccc/setuptools-0.7.4.zip (from https://pypi.org/simple/setuptools/), version: 0.7.4
2025-08-31T08:27:10,628     Found link https://files.pythonhosted.org/packages/6d/f8/72cd7acc71922d36d8056b0a4314455944f22dd776fa5a0caf10b12d20cb/setuptools-0.7.5.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.7.5
2025-08-31T08:27:10,629     Found link https://files.pythonhosted.org/packages/cc/b8/c5b652eb51d99872fec912d64cb9d06104ebd59551ad2053aba96862b3c7/setuptools-0.7.5.zip (from https://pypi.org/simple/setuptools/), version: 0.7.5
2025-08-31T08:27:10,630     Found link https://files.pythonhosted.org/packages/d5/6c/096e2061e907d322b099769ea819d7c6bcf7ac7a3402bfa050d09de38a18/setuptools-0.7.6.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.7.6
2025-08-31T08:27:10,631     Found link https://files.pythonhosted.org/packages/3d/17/734a648686d4bc184857a3b0b69f407a0489f4c51b3c6abcce1f5c06841d/setuptools-0.7.6.zip (from https://pypi.org/simple/setuptools/), version: 0.7.6
2025-08-31T08:27:10,631     Found link https://files.pythonhosted.org/packages/a1/e9/ace7f7b52bd4a1ab36e39bcf7a9fe1ce20ccf1d6e6f6625fec718856434f/setuptools-0.7.7.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.7.7
2025-08-31T08:27:10,632     Found link https://files.pythonhosted.org/packages/9d/a5/9917277554697b42ca6e21996ede42519044f841e23f7489728b6eed98dd/setuptools-0.7.7.zip (from https://pypi.org/simple/setuptools/), version: 0.7.7
2025-08-31T08:27:10,633     Found link https://files.pythonhosted.org/packages/9d/2c/91dafba5f967f5dbcc0c51822af3a2b11b6f65cae7ef04fc285fb3771ca2/setuptools-0.7.8.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.7.8
2025-08-31T08:27:10,634     Found link https://files.pythonhosted.org/packages/18/22/444bcadc8b170024c439cf60e862571b9504a70bbc95848a11cf26361a22/setuptools-0.7.8.zip (from https://pypi.org/simple/setuptools/), version: 0.7.8
2025-08-31T08:27:10,635     Found link https://files.pythonhosted.org/packages/18/f5/4448556e66efd9e9d21804d3ef745783cff42abc7c39573343f0ba94fc82/setuptools-0.8.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.8
2025-08-31T08:27:10,636     Found link https://files.pythonhosted.org/packages/1a/b7/a64c73af31bc3dcce8b37005b638553605a572feb5169c4766a159996254/setuptools-0.8.zip (from https://pypi.org/simple/setuptools/), version: 0.8
2025-08-31T08:27:10,637     Found link https://files.pythonhosted.org/packages/3b/ac/2b61b9e6cbeba2764f31d744478b1ea46a476b3623cc12c559435c14a972/setuptools-0.9.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.9
2025-08-31T08:27:10,638     Found link https://files.pythonhosted.org/packages/9f/a7/e459019b5871e7420ceccfb5dfde52def0ba8173406b441b8b6d314e50c1/setuptools-0.9.zip (from https://pypi.org/simple/setuptools/), version: 0.9
2025-08-31T08:27:10,638     Found link https://files.pythonhosted.org/packages/1a/52/645c11a1c57513a43a557cf752833c19223f365771e30c88637170026ef7/setuptools-0.9.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.9.1
2025-08-31T08:27:10,639     Found link https://files.pythonhosted.org/packages/9c/46/83b866faeab163db1c4a9fddf93e7d60e28ce2a97cf2669667551f496294/setuptools-0.9.1.zip (from https://pypi.org/simple/setuptools/), version: 0.9.1
2025-08-31T08:27:10,640     Found link https://files.pythonhosted.org/packages/2c/02/3e1e2e547114b6a659923c9d88fa74adec9aa46d46a48f70cd02b9fb4646/setuptools-0.9.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.9.2
2025-08-31T08:27:10,641     Found link https://files.pythonhosted.org/packages/4f/b3/51ef01e9af978f6ddc388754a201a5abb316fb8c84293901c92c52344b57/setuptools-0.9.2.zip (from https://pypi.org/simple/setuptools/), version: 0.9.2
2025-08-31T08:27:10,642     Found link https://files.pythonhosted.org/packages/70/43/f4c210d2d356312e197db577bc1ff250e1a1ce9d42cea53b0577f945e35d/setuptools-0.9.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.9.3
2025-08-31T08:27:10,643     Found link https://files.pythonhosted.org/packages/5b/01/7d51a958fc84528e6479bd94a902524f8008d07b152ca8d7385a76c05f45/setuptools-0.9.3.zip (from https://pypi.org/simple/setuptools/), version: 0.9.3
2025-08-31T08:27:10,644     Found link https://files.pythonhosted.org/packages/d8/00/37076fbd97e9c3505f5af64dce0cae55305e4a9efc05efe1468d2d3397b3/setuptools-0.9.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.9.4
2025-08-31T08:27:10,645     Found link https://files.pythonhosted.org/packages/f5/a8/4183275281748f649fb6023a33b2d3114acf6b88d6ad9e38d4ead96a570c/setuptools-0.9.4.zip (from https://pypi.org/simple/setuptools/), version: 0.9.4
2025-08-31T08:27:10,646     Found link https://files.pythonhosted.org/packages/ce/d8/bb3901aecd386dd5caa9fd05aaddd377bdbbd81ee32f7ce5ad6f9e70a479/setuptools-0.9.5.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.9.5
2025-08-31T08:27:10,647     Found link https://files.pythonhosted.org/packages/26/82/6c7fb9dc9191fc30bf071bec1b9096fdee6ece9e46de98fc17fcd9b6534c/setuptools-0.9.5.zip (from https://pypi.org/simple/setuptools/), version: 0.9.5
2025-08-31T08:27:10,647     Found link https://files.pythonhosted.org/packages/1a/49/db8869101a9ceb241f9c77f466a7eb5c0ca0c3c18cce7dcf536448ff9e2c/setuptools-0.9.6.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.9.6
2025-08-31T08:27:10,648     Found link https://files.pythonhosted.org/packages/e9/ce/1aa7d625015a5d39a44d42e743ed2ed35eb24d260e161f36dd7ee0fa0155/setuptools-0.9.6.zip (from https://pypi.org/simple/setuptools/), version: 0.9.6
2025-08-31T08:27:10,649     Found link https://files.pythonhosted.org/packages/ec/96/fed5a1a6633c296f9a8ff28070fc7578700e2cd30ec2d73e25ba42f14445/setuptools-0.9.7.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.9.7
2025-08-31T08:27:10,650     Found link https://files.pythonhosted.org/packages/34/c3/335e0706cce3dd8e0ca61d4a2b528c8803d6767711fd9a4e3a3f728167cb/setuptools-0.9.7.zip (from https://pypi.org/simple/setuptools/), version: 0.9.7
2025-08-31T08:27:10,670     Found link https://files.pythonhosted.org/packages/51/20/7b9e9cc363f176d9c3f1c4570e8ed8654ceba5cf3b0022d06add2f0e36ae/setuptools-0.9.8-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 0.9.8
2025-08-31T08:27:10,671     Found link https://files.pythonhosted.org/packages/58/61/b0af220037d130247dc90ca4bad813c12486f41f74d7d68467415a98a990/setuptools-0.9.8-py33-none-any.whl (from https://pypi.org/simple/setuptools/), version: 0.9.8
2025-08-31T08:27:10,672     Found link https://files.pythonhosted.org/packages/6a/a9/fe6661ade707a09c2a73b1a20e47f9e85fa1c1e1aec72e60b7d541550983/setuptools-0.9.8.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.9.8
2025-08-31T08:27:10,673     Found link https://files.pythonhosted.org/packages/0e/b7/591fbc0db1f45393629c73a3a0fc95656a8fd80ec24a7de27882613a4ce7/setuptools-0.9.8.zip (from https://pypi.org/simple/setuptools/), version: 0.9.8
2025-08-31T08:27:10,673     Found link https://files.pythonhosted.org/packages/08/3e/9d506abd494ae580528424201e28efcbb34d188848c547f7d30868c40192/setuptools-1.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.0
2025-08-31T08:27:10,674     Found link https://files.pythonhosted.org/packages/ef/69/2e29f2ab36ad3240fe884a8593c2b779bce2733a88a948e744a0aeb7f244/setuptools-1.0.zip (from https://pypi.org/simple/setuptools/), version: 1.0
2025-08-31T08:27:10,675     Found link https://files.pythonhosted.org/packages/eb/5b/aa07261d384bc8313c24490bc132f618bbe6ab700f7b9ed8754406ac3fe7/setuptools-1.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.1
2025-08-31T08:27:10,676     Found link https://files.pythonhosted.org/packages/a5/19/a9df3825e341570356136041580bb639e96482e0dd74bb60fe1571816263/setuptools-1.1.zip (from https://pypi.org/simple/setuptools/), version: 1.1
2025-08-31T08:27:10,677     Found link https://files.pythonhosted.org/packages/36/b2/28079abead6cddc7bfbba67e1f6219b3f39b3d20319ebf1dc56060b7b43c/setuptools-1.1.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.1.1
2025-08-31T08:27:10,678     Found link https://files.pythonhosted.org/packages/11/7a/b673ff9e739ffeff49d725a6d4f871e7fb0c1e66bf1cd70d6e71111dd891/setuptools-1.1.1.zip (from https://pypi.org/simple/setuptools/), version: 1.1.1
2025-08-31T08:27:10,679     Found link https://files.pythonhosted.org/packages/08/b2/e8808bfc2fcf0c599ec283c3dd51f2ef75992230e31b5e0a4ebd0f18e71d/setuptools-1.1.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.1.2
2025-08-31T08:27:10,680     Found link https://files.pythonhosted.org/packages/4a/a3/5ae98420be50bcb7d20924c912801b0c0d3965ec016aa0dea16c12381374/setuptools-1.1.2.zip (from https://pypi.org/simple/setuptools/), version: 1.1.2
2025-08-31T08:27:10,681     Found link https://files.pythonhosted.org/packages/56/7a/543eee732d4276b7a144faa8ef0a30778ae972028e9f197c00201750cd9b/setuptools-1.1.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.1.3
2025-08-31T08:27:10,682     Found link https://files.pythonhosted.org/packages/02/a1/f027eae4df0a7010d280784d17f649ff5ee5a005a8d2267fa00dbc1cace4/setuptools-1.1.3.zip (from https://pypi.org/simple/setuptools/), version: 1.1.3
2025-08-31T08:27:10,683     Found link https://files.pythonhosted.org/packages/2d/cf/71fc10f49b6fefaa798ee98c61d31529191913cc10b86689ad71a25a9101/setuptools-1.1.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.1.4
2025-08-31T08:27:10,683     Found link https://files.pythonhosted.org/packages/71/91/78ffe076adeb872bbae3b42d31050fe351e5ac49206df0b9205516de3435/setuptools-1.1.4.zip (from https://pypi.org/simple/setuptools/), version: 1.1.4
2025-08-31T08:27:10,684     Found link https://files.pythonhosted.org/packages/af/d7/3d8d926fb42146c3398c5bae93e6dae73b62090c253a1d290bce50be9c22/setuptools-1.1.5.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.1.5
2025-08-31T08:27:10,685     Found link https://files.pythonhosted.org/packages/6f/50/89bc49d9e40692b58cfa998843908f1517e72c8d265e98df5a5277ad5699/setuptools-1.1.5.zip (from https://pypi.org/simple/setuptools/), version: 1.1.5
2025-08-31T08:27:10,686     Found link https://files.pythonhosted.org/packages/fc/66/4fddcb714c184020e08c84897587773540ccb684d7915049722b9542ceba/setuptools-1.1.6-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 1.1.6
2025-08-31T08:27:10,687     Found link https://files.pythonhosted.org/packages/f6/7c/f43c90d21e676d2738c81674a21fad63a8d5f71d6e39cd35966214b7ce6c/setuptools-1.1.6.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.1.6
2025-08-31T08:27:10,688     Found link https://files.pythonhosted.org/packages/cb/0f/14c41a82f571530a259d6961632a92327a6c84a7a802a03409e46325be99/setuptools-1.1.6.zip (from https://pypi.org/simple/setuptools/), version: 1.1.6
2025-08-31T08:27:10,689     Found link https://files.pythonhosted.org/packages/c5/60/8737de8ab391b813e5a28402787e1d24ed4848f20d4e72f75f4555f90f4d/setuptools-1.1.7.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.1.7
2025-08-31T08:27:10,690     Found link https://files.pythonhosted.org/packages/20/f2/8fee0aa139eff61a6bea83b8096d253724328263668a5cf986e9ab63d909/setuptools-1.1.7.zip (from https://pypi.org/simple/setuptools/), version: 1.1.7
2025-08-31T08:27:10,691     Found link https://files.pythonhosted.org/packages/bc/93/c68754a5e4ebfbf2de47759039731d31a2f35c8d14b41c8a76eaa73d7ed1/setuptools-1.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 1.2
2025-08-31T08:27:10,692     Found link https://files.pythonhosted.org/packages/16/e6/07e8e1b6da199c05dc4c24dd66d2bc5da369ce03ee43ffb6adda5022f4f4/setuptools-1.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.2
2025-08-31T08:27:10,693     Found link https://files.pythonhosted.org/packages/13/33/ab03685ecf08a0f5cbea3f95aeb416591054c16b2b9cf7a825bc225de16a/setuptools-1.2.zip (from https://pypi.org/simple/setuptools/), version: 1.2
2025-08-31T08:27:10,694     Found link https://files.pythonhosted.org/packages/25/0a/fda40660c3b2c3f04086c3a572abb5a8e6877862d0f95059536c2e8f49ec/setuptools-1.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 1.3
2025-08-31T08:27:10,694     Found link https://files.pythonhosted.org/packages/64/9f/3dcfa7d882676993843bf6e9ab9ef0afd4da7ca9710f3eaf46c0761f56a0/setuptools-1.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.3
2025-08-31T08:27:10,695     Found link https://files.pythonhosted.org/packages/0a/53/33a54f63b9a5f58b3a779d20b93e79e2a7e0c37fa66a2529398203f6dde4/setuptools-1.3.zip (from https://pypi.org/simple/setuptools/), version: 1.3
2025-08-31T08:27:10,696     Found link https://files.pythonhosted.org/packages/a9/6f/71cabadc24a7289dc73abb640a592a28a228de5b0ae7cf859891490def01/setuptools-1.3.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 1.3.1
2025-08-31T08:27:10,697     Found link https://files.pythonhosted.org/packages/4e/37/528fa652fb8eeb6b62971439984aea99a65da79942fdd048b97859795975/setuptools-1.3.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.3.1
2025-08-31T08:27:10,698     Found link https://files.pythonhosted.org/packages/40/bd/a254bcd3e69a2dbc2220e7dec0dbf85486ce801a17f4842076f4dbb46ad1/setuptools-1.3.1.zip (from https://pypi.org/simple/setuptools/), version: 1.3.1
2025-08-31T08:27:10,699     Found link https://files.pythonhosted.org/packages/dd/18/e6f368cbb1625be291261865c7b4b728b4c49ef4f30e1107eec297986fad/setuptools-1.3.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 1.3.2
2025-08-31T08:27:10,700     Found link https://files.pythonhosted.org/packages/23/fa/0eeee1f840b1e772fa1538fd58478fd2d4950445ab4cf748e5a497144af6/setuptools-1.3.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.3.2
2025-08-31T08:27:10,701     Found link https://files.pythonhosted.org/packages/43/36/fc62d4e0e6f74aa820c85ff42d5a1ca8168410c1d559d316c679fc7c679f/setuptools-1.3.2.zip (from https://pypi.org/simple/setuptools/), version: 1.3.2
2025-08-31T08:27:10,702     Found link https://files.pythonhosted.org/packages/4d/7f/24c0d76fba6848a8ab06d3d773566a2465c4f005e106b5cd0ff494af0531/setuptools-1.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 1.4
2025-08-31T08:27:10,703     Found link https://files.pythonhosted.org/packages/3a/ed/843ddb53f5d41fbe56f10918aa34f6a9ed568d453e5075a9c573424a14aa/setuptools-1.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.4
2025-08-31T08:27:10,704     Found link https://files.pythonhosted.org/packages/45/65/9af2a0de870b706c93788334e2e32f336f5c0a684342143f79a4b984d806/setuptools-1.4.zip (from https://pypi.org/simple/setuptools/), version: 1.4
2025-08-31T08:27:10,707     Found link https://files.pythonhosted.org/packages/b2/0f/d08477648a2d4458fe9a149d351665a1742020bc45b6b20eed808fee2f2f/setuptools-1.4.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 1.4.1
2025-08-31T08:27:10,708     Found link https://files.pythonhosted.org/packages/d3/ce/ad0b1ee5e072b0cc95b61010bf673c9e52a595492a512769c57e61986ca2/setuptools-1.4.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.4.1
2025-08-31T08:27:10,709     Found link https://files.pythonhosted.org/packages/51/25/f1fa20ee2d2f36ef1ed514ef706db566296bea64b5ff44334c69c6cf005c/setuptools-1.4.1.zip (from https://pypi.org/simple/setuptools/), version: 1.4.1
2025-08-31T08:27:10,710     Found link https://files.pythonhosted.org/packages/b0/a2/288b40338c0878526e2c6f05dfc707eda9d21c6868875e4c2cd5e6ec51c9/setuptools-1.4.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 1.4.2
2025-08-31T08:27:10,711     Found link https://files.pythonhosted.org/packages/61/3c/8d680267eda244ad6391fb8b211bd39d8b527f3b66207976ef9f2f106230/setuptools-1.4.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.4.2
2025-08-31T08:27:10,712     Found link https://files.pythonhosted.org/packages/be/1d/bcacf98d1ab9383e0aa6e16dc8b6fcb75b87c1d42287333dd3821e79f70b/setuptools-1.4.2.zip (from https://pypi.org/simple/setuptools/), version: 1.4.2
2025-08-31T08:27:10,713     Found link https://files.pythonhosted.org/packages/13/3f/3a3addddfff8e9a0880199c97b009203aea99c6e579c7b01d605094456f9/setuptools-2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 2.0
2025-08-31T08:27:10,714     Found link https://files.pythonhosted.org/packages/28/84/27df240f3f8f52511965979aad7c7b77606f8fe41d4c90f2449e02172bb1/setuptools-2.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 2.0
2025-08-31T08:27:10,714     Found link https://files.pythonhosted.org/packages/7d/9a/ef929fd840f15be36daa94b35b2213bf257b2f511e2688875857d6391899/setuptools-2.0.zip (from https://pypi.org/simple/setuptools/), version: 2.0
2025-08-31T08:27:10,715     Found link https://files.pythonhosted.org/packages/04/c7/4937ce3aaf09cf5babd413866f4117d4d039560a6b80d7984ee78eee40af/setuptools-2.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 2.0.1
2025-08-31T08:27:10,716     Found link https://files.pythonhosted.org/packages/7d/73/2a886a194567bc5d5089b1727ea52611058bcb2c61bb1305e1d7e1ba1480/setuptools-2.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 2.0.1
2025-08-31T08:27:10,717     Found link https://files.pythonhosted.org/packages/0c/a1/df17fa54c78dcaec8f3e88f6c7a4986b73dac0f36deb318b41a5d4aa666d/setuptools-2.0.1.zip (from https://pypi.org/simple/setuptools/), version: 2.0.1
2025-08-31T08:27:10,718     Found link https://files.pythonhosted.org/packages/cc/fa/e73ed700bcaca3122f1dee7efd45a7af5d882b202a255c7a08416cd4680e/setuptools-2.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 2.0.2
2025-08-31T08:27:10,719     Found link https://files.pythonhosted.org/packages/b1/e4/5af6558ad5db8b9be7ac0be2f18282d538964b6ee423c73174a6d3ef50b5/setuptools-2.0.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 2.0.2
2025-08-31T08:27:10,720     Found link https://files.pythonhosted.org/packages/b0/8c/a9f4306b425b6652c9ce5a4d5c9670161455cb3bd7894e784c0fcaaef65d/setuptools-2.0.2.zip (from https://pypi.org/simple/setuptools/), version: 2.0.2
2025-08-31T08:27:10,721     Found link https://files.pythonhosted.org/packages/bc/bc/f67a89984bda6d3e3b446645d54d91a404154afa11aabc23135305f3646a/setuptools-2.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 2.1
2025-08-31T08:27:10,722     Found link https://files.pythonhosted.org/packages/a1/ab/885e331ed2d49f16d40e2d75bdccccdbb318e5007d28d47d218438ee1175/setuptools-2.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 2.1
2025-08-31T08:27:10,723     Found link https://files.pythonhosted.org/packages/69/bd/f37a4f52937577291f0f18bc51161f3220f2ff815cc976c3f3097bf4a386/setuptools-2.1.zip (from https://pypi.org/simple/setuptools/), version: 2.1
2025-08-31T08:27:10,724     Found link https://files.pythonhosted.org/packages/ac/68/08fb37b00b139a397264472d3d39468e9e87e66df125f20b347a0bc91a13/setuptools-2.1.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 2.1.1
2025-08-31T08:27:10,725     Found link https://files.pythonhosted.org/packages/16/06/10511928cd6040cb8c42bc4d7f9b6dad486c2afdbf814b036a43540f512a/setuptools-2.1.1.zip (from https://pypi.org/simple/setuptools/), version: 2.1.1
2025-08-31T08:27:10,726     Found link https://files.pythonhosted.org/packages/b8/0e/dd4d92e799c77f14dd0dc3bb006d5f7a8e86fadac3e61944dd6dba823e13/setuptools-2.1.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 2.1.2
2025-08-31T08:27:10,727     Found link https://files.pythonhosted.org/packages/7e/24/e63ddeadfeb93c370c4eb3686628433510c80440b1dbca810e715c1bb622/setuptools-2.1.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 2.1.2
2025-08-31T08:27:10,727     Found link https://files.pythonhosted.org/packages/73/e5/61e83f356cb1a4d77ab5818827db929d6b368310e9ad9aff59a0e40b3fd5/setuptools-2.1.2.zip (from https://pypi.org/simple/setuptools/), version: 2.1.2
2025-08-31T08:27:10,729     Found link https://files.pythonhosted.org/packages/6a/67/4b82a4c0bf81a4f73b2a68be918d5ec9240c6e50fafe333d455683304321/setuptools-2.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 2.2
2025-08-31T08:27:10,729     Found link https://files.pythonhosted.org/packages/8b/62/6b730b1c56ecd6c515de8748acedb1ff88761634315ff575182e97afa1bf/setuptools-2.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 2.2
2025-08-31T08:27:10,730     Found link https://files.pythonhosted.org/packages/72/16/738ef65b2659b3a84573c51094afbfb0c263f7cd51911c3caf5e4f7b8c0b/setuptools-2.2.zip (from https://pypi.org/simple/setuptools/), version: 2.2
2025-08-31T08:27:10,731     Found link https://files.pythonhosted.org/packages/a8/42/177352d8b06614904c213ad1693370bd444585887e88697d28d0a6c1c913/setuptools-3.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.0
2025-08-31T08:27:10,732     Found link https://files.pythonhosted.org/packages/ea/db/383b4abaa84fab598e02c2019d531676ffd33617a8d8628c3724e7733921/setuptools-3.0.zip (from https://pypi.org/simple/setuptools/), version: 3.0
2025-08-31T08:27:10,733     Found link https://files.pythonhosted.org/packages/2d/ef/e4c40d37f9cb727bc35bd01ddaee847e22ceaf8e943414cc30d4a2222ced/setuptools-3.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.0.1
2025-08-31T08:27:10,734     Found link https://files.pythonhosted.org/packages/52/32/073e1c2325cb65425593cb99897aadb7715eb5ba664b5eb187477d8b6df6/setuptools-3.0.1.zip (from https://pypi.org/simple/setuptools/), version: 3.0.1
2025-08-31T08:27:10,735     Found link https://files.pythonhosted.org/packages/fe/cb/5c3ecf3866938e230be1b3d355ff9501f3f6b65ae5c583f88bf59855345f/setuptools-3.0.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.0.2
2025-08-31T08:27:10,736     Found link https://files.pythonhosted.org/packages/f1/ee/052f6fbd63664b9e8b8a5a1b6e667c078c54600319feafc7265e5a367cd2/setuptools-3.0.2.zip (from https://pypi.org/simple/setuptools/), version: 3.0.2
2025-08-31T08:27:10,737     Found link https://files.pythonhosted.org/packages/94/ee/d2326117a111fb978cb1d6f2e62e5cf8a63f057e828145506e7b4a32d3fe/setuptools-3.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.1
2025-08-31T08:27:10,738     Found link https://files.pythonhosted.org/packages/9a/fc/46d5fa8dd1a60c0091a940d67724fd42b03a7866cde64ac921e2e2d7d6a6/setuptools-3.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.1
2025-08-31T08:27:10,738     Found link https://files.pythonhosted.org/packages/96/c2/beaef5bdd2b706c6ffac24dd3be7e93f67733bfe4dff30372a0ac2b4de4e/setuptools-3.1.zip (from https://pypi.org/simple/setuptools/), version: 3.1
2025-08-31T08:27:10,739     Found link https://files.pythonhosted.org/packages/bd/1f/b0bade1b1e905ae7e259f576490753ca349be1496cefccc8f69c6423547e/setuptools-3.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.2
2025-08-31T08:27:10,740     Found link https://files.pythonhosted.org/packages/c4/98/b0aba9599fc1b410c84b77e9ea5710b76a3e4174c1849ac769670b77c0e1/setuptools-3.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.2
2025-08-31T08:27:10,741     Found link https://files.pythonhosted.org/packages/91/fd/e4acce69d20ee1c8e2a6bb3a5b83663949097ae58c30976ff09956b26597/setuptools-3.2.zip (from https://pypi.org/simple/setuptools/), version: 3.2
2025-08-31T08:27:10,742     Found link https://files.pythonhosted.org/packages/fc/20/0b304ea9830d53c9068e1e96bbf1ee529283f96ee0ee6ccaaa697f7b2383/setuptools-3.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.3
2025-08-31T08:27:10,743     Found link https://files.pythonhosted.org/packages/82/e6/049fc4474cf5cebab5748e886836af23b41436f8b069eac836c7231e7325/setuptools-3.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.3
2025-08-31T08:27:10,744     Found link https://files.pythonhosted.org/packages/24/52/857fd91f603207c941b6c6844ca0e2ebdb8d5621264c32188d098887588b/setuptools-3.3.zip (from https://pypi.org/simple/setuptools/), version: 3.3
2025-08-31T08:27:10,745     Found link https://files.pythonhosted.org/packages/13/62/1c94404356ae0ecebd6fba55898d7b3c385bdb5dc18558686495659355fd/setuptools-3.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.4
2025-08-31T08:27:10,746     Found link https://files.pythonhosted.org/packages/e1/78/91598beae5a49bb7f768ffea849f2a4b49f6e3fc0401ff9737d39cf35d29/setuptools-3.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.4
2025-08-31T08:27:10,747     Found link https://files.pythonhosted.org/packages/4c/1e/d0db812bfb6c3e798c382c7509fc8470ecd217f2e2eb597f9ebe035bd688/setuptools-3.4.zip (from https://pypi.org/simple/setuptools/), version: 3.4
2025-08-31T08:27:10,748     Found link https://files.pythonhosted.org/packages/d1/6c/37f126e8be2aad1550b2e93f339878b048aa83c2b4d8489a3be8fbee2a9d/setuptools-3.4.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.4.1
2025-08-31T08:27:10,749     Found link https://files.pythonhosted.org/packages/13/88/132500071ad154086bb14cda98703008326a3f0e3c488fa99f3c4241d7dd/setuptools-3.4.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.4.1
2025-08-31T08:27:10,750     Found link https://files.pythonhosted.org/packages/6c/09/46f4ae75d3503005347c62789594aadaad7d4109e8f33b03e7232fc441de/setuptools-3.4.1.zip (from https://pypi.org/simple/setuptools/), version: 3.4.1
2025-08-31T08:27:10,751     Found link https://files.pythonhosted.org/packages/46/0e/98de4d7f466603fe1fb9be7b602fed7c5e2dd55f25829c145f0041314917/setuptools-3.4.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.4.2
2025-08-31T08:27:10,752     Found link https://files.pythonhosted.org/packages/00/a0/f6089508f7f5f061329fc20bb3baf70e7891a0cf9a943f2208706aad353f/setuptools-3.4.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.4.2
2025-08-31T08:27:10,753     Found link https://files.pythonhosted.org/packages/72/8e/a216c7974627f4e393a28d517716102700b93af61b2b11372451393c4057/setuptools-3.4.2.zip (from https://pypi.org/simple/setuptools/), version: 3.4.2
2025-08-31T08:27:10,754     Found link https://files.pythonhosted.org/packages/03/e2/b8421d4ed72fa187b5ef696755f452df7e6cdc821ea119bd5dda3efc2f72/setuptools-3.4.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.4.3
2025-08-31T08:27:10,754     Found link https://files.pythonhosted.org/packages/f4/fe/aa9650b161dbf75ce5506dba83551de214fbcc1388297bd9f07b02913c53/setuptools-3.4.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.4.3
2025-08-31T08:27:10,755     Found link https://files.pythonhosted.org/packages/1a/a8/c5661640a25128d0a90ed98f624a7ee17b60d4f068bc5ba7a42f266f655a/setuptools-3.4.3.zip (from https://pypi.org/simple/setuptools/), version: 3.4.3
2025-08-31T08:27:10,756     Found link https://files.pythonhosted.org/packages/cc/f0/351de04af115d4c3595c0632d7ce619a49721c11364b48d8eace0db4c80c/setuptools-3.4.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.4.4
2025-08-31T08:27:10,757     Found link https://files.pythonhosted.org/packages/4a/e5/8316b07bab05ec87ff969841be6a3f18e30ca1ec3031e7d30ec7313aa04b/setuptools-3.4.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.4.4
2025-08-31T08:27:10,758     Found link https://files.pythonhosted.org/packages/47/48/92b82ea3022f734b4f72c52a2b614991aa3c430a713f575b540d34dfb87c/setuptools-3.4.4.zip (from https://pypi.org/simple/setuptools/), version: 3.4.4
2025-08-31T08:27:10,759     Found link https://files.pythonhosted.org/packages/5f/4a/fef43230b0a42c9945f6838b4bcb6e4abe2efc70a5cf0bb3162bd493194a/setuptools-3.5-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.5
2025-08-31T08:27:10,760     Found link https://files.pythonhosted.org/packages/e0/bf/207713b5cb61a756d3a02d843c8e96851c81fa2327ccb448f4bf35ec4c59/setuptools-3.5.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.5
2025-08-31T08:27:10,761     Found link https://files.pythonhosted.org/packages/8a/ab/db10e77928961439aa7460aeba9b64d685f8a4ad7444661a00f3175e5811/setuptools-3.5.zip (from https://pypi.org/simple/setuptools/), version: 3.5
2025-08-31T08:27:10,762     Found link https://files.pythonhosted.org/packages/9a/d3/22fcca731a7151fbd5ae5092b6a8cfa610db8fc649580267d0f4bb71de3b/setuptools-3.5.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.5.1
2025-08-31T08:27:10,763     Found link https://files.pythonhosted.org/packages/60/d3/b69a78ffbc4413bfb13d6a722daef01f2c89c4582b55c5516b58eb11274c/setuptools-3.5.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.5.1
2025-08-31T08:27:10,764     Found link https://files.pythonhosted.org/packages/6f/6f/c26e40e5ffa9aa4601d9fa27a7238ef38bf15d19e683a5edb2524cf156ab/setuptools-3.5.1.zip (from https://pypi.org/simple/setuptools/), version: 3.5.1
2025-08-31T08:27:10,765     Found link https://files.pythonhosted.org/packages/1c/2d/ea0834bcce178d3fc99b916211d969bf30e8955a303d5977881e2d5d9dd0/setuptools-3.5.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.5.2
2025-08-31T08:27:10,766     Found link https://files.pythonhosted.org/packages/22/de/75592eb307ed9bf573c73619229bae3babb6765977c3cfed3248075d8430/setuptools-3.5.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.5.2
2025-08-31T08:27:10,767     Found link https://files.pythonhosted.org/packages/a3/d7/1195e7435dfab3be42a1c30f24188387e08bee376888b5a5fe2ac8750501/setuptools-3.5.2.zip (from https://pypi.org/simple/setuptools/), version: 3.5.2
2025-08-31T08:27:10,768     Found link https://files.pythonhosted.org/packages/40/8f/cae21061a6871ca4624287b97711ea5747b24a937c18cd41b23c95b6062e/setuptools-3.6-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.6
2025-08-31T08:27:10,769     Found link https://files.pythonhosted.org/packages/d3/3e/e87db7dbf6e65b9b04bf2772197af77f711cfadb038ba76d2acfcc2efa72/setuptools-3.6.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.6
2025-08-31T08:27:10,769     Found link https://files.pythonhosted.org/packages/38/79/40acb2edbc4f7ff4f476b9c87a64d1095bbc0a6858545f791c740e155add/setuptools-3.6.zip (from https://pypi.org/simple/setuptools/), version: 3.6
2025-08-31T08:27:10,770     Found link https://files.pythonhosted.org/packages/a1/59/6a50e86731711ff2ac4c51c96e080c21cd9af81c46f388c63a5f358931e0/setuptools-3.7-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.7
2025-08-31T08:27:10,771     Found link https://files.pythonhosted.org/packages/2a/a3/4cc9d46ae7c5fdedd86a4332d73ddad458e20ab0feb7fda011b665c9d42c/setuptools-3.7.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.7
2025-08-31T08:27:10,772     Found link https://files.pythonhosted.org/packages/d4/d0/dfc40771bf97c7994df04f8c4846a26066ec9230d07d2dc44d83726ede23/setuptools-3.7.zip (from https://pypi.org/simple/setuptools/), version: 3.7
2025-08-31T08:27:10,773     Found link https://files.pythonhosted.org/packages/94/b7/0eb75451f3dfb14b41cfcb12e701128564c9526a8d38995d8f210be7ee00/setuptools-3.7.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.7.1
2025-08-31T08:27:10,774     Found link https://files.pythonhosted.org/packages/38/b8/007e39bf2d853ba3b930e7d48b3a767a94f3a3b96a99df6d09ac9ddb1038/setuptools-3.7.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.7.1
2025-08-31T08:27:10,775     Found link https://files.pythonhosted.org/packages/b3/97/a7507bf4e8c6b2f6b1f492e051530308912c7bffd8a3c5f41f42f57f04ec/setuptools-3.7.1.zip (from https://pypi.org/simple/setuptools/), version: 3.7.1
2025-08-31T08:27:10,776     Found link https://files.pythonhosted.org/packages/a5/22/3f6968082291391d668583b719f8b255e15ee6b7c583b7b6b7c05918e57a/setuptools-3.8-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.8
2025-08-31T08:27:10,777     Found link https://files.pythonhosted.org/packages/cc/33/992be126171d94666dddda9c785dac7d6c96ab928c13e136239938a72b1f/setuptools-3.8.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.8
2025-08-31T08:27:10,778     Found link https://files.pythonhosted.org/packages/ee/d7/34f3bef82a7ffe13625b8ce457df4e4d46c202113ecb5f655872aeb71934/setuptools-3.8.zip (from https://pypi.org/simple/setuptools/), version: 3.8
2025-08-31T08:27:10,779     Found link https://files.pythonhosted.org/packages/9f/76/1789d66f14c45100dd58590e453a481851c40a91df2f3b4f2ae880cf25e4/setuptools-3.8.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.8.1
2025-08-31T08:27:10,780     Found link https://files.pythonhosted.org/packages/0b/2f/05323cd8c349939ed38bf72611cd02374cc553c34872996e38ebf3107b0a/setuptools-3.8.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.8.1
2025-08-31T08:27:10,781     Found link https://files.pythonhosted.org/packages/29/55/4c68ee6236b36fb6032437b93c635246510fb001d700467f4063a214916a/setuptools-3.8.1.zip (from https://pypi.org/simple/setuptools/), version: 3.8.1
2025-08-31T08:27:10,781     Found link https://files.pythonhosted.org/packages/12/24/0885d9fe662ef964090217e3833f2ed4a67dfd446f9ddd428304d224eb6f/setuptools-4.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 4.0
2025-08-31T08:27:10,782     Found link https://files.pythonhosted.org/packages/54/07/6dfdb40647a291a665bfa66d228d1d516db9aaa1e2e9a2f84c6c97ac6c69/setuptools-4.0.zip (from https://pypi.org/simple/setuptools/), version: 4.0
2025-08-31T08:27:10,783     Found link https://files.pythonhosted.org/packages/52/71/a6e77590363fa6e3fe8ca14eb951476f08ad103486437335f9848a09e3c2/setuptools-4.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 4.0.1
2025-08-31T08:27:10,784     Found link https://files.pythonhosted.org/packages/cb/e0/b5ecf534e14304e62c781614d683d0daa571efe92678901559ea84c1559e/setuptools-4.0.1.zip (from https://pypi.org/simple/setuptools/), version: 4.0.1
2025-08-31T08:27:10,785     Found link https://files.pythonhosted.org/packages/81/94/ab636294e0a5180a51760909cc058d98ad9d01f7aaac9791e4fa1b6f2a8c/setuptools-5.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.0
2025-08-31T08:27:10,786     Found link https://files.pythonhosted.org/packages/43/49/92974712ba5b150d530abfea49a3591a547bdcb7b3c56594b0a1b38c78f7/setuptools-5.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.0
2025-08-31T08:27:10,787     Found link https://files.pythonhosted.org/packages/56/e9/94e4d4576ff800e67cb14bbe2d7f2944b583b74f8e0e844b566c15db838f/setuptools-5.0.zip (from https://pypi.org/simple/setuptools/), version: 5.0
2025-08-31T08:27:10,788     Found link https://files.pythonhosted.org/packages/d9/00/356346173b9aa57da6fde8def53587f6af51df29b1312a941feef13aaed8/setuptools-5.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.0.1
2025-08-31T08:27:10,789     Found link https://files.pythonhosted.org/packages/b3/7f/ff28c2b6d7b24fc6940d2a93d2ac736d844b499a30c8eb9e03d8379aa4a9/setuptools-5.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.0.1
2025-08-31T08:27:10,790     Found link https://files.pythonhosted.org/packages/52/83/870642b2d14d46e1f898edf722434d3b2812418705d501f5a0503a7f1761/setuptools-5.0.1.zip (from https://pypi.org/simple/setuptools/), version: 5.0.1
2025-08-31T08:27:10,791     Found link https://files.pythonhosted.org/packages/c6/31/e868dc1720daad287b658caef36defb02de9c7aad4b803c9c03bcc70c2e3/setuptools-5.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.0.2
2025-08-31T08:27:10,792     Found link https://files.pythonhosted.org/packages/1a/19/747b3fceb402d028dc93f227dd39d294ad8365c50d9fbde822ac151c9ab2/setuptools-5.0.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.0.2
2025-08-31T08:27:10,793     Found link https://files.pythonhosted.org/packages/92/c9/2f3a1f0c8b7f53892ac293953b47a7fc8a07e9a38b3d2966cf7302c49514/setuptools-5.0.2.zip (from https://pypi.org/simple/setuptools/), version: 5.0.2
2025-08-31T08:27:10,794     Found link https://files.pythonhosted.org/packages/33/8d/948cd1b924c3e81298da106a7b15942e824714f41f3e34ea22a351637f2c/setuptools-5.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.1
2025-08-31T08:27:10,794     Found link https://files.pythonhosted.org/packages/75/23/4b74bbff9c646a5235e85f619c0d541357b1f8ecf2ae9f68f03dccdabcfa/setuptools-5.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.1
2025-08-31T08:27:10,795     Found link https://files.pythonhosted.org/packages/e3/55/66e9cb495828d918c30b914bfb1ef2f6f22b69cc01ab1f56be40db61e922/setuptools-5.1.zip (from https://pypi.org/simple/setuptools/), version: 5.1
2025-08-31T08:27:10,796     Found link https://files.pythonhosted.org/packages/aa/85/e9e49394bc7f131a58dc130955ca73fa0bbe27bb2b247505260500901fb7/setuptools-5.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.2
2025-08-31T08:27:10,797     Found link https://files.pythonhosted.org/packages/93/e4/d7813c313947f6753f991ea7dd9101350373519aaab3f57a2ac5c50bb962/setuptools-5.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.2
2025-08-31T08:27:10,798     Found link https://files.pythonhosted.org/packages/67/ad/0feed436050d75dcb7f072abd0eaa6a367ca298e17d289040ae7c23d4bc1/setuptools-5.2.zip (from https://pypi.org/simple/setuptools/), version: 5.2
2025-08-31T08:27:10,799     Found link https://files.pythonhosted.org/packages/55/8c/e2020e08b436877d546d51e836766b448ef455a7146a2990cd3507d05acc/setuptools-5.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.3
2025-08-31T08:27:10,800     Found link https://files.pythonhosted.org/packages/4a/e0/7e35bf11ba31fa177976cd275ac1ade700b7d39d63715a6240a711d412fd/setuptools-5.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.3
2025-08-31T08:27:10,801     Found link https://files.pythonhosted.org/packages/48/d5/62680f41e2f6c208228c822f8932d4c7aa8a3127e12d708b5de9ad70136b/setuptools-5.3.zip (from https://pypi.org/simple/setuptools/), version: 5.3
2025-08-31T08:27:10,802     Found link https://files.pythonhosted.org/packages/48/c1/8f5c6fea2427904365c570da5c9b2e1b28fa5d9c8b02e31cf5b8969f722b/setuptools-5.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.4
2025-08-31T08:27:10,803     Found link https://files.pythonhosted.org/packages/00/2e/e023df8df47462a053fa8cf5225adce2fe24644c7848fb7728a29b24607e/setuptools-5.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.4
2025-08-31T08:27:10,804     Found link https://files.pythonhosted.org/packages/d5/a8/81835fcd723a073b38d2d86d1a8f6e109eb88cce1a252af81d4b591563d4/setuptools-5.4.zip (from https://pypi.org/simple/setuptools/), version: 5.4
2025-08-31T08:27:10,805     Found link https://files.pythonhosted.org/packages/b1/ba/02218786fe9d5beeb2cfdaf0e423219d132845774d703f6e8a708dd5e642/setuptools-5.4.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.4.1
2025-08-31T08:27:10,806     Found link https://files.pythonhosted.org/packages/cb/55/4143b8a178e17c39c246d95dd0620e8c26c699ffc5267eb5d444b6b2429a/setuptools-5.4.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.4.1
2025-08-31T08:27:10,807     Found link https://files.pythonhosted.org/packages/98/9c/079cd02e1511fa0bc155af16a333aef6a33d9753e7cb2ba201f4cbd79b0c/setuptools-5.4.1.zip (from https://pypi.org/simple/setuptools/), version: 5.4.1
2025-08-31T08:27:10,808     Found link https://files.pythonhosted.org/packages/bd/51/e4f4f62b5b70b191f955d04aed76fe1dc32926db48c5ba3c93ccaddd391c/setuptools-5.4.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.4.2
2025-08-31T08:27:10,808     Found link https://files.pythonhosted.org/packages/90/99/1b25b0ad3c07400b42dfd82e53b63e2b2517f5cd2cecbec5f639aa2a26f0/setuptools-5.4.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.4.2
2025-08-31T08:27:10,809     Found link https://files.pythonhosted.org/packages/1f/62/4c02b8534d35c0d43648e11ca92ca95ad6abe5abcc01edf8c18aeb01da4f/setuptools-5.4.2.zip (from https://pypi.org/simple/setuptools/), version: 5.4.2
2025-08-31T08:27:10,810     Found link https://files.pythonhosted.org/packages/40/60/478266f8f2dba7bb5f51432e5ece4fd418a6e4a518c6cba3fd275e6603d7/setuptools-5.5-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.5
2025-08-31T08:27:10,811     Found link https://files.pythonhosted.org/packages/ce/a5/cd5986d92c030bd92754c099d617f9b4f3c7a913345205073566980d5435/setuptools-5.5.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.5
2025-08-31T08:27:10,843     Found link https://files.pythonhosted.org/packages/9d/93/c996180360f022b09cab7f0b71a80967189eefa6d17ebe7f01c18af5fcc1/setuptools-5.5.zip (from https://pypi.org/simple/setuptools/), version: 5.5
2025-08-31T08:27:10,845     Found link https://files.pythonhosted.org/packages/97/b1/3c62eb46609eb301b7e7faffb3a8d378c42bba822346302312b345f258c2/setuptools-5.5.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.5.1
2025-08-31T08:27:10,846     Found link https://files.pythonhosted.org/packages/47/15/7f9aabb1ce09d3dc5ecdff2f5a97e0a47f724fe8e398eff6a88626d0164c/setuptools-5.5.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.5.1
2025-08-31T08:27:10,847     Found link https://files.pythonhosted.org/packages/07/37/b4c230b767cbe7ade1df979a32e38856ddface17124e6da31797a1f1448c/setuptools-5.5.1.zip (from https://pypi.org/simple/setuptools/), version: 5.5.1
2025-08-31T08:27:10,848     Found link https://files.pythonhosted.org/packages/12/7b/8a12ea7cbc3ae519ee304edaac71b17d74ce02eb4a2ced615e9ba3bc074e/setuptools-5.6-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.6
2025-08-31T08:27:10,848     Found link https://files.pythonhosted.org/packages/bc/f1/b248d4facd9b9710ef59d006ea05ea1afa98d9c584120319076f9b3b6b7a/setuptools-5.6.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.6
2025-08-31T08:27:10,849     Found link https://files.pythonhosted.org/packages/c4/e7/5be3134b53395e0f541f6da20bba04046b588cbd4ea666f799fddd838246/setuptools-5.6.zip (from https://pypi.org/simple/setuptools/), version: 5.6
2025-08-31T08:27:10,850     Found link https://files.pythonhosted.org/packages/28/29/2a99aaa46f9e7ca267433123a134132a06cbf8691b77b6e8d5b4d9915b72/setuptools-5.7-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.7
2025-08-31T08:27:10,851     Found link https://files.pythonhosted.org/packages/1c/09/3b60801cbd3ff9ac5ded466390c78b55703dcae28094f528330f498e9242/setuptools-5.7.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.7
2025-08-31T08:27:10,852     Found link https://files.pythonhosted.org/packages/08/1b/cfcdd4381459c3967a08dd3b7c16b7f10a5bfb8ad5c40b56f8ee4a25e8d7/setuptools-5.7.zip (from https://pypi.org/simple/setuptools/), version: 5.7
2025-08-31T08:27:10,853     Found link https://files.pythonhosted.org/packages/81/fd/b942a1caf9aa7340f93143ed81301a92b18f5e81116245252f09f8f5d557/setuptools-5.8-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.8
2025-08-31T08:27:10,854     Found link https://files.pythonhosted.org/packages/3e/9d/91d3ddf7e62eac384a95b5a8a0d4a46383d1d90b19b1232614cb20373544/setuptools-5.8.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.8
2025-08-31T08:27:10,855     Found link https://files.pythonhosted.org/packages/38/d7/71a61d368a84669c6a82b593f53e4163a1031271fc55e597cd3cd108e4f9/setuptools-5.8.zip (from https://pypi.org/simple/setuptools/), version: 5.8
2025-08-31T08:27:10,856     Found link https://files.pythonhosted.org/packages/71/bd/bbfc6a7b9ba0900f9ab44e2b03b301738cd9d90334afea8939e2536c1683/setuptools-6.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 6.0.1
2025-08-31T08:27:10,857     Found link https://files.pythonhosted.org/packages/9e/6c/3f5fd7df720b8285def2b5f111acbd79b6eb6e29fb2bbba6432a80cb30b1/setuptools-6.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 6.0.1
2025-08-31T08:27:10,858     Found link https://files.pythonhosted.org/packages/c2/82/2b2c796e0624bedfadc2b69a578b677fbba984a4fd700e709108ce3b750f/setuptools-6.0.1.zip (from https://pypi.org/simple/setuptools/), version: 6.0.1
2025-08-31T08:27:10,859     Found link https://files.pythonhosted.org/packages/af/55/954114b84b021d59746eb602a8d0b937b22d5b17813adcf1003e39a8147c/setuptools-6.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 6.0.2
2025-08-31T08:27:10,860     Found link https://files.pythonhosted.org/packages/26/8c/e1c6149e371758bc160bccce4efead2fbf3452808f0664470c016750511a/setuptools-6.0.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 6.0.2
2025-08-31T08:27:10,860     Found link https://files.pythonhosted.org/packages/4a/8c/e14333caa5fcfa69d82d87ff68c5d192856ae271d0bc943d8b89333ca955/setuptools-6.0.2.zip (from https://pypi.org/simple/setuptools/), version: 6.0.2
2025-08-31T08:27:10,861     Found link https://files.pythonhosted.org/packages/49/62/093854427bd78f9b7d3359cd0d116338fdcca3bca041265f949c35dc3213/setuptools-6.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 6.1
2025-08-31T08:27:10,862     Found link https://files.pythonhosted.org/packages/54/d7/7e2b70b32ed7792e233b4d9891da77e9a5542a0fcb1d68e5a690fc73b0b3/setuptools-6.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 6.1
2025-08-31T08:27:10,863     Found link https://files.pythonhosted.org/packages/18/1f/6d365ad3dc73ef876c52c9943cc3bb4df93ff134b3e4f7cd5477c8e502b2/setuptools-6.1.zip (from https://pypi.org/simple/setuptools/), version: 6.1
2025-08-31T08:27:10,864     Found link https://files.pythonhosted.org/packages/e0/af/9ad21bc766c436b087f3fd63ffcef7f6819cc52f1905787450ac7fec0239/setuptools-7.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 7.0
2025-08-31T08:27:10,865     Found link https://files.pythonhosted.org/packages/0b/48/7298047bf4d67972d9bcb8a546e34f71ee4376d46186615b29678ac33a54/setuptools-7.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 7.0
2025-08-31T08:27:10,866     Found link https://files.pythonhosted.org/packages/fb/cb/279fb618621107373dc96d05df87547be5c34cc9d0ade8bb18929206360c/setuptools-7.0.zip (from https://pypi.org/simple/setuptools/), version: 7.0
2025-08-31T08:27:10,867     Found link https://files.pythonhosted.org/packages/ef/e7/537d8016e3a2026b5da2d4c7050c7a67e07989d804a4c97130e825ab9b78/setuptools-8.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 8.0
2025-08-31T08:27:10,868     Found link https://files.pythonhosted.org/packages/75/61/23794707407db0a66ead0baea37ec50b68dc8077ccd8ff08846bbab69e55/setuptools-8.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 8.0
2025-08-31T08:27:10,869     Found link https://files.pythonhosted.org/packages/a3/47/198b972944ce33de2b3dde67f4fdc156d8f41d656caa8f8b53dcaa066cc8/setuptools-8.0.zip (from https://pypi.org/simple/setuptools/), version: 8.0
2025-08-31T08:27:10,870     Found link https://files.pythonhosted.org/packages/75/8d/08c18187dc4b8f321cffcf37b03f4681ec2e7dbf19aa8e199c99b5842ab9/setuptools-8.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 8.0.1
2025-08-31T08:27:10,871     Found link https://files.pythonhosted.org/packages/b3/dc/bd60003eb8f044cb4626536d88c7fbc562eae02d596b8318d7638dde5f26/setuptools-8.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 8.0.1
2025-08-31T08:27:10,872     Found link https://files.pythonhosted.org/packages/28/e4/3d553bb84eae6d331fdb24a448e8bc455d6a60a63ca61a6633e9c5ff7407/setuptools-8.0.1.zip (from https://pypi.org/simple/setuptools/), version: 8.0.1
2025-08-31T08:27:10,873     Found link https://files.pythonhosted.org/packages/80/43/6adc94eb236ac6a14426aab29d96cdf7f406877361634872b75cfb068595/setuptools-8.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 8.0.2
2025-08-31T08:27:10,874     Found link https://files.pythonhosted.org/packages/95/96/9aec808b0b7ddfadcd9bec608548e896f928db8da6d4c9aa8f6e8a588464/setuptools-8.0.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 8.0.2
2025-08-31T08:27:10,875     Found link https://files.pythonhosted.org/packages/9e/4d/3a3b5ef6f18bfe1ee831b3313625973e48bc7af3029691ea916e316407e4/setuptools-8.0.2.zip (from https://pypi.org/simple/setuptools/), version: 8.0.2
2025-08-31T08:27:10,876     Found link https://files.pythonhosted.org/packages/50/26/483e2dbcee986da3276175d4f2ea6260c7a7cca1b7568e1a12f009451429/setuptools-8.0.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 8.0.3
2025-08-31T08:27:10,877     Found link https://files.pythonhosted.org/packages/8e/12/812047ed6e8bae2047f611c8b45d50ef7163b8ee569a0a57b2d9be22b36d/setuptools-8.0.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 8.0.3
2025-08-31T08:27:10,877     Found link https://files.pythonhosted.org/packages/a3/13/8c4fb8df6433711a5c53aa96f9e93993e4e58124a29560d500cdfc7283b9/setuptools-8.0.3.zip (from https://pypi.org/simple/setuptools/), version: 8.0.3
2025-08-31T08:27:10,878     Found link https://files.pythonhosted.org/packages/21/f4/e27f1a024b200b6c57d02c93ef9cc61d4aad15aca9364ad2c477112f68d6/setuptools-8.0.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 8.0.4
2025-08-31T08:27:10,879     Found link https://files.pythonhosted.org/packages/0c/d2/011e4648bbf92c8f393c8ec23a3766c17cea3cdc2913e00ebe42947c1305/setuptools-8.0.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 8.0.4
2025-08-31T08:27:10,880     Found link https://files.pythonhosted.org/packages/b8/3e/ceff6491997a5946465d5f1185f68acf8d54920c9ccb165a4654dcbd6cdd/setuptools-8.0.4.zip (from https://pypi.org/simple/setuptools/), version: 8.0.4
2025-08-31T08:27:10,881     Found link https://files.pythonhosted.org/packages/7a/d9/09e73cb52fe58697ffa955fcbba0e5c480bec88054fe729f9bc9ceb4fb9a/setuptools-8.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 8.1
2025-08-31T08:27:10,882     Found link https://files.pythonhosted.org/packages/ef/08/e37c9183f251f4a5b4e78c1371e173dea58d12a7c79ce40b63861797a7cc/setuptools-8.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 8.1
2025-08-31T08:27:10,883     Found link https://files.pythonhosted.org/packages/4f/54/442b0660c17ddf36e8531240abfe25a983e49451bed16f9c2b728559a8e1/setuptools-8.1.zip (from https://pypi.org/simple/setuptools/), version: 8.1
2025-08-31T08:27:10,884     Found link https://files.pythonhosted.org/packages/3c/e7/f8373689b94080d71ebf17edd3b16f05eadb278975d73490ec5755274f96/setuptools-8.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 8.2
2025-08-31T08:27:10,885     Found link https://files.pythonhosted.org/packages/5c/94/b852a1920e6c769f7b07568c952301d3524602560cf0f6c95cd55630a173/setuptools-8.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 8.2
2025-08-31T08:27:10,886     Found link https://files.pythonhosted.org/packages/46/9c/f58ba661ceca4d23857f7bcd8ffc2ae82257e24d6e6d736e03dd5a7a24a4/setuptools-8.2.zip (from https://pypi.org/simple/setuptools/), version: 8.2
2025-08-31T08:27:10,887     Found link https://files.pythonhosted.org/packages/dc/85/9653e32a36d4adf8ab35a2cbf0f25d387242a40b859cdcb0534eedf23b44/setuptools-8.2.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 8.2.1
2025-08-31T08:27:10,888     Found link https://files.pythonhosted.org/packages/1c/4c/b71920059f7be5335eea9f608703f1320d7467f3177e9f8dbf57d2964ff4/setuptools-8.2.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 8.2.1
2025-08-31T08:27:10,889     Found link https://files.pythonhosted.org/packages/a9/40/2f5948813c2542c3ca7384c16044963382bf6eb5c8d3d1d993891cf1747a/setuptools-8.2.1.zip (from https://pypi.org/simple/setuptools/), version: 8.2.1
2025-08-31T08:27:10,890     Found link https://files.pythonhosted.org/packages/ef/3a/6e1811346d7db4c237ef88af3c9b25cd798d6ffbbebbb08fd9267deea221/setuptools-8.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 8.3
2025-08-31T08:27:10,891     Found link https://files.pythonhosted.org/packages/73/48/e8971a9af1a2dc1a1d707fa8837f3f5662d584d1e214cc810fdcb185f8c7/setuptools-8.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 8.3
2025-08-31T08:27:10,891     Found link https://files.pythonhosted.org/packages/c6/5f/69dd9d47534efc1c2d566800b70ce687e20bc0e4bf9f91030659ce442018/setuptools-8.3.zip (from https://pypi.org/simple/setuptools/), version: 8.3
2025-08-31T08:27:10,893     Found link https://files.pythonhosted.org/packages/9b/84/984f56186a1c168b6bcdea368a7ffd9ac2dc1a8e542be65193e3c2ead9d9/setuptools-9.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 9.0
2025-08-31T08:27:10,893     Found link https://files.pythonhosted.org/packages/26/58/ece52b43b90885050cb93ef03c9651e85dee9958bfbd1bae58dab041c81b/setuptools-9.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 9.0
2025-08-31T08:27:10,894     Found link https://files.pythonhosted.org/packages/f6/84/5479171fd0a3f00e6ae2efffbd07975ba9c699cc7627cabcd4b7cc7839b0/setuptools-9.0.zip (from https://pypi.org/simple/setuptools/), version: 9.0
2025-08-31T08:27:10,895     Found link https://files.pythonhosted.org/packages/4d/a7/f14baf6e3f1bd91b23e3fe9cccd4a4a9c86341f5d4658a3fc16fe0c79097/setuptools-9.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 9.0.1
2025-08-31T08:27:10,896     Found link https://files.pythonhosted.org/packages/34/65/39ffd8d3344ece1e0ed664a509df7d022873eb314676fd49ddae91b3407e/setuptools-9.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 9.0.1
2025-08-31T08:27:10,897     Found link https://files.pythonhosted.org/packages/16/2c/1ad571e85048c57b4e7ba2218d0fff3db0452e8bfa0c20e1543e26f85121/setuptools-9.0.1.zip (from https://pypi.org/simple/setuptools/), version: 9.0.1
2025-08-31T08:27:10,898     Found link https://files.pythonhosted.org/packages/98/65/5893faed89f4f095b4ae8c95bb7332523ecd893c8ccb12fc4d8a80814a01/setuptools-9.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 9.1
2025-08-31T08:27:10,899     Found link https://files.pythonhosted.org/packages/c4/9b/159ffa84fe2f37fffdeda588717574e53cd2f6e68acf439b0759c9a921eb/setuptools-9.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 9.1
2025-08-31T08:27:10,900     Found link https://files.pythonhosted.org/packages/35/b2/626974cb6f02c4d58c33471b597f6723560f74be322857e9cd24700c3c70/setuptools-9.1.zip (from https://pypi.org/simple/setuptools/), version: 9.1
2025-08-31T08:27:10,901     Found link https://files.pythonhosted.org/packages/db/9d/863d9e5fb76a3942644372ff690a38106b37069211ef1294e270ffc6f346/setuptools-10.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 10.0
2025-08-31T08:27:10,902     Found link https://files.pythonhosted.org/packages/e7/57/26be96f253f0fa9b210f9b3e8430e8fc33a6a1cd5bfd7e175b31bbcfc5d7/setuptools-10.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 10.0
2025-08-31T08:27:10,903     Found link https://files.pythonhosted.org/packages/e4/07/3ce9d7c0f487e637c5f93dd035032aeddb4d2891a29cbaa8b7440a365515/setuptools-10.0.zip (from https://pypi.org/simple/setuptools/), version: 10.0
2025-08-31T08:27:10,904     Found link https://files.pythonhosted.org/packages/af/05/08d31c8011c1981ac79870c5ba5fc4e0f2cb4154a104341dabea7be34df2/setuptools-10.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 10.0.1
2025-08-31T08:27:10,905     Found link https://files.pythonhosted.org/packages/ee/62/38f2e8f34edb5e0ebd7fc64b569b72a94f7972ecfe9fb7f280008b092dd7/setuptools-10.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 10.0.1
2025-08-31T08:27:10,906     Found link https://files.pythonhosted.org/packages/00/43/136856df6b50dfb8edf1a4a4936455d68dc38ffa908763a055def184b0a9/setuptools-10.0.1.zip (from https://pypi.org/simple/setuptools/), version: 10.0.1
2025-08-31T08:27:10,907     Found link https://files.pythonhosted.org/packages/b2/69/699982624afc34549c8533bbf12774391862843faaa95d7ed795d0e2c36d/setuptools-10.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 10.1
2025-08-31T08:27:10,908     Found link https://files.pythonhosted.org/packages/9b/4b/79343fa8526cab01c95dca96caf50a9d2ea35e5075e29d1b168bf2add2bf/setuptools-10.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 10.1
2025-08-31T08:27:10,908     Found link https://files.pythonhosted.org/packages/87/a6/2c8af2d92c94b6a7c1c2cf3272b25fa2ef59b28b74144b0755bb29b281c2/setuptools-10.1.zip (from https://pypi.org/simple/setuptools/), version: 10.1
2025-08-31T08:27:10,909     Found link https://files.pythonhosted.org/packages/0f/ab/039427a18215b6a4a3bb023aeae0768f11b57778c611ee3d1a13306bd4ed/setuptools-10.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 10.2
2025-08-31T08:27:10,910     Found link https://files.pythonhosted.org/packages/75/e4/a85e8443980946967272049950361758805fda5e0b89d7d9bb348979f2fe/setuptools-10.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 10.2
2025-08-31T08:27:10,911     Found link https://files.pythonhosted.org/packages/0f/6d/1f8cdc3b0b57076ff2c8f8542b7e1d0826fe017815253eb98e98b1c7e0ba/setuptools-10.2.zip (from https://pypi.org/simple/setuptools/), version: 10.2
2025-08-31T08:27:10,912     Found link https://files.pythonhosted.org/packages/cf/82/1f64bdc07e33eca057b77594d0f87a5a015bc831e9a8a891596c392117be/setuptools-10.2.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 10.2.1
2025-08-31T08:27:10,913     Found link https://files.pythonhosted.org/packages/f8/7c/7551890036f17361996276387d16f6b93201566c86fff7bf7ccc43f51404/setuptools-10.2.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 10.2.1
2025-08-31T08:27:10,914     Found link https://files.pythonhosted.org/packages/70/6a/ce73dca788c85cfbfd1da29d70ce8ae16222c7e044bc75b0871418e577d9/setuptools-10.2.1.zip (from https://pypi.org/simple/setuptools/), version: 10.2.1
2025-08-31T08:27:10,915     Found link https://files.pythonhosted.org/packages/b8/65/1d62dea9e62e7680546678f445e24247d2c1dbd75c63a3936d2aa645760c/setuptools-11.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 11.0
2025-08-31T08:27:10,916     Found link https://files.pythonhosted.org/packages/c9/b6/fa2bd564458bf8e2493e4db4b95922f53bb38656ec9c4997254370d5521c/setuptools-11.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 11.0
2025-08-31T08:27:10,917     Found link https://files.pythonhosted.org/packages/37/53/de4e6b7ff77d1d4c3781819583021861b7ec39fbdf363f79b30bf8aecf4c/setuptools-11.0.zip (from https://pypi.org/simple/setuptools/), version: 11.0
2025-08-31T08:27:10,918     Found link https://files.pythonhosted.org/packages/b5/fc/34b8ae9f65418fda18efa13afa9c216c01f2efdde699702eee69604bb1f7/setuptools-11.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 11.1
2025-08-31T08:27:10,919     Found link https://files.pythonhosted.org/packages/1e/d9/295b5bcb96e4828dd517e8f140467df79c5b4dd513e6d98ca336b927e96f/setuptools-11.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 11.1
2025-08-31T08:27:10,920     Found link https://files.pythonhosted.org/packages/11/ed/1a33e609a40ba5bb5e87f1b9b601c103dbd66269bf241120afb9caccf462/setuptools-11.1.zip (from https://pypi.org/simple/setuptools/), version: 11.1
2025-08-31T08:27:10,921     Found link https://files.pythonhosted.org/packages/80/90/6788a1fa2fd333acc1e5adfccbceb2c0c0eedb8aefaac8b224f12d1230e7/setuptools-11.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 11.2
2025-08-31T08:27:10,922     Found link https://files.pythonhosted.org/packages/2f/aa/cc5b2e1e3326a35601508968767508374031c07e70e880e0f00c3e49fb2d/setuptools-11.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 11.2
2025-08-31T08:27:10,922     Found link https://files.pythonhosted.org/packages/f2/29/e69f1c1a12c579c6da265dc6594722ab11010683806e4e742eb7c8ffe08d/setuptools-11.2.zip (from https://pypi.org/simple/setuptools/), version: 11.2
2025-08-31T08:27:10,924     Found link https://files.pythonhosted.org/packages/db/c8/fb6817e76a2b6ab00e38c92286c526a8969e86a6739d251133ebcb7697ad/setuptools-11.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 11.3
2025-08-31T08:27:10,925     Found link https://files.pythonhosted.org/packages/34/a9/65ef401499e6878b3c67c473ecfd8803eacf274b03316ec8f2e86116708d/setuptools-11.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 11.3
2025-08-31T08:27:10,925     Found link https://files.pythonhosted.org/packages/85/b9/f32b943ce45853d778458ce0f9af007641557a5257acea29458e8cc2115d/setuptools-11.3.zip (from https://pypi.org/simple/setuptools/), version: 11.3
2025-08-31T08:27:10,927     Found link https://files.pythonhosted.org/packages/32/da/46df61c1c7f71483c73af190ff668c31fff096d789d0dd5ed83170e9366a/setuptools-11.3.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 11.3.1
2025-08-31T08:27:10,927     Found link https://files.pythonhosted.org/packages/ac/34/8e23ee6e86e0a7f2ad934aa7e16b03c13b3a3c1058d7972c60a60111cf2a/setuptools-11.3.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 11.3.1
2025-08-31T08:27:10,928     Found link https://files.pythonhosted.org/packages/98/44/cf4a8843803aa272b290679c2b08236029752c927bedaf3a6805b0191c3c/setuptools-11.3.1.zip (from https://pypi.org/simple/setuptools/), version: 11.3.1
2025-08-31T08:27:10,929     Found link https://files.pythonhosted.org/packages/3a/31/1faf2685a0cea0c36d4bbc035e53414026fdd5bd5f4e31b8b3c5d1767a54/setuptools-12.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 12.0
2025-08-31T08:27:10,930     Found link https://files.pythonhosted.org/packages/9e/be/ca16313dcc62f3b69b6f204470806042847656380cd401241a7b69b91a07/setuptools-12.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 12.0
2025-08-31T08:27:10,931     Found link https://files.pythonhosted.org/packages/9d/c9/b837359319988b156b9deed87ab6e8fc7e709afa82a97b93191c5a0077f4/setuptools-12.0.zip (from https://pypi.org/simple/setuptools/), version: 12.0
2025-08-31T08:27:10,932     Found link https://files.pythonhosted.org/packages/9f/ae/2344d112a43c5409449e8edeef86553c572150e596a455dc8fc8dce132d3/setuptools-12.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 12.0.1
2025-08-31T08:27:10,933     Found link https://files.pythonhosted.org/packages/31/f5/17ce5fa1f49d1665e7ec9fe5a2d1e6e73032d8f7cfb32440454059679a6f/setuptools-12.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 12.0.1
2025-08-31T08:27:10,934     Found link https://files.pythonhosted.org/packages/8d/40/7814758efbad56c5b13c7ca3bbb49b198577b3f62dd88334be7d1a9df6f7/setuptools-12.0.1.zip (from https://pypi.org/simple/setuptools/), version: 12.0.1
2025-08-31T08:27:10,935     Found link https://files.pythonhosted.org/packages/37/9c/e623f9b14d1b66ac1b73f6cefaef63c6116895c4a38c015a78d1c2e135c4/setuptools-12.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 12.0.2
2025-08-31T08:27:10,936     Found link https://files.pythonhosted.org/packages/eb/59/4103a48ece1a341350a587dd5ef8e27ea75d411c709cf59cf01e78b49a55/setuptools-12.0.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 12.0.2
2025-08-31T08:27:10,937     Found link https://files.pythonhosted.org/packages/49/f7/5962355be50b9ba5ea1e18fec91619c18ed6db434f0861085bc84db649b0/setuptools-12.0.2.zip (from https://pypi.org/simple/setuptools/), version: 12.0.2
2025-08-31T08:27:10,938     Found link https://files.pythonhosted.org/packages/2b/41/eef9b1bcf9dd28db416d2ca6f9b093ee0de74e758a3926a3fb18bb3f11dc/setuptools-12.0.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 12.0.3
2025-08-31T08:27:10,939     Found link https://files.pythonhosted.org/packages/aa/17/36aaaceb141ad7cbb9851158a8fd73215b93a63e7162fe5fcd7d773fb9b9/setuptools-12.0.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 12.0.3
2025-08-31T08:27:10,940     Found link https://files.pythonhosted.org/packages/39/8d/803fea27b92c8147f47e6254478a39eeef86b46d6fa72db6a358352b429c/setuptools-12.0.3.zip (from https://pypi.org/simple/setuptools/), version: 12.0.3
2025-08-31T08:27:10,941     Found link https://files.pythonhosted.org/packages/a0/b7/cc0ce2cb14b2312b253521c5985c1689e7e86ef1e27e36e4da6b4ccda768/setuptools-12.0.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 12.0.4
2025-08-31T08:27:10,941     Found link https://files.pythonhosted.org/packages/2c/1a/af35b7251503e04ca6946d2075bc694818edddbe1366b0c172c3e74c6133/setuptools-12.0.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 12.0.4
2025-08-31T08:27:10,942     Found link https://files.pythonhosted.org/packages/ac/9a/ee5772e08133a17f0640bd38ec3af687609d63a04f98a42fca142f73b6b3/setuptools-12.0.4.zip (from https://pypi.org/simple/setuptools/), version: 12.0.4
2025-08-31T08:27:10,943     Found link https://files.pythonhosted.org/packages/77/71/266b72e5c7df0f8a560599617495172036878ba24cff1e22ac4882d919b8/setuptools-12.0.5-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 12.0.5
2025-08-31T08:27:10,944     Found link https://files.pythonhosted.org/packages/c6/b6/7d0793d138644f8857753ac341e1f5fe744f157754a7b2b59a93b0ce6c38/setuptools-12.0.5.tar.gz (from https://pypi.org/simple/setuptools/), version: 12.0.5
2025-08-31T08:27:10,945     Found link https://files.pythonhosted.org/packages/6f/bd/cde3aff4ef0b38b305ed68c05b696a202c2e7e72718831ade33eabd6d283/setuptools-12.0.5.zip (from https://pypi.org/simple/setuptools/), version: 12.0.5
2025-08-31T08:27:10,946     Found link https://files.pythonhosted.org/packages/a4/be/f9b8ef5079705f5872014198e1b5ddcefcedc75c22a59600868ca68cbbd0/setuptools-12.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 12.1
2025-08-31T08:27:10,947     Found link https://files.pythonhosted.org/packages/00/5b/a7dd72d8bab089f2c946b3682f1f9ebb459ca8c4bfef7b14640318ace782/setuptools-12.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 12.1
2025-08-31T08:27:10,948     Found link https://files.pythonhosted.org/packages/a8/4d/b668121f41308c83763a3f6030e9fde5cc8fd56cba422b923b0da3ac7668/setuptools-12.1.zip (from https://pypi.org/simple/setuptools/), version: 12.1
2025-08-31T08:27:10,949     Found link https://files.pythonhosted.org/packages/0b/36/6322d63caee39ce5efb932a289d892cf4c7b54e7e43376b7617638cd6e40/setuptools-12.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 12.2
2025-08-31T08:27:10,950     Found link https://files.pythonhosted.org/packages/13/c0/216e0adececaabad0bdfb11819af62b8c79ca507a179a01504adbf3726a3/setuptools-12.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 12.2
2025-08-31T08:27:10,951     Found link https://files.pythonhosted.org/packages/2c/72/1591dfe73b26a05bf53cd8035f85541283f9cb43febc67b76b6dd87fecb3/setuptools-12.2.zip (from https://pypi.org/simple/setuptools/), version: 12.2
2025-08-31T08:27:10,952     Found link https://files.pythonhosted.org/packages/ac/0f/29fb77656be5ab4cd72e51b5670f2f13b227377ae020ba49d9de2e4119a0/setuptools-12.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 12.3
2025-08-31T08:27:10,953     Found link https://files.pythonhosted.org/packages/d3/38/3f947884c009fc65c4d9f60ff154230be6226ac2215a30e631e155418a30/setuptools-12.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 12.3
2025-08-31T08:27:10,954     Found link https://files.pythonhosted.org/packages/e7/94/f2afdffc82361f4f0f1d771cb18cc9a757d4a52741453a3639bea5c34c4d/setuptools-12.3.zip (from https://pypi.org/simple/setuptools/), version: 12.3
2025-08-31T08:27:10,955     Found link https://files.pythonhosted.org/packages/95/c2/aba5df20f8f8b75c6cd99970809a789ac9ce5bd3033b9693098d9e647228/setuptools-12.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 12.4
2025-08-31T08:27:10,956     Found link https://files.pythonhosted.org/packages/05/99/4eb2d51cc8a1bbc2252c186f8455c68898734529b64daafaaf7d62264f94/setuptools-12.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 12.4
2025-08-31T08:27:10,956     Found link https://files.pythonhosted.org/packages/76/9d/4a0937535b4ed0ef752ed48dfd950d0d9c6ab3063a22f318ea08154d8bec/setuptools-12.4.zip (from https://pypi.org/simple/setuptools/), version: 12.4
2025-08-31T08:27:10,957     Found link https://files.pythonhosted.org/packages/08/80/6eb388e929f7212820aaf0e0943787ccb36bd49b86f0f7c4bf8e6ac00d27/setuptools-13.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 13.0.1
2025-08-31T08:27:10,958     Found link https://files.pythonhosted.org/packages/fa/ef/c0e1ac0e7509593a0addee204a4fc6b577e9323b5e92f03cccfc242ca5fa/setuptools-13.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 13.0.1
2025-08-31T08:27:10,959     Found link https://files.pythonhosted.org/packages/af/c5/63fe880591c601410cd2a168df603b24d66127a3c502b4688272e332ec19/setuptools-13.0.1.zip (from https://pypi.org/simple/setuptools/), version: 13.0.1
2025-08-31T08:27:10,960     Found link https://files.pythonhosted.org/packages/39/dd/d899e0ec56742d82a0ab83adff7ae0a2f36245047214bee9a6442bb9d4c6/setuptools-13.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 13.0.2
2025-08-31T08:27:10,961     Found link https://files.pythonhosted.org/packages/9f/9f/b8accb44e584d08bbdce792e4b99502f998b84130283c2ca539a4c3f2fd0/setuptools-13.0.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 13.0.2
2025-08-31T08:27:10,962     Found link https://files.pythonhosted.org/packages/ff/f3/498a65f5ed63ef35126da543d1be46b1526f0eb4f03dc47ffa2bdccf7e8b/setuptools-13.0.2.zip (from https://pypi.org/simple/setuptools/), version: 13.0.2
2025-08-31T08:27:10,963     Found link https://files.pythonhosted.org/packages/fb/5c/4e5898b5052e81a271faa03b0b9f5236c65682c3736d499d8de455264034/setuptools-14.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 14.0
2025-08-31T08:27:10,964     Found link https://files.pythonhosted.org/packages/60/79/b64b985b6c5eada9c650e12fb0ebd8c0136dbeabbd5b9b1be45f433a5ca1/setuptools-14.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 14.0
2025-08-31T08:27:10,965     Found link https://files.pythonhosted.org/packages/49/09/825f890e9f078a3ea74005bce4309143eee2662195f559b0d9b3910b868b/setuptools-14.0.zip (from https://pypi.org/simple/setuptools/), version: 14.0
2025-08-31T08:27:10,966     Found link https://files.pythonhosted.org/packages/7c/75/10917197567ce27a7d006fbdb5c37003478f626b1247c738f0d8584b9788/setuptools-14.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 14.1
2025-08-31T08:27:10,967     Found link https://files.pythonhosted.org/packages/1b/6c/de1a4da56ec6e7671d9b183ba0ad1ce76932d592be9c0da401538d98e1e5/setuptools-14.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 14.1
2025-08-31T08:27:10,968     Found link https://files.pythonhosted.org/packages/d7/f3/ac34e3cab9e07736ec3a72b1b435a3a4534daeb21a80d04ae411d09e73d0/setuptools-14.1.zip (from https://pypi.org/simple/setuptools/), version: 14.1
2025-08-31T08:27:10,969     Found link https://files.pythonhosted.org/packages/ca/a8/b3ced8c646d6e8e84b5b7e1861505b984c0a59bdd52c87fdf9765abf2a0b/setuptools-14.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 14.1.1
2025-08-31T08:27:10,970     Found link https://files.pythonhosted.org/packages/40/aa/7e810622378d14fe1f1ee6cc88c91a7c62f25dfa0f0b4cf3343d848ca5b1/setuptools-14.1.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 14.1.1
2025-08-31T08:27:10,970     Found link https://files.pythonhosted.org/packages/f1/c8/b5b997ff066cbf987660aa22bdc7b8b2cc804eea97170103b601bc7a40e5/setuptools-14.1.1.zip (from https://pypi.org/simple/setuptools/), version: 14.1.1
2025-08-31T08:27:10,971     Found link https://files.pythonhosted.org/packages/86/1e/55c39c8e647375f4ee053ab25dd47f847773113b3549e7642352a0d712f6/setuptools-14.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 14.2
2025-08-31T08:27:10,972     Found link https://files.pythonhosted.org/packages/43/3c/cb8b12b0f780caffdbb9621f63f39bb587f5549965ec0982abe73536e037/setuptools-14.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 14.2
2025-08-31T08:27:10,973     Found link https://files.pythonhosted.org/packages/b6/8b/19adbcfc88963f48906bd390c743184f59ca8c096dfb17c8a8b972436443/setuptools-14.2.zip (from https://pypi.org/simple/setuptools/), version: 14.2
2025-08-31T08:27:10,974     Found link https://files.pythonhosted.org/packages/e8/ac/6a4d5ea808ef5fe0a13319088e42937297140f112e86fbda5aff7c31cadc/setuptools-14.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 14.3
2025-08-31T08:27:10,975     Found link https://files.pythonhosted.org/packages/c6/07/2f5de27db67b1a7799811be804aa77dac9e04aaf39d8273f24205bb6dfb2/setuptools-14.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 14.3
2025-08-31T08:27:10,976     Found link https://files.pythonhosted.org/packages/7b/2e/6abcca232b3ee13e4b4d26ff27a06b7b473a597b18b91802668ab141d29d/setuptools-14.3.zip (from https://pypi.org/simple/setuptools/), version: 14.3
2025-08-31T08:27:10,977     Found link https://files.pythonhosted.org/packages/6d/eb/2fd142cc6387b5304850698369250f05fec5a69ae50e8ee512d6ec25237c/setuptools-14.3.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 14.3.1
2025-08-31T08:27:10,978     Found link https://files.pythonhosted.org/packages/e2/99/2f6deb6f2f50b7eb289f83d03d81d1018333b8886b1ca6c8dd7c7b52f3f9/setuptools-14.3.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 14.3.1
2025-08-31T08:27:10,979     Found link https://files.pythonhosted.org/packages/da/f0/7ef454473979ecf6d337c44c0af776d5793a31e0194391ac31e23392e8c9/setuptools-14.3.1.zip (from https://pypi.org/simple/setuptools/), version: 14.3.1
2025-08-31T08:27:10,980     Found link https://files.pythonhosted.org/packages/77/8d/7821039e75a509e52828c3f7bcc9faf4218aff2cbf37304e2ba239326db1/setuptools-15.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 15.0
2025-08-31T08:27:10,981     Found link https://files.pythonhosted.org/packages/7c/40/b38a541524c417e32333e1d459c7f2be56f8aceb96fd527476a5232276a7/setuptools-15.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 15.0
2025-08-31T08:27:10,982     Found link https://files.pythonhosted.org/packages/43/d8/8952db17766ec989fca23dc2305535efcbe6b3d07d4493f4cf312f94463d/setuptools-15.0.zip (from https://pypi.org/simple/setuptools/), version: 15.0
2025-08-31T08:27:10,983     Found link https://files.pythonhosted.org/packages/4f/58/07877759f873430057c08bde2136d489842597032cb5c8bbcc54aa0093b7/setuptools-15.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 15.1
2025-08-31T08:27:10,984     Found link https://files.pythonhosted.org/packages/de/14/2cf462619805bf49c1395030509fc4b30dd118d56ae94f0551910308fcbc/setuptools-15.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 15.1
2025-08-31T08:27:10,984     Found link https://files.pythonhosted.org/packages/db/db/bc5443e648500e22b48a3b55f7614157d2187b622936836a014de7e8e6c6/setuptools-15.1.zip (from https://pypi.org/simple/setuptools/), version: 15.1
2025-08-31T08:27:10,986     Found link https://files.pythonhosted.org/packages/21/9d/a071a5a012ce6db6c5e1cd5ef1125619eaf72195e389ba83f8399725ba4a/setuptools-15.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 15.2
2025-08-31T08:27:10,986     Found link https://files.pythonhosted.org/packages/a1/5f/e290ea36e7749a0d58ed2daab8c138fbe28178b91bc68d62d85a85964406/setuptools-15.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 15.2
2025-08-31T08:27:10,987     Found link https://files.pythonhosted.org/packages/28/17/f1b300eeec0405388bfffc51a1efb37c45ad713c978b231f2c24e1a7cee4/setuptools-15.2.zip (from https://pypi.org/simple/setuptools/), version: 15.2
2025-08-31T08:27:10,988     Found link https://files.pythonhosted.org/packages/66/5e/717a861f50bc8fa2a9bd516a9be52c9d482d3af5dd6b9bad56d2893eb50a/setuptools-16.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 16.0
2025-08-31T08:27:10,989     Found link https://files.pythonhosted.org/packages/03/68/ff7b42cce92cfb96d299311836249fa1d6adb050a2444b87c1d661adf5ec/setuptools-16.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 16.0
2025-08-31T08:27:10,990     Found link https://files.pythonhosted.org/packages/4f/2d/5ccd59268e5b9243e40bb93ff654499669ad210817f6cafaf396f0574a20/setuptools-16.0.zip (from https://pypi.org/simple/setuptools/), version: 16.0
2025-08-31T08:27:10,991     Found link https://files.pythonhosted.org/packages/b6/f0/f93e7c38bb7242ad00f78ea799fd3a0362f8316edc916a0d8ab02f0bcfcd/setuptools-17.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 17.0
2025-08-31T08:27:10,992     Found link https://files.pythonhosted.org/packages/df/b6/0d8caceca41ad57cf6902b533626481aadf79686024836cdab34fa470990/setuptools-17.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 17.0
2025-08-31T08:27:10,993     Found link https://files.pythonhosted.org/packages/0e/59/8562edadb9bd37d7efd73b2156ec9e7aa1e5df027837b0cb147430b6b12f/setuptools-17.0.zip (from https://pypi.org/simple/setuptools/), version: 17.0
2025-08-31T08:27:10,994     Found link https://files.pythonhosted.org/packages/d6/86/5e0b49553de3c450bca91a303a052bf26f54df14cf59ab65fbe77e452f87/setuptools-17.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 17.1
2025-08-31T08:27:10,995     Found link https://files.pythonhosted.org/packages/94/aa/68a87f84793f4efb0fe2d311f903f97c089dbc8d6c366541d63e5766a174/setuptools-17.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 17.1
2025-08-31T08:27:10,996     Found link https://files.pythonhosted.org/packages/0b/23/ffbb0b89f01676e28d2e79bd5cba47e2aa617bf13691c0cd3fc82a646fc4/setuptools-17.1.zip (from https://pypi.org/simple/setuptools/), version: 17.1
2025-08-31T08:27:10,997     Found link https://files.pythonhosted.org/packages/87/01/2d147e63b6cfb6948491efc73f6c9219c0bc5d9d183c9ab6bed8430fa78b/setuptools-17.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 17.1.1
2025-08-31T08:27:10,998     Found link https://files.pythonhosted.org/packages/3e/39/4b0c9d8121f0a43a466139aac0939acf0e0dc15e4c8a1bb61b06fd8fe654/setuptools-17.1.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 17.1.1
2025-08-31T08:27:10,999     Found link https://files.pythonhosted.org/packages/ab/45/fbcb04dbf423a82cd530f63a1a265b55055ec61bf5af250fc4e1044b60cf/setuptools-17.1.1.zip (from https://pypi.org/simple/setuptools/), version: 17.1.1
2025-08-31T08:27:11,000     Found link https://files.pythonhosted.org/packages/65/07/c240e40af3180056b16d0c343b23cfd0a3a7206e077cd1ef887cc5fc0d91/setuptools-18.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.0
2025-08-31T08:27:11,000     Found link https://files.pythonhosted.org/packages/04/9f/9e15924a1ee397d23b86f1dfed3aa9f1ce3db2572996530385917c925faf/setuptools-18.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.0
2025-08-31T08:27:11,001     Found link https://files.pythonhosted.org/packages/d8/4e/bcc2292b28f7d2bc0e859247eea94e589d4aa730b6b36d268be9f5f9e238/setuptools-18.0.zip (from https://pypi.org/simple/setuptools/), version: 18.0
2025-08-31T08:27:11,002     Found link https://files.pythonhosted.org/packages/00/d5/1233f051f7ce669a2009301aa75f1efbd97ccde6b60236997fd9111d5297/setuptools-18.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.0.1
2025-08-31T08:27:11,003     Found link https://files.pythonhosted.org/packages/8c/04/f4a2dce4364c0bfbb1992e4b3a8e01eb196bb46202f96a62e73927a752ef/setuptools-18.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.0.1
2025-08-31T08:27:11,004     Found link https://files.pythonhosted.org/packages/e1/c3/a9db1ecd786b88c3454b42498945e4a341b68d8717bde8d5c8aa0d32e604/setuptools-18.0.1.zip (from https://pypi.org/simple/setuptools/), version: 18.0.1
2025-08-31T08:27:11,005     Found link https://files.pythonhosted.org/packages/10/40/f079e5f10cedefa29fd3b62173da977cf736064b76d7541377afc8802e27/setuptools-18.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.1
2025-08-31T08:27:11,006     Found link https://files.pythonhosted.org/packages/c9/54/b716bdd25bb6096686d2dc6e1f2de9c58b6042a5dc40cd45918dcf835d50/setuptools-18.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.1
2025-08-31T08:27:11,007     Found link https://files.pythonhosted.org/packages/b7/37/63e7e32c0b29c6100d22aac00681c92165411dd50696db0db14abc0d71c5/setuptools-18.1.zip (from https://pypi.org/simple/setuptools/), version: 18.1
2025-08-31T08:27:11,008     Found link https://files.pythonhosted.org/packages/c3/f6/b3224fb53fd3ddebdcc2aafb8f2d3a044a66446c9f17f4e5a24ca03b781b/setuptools-18.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.2
2025-08-31T08:27:11,009     Found link https://files.pythonhosted.org/packages/44/34/88291437ae25021cf632ecc8d81587c18deec404642fceee4a59478f57ba/setuptools-18.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.2
2025-08-31T08:27:11,010     Found link https://files.pythonhosted.org/packages/f5/f4/03fdc144f760de50a2a1d82975e25af0b4374ae0d8b934eeb28e248468d0/setuptools-18.2.zip (from https://pypi.org/simple/setuptools/), version: 18.2
2025-08-31T08:27:11,011     Found link https://files.pythonhosted.org/packages/e3/15/361a2f5c0a660ee497eec4981eff772cdfe3b181a85c407b2879cc4454e4/setuptools-18.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.3
2025-08-31T08:27:11,012     Found link https://files.pythonhosted.org/packages/5b/07/56cc2388ab75c15cbeb56dde0542d6c12aa58db6ed76d90448177a8ed8e3/setuptools-18.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.3
2025-08-31T08:27:11,013     Found link https://files.pythonhosted.org/packages/13/9f/3b21c8ced6b093afb828b181bd0351dfc6043cb3f96132f3a390fea7de51/setuptools-18.3.zip (from https://pypi.org/simple/setuptools/), version: 18.3
2025-08-31T08:27:11,014     Found link https://files.pythonhosted.org/packages/09/f3/1dde395f7d8416510d276e5f4ccafd1ea3690a14e2e7af1dc5481d78e239/setuptools-18.3.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.3.1
2025-08-31T08:27:11,014     Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/89/ea/4fb7162ef9244471947676d549ef1603c67dfd257427c0549b51357a1e5a/setuptools-18.3.1-py3.4.egg (from https://pypi.org/simple/setuptools/)
2025-08-31T08:27:11,015     Found link https://files.pythonhosted.org/packages/86/8a/c4666b05c74e840eb9b09d28f4e7ae76fc9075e8c653d0eb4d265a5b49d9/setuptools-18.3.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.3.1
2025-08-31T08:27:11,016     Found link https://files.pythonhosted.org/packages/22/26/6fdaea27dbe43163d63871f31cfce9a928520f616c1cbb5c98f2a37920a6/setuptools-18.3.1.zip (from https://pypi.org/simple/setuptools/), version: 18.3.1
2025-08-31T08:27:11,017     Found link https://files.pythonhosted.org/packages/4b/24/aa010e86a1762750be5c6863d95cb27721cec5382221dab1bdd76dbb0b33/setuptools-18.3.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.3.2
2025-08-31T08:27:11,018     Found link https://files.pythonhosted.org/packages/52/ba/51f53c8fa0c72750d6ea99d9493987a353a7a756cd7fba830326edda82d9/setuptools-18.3.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.3.2
2025-08-31T08:27:11,019     Found link https://files.pythonhosted.org/packages/fe/ce/063abef42134e75edc350ef67fdd3baf3df487ffe8e9cd4e282e864192aa/setuptools-18.3.2.zip (from https://pypi.org/simple/setuptools/), version: 18.3.2
2025-08-31T08:27:11,020     Found link https://files.pythonhosted.org/packages/cb/e7/63e4efa1bd3396d0d7d0697d896c7c9c39635a8929424c4016b0abcf6e4d/setuptools-18.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.4
2025-08-31T08:27:11,021     Found link https://files.pythonhosted.org/packages/f4/4c/2b6ab405ed5a3a9aba8db8d163fe37feafc284135e2cc7c1919c57a90bf9/setuptools-18.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.4
2025-08-31T08:27:11,022     Found link https://files.pythonhosted.org/packages/04/79/0d1aace91c2ba8edbc23930b4c08d81ff0ebd016726f213a427af34893b8/setuptools-18.4.zip (from https://pypi.org/simple/setuptools/), version: 18.4
2025-08-31T08:27:11,023     Found link https://files.pythonhosted.org/packages/69/9d/e6ff1608e4308ae7c544050b58926daa4bf7764e963c09cc9f9a0bcd3728/setuptools-18.5-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.5
2025-08-31T08:27:11,024     Found link https://files.pythonhosted.org/packages/ec/6d/b433a14c77ad17b917a9646d5ac96275309170a88fcffc967def7a1ba8ce/setuptools-18.5.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.5
2025-08-31T08:27:11,025     Found link https://files.pythonhosted.org/packages/01/e6/15b9f1d1dcbde0984c499c3775be47ea0e4063bc34d2e843c4425d164436/setuptools-18.5.zip (from https://pypi.org/simple/setuptools/), version: 18.5
2025-08-31T08:27:11,026     Found link https://files.pythonhosted.org/packages/1d/99/3375dfc6e5b5212f32438131dbd721762404bc6ba6c75a0eb4836b309756/setuptools-18.6-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.6
2025-08-31T08:27:11,027     Found link https://files.pythonhosted.org/packages/d3/c5/c61734bfbba5a635f2bc9f0dc0f031cee59b69165e02b391b966f63bee88/setuptools-18.6.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.6
2025-08-31T08:27:11,027     Found link https://files.pythonhosted.org/packages/27/9d/b481808fd55856faa1bee32a7749de5c59e67096abbbeca609546a7ce1d7/setuptools-18.6.zip (from https://pypi.org/simple/setuptools/), version: 18.6
2025-08-31T08:27:11,029     Found link https://files.pythonhosted.org/packages/63/a5/a9369d7450c8725c7ea868ea395108eaa86ce4db38480fe714d3ebc2987f/setuptools-18.6.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.6.1
2025-08-31T08:27:11,030     Found link https://files.pythonhosted.org/packages/d7/6c/c44de1eb48a0528aee19ead52f64afac7830230ef94314e10d6de5c79ffd/setuptools-18.6.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.6.1
2025-08-31T08:27:11,031     Found link https://files.pythonhosted.org/packages/0d/c2/e2e94f17a5e3a9d23f6ade1936b276d37b5615c970847f7a73ac00dc597f/setuptools-18.6.1.zip (from https://pypi.org/simple/setuptools/), version: 18.6.1
2025-08-31T08:27:11,032     Found link https://files.pythonhosted.org/packages/47/04/7b211cb108f0ef1ec8d7f22750fb29126535609aabf9d4ae2a3d1392d10d/setuptools-18.7-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.7
2025-08-31T08:27:11,033     Found link https://files.pythonhosted.org/packages/b8/07/41e7b2d50ad56bff7767c9faffa3f006f30fe9bbde255b6dd13fb88f6c06/setuptools-18.7.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.7
2025-08-31T08:27:11,034     Found link https://files.pythonhosted.org/packages/1c/a9/0dc5641ce1e46eb08a25d6e986faf524d44377b3bc29405acfead2b7456b/setuptools-18.7.zip (from https://pypi.org/simple/setuptools/), version: 18.7
2025-08-31T08:27:11,035     Found link https://files.pythonhosted.org/packages/47/77/a1fd66157a3f27ccb1a5537897328f00c8a2ce52294841685eddbd83a752/setuptools-18.7.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.7.1
2025-08-31T08:27:11,035     Found link https://files.pythonhosted.org/packages/a2/20/5b06560f0a2a58df41ad920bd7c63811bc0496f1de28740ba5bb166bf5ac/setuptools-18.7.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.7.1
2025-08-31T08:27:11,036     Found link https://files.pythonhosted.org/packages/dc/a3/36a19c2d8187cd3d67537d1ff8d66d649738b820624dcb0953c8688648e5/setuptools-18.7.1.zip (from https://pypi.org/simple/setuptools/), version: 18.7.1
2025-08-31T08:27:11,037     Found link https://files.pythonhosted.org/packages/57/a4/f6b8bc74006295a8cf0a5a6c7d2abb23d0e061cf98c24bc8262c89c69212/setuptools-18.8-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.8
2025-08-31T08:27:11,038     Found link https://files.pythonhosted.org/packages/a8/44/e71cea10c597efc7c8255926c70fbd5cf0a919b88589877f01b3cf3bd796/setuptools-18.8.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.8
2025-08-31T08:27:11,039     Found link https://files.pythonhosted.org/packages/43/d9/015139565e4aa1be4fff52d6eccebf57df546ca9048df150d2b5c594aaf7/setuptools-18.8.zip (from https://pypi.org/simple/setuptools/), version: 18.8
2025-08-31T08:27:11,040     Found link https://files.pythonhosted.org/packages/62/bb/f30c6eec4fdad80dd2e24beca74f48b8953c989955d2e39572a2bba37e29/setuptools-18.8.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.8.1
2025-08-31T08:27:11,041     Found link https://files.pythonhosted.org/packages/e9/6b/60f0e5adea1b61bce06ffd02f414b0c115ec9608943c7387c997511d7cdc/setuptools-18.8.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.8.1
2025-08-31T08:27:11,042     Found link https://files.pythonhosted.org/packages/c8/4b/b87d0332ae6b6f816ebc7dd35b6ab7bc488af4acdf5d90e6a1fe3fa4be59/setuptools-18.8.1.zip (from https://pypi.org/simple/setuptools/), version: 18.8.1
2025-08-31T08:27:11,043     Found link https://files.pythonhosted.org/packages/25/e5/76920c6242c51dd97f418d9cdbb93bac9cc3626dbdfb67d0c7909b7332a7/setuptools-19.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.0
2025-08-31T08:27:11,044     Found link https://files.pythonhosted.org/packages/fd/0e/b4336a46bfa7f7aa2163d063ce7f85c9689a84d3ae4c918822b68e11ff7e/setuptools-19.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.0
2025-08-31T08:27:11,045     Found link https://files.pythonhosted.org/packages/07/a1/94d559a3b242c81d85a5ff6f283248952995b72c46bd84222f4d2c6c8fb6/setuptools-19.0.zip (from https://pypi.org/simple/setuptools/), version: 19.0
2025-08-31T08:27:11,046     Found link https://files.pythonhosted.org/packages/b8/b9/f7dadfb59d1f957bcb64c2e760fc4e1e6517e080ff23b7d02fa25c6c0f9a/setuptools-19.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.1
2025-08-31T08:27:11,047     Found link https://files.pythonhosted.org/packages/62/80/a982219d12596ae3ea8a03854b357cd5718ddb95721c00593464765cfb88/setuptools-19.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.1
2025-08-31T08:27:11,048     Found link https://files.pythonhosted.org/packages/49/a0/607ab10a870efb0276f9b2592fac438a008ea7af548cdaa86e1d31676483/setuptools-19.1.zip (from https://pypi.org/simple/setuptools/), version: 19.1
2025-08-31T08:27:11,049     Found link https://files.pythonhosted.org/packages/c9/7e/ff929dfb3c6268dfa23f86698b9ca17674cc2464e3b7bee8bd05ac653ed3/setuptools-19.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.1.1
2025-08-31T08:27:11,050     Found link https://files.pythonhosted.org/packages/8d/37/bd37d4432b0f788bdd2092f63190515c124e75613a24eccafe6f019d13d6/setuptools-19.1.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.1.1
2025-08-31T08:27:11,050     Found link https://files.pythonhosted.org/packages/99/97/b9ab8825b69fa53006ec6ff65322a75dfed4405af4c3cbc994f08a28e678/setuptools-19.1.1.zip (from https://pypi.org/simple/setuptools/), version: 19.1.1
2025-08-31T08:27:11,051     Found link https://files.pythonhosted.org/packages/50/4c/d1a74a90deb70f72981c138a70d3d0799721e5bd1dc8c4201900141b8915/setuptools-19.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.2
2025-08-31T08:27:11,052     Found link https://files.pythonhosted.org/packages/2d/f7/02abdb61deaf8135e463b7081d053e952cae3672f3f09d75ca26f4c824c9/setuptools-19.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.2
2025-08-31T08:27:11,053     Found link https://files.pythonhosted.org/packages/0f/b6/9357ac9dcbd267209621a1550ef6cf800d6055a6ed5814c75c1aa8c0dee7/setuptools-19.2.zip (from https://pypi.org/simple/setuptools/), version: 19.2
2025-08-31T08:27:11,054     Found link https://files.pythonhosted.org/packages/c8/df/d060af2269b6d4da20ef976368e97b500912f7f4a0066f1d13e66e691d6d/setuptools-19.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.3
2025-08-31T08:27:11,055     Found link https://files.pythonhosted.org/packages/1e/99/7606f9494383e77c2e2da269ffea6bff0412238c72a44930d6c2084ec961/setuptools-19.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.3
2025-08-31T08:27:11,056     Found link https://files.pythonhosted.org/packages/81/01/d296546e7a005d0eac2944cdb6f065db8fae4df41a982be9af130047cbc0/setuptools-19.3.zip (from https://pypi.org/simple/setuptools/), version: 19.3
2025-08-31T08:27:11,057     Found link https://files.pythonhosted.org/packages/cd/1f/8415bc5ec42da81d4c5da35a21eb8c36f33768de99daeee09c33aacd51eb/setuptools-19.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.4
2025-08-31T08:27:11,058     Found link https://files.pythonhosted.org/packages/65/1b/7fbfa8da32c8daaebdd3c932986d43646d46855d609db5d39b558a823ccf/setuptools-19.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.4
2025-08-31T08:27:11,059     Found link https://files.pythonhosted.org/packages/df/ae/95089f178d0ff51c7c218951b9bfc51d10170829c7dc23640af064440ecd/setuptools-19.4.zip (from https://pypi.org/simple/setuptools/), version: 19.4
2025-08-31T08:27:11,060     Found link https://files.pythonhosted.org/packages/90/e5/eebf9ffd75cb3df96d1fa639a86e3c6db555457854328f5c2706ac4068c2/setuptools-19.4.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.4.1
2025-08-31T08:27:11,061     Found link https://files.pythonhosted.org/packages/23/fa/980413db21bbeba755078e166b5bfe7d0e86b3dfbaf165f0d9575ded9abc/setuptools-19.4.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.4.1
2025-08-31T08:27:11,062     Found link https://files.pythonhosted.org/packages/e2/9e/052567ebe44024d17dbe8eb967f0227a23b0f68f47f6e54d11d9e2afccc0/setuptools-19.4.1.zip (from https://pypi.org/simple/setuptools/), version: 19.4.1
2025-08-31T08:27:11,063     Found link https://files.pythonhosted.org/packages/86/8b/375384ae41dcd985b66f5988a3122fecc872d3a6915090238508f9ad90d1/setuptools-19.5-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.5
2025-08-31T08:27:11,064     Found link https://files.pythonhosted.org/packages/14/59/93b6a05121d26276354c95ccd31aa7cfb97a01eed5c598c295b8ff829c57/setuptools-19.5.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.5
2025-08-31T08:27:11,065     Found link https://files.pythonhosted.org/packages/9b/00/d24d8f4c26c6dfcf25f5456eaa0c4a64a1d4f40006a3dc05a6928c5ba63a/setuptools-19.5.zip (from https://pypi.org/simple/setuptools/), version: 19.5
2025-08-31T08:27:11,066     Found link https://files.pythonhosted.org/packages/1c/84/e54b5356f7de2f7d33b6c6c4c187b12dc6f5417861a0d81271a6c37ecc3c/setuptools-19.6-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.6
2025-08-31T08:27:11,067     Found link https://files.pythonhosted.org/packages/8c/58/0a9154c04ff99594c5563e2b03fdcded92e128afd5fa56db202b5877933b/setuptools-19.6.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.6
2025-08-31T08:27:11,067     Found link https://files.pythonhosted.org/packages/f7/38/192acd9604546870cfe8f106923a63c5a532324cffc94f041a697b64cc5d/setuptools-19.6.zip (from https://pypi.org/simple/setuptools/), version: 19.6
2025-08-31T08:27:11,068     Found link https://files.pythonhosted.org/packages/ee/b5/595168f70a743d933bac6d4eb131dc9fc4a58fd38c59377a2c3903a7829d/setuptools-19.6.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.6.1
2025-08-31T08:27:11,069     Found link https://files.pythonhosted.org/packages/28/02/a4e4199e27414c7b9bd01b24284b239a43fdebfd5cae50cc97821562cbfa/setuptools-19.6.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.6.1
2025-08-31T08:27:11,070     Found link https://files.pythonhosted.org/packages/fe/e4/83bda2ba07ba3489374583a7a2b1d1a56fb993314e80b09fa6898557a26f/setuptools-19.6.1.zip (from https://pypi.org/simple/setuptools/), version: 19.6.1
2025-08-31T08:27:11,071     Found link https://files.pythonhosted.org/packages/09/0e/ad6774ef6f280c255fa1ce14c83d2df8d83a841621d538c0474fc9603160/setuptools-19.6.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.6.2
2025-08-31T08:27:11,072     Found link https://files.pythonhosted.org/packages/3e/ec/9fec74fc9e96dca889df66833fc2b5eb0a158d3d6a71b9ad016dfd2a301f/setuptools-19.6.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.6.2
2025-08-31T08:27:11,073     Found link https://files.pythonhosted.org/packages/8c/69/c4ec7b141a529fea6f7baa71e04fd1c43b146529a602f660d072c01e865f/setuptools-19.6.2.zip (from https://pypi.org/simple/setuptools/), version: 19.6.2
2025-08-31T08:27:11,074     Found link https://files.pythonhosted.org/packages/26/39/f94c9a95b11f7616adda92d7edbf2cf60079991df53af2ad1462c767a9c1/setuptools-19.7-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.7
2025-08-31T08:27:11,075     Found link https://files.pythonhosted.org/packages/47/79/90fc6fa184a25502f901bdda59c0423dbbfb5ace72557aa0bc47db00de8a/setuptools-19.7.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.7
2025-08-31T08:27:11,076     Found link https://files.pythonhosted.org/packages/d2/22/2ed3e5bdae82c5f8b98d7d12b24951c73c87308afc77b3e746afb5895bb2/setuptools-19.7.zip (from https://pypi.org/simple/setuptools/), version: 19.7
2025-08-31T08:27:11,077     Found link https://files.pythonhosted.org/packages/f9/08/1cee3e1650e036fdc54ff328d88a735ed8ca7ac6a0bb20d26ccb27790575/setuptools-20.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.0
2025-08-31T08:27:11,078     Found link https://files.pythonhosted.org/packages/b2/8d/9cb60a838a783769729b6e3e9c42f53e735e9e2443ce0181ffc5a59ae826/setuptools-20.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.0
2025-08-31T08:27:11,079     Found link https://files.pythonhosted.org/packages/bc/bc/906f911c3255509b29f2edd7f7b63df11c2bb5be3348c8a6a557e326eb79/setuptools-20.0.zip (from https://pypi.org/simple/setuptools/), version: 20.0
2025-08-31T08:27:11,080     Found link https://files.pythonhosted.org/packages/53/f3/a1ed894c585833a22f7eb362afff8c381fc433efc3c305e4b681f783b769/setuptools-20.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.1
2025-08-31T08:27:11,081     Found link https://files.pythonhosted.org/packages/19/81/2d203308707cc50c531381e8a64965d0cfd233f64bf9e61bf76bd8710950/setuptools-20.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.1
2025-08-31T08:27:11,082     Found link https://files.pythonhosted.org/packages/b9/f4/daf82e949ff2602dd0e8f3e2e50091788135c0eb9f2d92a8468f2d745513/setuptools-20.1.zip (from https://pypi.org/simple/setuptools/), version: 20.1
2025-08-31T08:27:11,083     Found link https://files.pythonhosted.org/packages/e8/82/3b5455f74bf9ac0757d09c625b7741e6fc284d7519cffc3babb6c5173cf5/setuptools-20.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.1.1
2025-08-31T08:27:11,083     Found link https://files.pythonhosted.org/packages/9a/6f/3e4e5cc3fb0a155372791b0dbd0a997cea9699a72345d8e5f8fdbcc4e615/setuptools-20.1.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.1.1
2025-08-31T08:27:11,084     Found link https://files.pythonhosted.org/packages/0a/ac/982625a3231061811b02bfe1715c823ca6e483689cdebaab34e55c3200b4/setuptools-20.1.1.zip (from https://pypi.org/simple/setuptools/), version: 20.1.1
2025-08-31T08:27:11,085     Found link https://files.pythonhosted.org/packages/bc/6c/a07e4fd8ff7c7aa4eb535c17a7a5408d87a3d0bfc7251dea97f87be09f42/setuptools-20.2.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.2.2
2025-08-31T08:27:11,086     Found link https://files.pythonhosted.org/packages/69/65/4c544cde88d4d876cdf5cbc5f3f15d02646477756d89547e9a7ecd6afa76/setuptools-20.2.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.2.2
2025-08-31T08:27:11,087     Found link https://files.pythonhosted.org/packages/50/31/b777a1f82d2b34836b3a5f61d57977392e3bbe16d255b73a43a2f2e51b8d/setuptools-20.2.2.zip (from https://pypi.org/simple/setuptools/), version: 20.2.2
2025-08-31T08:27:11,088     Found link https://files.pythonhosted.org/packages/27/c5/a1dccd24bb075f0063afa13b15747a28d40efb1cccc8e85bdf256ae1475f/setuptools-20.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.3
2025-08-31T08:27:11,089     Found link https://files.pythonhosted.org/packages/2e/5e/b143cf33d98c41f2fb69fbcf50fbd4450e22771b1235aee515d48ecb3eac/setuptools-20.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.3
2025-08-31T08:27:11,090     Found link https://files.pythonhosted.org/packages/cd/c3/bb18476d15774c1d1ed0f91ad8ffa920b6e5133e6a6288c47e00ed10d30d/setuptools-20.3.zip (from https://pypi.org/simple/setuptools/), version: 20.3
2025-08-31T08:27:11,091     Found link https://files.pythonhosted.org/packages/89/8c/200568ed24675f32dfa8ff8df130c66edf4563b05b4b0a7e88b121683d7e/setuptools-20.3.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.3.1
2025-08-31T08:27:11,092     Found link https://files.pythonhosted.org/packages/fc/bf/e129e7ef5192a182228ad4aeb164442dab838f7038cabdc1b8e4b2366ae9/setuptools-20.3.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.3.1
2025-08-31T08:27:11,093     Found link https://files.pythonhosted.org/packages/9b/52/20f47b5f8ea75a76c789bdc6d003c1e05d0f52c1d046a72f37db5065724f/setuptools-20.3.1.zip (from https://pypi.org/simple/setuptools/), version: 20.3.1
2025-08-31T08:27:11,094     Found link https://files.pythonhosted.org/packages/6c/e6/1e47ec467ba8224fddbd7ce63eee7958b4a43960b8306b28392fc0a30320/setuptools-20.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.4
2025-08-31T08:27:11,095     Found link https://files.pythonhosted.org/packages/1b/10/021a03228d67fb287d9df9c46ef7b29f0b86579d04fb6bd24158dfb0173e/setuptools-20.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.4
2025-08-31T08:27:11,096     Found link https://files.pythonhosted.org/packages/c3/4a/c39e4d726c26aabaa07428cfd44ba3f65f7576771ebe5874b65714bb9ab3/setuptools-20.4.zip (from https://pypi.org/simple/setuptools/), version: 20.4
2025-08-31T08:27:11,097     Found link https://files.pythonhosted.org/packages/82/df/885e56f3a282f876b7280d98971efac45815ea372021b46bf25e82e4fe51/setuptools-20.6.6-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.6.6
2025-08-31T08:27:11,098     Found link https://files.pythonhosted.org/packages/83/9c/c35ea1a8c489518d59660bff85f83632bb421e1877e84328b7de0672709e/setuptools-20.6.6.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.6.6
2025-08-31T08:27:11,098     Found link https://files.pythonhosted.org/packages/aa/bb/491858898e25460f9cf38c2757d134bd6bd5f6d54594dd0d2455e21cadb5/setuptools-20.6.6.zip (from https://pypi.org/simple/setuptools/), version: 20.6.6
2025-08-31T08:27:11,099     Found link https://files.pythonhosted.org/packages/45/11/e67731adbe045d384dabb5de73b900db57f37a1399bfd9ef12dcae4b35b9/setuptools-20.6.7-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.6.7
2025-08-31T08:27:11,100     Found link https://files.pythonhosted.org/packages/72/60/120420b893a7a8fe6aa7d0a6b78d80f145cbb832e1c6035b9b24f1583418/setuptools-20.6.7.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.6.7
2025-08-31T08:27:11,101     Found link https://files.pythonhosted.org/packages/de/ef/d99fd3410990c69619ddadeed594dba1f307054ab0b35d5140cda6e774fc/setuptools-20.6.7.zip (from https://pypi.org/simple/setuptools/), version: 20.6.7
2025-08-31T08:27:11,102     Found link https://files.pythonhosted.org/packages/69/66/b3153ccb7e0a631b32ba51f02ecc781b3c9ea37b4a831b9bf06a235c0f10/setuptools-20.6.8-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.6.8
2025-08-31T08:27:11,103     Found link https://files.pythonhosted.org/packages/52/11/7eda69b8e0d2009822c970d8acd9bf3056d1daec1ed96310c8aeb39f1a46/setuptools-20.6.8.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.6.8
2025-08-31T08:27:11,104     Found link https://files.pythonhosted.org/packages/1d/3f/a5a1e8a805c9b8ce8ca085ebc79b0dd329e2b797cecd38a769a06531f6da/setuptools-20.6.8.zip (from https://pypi.org/simple/setuptools/), version: 20.6.8
2025-08-31T08:27:11,105     Found link https://files.pythonhosted.org/packages/73/73/57576f40b4d87a4f8d0fba656469d05559910337d852bc513ff34f47bdc8/setuptools-20.7.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.7.0
2025-08-31T08:27:11,106     Found link https://files.pythonhosted.org/packages/e8/8a/267dca7818b5ba66bd85e1dbf5f867f14c7c16d823455d0f3103e6085a04/setuptools-20.7.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.7.0
2025-08-31T08:27:11,107     Found link https://files.pythonhosted.org/packages/a2/6b/3203c18962402ce25875f7682970283991fe401d0ee5fcac96829727c188/setuptools-20.7.0.zip (from https://pypi.org/simple/setuptools/), version: 20.7.0
2025-08-31T08:27:11,108     Found link https://files.pythonhosted.org/packages/8b/59/51b23f214a5ae5b3c0e7307a211a4fe71a6a07ca3b9fc2e36742a85963b4/setuptools-20.8.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.8.0
2025-08-31T08:27:11,109     Found link https://files.pythonhosted.org/packages/ec/84/9fa193404ad183c712088fcef43a3a52f94e06b3825bd594861952fd556e/setuptools-20.8.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.8.0
2025-08-31T08:27:11,110     Found link https://files.pythonhosted.org/packages/fb/0c/c33d7bcb99c28cfe177f05cccb423327a1fcbf21a49593013dac6b6595ce/setuptools-20.8.0.zip (from https://pypi.org/simple/setuptools/), version: 20.8.0
2025-08-31T08:27:11,111     Found link https://files.pythonhosted.org/packages/4f/4b/d492e47006cf1fe5a1c5000c61921cbb740bdf25de9e41150205261dcbfd/setuptools-20.8.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.8.1
2025-08-31T08:27:11,112     Found link https://files.pythonhosted.org/packages/da/11/5ba1a8162dca3c28666e448f3a8ddb8057e786b09bbd48f3c381ab26e898/setuptools-20.8.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.8.1
2025-08-31T08:27:11,112     Found link https://files.pythonhosted.org/packages/c4/19/c1bdc88b53da654df43770f941079dbab4e4788c2dcb5658fb86259894c7/setuptools-20.8.1.zip (from https://pypi.org/simple/setuptools/), version: 20.8.1
2025-08-31T08:27:11,113     Found link https://files.pythonhosted.org/packages/c0/8f/f02fdd83bed337d3fd504c279b2bd94895fc0ae81d162ba1deca846d739d/setuptools-20.9.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.9.0
2025-08-31T08:27:11,114     Found link https://files.pythonhosted.org/packages/00/d7/5511e82e0645ed4b939bb42f0a07450d0cdf9cf3ed08758b459f3d002747/setuptools-20.9.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.9.0
2025-08-31T08:27:11,115     Found link https://files.pythonhosted.org/packages/36/cb/57c5af3e6b2795e3eef0af035ae712e3528b1007f6f972721162ae5167aa/setuptools-20.9.0.zip (from https://pypi.org/simple/setuptools/), version: 20.9.0
2025-08-31T08:27:11,116     Found link https://files.pythonhosted.org/packages/c5/e2/72d706eeda837564b9fecdc8b2bf48b33467ae928ed05d4ac157463c90fb/setuptools-20.10.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.10.1
2025-08-31T08:27:11,117     Found link https://files.pythonhosted.org/packages/d3/16/21cf5dc6974280197e42d57bf7d372380562ec69aef9bb796b5e2dbbed6e/setuptools-20.10.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.10.1
2025-08-31T08:27:11,118     Found link https://files.pythonhosted.org/packages/86/ee/622e83b0dbede6d48891ed209fa5ca83fcc485f9b6696cf56796eda40806/setuptools-20.10.1.zip (from https://pypi.org/simple/setuptools/), version: 20.10.1
2025-08-31T08:27:11,119     Found link https://files.pythonhosted.org/packages/15/b7/a76624e5a3b18c8c1c8d33a5240b34cdabb08aef2da44b536a8b53ba1a45/setuptools-21.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 21.0.0
2025-08-31T08:27:11,120     Found link https://files.pythonhosted.org/packages/ff/d4/209f4939c49e31f5524fa0027bf1c8ec3107abaf7c61fdaad704a648c281/setuptools-21.0.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 21.0.0
2025-08-31T08:27:11,121     Found link https://files.pythonhosted.org/packages/1d/c0/57c129132059297460922eec3cabf3016e792455adf9db8c5b144db67d69/setuptools-21.0.0.zip (from https://pypi.org/simple/setuptools/), version: 21.0.0
2025-08-31T08:27:11,122     Found link https://files.pythonhosted.org/packages/48/9b/b9a9b3aaf83171a97cbfcef1bfb4a92ab3f7ed3bd74fdeb7e079617ee637/setuptools-21.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 21.1.0
2025-08-31T08:27:11,123     Found link https://files.pythonhosted.org/packages/f0/32/99ead2d74cba43bd59aa213e9c6e8212a9d3ed07805bb66b8bf9affbb541/setuptools-21.1.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 21.1.0
2025-08-31T08:27:11,124     Found link https://files.pythonhosted.org/packages/d3/70/1bd111ada7168f63d6134fc1a574f689e1b46156634b4ad8b77428210fcb/setuptools-21.1.0.zip (from https://pypi.org/simple/setuptools/), version: 21.1.0
2025-08-31T08:27:11,125     Found link https://files.pythonhosted.org/packages/57/68/a5b7002017dfbbf5f52bc23d4a9adedc97f7ceb5d92ae15591e858a56415/setuptools-21.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 21.2.0
2025-08-31T08:27:11,126     Found link https://files.pythonhosted.org/packages/8a/c1/d2de34cfd207a5c14efda8a5cd4fe7fd47ca9d91549e0a8309a15cedfbfb/setuptools-21.2.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 21.2.0
2025-08-31T08:27:11,126     Found link https://files.pythonhosted.org/packages/f9/ca/a4dd1a61159fc9576ff3b06c0ba71ff3f1367d409451e815398ba94b0697/setuptools-21.2.0.zip (from https://pypi.org/simple/setuptools/), version: 21.2.0
2025-08-31T08:27:11,127     Found link https://files.pythonhosted.org/packages/0b/71/2c2a7eedb682cfba4d86bc656be8e7c9e92795982b91487be6e4aa9713af/setuptools-21.2.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 21.2.1
2025-08-31T08:27:11,128     Found link https://files.pythonhosted.org/packages/13/e8/35d9c7528b3c266a17e888bea1e02eb061e9ab6cdabc7107dfb7da83a1d2/setuptools-21.2.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 21.2.1
2025-08-31T08:27:11,129     Found link https://files.pythonhosted.org/packages/18/43/f297fa8752573e03835971312ebecc167c5edf7e1dda810a7a799323f4d9/setuptools-21.2.1.zip (from https://pypi.org/simple/setuptools/), version: 21.2.1
2025-08-31T08:27:11,130     Found link https://files.pythonhosted.org/packages/9e/33/b4e3494d886eadde48f47f73fb0fc4e4061c65e9c05b0807c0e61e91a51b/setuptools-21.2.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 21.2.2
2025-08-31T08:27:11,131     Found link https://files.pythonhosted.org/packages/5b/6e/a4bf49ddc41f144fd511f24c096dfa7600bffaf348563e08ef381dd6323e/setuptools-21.2.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 21.2.2
2025-08-31T08:27:11,132     Found link https://files.pythonhosted.org/packages/94/ed/99b4cc83113d8f46234f8f4e47e0040977cac546de4d5f8bca9f52b54841/setuptools-21.2.2.zip (from https://pypi.org/simple/setuptools/), version: 21.2.2
2025-08-31T08:27:11,133     Found link https://files.pythonhosted.org/packages/70/4b/77c40f3a85809da4912977bcc949b541938250c3f65001bdc4e06cb2cfed/setuptools-22.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 22.0.0
2025-08-31T08:27:11,134     Found link https://files.pythonhosted.org/packages/f5/90/010892bde11d2da00548285da29a055e6b0e3b81592bb6021571b87f34a1/setuptools-22.0.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 22.0.0
2025-08-31T08:27:11,135     Found link https://files.pythonhosted.org/packages/0e/a4/d6e76f14075235f9ce64bba95bfb277ce24b305f1300afe353c2143ba234/setuptools-22.0.0.zip (from https://pypi.org/simple/setuptools/), version: 22.0.0
2025-08-31T08:27:11,136     Found link https://files.pythonhosted.org/packages/4f/d8/155e8dd2cf61d5091a331b7a5fec3bd0849a6f92a2108755ce0a031cc5b4/setuptools-22.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 22.0.1
2025-08-31T08:27:11,137     Found link https://files.pythonhosted.org/packages/a1/40/4e7350f71abd12eeb995ff6b22fb1e00e6e92b9197237684f9dd50a34076/setuptools-22.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 22.0.1
2025-08-31T08:27:11,138     Found link https://files.pythonhosted.org/packages/7d/b1/07544b46e1a0895c5049e23bb4b4959891970db24d03adb8a59b42c511b3/setuptools-22.0.1.zip (from https://pypi.org/simple/setuptools/), version: 22.0.1
2025-08-31T08:27:11,139     Found link https://files.pythonhosted.org/packages/a6/2b/803bd512ae9a69164ccfc29d289c99fa1b50cdfeb57aa3ab2239094e4751/setuptools-22.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 22.0.2
2025-08-31T08:27:11,140     Found link https://files.pythonhosted.org/packages/c4/53/c15ebef877fef2f719e0b6ddd380f64c1753080691108e061c1ca21ed449/setuptools-22.0.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 22.0.2
2025-08-31T08:27:11,141     Found link https://files.pythonhosted.org/packages/5e/65/c711495d09bfac87daa46af76051cd977eb6dd18b6aa63bd5be6fe30eac3/setuptools-22.0.2.zip (from https://pypi.org/simple/setuptools/), version: 22.0.2
2025-08-31T08:27:11,142     Found link https://files.pythonhosted.org/packages/5e/c2/8ab39c2652566b2a99875296a67b14bc21603553b47c7526d3afd95f2b32/setuptools-22.0.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 22.0.4
2025-08-31T08:27:11,143     Found link https://files.pythonhosted.org/packages/fb/df/68cc65abf4214a64e46da79b4bfa4a0f8d2cd8f0fb9bc7fae490c95141e1/setuptools-22.0.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 22.0.4
2025-08-31T08:27:11,144     Found link https://files.pythonhosted.org/packages/3b/01/a43e38867f02831cdad642cbae50958a1e87acc5f4dbe21b65c70f0b2bc3/setuptools-22.0.4.zip (from https://pypi.org/simple/setuptools/), version: 22.0.4
2025-08-31T08:27:11,145     Found link https://files.pythonhosted.org/packages/9c/e7/61c61680de7051a5de59ee58ef59738609cdfd2ac79575fc93230c2fd1a5/setuptools-22.0.5-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 22.0.5
2025-08-31T08:27:11,146     Found link https://files.pythonhosted.org/packages/90/7a/b64d5804b6d1aebed1892e4df1c21bcb4f8480095ba8004e48999601119d/setuptools-22.0.5.tar.gz (from https://pypi.org/simple/setuptools/), version: 22.0.5
2025-08-31T08:27:11,146     Found link https://files.pythonhosted.org/packages/f4/27/72b6758f84cbd0dc2a21b87be7d080f491efa8c7bc23f12572f7f3a21b1e/setuptools-22.0.5.zip (from https://pypi.org/simple/setuptools/), version: 22.0.5
2025-08-31T08:27:11,147     Found link https://files.pythonhosted.org/packages/74/7c/c75c4f4032a4627406db06b742cdc7ba24c4833cd423ea7e22882380abde/setuptools-23.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 23.0.0
2025-08-31T08:27:11,148     Found link https://files.pythonhosted.org/packages/45/5e/79ca67a0d6f2f42bfdd9e467ef97398d6ad87ee2fa9c8cdf7caf3ddcab1e/setuptools-23.0.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 23.0.0
2025-08-31T08:27:11,149     Found link https://files.pythonhosted.org/packages/48/93/34a0210b2cb822ef2bde0b0849db071944ffb635ae7dabc9537d05827215/setuptools-23.0.0.zip (from https://pypi.org/simple/setuptools/), version: 23.0.0
2025-08-31T08:27:11,150     Found link https://files.pythonhosted.org/packages/d7/3d/577bafbfc9fcd78ed7b45de24a6bc30a94cc75cbde786389f1014d433614/setuptools-23.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 23.1.0
2025-08-31T08:27:11,151     Found link https://files.pythonhosted.org/packages/9f/7c/0a33c528164f1b7ff8cf0684cf88c2e733c8ae0119ceca4a3955c7fc059d/setuptools-23.1.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 23.1.0
2025-08-31T08:27:11,152     Found link https://files.pythonhosted.org/packages/89/86/ab1bf3a2550dcf43e2f5e77d72e9edb53dc701e78cbf07ef88ff8a08333e/setuptools-23.1.0.zip (from https://pypi.org/simple/setuptools/), version: 23.1.0
2025-08-31T08:27:11,153     Found link https://files.pythonhosted.org/packages/40/2d/7304d8992682423fbf0bd2b91107b1f0bc1e074a734f735589b2cce8f4a4/setuptools-23.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 23.2.0
2025-08-31T08:27:11,154     Found link https://files.pythonhosted.org/packages/a8/d1/b2f3500d39e8b0b4e1780fc10c8e6536db7718e3badd673be29760ce3369/setuptools-23.2.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 23.2.0
2025-08-31T08:27:11,155     Found link https://files.pythonhosted.org/packages/ce/4e/d8d780d710a553a2900c087fb297646f01c023d44822a570f24e141efaf8/setuptools-23.2.0.zip (from https://pypi.org/simple/setuptools/), version: 23.2.0
2025-08-31T08:27:11,156     Found link https://files.pythonhosted.org/packages/a0/f9/d17efe888634046672f99514947c19d7568459a77c417576d99007671e42/setuptools-23.2.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 23.2.1
2025-08-31T08:27:11,157     Found link https://files.pythonhosted.org/packages/de/ca/21e71a0f9efc6f98462f92b1ebafcaf404b17b1bb9dbba11cf2adeaa5e35/setuptools-23.2.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 23.2.1
2025-08-31T08:27:11,158     Found link https://files.pythonhosted.org/packages/53/80/f00b72a5b155831213f79be0ef1a468199fc028219354dc92f18720e1c6b/setuptools-23.2.1.zip (from https://pypi.org/simple/setuptools/), version: 23.2.1
2025-08-31T08:27:11,159     Found link https://files.pythonhosted.org/packages/9f/e7/0dad3c2362a4b0ef0a432d07d5b8dab433a1b3cff54e55045b36f05153c2/setuptools-24.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 24.0.0
2025-08-31T08:27:11,160     Found link https://files.pythonhosted.org/packages/0a/40/a740a4890d9cc8f725f67da158ab250d3926b874e0f7cb85bdc836e3d069/setuptools-24.0.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 24.0.0
2025-08-31T08:27:11,160     Found link https://files.pythonhosted.org/packages/f6/d7/5caa03e11cb95140c08c4488e25979f3a6f8fc8695ca68d3c82fb97c2ba6/setuptools-24.0.0.zip (from https://pypi.org/simple/setuptools/), version: 24.0.0
2025-08-31T08:27:11,162     Found link https://files.pythonhosted.org/packages/e3/08/407c327962e7138de49ca09b599a32fffcc67c612dd78e7433945fd64d26/setuptools-24.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 24.0.1
2025-08-31T08:27:11,162     Found link https://files.pythonhosted.org/packages/7a/a8/5877fa2cec00f7678618fb465878fd9356858f0894b60c6960364b5cf816/setuptools-24.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 24.0.1
2025-08-31T08:27:11,163     Found link https://files.pythonhosted.org/packages/8b/ae/6c8fd57ce6c8313ce12bc6a32b488022d94423c25edadb63a9ae88fb013c/setuptools-24.0.1.zip (from https://pypi.org/simple/setuptools/), version: 24.0.1
2025-08-31T08:27:11,164     Found link https://files.pythonhosted.org/packages/75/5b/0a6348c852aabbecdc2a1cdea39f08df569ef8b5d576e6b88bd3fb60d67f/setuptools-24.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 24.0.2
2025-08-31T08:27:11,165     Found link https://files.pythonhosted.org/packages/21/d7/3e7e4b42d40469d2b770e10aee5b49538ecf2853eb5635d2d2536b286e2d/setuptools-24.0.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 24.0.2
2025-08-31T08:27:11,166     Found link https://files.pythonhosted.org/packages/f7/83/2865ee5727b46234c68efb833363dbce1922a191dd46e246853246a46182/setuptools-24.0.2.zip (from https://pypi.org/simple/setuptools/), version: 24.0.2
2025-08-31T08:27:11,167     Found link https://files.pythonhosted.org/packages/77/1d/aa9cee9843393165388ae2d764e811c42f995d9a493ec27354d8c9638216/setuptools-24.0.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 24.0.3
2025-08-31T08:27:11,168     Found link https://files.pythonhosted.org/packages/84/24/610d8bb87219ed6d0928018b7b35ac6f6f6ef27a71ed6a2d0cfb68200f65/setuptools-24.0.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 24.0.3
2025-08-31T08:27:11,169     Found link https://files.pythonhosted.org/packages/fe/d1/19813ec0d7966829b0f3fb2a975706e19c475251142e683d7a15660b180c/setuptools-24.0.3.zip (from https://pypi.org/simple/setuptools/), version: 24.0.3
2025-08-31T08:27:11,170     Found link https://files.pythonhosted.org/packages/3e/c0/f4d9dad75777145c47d0d76ae89ac1448b9000e47834fc4cbf218f172807/setuptools-24.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 24.1.0
2025-08-31T08:27:11,171     Found link https://files.pythonhosted.org/packages/83/2a/2e0b93208a8e68e536a1861ed91eca8b06b24cd63255e6ae31648233acdd/setuptools-24.1.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 24.1.0
2025-08-31T08:27:11,172     Found link https://files.pythonhosted.org/packages/d9/4b/566dd5f069c910a9cc642764bfac6dc41cf3441da77da28ed6210a3643be/setuptools-24.1.0.zip (from https://pypi.org/simple/setuptools/), version: 24.1.0
2025-08-31T08:27:11,173     Found link https://files.pythonhosted.org/packages/f3/11/37e470ce38a152b9674a71a5fd1ea3bca1a388d18dd542000da0409ce44b/setuptools-24.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 24.1.1
2025-08-31T08:27:11,174     Found link https://files.pythonhosted.org/packages/46/91/52d4045fef23635249f7da1547588cff37b75df36238a3a994dc760b0e73/setuptools-24.1.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 24.1.1
2025-08-31T08:27:11,174     Found link https://files.pythonhosted.org/packages/37/cd/92dab23239b6aa67871ceb73bf1ab924eab4fcc79f37e2d21ce665b0dc2a/setuptools-24.1.1.zip (from https://pypi.org/simple/setuptools/), version: 24.1.1
2025-08-31T08:27:11,176     Found link https://files.pythonhosted.org/packages/b6/aa/853ddef15e7d397e191fcf7b3436f21483b77a0da6156bf0ae77f25b5998/setuptools-24.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 24.2.0
2025-08-31T08:27:11,176     Found link https://files.pythonhosted.org/packages/ee/a7/6595292baa2a9d5a39affcdc37e4c5f2763ed440c94a08852b222d17e953/setuptools-24.2.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 24.2.0
2025-08-31T08:27:11,177     Found link https://files.pythonhosted.org/packages/7f/df/f1db5805f28f80f19711d96e33eb172cfda95541d828e0d6dc806720fec3/setuptools-24.2.0.zip (from https://pypi.org/simple/setuptools/), version: 24.2.0
2025-08-31T08:27:11,178     Found link https://files.pythonhosted.org/packages/9f/3e/e4912f33a92257b29c28aa1d7121e8081536d9291d6185a313ecf0d1f8c7/setuptools-24.2.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 24.2.1
2025-08-31T08:27:11,179     Found link https://files.pythonhosted.org/packages/1e/07/172354ef5424923c1bf2e7c89233ab790a7c462536849957602752ebad25/setuptools-24.2.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 24.2.1
2025-08-31T08:27:11,180     Found link https://files.pythonhosted.org/packages/46/e7/d3d168372022bbb555619f5bc50bbc93d1c2309e3c1b607dc6b0c705df0f/setuptools-24.2.1.zip (from https://pypi.org/simple/setuptools/), version: 24.2.1
2025-08-31T08:27:11,181     Found link https://files.pythonhosted.org/packages/dd/b8/d195d56c0a6ef8f2816a6e41a4e8ed8446bc647c6abd6e212f7190e93aff/setuptools-24.3.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 24.3.0
2025-08-31T08:27:11,182     Found link https://files.pythonhosted.org/packages/1b/4f/e52b81c47396668deb139b628f4ebb499b3cd39fc05382851fa985d0b642/setuptools-24.3.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 24.3.0
2025-08-31T08:27:11,183     Found link https://files.pythonhosted.org/packages/d1/81/444dec9e9a7eab092651e501b27786d16ac36a28da990e59e8ed2d2c033c/setuptools-24.3.0.zip (from https://pypi.org/simple/setuptools/), version: 24.3.0
2025-08-31T08:27:11,184     Found link https://files.pythonhosted.org/packages/0b/1d/6debaf800af0bb247da8ee7bb167b5be6c87ca0a8f62593daa7b307aa20d/setuptools-24.3.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 24.3.1
2025-08-31T08:27:11,185     Found link https://files.pythonhosted.org/packages/5c/dd/c60ce480ae7f9acd5a31a91f8240d080ff213e5eb897d00c356d20e8328c/setuptools-24.3.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 24.3.1
2025-08-31T08:27:11,186     Found link https://files.pythonhosted.org/packages/73/f0/91e5227c2e99631036cc03e5ad0fc3f5c572c41b80948dfeb6d30d08e77d/setuptools-24.3.1.zip (from https://pypi.org/simple/setuptools/), version: 24.3.1
2025-08-31T08:27:11,187     Found link https://files.pythonhosted.org/packages/1f/eb/cee6969380d12f43444b8fd81a6f806f63123b5bbaba6afcec69df2766db/setuptools-25.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.0.0
2025-08-31T08:27:11,188     Found link https://files.pythonhosted.org/packages/a0/85/24d3b6b331b056180f28ce19658a515364dca58aa9e88eff2ac39bf825f2/setuptools-25.0.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.0.0
2025-08-31T08:27:11,189     Found link https://files.pythonhosted.org/packages/dc/9f/ecd9443b342757cd223088c419aa35c68b3ccf1782017c18d0398c9ceab7/setuptools-25.0.0.zip (from https://pypi.org/simple/setuptools/), version: 25.0.0
2025-08-31T08:27:11,190     Found link https://files.pythonhosted.org/packages/69/31/1f1f638830f55a57f8e7f6b7ae265baee2dfe55c687d9f39eb053e88a6b4/setuptools-25.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.0.1
2025-08-31T08:27:11,190     Found link https://files.pythonhosted.org/packages/f0/21/708b3eb6709ece3cb2613b6c44e749823c435bef0b26b9b45be1634afe16/setuptools-25.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.0.1
2025-08-31T08:27:11,191     Found link https://files.pythonhosted.org/packages/0a/f0/904432438dda1b4ed33c668392756bb45ae25a945458dd34d8215e68bdd7/setuptools-25.0.1.zip (from https://pypi.org/simple/setuptools/), version: 25.0.1
2025-08-31T08:27:11,192     Found link https://files.pythonhosted.org/packages/51/23/9ba87803415bf3e855db1f15973161aca7d317b697d31e8f02b92a53165b/setuptools-25.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.0.2
2025-08-31T08:27:11,193     Found link https://files.pythonhosted.org/packages/7a/ad/238451bc76d3b280395d785c390dcc01645af68059d221a45a872865f73c/setuptools-25.0.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.0.2
2025-08-31T08:27:11,194     Found link https://files.pythonhosted.org/packages/b6/e6/b373ff0579a030ccd35829afe892f49460b44a028fc238a30573c4fa6f05/setuptools-25.0.2.zip (from https://pypi.org/simple/setuptools/), version: 25.0.2
2025-08-31T08:27:11,195     Found link https://files.pythonhosted.org/packages/48/c6/3a30a886ea43ca7aef2c0d9a642d7ecdaa319579454ca340adea5aba89e8/setuptools-25.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.1.0
2025-08-31T08:27:11,196     Found link https://files.pythonhosted.org/packages/17/ed/ea984f05dd29e7a1ffdee0eba8335b5c73903e2ca10915fbdb6e8c5084c7/setuptools-25.1.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.1.0
2025-08-31T08:27:11,197     Found link https://files.pythonhosted.org/packages/29/c1/33ab781160aede84140523f2fd0685b0bbe46b2d0b7aa9b033a9665cabc4/setuptools-25.1.0.zip (from https://pypi.org/simple/setuptools/), version: 25.1.0
2025-08-31T08:27:11,198     Found link https://files.pythonhosted.org/packages/20/27/5a49d6ee5df931a86ab73b85631192da29bbec86db37d2e8024aba7cda25/setuptools-25.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.1.1
2025-08-31T08:27:11,199     Found link https://files.pythonhosted.org/packages/9c/25/fa63da717a694ecf3bdb27f438450f535cdcabd77a955b5b05113f1abd11/setuptools-25.1.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.1.1
2025-08-31T08:27:11,200     Found link https://files.pythonhosted.org/packages/89/2d/5c3517d4cf69d005151fdfccd6b3f9a342678dfab15b95a9272456cf70b5/setuptools-25.1.1.zip (from https://pypi.org/simple/setuptools/), version: 25.1.1
2025-08-31T08:27:11,201     Found link https://files.pythonhosted.org/packages/9a/75/612e5aae898d83b1f40337cef46693462ba5ad26197950294c686ac4b533/setuptools-25.1.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.1.2
2025-08-31T08:27:11,202     Found link https://files.pythonhosted.org/packages/12/1a/95c4ce8205e114efa16e91323c372d9a8adfa560d8cd00ad4b3aa2e27ae0/setuptools-25.1.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.1.2
2025-08-31T08:27:11,203     Found link https://files.pythonhosted.org/packages/94/99/3b63b80785fcf51b1429eee0491dd975828da68956d58752d9953deff478/setuptools-25.1.2.zip (from https://pypi.org/simple/setuptools/), version: 25.1.2
2025-08-31T08:27:11,204     Found link https://files.pythonhosted.org/packages/a0/67/266580f0326b2f1e46b1aae86907ad3935e980082f15d262acbf289a7d92/setuptools-25.1.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.1.3
2025-08-31T08:27:11,205     Found link https://files.pythonhosted.org/packages/46/db/baa571da945ff731f3739a119574e89b12add9b05c03842103bd641d0990/setuptools-25.1.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.1.3
2025-08-31T08:27:11,206     Found link https://files.pythonhosted.org/packages/c8/e0/d27f3b315a7bce1cc03b7d8b33bb6119806a385b06f20a27e3741614bdef/setuptools-25.1.3.zip (from https://pypi.org/simple/setuptools/), version: 25.1.3
2025-08-31T08:27:11,207     Found link https://files.pythonhosted.org/packages/b9/c4/c179ea0c805a552ce6e7fdd061c08b6de91f41a689a09581214fb09544bb/setuptools-25.1.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.1.4
2025-08-31T08:27:11,208     Found link https://files.pythonhosted.org/packages/4c/02/3cb39568f0946b29826f068f7a717f7ab24fd32f79d2cbc0ba044ed568e6/setuptools-25.1.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.1.4
2025-08-31T08:27:11,208     Found link https://files.pythonhosted.org/packages/e5/46/caa9a57d19ab44254f8c8cc1c613a46dc21aa3611e3bb5f7cbaf1a4d3c08/setuptools-25.1.4.zip (from https://pypi.org/simple/setuptools/), version: 25.1.4
2025-08-31T08:27:11,209     Found link https://files.pythonhosted.org/packages/cd/bd/f640c01881d07e46ea14e73b19434ce21ec6e9bed4275aea1a02ec17769f/setuptools-25.1.5-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.1.5
2025-08-31T08:27:11,210     Found link https://files.pythonhosted.org/packages/5b/ea/0c0c51368b260e0b314acb8ce4a28e759022435c860e1c5cc72fb4b211ec/setuptools-25.1.5.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.1.5
2025-08-31T08:27:11,211     Found link https://files.pythonhosted.org/packages/91/f6/a6fed3e2484b9062ead5f3b90cb1a5ceed55140b214300d9c00f2b4b04b7/setuptools-25.1.5.zip (from https://pypi.org/simple/setuptools/), version: 25.1.5
2025-08-31T08:27:11,212     Found link https://files.pythonhosted.org/packages/0f/31/47f09564c1f513b18c34aa755181d7a66362c16a8873221e4082d7d758da/setuptools-25.1.6-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.1.6
2025-08-31T08:27:11,213     Found link https://files.pythonhosted.org/packages/1f/7a/6b239a65d452b04ad8068193ae313b386e6fc745b92cd4584fccebecebf0/setuptools-25.1.6.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.1.6
2025-08-31T08:27:11,214     Found link https://files.pythonhosted.org/packages/c3/40/4c0e626ae88f44ddfeb56b58a8dc3d8b8c4274b245e5ffacdc75ebe1d9c7/setuptools-25.1.6.zip (from https://pypi.org/simple/setuptools/), version: 25.1.6
2025-08-31T08:27:11,215     Found link https://files.pythonhosted.org/packages/9b/81/5258d4928d2ba039c98f8175e6c3d3995814b9449b57802be9d71e37c944/setuptools-25.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.2.0
2025-08-31T08:27:11,216     Found link https://files.pythonhosted.org/packages/9f/32/81c324675725d78e7f6da777483a3453611a427db0145dfb878940469692/setuptools-25.2.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.2.0
2025-08-31T08:27:11,217     Found link https://files.pythonhosted.org/packages/93/56/225ab3880e2ef5e6d85334843141e97ffad2acb2044278de5acb174c73d3/setuptools-25.2.0.zip (from https://pypi.org/simple/setuptools/), version: 25.2.0
2025-08-31T08:27:11,218     Found link https://files.pythonhosted.org/packages/6b/41/c6bf7e2ee1d43d1e3fab6bf830cd63d333d3a28249f145194a2accd12eab/setuptools-25.3.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.3.0
2025-08-31T08:27:11,219     Found link https://files.pythonhosted.org/packages/b1/9a/cda61ff6ea0e10780dcc49c8fd021d980398285e85c54e4977f88f8c2a9c/setuptools-25.3.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.3.0
2025-08-31T08:27:11,220     Found link https://files.pythonhosted.org/packages/78/1f/3da475bb81ae407962c65e29736ebb3c36728fc1e6335c66b054bf6db5ca/setuptools-25.3.0.zip (from https://pypi.org/simple/setuptools/), version: 25.3.0
2025-08-31T08:27:11,221     Found link https://files.pythonhosted.org/packages/cd/48/45dee63e94368e331cfd8d90d1e804e8ad0c0d055e677ef2c1317de863e1/setuptools-25.4.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.4.0
2025-08-31T08:27:11,222     Found link https://files.pythonhosted.org/packages/fa/76/a94f7738865199ab9700977612ec1ba3298fb271ba3a8981017a48507c31/setuptools-25.4.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.4.0
2025-08-31T08:27:11,222     Found link https://files.pythonhosted.org/packages/3b/40/69fefe3c5c06923a6518a2c1abe6664d985a63da3614cef75d8c119eb634/setuptools-25.4.0.zip (from https://pypi.org/simple/setuptools/), version: 25.4.0
2025-08-31T08:27:11,223     Found link https://files.pythonhosted.org/packages/07/1a/19b5d2de13e1c300f703e7914031fe5fe449d19e0ded5a34db9f3e7969ff/setuptools-26.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 26.0.0
2025-08-31T08:27:11,224     Found link https://files.pythonhosted.org/packages/0d/13/ce6a0a22220f3da7483131bb8212d5791a03c8c3e86ff61b2c6a2de547cd/setuptools-26.0.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 26.0.0
2025-08-31T08:27:11,225     Found link https://files.pythonhosted.org/packages/fd/e2/6685fa17489a921804951bdeb13faa177cd1095da91d9371c4908c903367/setuptools-26.0.0.zip (from https://pypi.org/simple/setuptools/), version: 26.0.0
2025-08-31T08:27:11,226     Found link https://files.pythonhosted.org/packages/29/17/fbfdcf6b6bbd243f2db12372ac2970dcaf75be4d761d922b1e6a389934d3/setuptools-26.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 26.1.0
2025-08-31T08:27:11,227     Found link https://files.pythonhosted.org/packages/df/c3/4265eb901f9db8c0ea5bdfb344084d85bc96c1a9b883f70430254b5491f6/setuptools-26.1.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 26.1.0
2025-08-31T08:27:11,228     Found link https://files.pythonhosted.org/packages/a3/f0/92458608fdc6747f5ad92c5b4fda5d31ecb1e1f18cf1c74207ca6c26bfa7/setuptools-26.1.0.zip (from https://pypi.org/simple/setuptools/), version: 26.1.0
2025-08-31T08:27:11,229     Found link https://files.pythonhosted.org/packages/3b/c7/e9724e6f81c96248fba5876054418c11d327b3093d075790903cd66fad44/setuptools-26.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 26.1.1
2025-08-31T08:27:11,230     Found link https://files.pythonhosted.org/packages/32/3c/e853a68b703f347f5ed86585c2dd2828a83252e1216c1201fa6f81270578/setuptools-26.1.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 26.1.1
2025-08-31T08:27:11,231     Found link https://files.pythonhosted.org/packages/6f/10/5398a054e63ce97921913052fde13ebf332a3a4104c50c4d7be9c465930e/setuptools-26.1.1.zip (from https://pypi.org/simple/setuptools/), version: 26.1.1
2025-08-31T08:27:11,232     Found link https://files.pythonhosted.org/packages/4b/30/ab37d6856850cb5a39041f1149498b71c580d0001d34035c7c276e55bed3/setuptools-27.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 27.0.0
2025-08-31T08:27:11,233     Found link https://files.pythonhosted.org/packages/70/0b/5766531af44aabeb52238beb95491d9323a32d83f1a6d202bf8cb56bdb90/setuptools-27.0.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 27.0.0
2025-08-31T08:27:11,234     Found link https://files.pythonhosted.org/packages/0f/a6/e790304c3676cc50269c0a79b5686ad3713f0986e3b2a3a5f00e7d1de1c4/setuptools-27.0.0.zip (from https://pypi.org/simple/setuptools/), version: 27.0.0
2025-08-31T08:27:11,235     Found link https://files.pythonhosted.org/packages/ac/d9/326012112791f043aab374221e1a096ac0b41c3097fcd0b33408b85d077d/setuptools-27.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 27.1.0
2025-08-31T08:27:11,236     Found link https://files.pythonhosted.org/packages/a0/21/964dfff9e662bbee6004641b5e3dabdaef14de6f179833571dc7b83ebe8c/setuptools-27.1.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 27.1.0
2025-08-31T08:27:11,237     Found link https://files.pythonhosted.org/packages/0e/ae/e55aa2c072b42f99229676f4a20291afb7d31678acd8672217911ffc696b/setuptools-27.1.0.zip (from https://pypi.org/simple/setuptools/), version: 27.1.0
2025-08-31T08:27:11,238     Found link https://files.pythonhosted.org/packages/2d/76/bce013588c82099ea243241441364db1e55a8d2d1a7cc962cee8873ccaea/setuptools-27.1.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 27.1.2
2025-08-31T08:27:11,239     Found link https://files.pythonhosted.org/packages/7b/e7/d9b468ead9854ca55110325ce00ae6ee64d11b957cc5214aa5174738187e/setuptools-27.1.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 27.1.2
2025-08-31T08:27:11,240     Found link https://files.pythonhosted.org/packages/80/cd/9bc7dc5aba7c64bd01f7a26517c622d9e863f5f58c75a433faffe55822fc/setuptools-27.1.2.zip (from https://pypi.org/simple/setuptools/), version: 27.1.2
2025-08-31T08:27:11,241     Found link https://files.pythonhosted.org/packages/0c/5d/309113d5359654094f7423ad9c32ac55255b83304f36d0fa96129f28db83/setuptools-27.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 27.2.0
2025-08-31T08:27:11,242     Found link https://files.pythonhosted.org/packages/87/ba/54197971d107bc06f5f3fbdc0d728a7ae0b10cafca46acfddba65a0899d8/setuptools-27.2.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 27.2.0
2025-08-31T08:27:11,242     Found link https://files.pythonhosted.org/packages/a5/88/e0b97490f4a7148c3e7766c9047b6fdc0eb760510dd428dcbe70e2d0b046/setuptools-27.2.0.zip (from https://pypi.org/simple/setuptools/), version: 27.2.0
2025-08-31T08:27:11,243     Found link https://files.pythonhosted.org/packages/8d/ae/766f375fc05b3d345b7082333da9f8b49af02d9c5680ff4eb15655fc5ae1/setuptools-27.3.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 27.3.0
2025-08-31T08:27:11,244     Found link https://files.pythonhosted.org/packages/72/e1/741cd8c4825e58119481d8be4254c9cd133db50876b159cdf8cbd253fbb3/setuptools-27.3.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 27.3.0
2025-08-31T08:27:11,245     Found link https://files.pythonhosted.org/packages/a9/84/8542f2f057005f4d9f788a5b686a4656614dade9ff84b528b20f4f1f70be/setuptools-27.3.0.zip (from https://pypi.org/simple/setuptools/), version: 27.3.0
2025-08-31T08:27:11,246     Found link https://files.pythonhosted.org/packages/6d/24/21cfe43cf54ee6461ac31dd96bf9ae2ba18594c073b6ef4fb36a1ad92d4c/setuptools-27.3.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 27.3.1
2025-08-31T08:27:11,247     Found link https://files.pythonhosted.org/packages/30/79/36ae55fa99fb888ddfbfd0c0c75e3e2b14d943822012401cdaa99085f6ea/setuptools-27.3.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 27.3.1
2025-08-31T08:27:11,248     Found link https://files.pythonhosted.org/packages/41/2e/2944b9b85b4ea2a65eedb0578c3d0037f5ac07f193e3544c2f26b0a76191/setuptools-27.3.1.zip (from https://pypi.org/simple/setuptools/), version: 27.3.1
2025-08-31T08:27:11,249     Found link https://files.pythonhosted.org/packages/10/46/2a5a1fa61982a622d803d3744ce5fc551ddbb35b26a4c0e1115a428f879c/setuptools-28.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.0.0
2025-08-31T08:27:11,250     Found link https://files.pythonhosted.org/packages/f7/94/eee867605a99ac113c4108534ad7c292ed48bf1d06dfe7b63daa51e49987/setuptools-28.0.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.0.0
2025-08-31T08:27:11,251     Found link https://files.pythonhosted.org/packages/14/41/b1acc3a67584fc45080dad57445807f1d4a7f5175aea2ba77d044c50ace7/setuptools-28.0.0.zip (from https://pypi.org/simple/setuptools/), version: 28.0.0
2025-08-31T08:27:11,252     Found link https://files.pythonhosted.org/packages/27/1b/a7e72fc6590cafbf9d85a96050fe05d6484133e818c4f256ff9fc9b85a34/setuptools-28.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.1.0
2025-08-31T08:27:11,253     Found link https://files.pythonhosted.org/packages/8b/41/da4f755b212af7eeeaa6f4f336d1b8d8782531610dd945e115a93cf69801/setuptools-28.1.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.1.0
2025-08-31T08:27:11,254     Found link https://files.pythonhosted.org/packages/13/e1/bc23cc7207daaae29862c6bf777afe94660af40493ae0a7269f2f616e136/setuptools-28.1.0.zip (from https://pypi.org/simple/setuptools/), version: 28.1.0
2025-08-31T08:27:11,255     Found link https://files.pythonhosted.org/packages/be/20/3f4d2fb59ddeed35532bd4e11e900abcf8019d29f4558d38169639303536/setuptools-28.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.2.0
2025-08-31T08:27:11,256     Found link https://files.pythonhosted.org/packages/fa/dd/e310aaaf1702516e12451d2d5eb78175587edc7fbeb1afd58263171e9384/setuptools-28.2.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.2.0
2025-08-31T08:27:11,257     Found link https://files.pythonhosted.org/packages/c9/9b/a03e851505aba1f7b33cb7135ac42cf0fff61dcd9a218f4592738bd310ea/setuptools-28.2.0.zip (from https://pypi.org/simple/setuptools/), version: 28.2.0
2025-08-31T08:27:11,258     Found link https://files.pythonhosted.org/packages/21/5c/46a549d8b15f751e9428d5e821e9bc3f69dd8b579c3a9f13ab9bd3e75589/setuptools-28.3.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.3.0
2025-08-31T08:27:11,258     Found link https://files.pythonhosted.org/packages/6b/dd/a7de8caeeffab76bacf56972b3f090c12e0ae6932245abbce706690a6436/setuptools-28.3.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.3.0
2025-08-31T08:27:11,259     Found link https://files.pythonhosted.org/packages/eb/88/ae1edbd71d08e37537f515ba83873a52df12fe2fffaa62cdc6142044ab6a/setuptools-28.3.0.zip (from https://pypi.org/simple/setuptools/), version: 28.3.0
2025-08-31T08:27:11,260     Found link https://files.pythonhosted.org/packages/42/98/96c206155a10b61ecf06b60b31f9679d5513f97f6526c4f996ec71976cc1/setuptools-28.4.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.4.0
2025-08-31T08:27:11,261     Found link https://files.pythonhosted.org/packages/a4/d3/a174c339d20fa9c687d079742c0b8a04aa70150823050aa952ccd7f560da/setuptools-28.4.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.4.0
2025-08-31T08:27:11,262     Found link https://files.pythonhosted.org/packages/67/6b/e0ad595d4a69078c051e5e4deb188ce8136bd6f762c80b1129483002603e/setuptools-28.4.0.zip (from https://pypi.org/simple/setuptools/), version: 28.4.0
2025-08-31T08:27:11,263     Found link https://files.pythonhosted.org/packages/e9/41/4bcb23afdd1c94e73d333344a75fe1ea0800461f6eb13c2a0135075e12ca/setuptools-28.5.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.5.0
2025-08-31T08:27:11,264     Found link https://files.pythonhosted.org/packages/8a/36/df963b2b3f841dd44fdcefa23e33aee89a77e6b2dc89319d39199c977f91/setuptools-28.5.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.5.0
2025-08-31T08:27:11,265     Found link https://files.pythonhosted.org/packages/7a/a6/b46d288805469509f776ee7c805d9d253a3e9d8a77d28925d6662f89a278/setuptools-28.5.0.zip (from https://pypi.org/simple/setuptools/), version: 28.5.0
2025-08-31T08:27:11,266     Found link https://files.pythonhosted.org/packages/0a/82/7f0156a8d1cbb6bff246f479afa379204dbfab159ae1ff2029a90a6fd461/setuptools-28.6.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.6.0
2025-08-31T08:27:11,267     Found link https://files.pythonhosted.org/packages/cd/1b/2aaf7aef152a274c687e0441a75f3df5fa1de0144cf3fba856d916558c20/setuptools-28.6.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.6.0
2025-08-31T08:27:11,268     Found link https://files.pythonhosted.org/packages/9d/60/e19cf81ad1743cebea5a799d4ff7179b705b949844c841975e3be4bbb26e/setuptools-28.6.0.zip (from https://pypi.org/simple/setuptools/), version: 28.6.0
2025-08-31T08:27:11,269     Found link https://files.pythonhosted.org/packages/8a/1f/e2e14f0b98d0b6de6c3fb4e8a3b45d3b8907783937c497cb53539c0d2b19/setuptools-28.6.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.6.1
2025-08-31T08:27:11,270     Found link https://files.pythonhosted.org/packages/b5/9a/9ce1a45a076f977cb870bf0c9370347c9371b0e9aa9ca9859196ce58afda/setuptools-28.6.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.6.1
2025-08-31T08:27:11,271     Found link https://files.pythonhosted.org/packages/57/d7/0848d1152d479cb8d7329919cc4ec4f8a21c5487c5bbd95c3a15c290eee1/setuptools-28.6.1.zip (from https://pypi.org/simple/setuptools/), version: 28.6.1
2025-08-31T08:27:11,272     Found link https://files.pythonhosted.org/packages/fb/46/642886741c17d0e4caf08358a6588467b3b1abd8e935384cff84973484fa/setuptools-28.7.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.7.0
2025-08-31T08:27:11,272     Found link https://files.pythonhosted.org/packages/94/b5/f1ad3a987acdf58eda28e720b671af6aef43dfe2b8e54682dece964799e7/setuptools-28.7.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.7.0
2025-08-31T08:27:11,273     Found link https://files.pythonhosted.org/packages/0d/be/9f2857889551d53a103e7a9bb6f2fdb8416e263b0dcc27e8130a1367363c/setuptools-28.7.0.zip (from https://pypi.org/simple/setuptools/), version: 28.7.0
2025-08-31T08:27:11,274     Found link https://files.pythonhosted.org/packages/74/c5/c78a788e65f9eb241c531839e909df1226534ea2d09d300231766b82b79a/setuptools-28.7.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.7.1
2025-08-31T08:27:11,275     Found link https://files.pythonhosted.org/packages/1d/04/97e37cf85972ea19364c22db34ee8192db3876a80ed5bffd6413dcdabe2d/setuptools-28.7.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.7.1
2025-08-31T08:27:11,276     Found link https://files.pythonhosted.org/packages/9a/37/7f85f5b4b03983357c0d1d3f5fbd2602e0ab278d9c2792544db0eb52447f/setuptools-28.7.1.zip (from https://pypi.org/simple/setuptools/), version: 28.7.1
2025-08-31T08:27:11,277     Found link https://files.pythonhosted.org/packages/3b/7e/293d19ccd106119e35db4bf3e111b1895098f618b455b758aa636496cf03/setuptools-28.8.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.8.0
2025-08-31T08:27:11,278     Found link https://files.pythonhosted.org/packages/25/4e/1b16cfe90856235a13872a6641278c862e4143887d11a12ac4905081197f/setuptools-28.8.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.8.0
2025-08-31T08:27:11,279     Found link https://files.pythonhosted.org/packages/e9/93/e53fb79dbf5f4a1407feed7a19ea6d0e83765b354754e003cce7aa12b976/setuptools-28.8.0.zip (from https://pypi.org/simple/setuptools/), version: 28.8.0
2025-08-31T08:27:11,280     Found link https://files.pythonhosted.org/packages/1d/c7/edad005b9fcc59f299a05394980ca76a376254d8dbcab639bb3e2e989807/setuptools-28.8.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.8.1
2025-08-31T08:27:11,281     Found link https://files.pythonhosted.org/packages/73/cc/69479045ede36b4786e6069d616dc6c232ee875e8686ef9fd7af3d3c7404/setuptools-28.8.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.8.1
2025-08-31T08:27:11,282     Found link https://files.pythonhosted.org/packages/07/39/899c49ac766533c2326133a73de1bebf980c116d30df9d38445cd767b0c7/setuptools-28.8.1.zip (from https://pypi.org/simple/setuptools/), version: 28.8.1
2025-08-31T08:27:11,283     Found link https://files.pythonhosted.org/packages/5b/22/ee2f999f9fc1ce934b523852bd7c1ea12e0f0fa1de19317135a0d1159507/setuptools-29.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 29.0.0
2025-08-31T08:27:11,284     Found link https://files.pythonhosted.org/packages/8b/40/9fd40ccf8987ae89e43298eac4f662bab2d739cbb8943b9c019fe1974fdb/setuptools-29.0.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 29.0.0
2025-08-31T08:27:11,285     Found link https://files.pythonhosted.org/packages/6f/4f/62e4eb1ff67f8877434b3aaa62298cd0abcac9a73aee44b00249b9bac1f7/setuptools-29.0.0.zip (from https://pypi.org/simple/setuptools/), version: 29.0.0
2025-08-31T08:27:11,286     Found link https://files.pythonhosted.org/packages/06/4b/86a670fd21f7849adb092e40883c48dcd0d66b8a878fc8d63b7f0ea04213/setuptools-29.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 29.0.1
2025-08-31T08:27:11,287     Found link https://files.pythonhosted.org/packages/59/88/2f3990916931a5de6fa9706d6d75eb32ee8b78627bb2abaab7ed9e6d0622/setuptools-29.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 29.0.1
2025-08-31T08:27:11,287     Found link https://files.pythonhosted.org/packages/1a/31/3c29a0d6eaf8851d2031003f300b4accb724e3f5c4d519e8e7d88bc373a3/setuptools-29.0.1.zip (from https://pypi.org/simple/setuptools/), version: 29.0.1
2025-08-31T08:27:11,288     Found link https://files.pythonhosted.org/packages/d8/ca/dff6c67f45bff7a2ad2fd9a69ae9ebdbea742fd961f76486ae2d84517464/setuptools-30.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 30.0.0
2025-08-31T08:27:11,289     Found link https://files.pythonhosted.org/packages/66/6d/dad0d39ce1cfa98ef3634463926e7324e342c956aecb066968e2e3696300/setuptools-30.0.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 30.0.0
2025-08-31T08:27:11,290     Found link https://files.pythonhosted.org/packages/03/53/65d932f96d5aab57c21679c30e6ec33c37f8530828263d0a1d41f9faddc9/setuptools-30.0.0.zip (from https://pypi.org/simple/setuptools/), version: 30.0.0
2025-08-31T08:27:11,291     Found link https://files.pythonhosted.org/packages/f1/2b/6fb5c6988b062144d4d0fd5c31cd9ff74ce8ff55e1ee2a043efff49f0c91/setuptools-30.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 30.1.0
2025-08-31T08:27:11,292     Found link https://files.pythonhosted.org/packages/1e/43/002c8616db9a3e7be23c2556e39b90a32bb40ba0dc652de1999d5334d372/setuptools-30.1.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 30.1.0
2025-08-31T08:27:11,293     Found link https://files.pythonhosted.org/packages/34/28/ac537928ef346f7c6ba2bfa822450af4d2b41321964532ef9157112c830e/setuptools-30.1.0.zip (from https://pypi.org/simple/setuptools/), version: 30.1.0
2025-08-31T08:27:11,295     Found link https://files.pythonhosted.org/packages/b8/cb/b919f52dd81b4b2210d0c5529b6b629a4002e08d49a90183605d1181b10c/setuptools-30.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.2.0
2025-08-31T08:27:11,296     Found link https://files.pythonhosted.org/packages/f1/92/12c7251039b274c30106c3e0babdcb040cbd13c3ad4b3f0ef9a7c217e36a/setuptools-30.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.2.0
2025-08-31T08:27:11,297     Found link https://files.pythonhosted.org/packages/48/c0/f01379bc7b1b7684bdf4cc744b6124bc0a089349978ec576687ac8f809a7/setuptools-30.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.2.0
2025-08-31T08:27:11,298     Found link https://files.pythonhosted.org/packages/05/c3/b5534ca0113d5a6779802644f88f9e110de92287d2d11b7f83723778c83c/setuptools-30.2.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.2.1
2025-08-31T08:27:11,299     Found link https://files.pythonhosted.org/packages/7e/ee/9c5f692af20450c67ebfd2c8b6ec9fc359c00627162063832e647ee0d0a0/setuptools-30.2.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.2.1
2025-08-31T08:27:11,300     Found link https://files.pythonhosted.org/packages/c7/d5/9a95d0e941f753c372196a5b8cf050d5f48be1cb04842805e93a37ad10fa/setuptools-30.2.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.2.1
2025-08-31T08:27:11,301     Found link https://files.pythonhosted.org/packages/f3/5f/df3db5e01f268f53646f51f9b5063d6834a6744a0efdea4093bbcf86f83f/setuptools-30.3.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.3.0
2025-08-31T08:27:11,302     Found link https://files.pythonhosted.org/packages/e0/b4/1e023e0f0e3a1475c146889f91989a306162c162d76eceac8ad13d6fad8d/setuptools-30.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.3.0
2025-08-31T08:27:11,303     Found link https://files.pythonhosted.org/packages/9f/a4/97874b4ccdd40a6c0e8f8ed1c1dc3be709c126ebbd5f09edcbcc87856845/setuptools-30.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.3.0
2025-08-31T08:27:11,304     Found link https://files.pythonhosted.org/packages/16/9b/5e491cef98014d9a1b1f15896e503661d3973d02970583cfb026b613d0fd/setuptools-30.4.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.4.0
2025-08-31T08:27:11,305     Found link https://files.pythonhosted.org/packages/b4/ed/cf46e89ea621166473ad82657f8947218a76f8d9ab08721a3d3dc226d710/setuptools-30.4.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.4.0
2025-08-31T08:27:11,306     Found link https://files.pythonhosted.org/packages/84/c0/ffefe842cad8f73271a5169d65bfcc49862263569a9f26fe1ed1fa785589/setuptools-30.4.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.4.0
2025-08-31T08:27:11,307     Found link https://files.pythonhosted.org/packages/c2/03/9748e703e9f7402aa5d83ba496a350325a2686ba965d443bff91e0cbea09/setuptools-31.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 31.0.0
2025-08-31T08:27:11,307     Found link https://files.pythonhosted.org/packages/68/13/1bfbfbd86560e61fa9803d241084fff41a775bf56ee8b3ad72fc9e550dad/setuptools-31.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 31.0.0
2025-08-31T08:27:11,308     Found link https://files.pythonhosted.org/packages/06/07/606dbad6d0994d06a2e8147f4c6a7c699b7484efaf126810572a904ad1fd/setuptools-31.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 31.0.0
2025-08-31T08:27:11,310     Found link https://files.pythonhosted.org/packages/95/77/e7b546c84cd9d98f26cb7e2aaee8193abc17e23e19dfdcdcc10b8e9b6619/setuptools-31.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 31.0.1
2025-08-31T08:27:11,310     Found link https://files.pythonhosted.org/packages/42/03/3ece0509e844a31bae7a80adaf7b93fdbbe91cdb8c77f27d25dfd3b49db3/setuptools-31.0.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 31.0.1
2025-08-31T08:27:11,311     Found link https://files.pythonhosted.org/packages/4a/27/cf254815e1c31b4ccd37acce8d9ed9fb923c820c589b0cb3149b3f0e3ea3/setuptools-31.0.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 31.0.1
2025-08-31T08:27:11,312     Found link https://files.pythonhosted.org/packages/9f/d6/08d72760617ab501ebb3b30a945e19c0fa5cd1bfa80a7f6aacf481e60ee8/setuptools-32.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.0.0
2025-08-31T08:27:11,313     Found link https://files.pythonhosted.org/packages/dc/37/f01d823fd312ba8ea6c3aea906d2d6ac9e9e8bf9e7853e34f296e94b0d0d/setuptools-32.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.0.0
2025-08-31T08:27:11,314     Found link https://files.pythonhosted.org/packages/74/6e/a1eec5bab831386eb043438225e0a7d311702047d20cee460ad4318238f4/setuptools-32.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.0.0
2025-08-31T08:27:11,315     Found link https://files.pythonhosted.org/packages/28/cd/e9fbf7cf35aade9661304f9c3e86520e043042d1cd0df0bee238abe6ec94/setuptools-32.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.0
2025-08-31T08:27:11,316     Found link https://files.pythonhosted.org/packages/26/d1/dc7fe14ce4a3ff3faebf1ac11350de4104ea2d2a80c98393b55c84362b0c/setuptools-32.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.0
2025-08-31T08:27:11,317     Found link https://files.pythonhosted.org/packages/40/e2/114f0b42ca5d7dcbefafbcbe4f8fdbe407b577345caac08f943855d72fe1/setuptools-32.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.0
2025-08-31T08:27:11,318     Found link https://files.pythonhosted.org/packages/04/8a/0f562a74f21d2ed48c586ae9148a536905c9b3e4c4070c83611c3fbbbf59/setuptools-32.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.1
2025-08-31T08:27:11,319     Found link https://files.pythonhosted.org/packages/6b/b2/b79df1b728dc14469269844cbd6cbe82c71a16839a131c60357b13117c96/setuptools-32.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.1
2025-08-31T08:27:11,320     Found link https://files.pythonhosted.org/packages/d6/38/54338b224a06a618bc6e05453ab54094f0feede29f277f684e4985728fe2/setuptools-32.1.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.2
2025-08-31T08:27:11,321     Found link https://files.pythonhosted.org/packages/5f/66/bfd7f09fddc2530e5c1096736fe08742d475c4eab80fe8527f0440d885ec/setuptools-32.1.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.2
2025-08-31T08:27:11,322     Found link https://files.pythonhosted.org/packages/2a/0b/80d014192eb120270e936cb166e9c5f7d7e9316d20540d0cc41221be1d93/setuptools-32.1.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.3
2025-08-31T08:27:11,323     Found link https://files.pythonhosted.org/packages/60/23/8e79ce5164310c2f367a66a6110da77b0088365b14363a873bfc91d9c702/setuptools-32.1.3.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.3
2025-08-31T08:27:11,324     Found link https://files.pythonhosted.org/packages/3a/fb/570e51a1a4b0de85eb6ec36a6c47bd5fd7a55128a1391a15b6e21d290a87/setuptools-32.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.2.0
2025-08-31T08:27:11,325     Found link https://files.pythonhosted.org/packages/87/1a/33d3d05569e857c5c5cc3e90d197bf4d9696dc740a05f66a09599d66e5bd/setuptools-32.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.2.0
2025-08-31T08:27:11,326     Found link https://files.pythonhosted.org/packages/50/77/581dc566d4a03d408d3797153a537c0edc67aded8765ac556124e0e25ef0/setuptools-32.3.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.3.0
2025-08-31T08:27:11,327     Found link https://files.pythonhosted.org/packages/b0/04/d7aac18d0d8b1b9bd9b88af02af8090e72653753bced3226f9903cabb991/setuptools-32.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.3.0
2025-08-31T08:27:11,328     Found link https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.3.1
2025-08-31T08:27:11,329     Found link https://files.pythonhosted.org/packages/e8/68/f968ebc015c7e0021e76b60b8cfd29f9ffbae4b3b58d96ad20045a99562e/setuptools-32.3.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.3.1
2025-08-31T08:27:11,330     Found link https://files.pythonhosted.org/packages/d3/72/0108eee78038fa8961e2309d4486294b1035968bd940546748b72d309737/setuptools-33.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 33.1.0
2025-08-31T08:27:11,331     Found link https://files.pythonhosted.org/packages/74/48/b99482eaf90785868e0ba83e8d21a62cf88cf1067ff481f37eff528c22ab/setuptools-33.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 33.1.0
2025-08-31T08:27:11,332     Found link https://files.pythonhosted.org/packages/e5/53/92a8ac9d252ec170d9197dcf988f07e02305a06078d7e83a41ba4e3ed65b/setuptools-33.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 33.1.1
2025-08-31T08:27:11,333     Found link https://files.pythonhosted.org/packages/dc/8c/7c9869454bdc53e72fb87ace63eac39336879eef6f2bf96e946edbf03e90/setuptools-33.1.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 33.1.1
2025-08-31T08:27:11,334     Found link https://files.pythonhosted.org/packages/67/d9/0633db28d5c86047501909cdb7c2614602ca425c14ff38faf9eafa383010/setuptools-34.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.0
2025-08-31T08:27:11,334     Found link https://files.pythonhosted.org/packages/4f/5d/77ab299135d7a882fff2970b45c6a77d7d79db0363c395081770632e6f1d/setuptools-34.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.0
2025-08-31T08:27:11,336     Found link https://files.pythonhosted.org/packages/52/85/15b618883d7289920943c7971b1add55188a5e4769a4f1fbec982279bcc0/setuptools-34.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.1
2025-08-31T08:27:11,337     Found link https://files.pythonhosted.org/packages/b1/d1/3df86b914d72b18d37266f964a11576f135eadbb7d2e3c5165377e4263bc/setuptools-34.0.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.1
2025-08-31T08:27:11,338     Found link https://files.pythonhosted.org/packages/fb/95/6af4e7a9f3a1af7e04ffdf45dfdc1a86ab36e6888708e578e506b357240d/setuptools-34.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.2
2025-08-31T08:27:11,338     Found link https://files.pythonhosted.org/packages/e3/6b/bb793ca610f364d1888b9bd7b83dccd0c27d779e4fd91a953ce8bae74996/setuptools-34.0.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.2
2025-08-31T08:27:11,339     Found link https://files.pythonhosted.org/packages/e2/e4/4a35e641eb36f3a8a1ebe1a38cbd6f251da416cb2680ef44fab4fd07dc20/setuptools-34.0.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.3
2025-08-31T08:27:11,340     Found link https://files.pythonhosted.org/packages/d7/53/291726cd289b87588381db8a63f027819ee133a5764d7f0adbcb4a5f7951/setuptools-34.0.3.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.3
2025-08-31T08:27:11,342     Found link https://files.pythonhosted.org/packages/a7/62/3995dc3067cbf8d4a13ddac0f87417b9a08799c586b3faa77d62ad9085de/setuptools-34.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.1.0
2025-08-31T08:27:11,342     Found link https://files.pythonhosted.org/packages/64/88/d434873ba1ce02c0ed669f574afeabaeaaeec207929a41b5c1ed947270fc/setuptools-34.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.1.0
2025-08-31T08:27:11,344     Found link https://files.pythonhosted.org/packages/e4/1a/24d196d3f3c62db133afb09d221d0b9b2f48f6d7e81020e9892b4eab7686/setuptools-34.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.1.1
2025-08-31T08:27:11,344     Found link https://files.pythonhosted.org/packages/e2/51/3ea582a6d64dcd36858a10de31d43ca8ea0a3be5386dd0caf6503167cdfb/setuptools-34.1.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.1.1
2025-08-31T08:27:11,346     Found link https://files.pythonhosted.org/packages/9a/9e/7614c97ca7f88a74352c726cfae1fa3f9823701d3a8b71f8c95ea581e493/setuptools-34.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.2.0
2025-08-31T08:27:11,346     Found link https://files.pythonhosted.org/packages/16/ef/44baff6e9b1f8125d759d026757677a8a82d14d9974726f13726dee9adfb/setuptools-34.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.2.0
2025-08-31T08:27:11,347     Found link https://files.pythonhosted.org/packages/ad/bb/940a5b3244d62ffdef887dc3a8061649f4f0fa5cbbd498b09a862e91b6b9/setuptools-34.3.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.0
2025-08-31T08:27:11,348     Found link https://files.pythonhosted.org/packages/87/24/0a39eaaf6caac0dc20158c0d5e8e4e4f8a195d0481dc3d14043fb8e9ca94/setuptools-34.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.0
2025-08-31T08:27:11,349     Found link https://files.pythonhosted.org/packages/49/09/68b43c68492a9d437c137892d11427ac45a1497812c8a8ce2cd17649a27c/setuptools-34.3.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.1
2025-08-31T08:27:11,350     Found link https://files.pythonhosted.org/packages/03/79/e56106d77d3d2ae607ba1e1d7f8c3ed61880f7decba1f253feb714b7eafe/setuptools-34.3.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.1
2025-08-31T08:27:11,351     Found link https://files.pythonhosted.org/packages/de/b2/b63accae9aa1a4cf02e03c7522102f686a1bd9b8b1b847716198152d2c63/setuptools-34.3.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.2
2025-08-31T08:27:11,352     Found link https://files.pythonhosted.org/packages/b5/e2/cca325e160b8e12334f5b2923ffcdb3c02da9fded1d2899d7930ac1c7448/setuptools-34.3.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.2
2025-08-31T08:27:11,353     Found link https://files.pythonhosted.org/packages/dd/d5/0c24cf773269681b2ce088b7afbaadddc2273cf0bd91c3f3961458097de2/setuptools-34.3.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.3
2025-08-31T08:27:11,354     Found link https://files.pythonhosted.org/packages/d5/b7/e52b7dccd3f91eec858309dcd931c1387bf70b6d458c86a9bfcb50134fbd/setuptools-34.3.3.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.3
2025-08-31T08:27:11,355     Found link https://files.pythonhosted.org/packages/4f/45/4ff49ef85e3bda6e63eefeae4d42642de0c58b63acabf01cbf3512b851f6/setuptools-34.4.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.4.0
2025-08-31T08:27:11,356     Found link https://files.pythonhosted.org/packages/b7/58/53b0dea2c7563abebbc774318b298b8d78f41464e0b24833817e33c96438/setuptools-34.4.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.4.0
2025-08-31T08:27:11,357     Found link https://files.pythonhosted.org/packages/61/da/d37d49dc549683b7a5f1074641c6f42b4c0093dc7085bc680485ad160ef8/setuptools-34.4.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.4.1
2025-08-31T08:27:11,358     Found link https://files.pythonhosted.org/packages/ad/73/536baf7b0c6b20129a142f653b0b9750e6bbef5cc8ac03b4eb8fd939fc4c/setuptools-34.4.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.4.1
2025-08-31T08:27:11,359     Found link https://files.pythonhosted.org/packages/ff/96/5e917753dbdd7b28217c1068d9e3fbe54a7ef0ff3a6411d0cc81faf37070/setuptools-35.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 35.0.0
2025-08-31T08:27:11,360     Found link https://files.pythonhosted.org/packages/9d/4c/e52cb975d7deee609e78d24e652251dd2a10144c796ca982500cb15389c9/setuptools-35.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 35.0.0
2025-08-31T08:27:11,361     Found link https://files.pythonhosted.org/packages/76/10/f61ea34f5ca2ab6437d8529d10954cbdf0bbb0f9826e1b703863a66a40ae/setuptools-35.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 35.0.1
2025-08-31T08:27:11,362     Found link https://files.pythonhosted.org/packages/55/61/fdecfda95355db1c67daa6c8e6ee747f8a0bbc0a5e18f8bfd716bdffac3e/setuptools-35.0.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 35.0.1
2025-08-31T08:27:11,363     Found link https://files.pythonhosted.org/packages/27/45/79618f80704497f74f2de1ca62216a5c3ffdbd49f43047c81c30e126a055/setuptools-35.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 35.0.2
2025-08-31T08:27:11,364     Found link https://files.pythonhosted.org/packages/88/13/7d560b75334a8e4b4903f537b7e5a1ad9f1a2f1216e2587aaaf91b38c991/setuptools-35.0.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 35.0.2
2025-08-31T08:27:11,365     Found link https://files.pythonhosted.org/packages/fc/cb/748dcabb152fbc7eceaf585d052b8bc11cf028b917a7d2343cf1e0c092c3/setuptools-36.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.0.1
2025-08-31T08:27:11,366     Found link https://files.pythonhosted.org/packages/a9/23/720c7558ba6ad3e0f5ad01e0d6ea2288b486da32f053c73e259f7c392042/setuptools-36.0.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.0.1
2025-08-31T08:27:11,367     Found link https://files.pythonhosted.org/packages/e3/13/e5705e5a8fc366cfb92807d3c926ed033186f644a995b238fd7ba0ab2ea8/setuptools-36.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.1.0
2025-08-31T08:27:11,368     Found link https://files.pythonhosted.org/packages/8f/e1/02e6e8f5d5cb120748cdcff48b82c7fffce9750fdaf9362a860d669a617d/setuptools-36.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.1.0
2025-08-31T08:27:11,369     Found link https://files.pythonhosted.org/packages/62/64/5161818bd7d574dda208ec8e41307fd661b45ea8d5f6aa7e2dda09fc9b18/setuptools-36.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.1.1
2025-08-31T08:27:11,370     Found link https://files.pythonhosted.org/packages/0e/d3/672f680d7185bc30478691aea62486c85e51ff07b06a52635699b29c0460/setuptools-36.1.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.1.1
2025-08-31T08:27:11,371     Found link https://files.pythonhosted.org/packages/e2/79/a865e78ab721a6dda2dea171526e6f8db51ba50814766429477e87c6ba8a/setuptools-36.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.0
2025-08-31T08:27:11,372     Found link https://files.pythonhosted.org/packages/25/c1/344fdd1f543cba2d38c6fb7db86f2ffc468e72006487005e50df08f0243d/setuptools-36.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.0
2025-08-31T08:27:11,373     Found link https://files.pythonhosted.org/packages/54/78/55b06e9c83fe661bd7554ce8b2620c253cba25df36ae402ba184df980ec0/setuptools-36.2.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.1
2025-08-31T08:27:11,374     Found link https://files.pythonhosted.org/packages/ef/e7/c55562d31056ab4a2bb7edc51d750531db055c770664ea4542bccf0cf405/setuptools-36.2.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.1
2025-08-31T08:27:11,376     Found link https://files.pythonhosted.org/packages/b7/e8/c7e5fabf907ee4f17dbec13cf18eba3c48e1ac97adb209fcbd2e0f5e4316/setuptools-36.2.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.2
2025-08-31T08:27:11,376     Found link https://files.pythonhosted.org/packages/62/48/5902109864b2c22d5ed5804479175ae4e2239b04e06b5917d2dc90a83a8c/setuptools-36.2.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.2
2025-08-31T08:27:11,378     Found link https://files.pythonhosted.org/packages/4d/d8/fb50bb18b1b3652022f2f1ca560db7b0d8e02e9573b263e978501ba5f4a6/setuptools-36.2.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.3
2025-08-31T08:27:11,378     Found link https://files.pythonhosted.org/packages/46/44/648b37b1dc8f6e70c05c0f91cc7873b76484a924b8a2d5aa2e57d6846076/setuptools-36.2.3.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.3
2025-08-31T08:27:11,380     Found link https://files.pythonhosted.org/packages/9c/33/486970f273c7d8e4610bf17106a6b5949ddf214ff61835804407e02987e4/setuptools-36.2.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.4
2025-08-31T08:27:11,380     Found link https://files.pythonhosted.org/packages/08/ed/a71819fa8a3c689bb00df79a966921f7f59409352f3143a85f6937ae7c97/setuptools-36.2.4.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.4
2025-08-31T08:27:11,381     Found link https://files.pythonhosted.org/packages/47/0e/0a8d5b5de0325e276c772254d5036b9228b744befc427c9fb9997aab5f25/setuptools-36.2.5-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.5
2025-08-31T08:27:11,382     Found link https://files.pythonhosted.org/packages/e1/b1/b9a490783bc7c10ca9e87aecbdc21baedb97a80a65f98559f283e3c7fb46/setuptools-36.2.5.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.5
2025-08-31T08:27:11,383     Found link https://files.pythonhosted.org/packages/40/91/75d94d70b669ce6915b17992a68e2c3214a217f0d8e21aebbf94b10beae4/setuptools-36.2.6-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.6
2025-08-31T08:27:11,384     Found link https://files.pythonhosted.org/packages/1c/cf/bceaa680300c39f8561d43a06aaa2a9a3b6217ebd37ccadbc1aae0836e88/setuptools-36.2.6.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.6
2025-08-31T08:27:11,385     Found link https://files.pythonhosted.org/packages/f6/d0/926c904249bee08b7c92848cb015cc8204cc4a36c4e0f9132e32109f8ab1/setuptools-36.2.7-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.7
2025-08-31T08:27:11,386     Found link https://files.pythonhosted.org/packages/07/a0/11d3d76df54b9701c0f7bf23ea9b00c61c5e14eb7962bb29aed866a5844e/setuptools-36.2.7.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.7
2025-08-31T08:27:11,387     Found link https://files.pythonhosted.org/packages/25/56/8911aee89553b72f799f80790ddf1c36aeda125eb5bd0bd3487663856556/setuptools-36.3.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.3.0
2025-08-31T08:27:11,388     Found link https://files.pythonhosted.org/packages/6a/a7/e3af543c6dde4de7584536c868ac38570f58ae451f9201ff674532ea3809/setuptools-36.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.3.0
2025-08-31T08:27:11,389     Found link https://files.pythonhosted.org/packages/1b/95/e6f28144fdb6c06186c1f0e70cea02791e6ec787682bdfc437ce69b8186c/setuptools-36.4.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.4.0
2025-08-31T08:27:11,390     Found link https://files.pythonhosted.org/packages/28/4f/889339f38da415e49cff15b21ab27becbf4c017c79fbfdeca663f5b33b36/setuptools-36.4.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.4.0
2025-08-31T08:27:11,391     Found link https://files.pythonhosted.org/packages/32/28/16fffbead19dc705f9546134ca81090d6c266aff6173fb092bb6d8dfd76a/setuptools-36.5.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.5.0
2025-08-31T08:27:11,392     Found link https://files.pythonhosted.org/packages/a4/c8/9a7a47f683d54d83f648d37c3e180317f80dc126a304c45dc6663246233a/setuptools-36.5.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.5.0
2025-08-31T08:27:11,393     Found link https://files.pythonhosted.org/packages/bd/4c/b06ab3abfc8bc93b87b70f4cab22352c3c72deba7b71390d14bfffa97c85/setuptools-36.6.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.6.0
2025-08-31T08:27:11,394     Found link https://files.pythonhosted.org/packages/45/29/8814bf414e7cd1031e1a3c8a4169218376e284ea2553cc0822a6ea1c2d78/setuptools-36.6.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.6.0
2025-08-31T08:27:11,395     Found link https://files.pythonhosted.org/packages/85/36/b36167b5df1fe186ea0a476f7029cfb1f67ddc21dc24fe6704a89b162c99/setuptools-36.6.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.6.1
2025-08-31T08:27:11,396     Found link https://files.pythonhosted.org/packages/56/a0/4dfcc515b1b993286a64b9ab62562f09e6ed2d09288909aee1efdb9dde16/setuptools-36.6.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.6.1
2025-08-31T08:27:11,397     Found link https://files.pythonhosted.org/packages/3d/57/9b439f6de8dcca7663d592aa4b50c010a7e46bb842ce2ad087f5b48fc19f/setuptools-36.7.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.7.0
2025-08-31T08:27:11,398     Found link https://files.pythonhosted.org/packages/a9/5e/be163b88ee1c0093532e96ac68e42b840c5d85fd9888d8a96645ac5b71e4/setuptools-36.7.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.7.0
2025-08-31T08:27:11,399     Found link https://files.pythonhosted.org/packages/e5/63/8b03cf8480caef721a22ad4241202165ed95c3ba2d2ab7ba8886b239c021/setuptools-36.7.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.7.1
2025-08-31T08:27:11,400     Found link https://files.pythonhosted.org/packages/4f/12/fe19686c43d82c2101c70b917185682f4fc907cbfc9290368ecace403ad6/setuptools-36.7.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.7.1
2025-08-31T08:27:11,401     Found link https://files.pythonhosted.org/packages/d1/56/fe971f02e075c9e712f23d1fe5c427f573fce178c368deebf5794f80b7c9/setuptools-36.7.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.7.2
2025-08-31T08:27:11,402     Found link https://files.pythonhosted.org/packages/0f/22/7fdcc777ba60e2a8b1ea17f679c2652ffe80bd5a2f35d61c629cb9545d5e/setuptools-36.7.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.7.2
2025-08-31T08:27:11,403     Found link https://files.pythonhosted.org/packages/27/f6/fabfc9c71c9b1b99d2ec4768a6e1f73b2e924f51c89d436302b8c2a25459/setuptools-36.8.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.8.0
2025-08-31T08:27:11,404     Found link https://files.pythonhosted.org/packages/b8/04/be569e393006fa9a2c10ef72ea33133c2902baa115dd1d4279dae55c3b3b/setuptools-36.8.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.8.0
2025-08-31T08:27:11,406     Found link https://files.pythonhosted.org/packages/0f/40/b3c98aa32bc91d3d8c573443a29aa482d77268d77132b63f09d8385b21ff/setuptools-37.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 37.0.0
2025-08-31T08:27:11,407     Found link https://files.pythonhosted.org/packages/7c/cb/bdfbb0b6a56459d5461768de824d4f40ec4c4c778f3a8fb0b84c25f03b68/setuptools-37.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 37.0.0
2025-08-31T08:27:11,408     Found link https://files.pythonhosted.org/packages/54/60/54e7ee235b377854f8ccaec996ccae04c33f59eb86c44c387761a82cafea/setuptools-38.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.0.0
2025-08-31T08:27:11,409     Found link https://files.pythonhosted.org/packages/55/23/726b0d4f6c96ff62bd6593398b64427882c74939e862849ea8f2b0bc0bb8/setuptools-38.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.0.0
2025-08-31T08:27:11,410     Found link https://files.pythonhosted.org/packages/44/84/36374822b182d0334928af192ba03b7b287b27675a788d3e218af2773b8e/setuptools-38.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.1.0
2025-08-31T08:27:11,411     Found link https://files.pythonhosted.org/packages/c6/34/cd488be4302b6e72fa10a336eacd789c6ef2affa251e9c5f76402ccdb243/setuptools-38.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.1.0
2025-08-31T08:27:11,412     Found link https://files.pythonhosted.org/packages/09/ec/d02a4ec3942435c14677e4b6d6852a382ae19fc53f1a92184738450d0e72/setuptools-38.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.0
2025-08-31T08:27:11,413     Found link https://files.pythonhosted.org/packages/70/7a/1ca7761f8d056ecf40f0ed3300669bba184ce1ed943fa393ed0259606118/setuptools-38.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.0
2025-08-31T08:27:11,414     Found link https://files.pythonhosted.org/packages/dc/00/338a7476782b3059976ee4d1e2117e03f8bec6ae86c7a86b36648f491373/setuptools-38.2.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.1
2025-08-31T08:27:11,415     Found link https://files.pythonhosted.org/packages/27/25/6f8cf695e021a0b20ab9b1eaf95b286695e8ff27dea9afa4427f954f8998/setuptools-38.2.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.1
2025-08-31T08:27:11,416     Found link https://files.pythonhosted.org/packages/e3/39/ec976dc30d045c5ee30cfcd849b88726e0fa1d4ba9de44e6ec7e926b9f20/setuptools-38.2.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.3
2025-08-31T08:27:11,417     Found link https://files.pythonhosted.org/packages/41/80/268fda78a53c2629128f8174d2952c7f902c93ebaa2062b64f27aa101b07/setuptools-38.2.3.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.3
2025-08-31T08:27:11,419     Found link https://files.pythonhosted.org/packages/bb/e0/ea620f9ecbaaaf3ebb288cdbbe8cc20b6a789c17e42d8916662b218e3349/setuptools-38.2.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.4
2025-08-31T08:27:11,420     Found link https://files.pythonhosted.org/packages/69/56/f0f52281b5175e3d9ca8623dadbc3b684e66350ea9e0006736194b265e99/setuptools-38.2.4.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.4
2025-08-31T08:27:11,421     Found link https://files.pythonhosted.org/packages/4c/00/19ad1da0869e6699577d90ea843325036952015f924fc8488d181c140729/setuptools-38.2.5-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.5
2025-08-31T08:27:11,421     Found link https://files.pythonhosted.org/packages/e9/c3/5986db56819bd88e1a250cad2a97249211686b1b7b5d95f9ab64d403a2cb/setuptools-38.2.5.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.5
2025-08-31T08:27:11,423     Found link https://files.pythonhosted.org/packages/0c/f4/69bd5904cc1ecccf7b625f0d2f1de8cb168fe76bac31bec197c845c77a1d/setuptools-38.3.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.3.0
2025-08-31T08:27:11,424     Found link https://files.pythonhosted.org/packages/f4/21/9990132a250d49190c2fb41ea2adb9b4693c0b10ec1b92db476d3f06e6cb/setuptools-38.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.3.0
2025-08-31T08:27:11,425     Found link https://files.pythonhosted.org/packages/75/d1/5abca4ccf61a7ab86c255dd315fb96e566fbf9b5d3a480e72c93e8ec2802/setuptools-38.4.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.4.0
2025-08-31T08:27:11,425     Found link https://files.pythonhosted.org/packages/41/5f/6da80400340fd48ba4ae1c673be4dc3821ac06cd9821ea60f9c7d32a009f/setuptools-38.4.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.4.0
2025-08-31T08:27:11,426     Found link https://files.pythonhosted.org/packages/61/c8/3e04b8f555a598de6053bd6e07c6aa389e6801467599d166d17f984af6c0/setuptools-38.4.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.4.1
2025-08-31T08:27:11,427     Found link https://files.pythonhosted.org/packages/d7/18/ef605d86063c11555d497a5f049709d6a90c5f8232bd6748a692794c10b7/setuptools-38.4.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.4.1
2025-08-31T08:27:11,428     Found link https://files.pythonhosted.org/packages/aa/64/ea9f0f022bb9660b8a3c549754bf9105e05284ec408e93a65644522c1ecc/setuptools-38.5.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.5.0
2025-08-31T08:27:11,429     Found link https://files.pythonhosted.org/packages/1d/80/eb09090e89f658990ee8b92c41fd4f5b04b5a07ddac121b94874473c7171/setuptools-38.5.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.5.0
2025-08-31T08:27:11,430     Found link https://files.pythonhosted.org/packages/43/41/033a273f9a25cb63050a390ee8397acbc7eae2159195d85f06f17e7be45a/setuptools-38.5.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.5.1
2025-08-31T08:27:11,431     Found link https://files.pythonhosted.org/packages/6c/54/f7e9cea6897636a04e74c3954f0d8335cc38f7d01e27eec98026b049a300/setuptools-38.5.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.5.1
2025-08-31T08:27:11,432     Found link https://files.pythonhosted.org/packages/ad/dc/fcced9ec3f2561c0cbe8eb6527eef7cf4f4919a2b3a07891a36e846635af/setuptools-38.5.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.5.2
2025-08-31T08:27:11,433     Found link https://files.pythonhosted.org/packages/e0/02/2b14188e06ddf61e5b462e216b15d893e8472fca28b1b0c5d9272ad7e87c/setuptools-38.5.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.5.2
2025-08-31T08:27:11,434     Found link https://files.pythonhosted.org/packages/b2/8a/9b1fa583782c63b89d21c4bf32dfdee40fa30be1339201f0acfe3fb21510/setuptools-38.6.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.6.0
2025-08-31T08:27:11,435     Found link https://files.pythonhosted.org/packages/95/b9/7c61dcfa6953271f567a8db96f110cd8cf75e13a84c1d293649d584d2d39/setuptools-38.6.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.6.0
2025-08-31T08:27:11,436     Found link https://files.pythonhosted.org/packages/6f/91/ed40033d671744824b938d0cea41c0e35a42eded4254fe720d3226411a37/setuptools-38.6.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.6.1
2025-08-31T08:27:11,437     Found link https://files.pythonhosted.org/packages/d6/09/55f3263f7adbe1341529a47ed6dc0dfad915bc05a35a21b37da443962b67/setuptools-38.6.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.6.1
2025-08-31T08:27:11,438     Found link https://files.pythonhosted.org/packages/f3/8d/74c86edb326ee18c0ffbec9d0a97f6b5a519f6449a64d21673b29e67b8db/setuptools-38.7.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.7.0
2025-08-31T08:27:11,439     Found link https://files.pythonhosted.org/packages/0e/12/d62a8359835c4c46c883d6b80ea11f9333a8594ed45dae99aea92df2e72f/setuptools-38.7.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.7.0
2025-08-31T08:27:11,440     Found link https://files.pythonhosted.org/packages/26/57/69f35fa2ee411cfa3557efa40f776992dffb54d8edd52e03ec0be5fb3bb9/setuptools-39.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.0.0
2025-08-31T08:27:11,441     Found link https://files.pythonhosted.org/packages/47/bf/f1640538c9a329ef5459ad7093cf305767e45c5d9adcd6f97f1e43581944/setuptools-39.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.0.0
2025-08-31T08:27:11,442     Found link https://files.pythonhosted.org/packages/20/d7/04a0b689d3035143e2ff288f4b9ee4bf6ed80585cc121c90bfd85a1a8c2e/setuptools-39.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.0.1
2025-08-31T08:27:11,443     Found link https://files.pythonhosted.org/packages/72/c2/c09362ab29338413ab687b47dab03bab4a792e2bbb727a1eb5e0a88e3b86/setuptools-39.0.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.0.1
2025-08-31T08:27:11,444     Found link https://files.pythonhosted.org/packages/8c/10/79282747f9169f21c053c562a0baa21815a8c7879be97abd930dbcf862e8/setuptools-39.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.1.0
2025-08-31T08:27:11,445     Found link https://files.pythonhosted.org/packages/a6/5b/f399fcffb9128d642387133dc3aa9bb81f127b949cd4d9f63e5602ad1d71/setuptools-39.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.1.0
2025-08-31T08:27:11,446     Found link https://files.pythonhosted.org/packages/7f/e1/820d941153923aac1d49d7fc37e17b6e73bfbd2904959fffbad77900cf92/setuptools-39.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.2.0
2025-08-31T08:27:11,447     Found link https://files.pythonhosted.org/packages/1a/04/d6f1159feaccdfc508517dba1929eb93a2854de729fa68da9d5c6b48fa00/setuptools-39.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.2.0
2025-08-31T08:27:11,449     Found link https://files.pythonhosted.org/packages/ff/f4/385715ccc461885f3cedf57a41ae3c12b5fec3f35cce4c8706b1a112a133/setuptools-40.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.0.0
2025-08-31T08:27:11,450     Found link https://files.pythonhosted.org/packages/d3/3e/1d74cdcb393b68ab9ee18d78c11ae6df8447099f55fe86ee842f9c5b166c/setuptools-40.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.0.0
2025-08-31T08:27:11,451     Found link https://files.pythonhosted.org/packages/18/97/57c2a06449457449086182d8239c2261e9e63db69dceb266bc9f8212f788/setuptools-40.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.1.0
2025-08-31T08:27:11,452     Found link https://files.pythonhosted.org/packages/5a/df/b2e3d9693bb0dcbeac516a73dd7a9eb82b126ae52e4a74605a9b01beddd5/setuptools-40.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.1.0
2025-08-31T08:27:11,453     Found link https://files.pythonhosted.org/packages/72/3d/5235c1035a58a8b190607fef7814d972b5c2cf269aa15bad48535fdeea2b/setuptools-40.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.1.1
2025-08-31T08:27:11,454     Found link https://files.pythonhosted.org/packages/15/ff/8c1e022d096c201f9063a1fb836759db8e2aed3c85792560c3f92f8069ec/setuptools-40.1.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.1.1
2025-08-31T08:27:11,455     Found link https://files.pythonhosted.org/packages/66/e8/570bb5ca88a8bcd2a1db9c6246bb66615750663ffaaeada95b04ffe74e12/setuptools-40.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.2.0
2025-08-31T08:27:11,456     Found link https://files.pythonhosted.org/packages/ef/1d/201c13e353956a1c840f5d0fbf0461bd45bbd678ea4843ebf25924e8984c/setuptools-40.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.2.0
2025-08-31T08:27:11,457     Found link https://files.pythonhosted.org/packages/27/f9/0d705bb4963ee952946670f8a185d8ce3afca11084d60cf5c589622bfe6b/setuptools-40.3.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.3.0
2025-08-31T08:27:11,459     Found link https://files.pythonhosted.org/packages/80/f1/89d8a18ed758d4de4efbc56712676052b0f8a94f0d5c115d080b219f29af/setuptools-40.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.3.0
2025-08-31T08:27:11,460     Found link https://files.pythonhosted.org/packages/9f/ef/64d825524ad88c1a364126f335da89eca0d8ad9bea89313994103d182a50/setuptools-40.4.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.0
2025-08-31T08:27:11,461     Found link https://files.pythonhosted.org/packages/b0/58/10324f2e21466c2c3abebec1599121c0e38ccc1382f723d23e2fb80e25dd/setuptools-40.4.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.0
2025-08-31T08:27:11,462     Found link https://files.pythonhosted.org/packages/81/17/a6301c14aa0c0dd02938198ce911eba84602c7e927a985bf9015103655d1/setuptools-40.4.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.1
2025-08-31T08:27:11,463     Found link https://files.pythonhosted.org/packages/c3/a8/a497f2f220fd51a714d0a466a32b8ec7d71dafbb053cb490a427b5fa2a1c/setuptools-40.4.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.1
2025-08-31T08:27:11,464     Found link https://files.pythonhosted.org/packages/6e/9c/cc2eb661d85f4aa541910af1a72b834a0f5c9209079fcbd1438fa6da17c6/setuptools-40.4.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.2
2025-08-31T08:27:11,465     Found link https://files.pythonhosted.org/packages/67/76/f777f50a1303b481d575fcf2af7de336a23c88f17fb4b6e7894de6b602cd/setuptools-40.4.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.2
2025-08-31T08:27:11,466     Found link https://files.pythonhosted.org/packages/96/06/c8ee69628191285ddddffb277bd5abdf769166e7a14b867c2a172f0175b1/setuptools-40.4.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.3
2025-08-31T08:27:11,467     Found link https://files.pythonhosted.org/packages/6e/9c/6a003320b00ef237f94aa74e4ad66c57a7618f6c79d67527136e2544b728/setuptools-40.4.3.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.3
2025-08-31T08:27:11,468     Found link https://files.pythonhosted.org/packages/82/a1/ba6fb41367b375f5cb653d1317d8ca263c636cff6566e2da1b0da716069d/setuptools-40.5.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.5.0
2025-08-31T08:27:11,469     Found link https://files.pythonhosted.org/packages/26/e5/9897eee1100b166a61f91b68528cb692e8887300d9cbdaa1a349f6304b79/setuptools-40.5.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.5.0
2025-08-31T08:27:11,470     Found link https://files.pythonhosted.org/packages/18/1c/c0a1125640eab61a486ec4c7432fbf626db80cc3322c49180b07628e7689/setuptools-40.6.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.0
2025-08-31T08:27:11,471     Found link https://files.pythonhosted.org/packages/35/e8/863091ea5615f5bab19b350eccb507edaad0c56b2ca1ce3afdd311e3dc0b/setuptools-40.6.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.0
2025-08-31T08:27:11,472     Found link https://files.pythonhosted.org/packages/4b/47/1417da90ed6f4c88465d08ea2461ff41c94cc6cc223f333d130d7a99199a/setuptools-40.6.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.1
2025-08-31T08:27:11,473     Found link https://files.pythonhosted.org/packages/87/3a/d32f2aa163902b58e56921bf6977cac4ea3dc1c64be359fd800551c27f96/setuptools-40.6.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.1
2025-08-31T08:27:11,474     Found link https://files.pythonhosted.org/packages/e7/16/da8cb8046149d50940c6110310983abb359bbb8cbc3539e6bef95c29428a/setuptools-40.6.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.2
2025-08-31T08:27:11,475     Found link https://files.pythonhosted.org/packages/b0/d1/8acb42f391cba52e35b131e442e80deffbb8d0676b93261d761b1f0ef8fb/setuptools-40.6.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.2
2025-08-31T08:27:11,476     Found link https://files.pythonhosted.org/packages/37/06/754589caf971b0d2d48f151c2586f62902d93dc908e2fd9b9b9f6aa3c9dd/setuptools-40.6.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.3
2025-08-31T08:27:11,477     Found link https://files.pythonhosted.org/packages/37/1b/b25507861991beeade31473868463dad0e58b1978c209de27384ae541b0b/setuptools-40.6.3.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.3
2025-08-31T08:27:11,478     Found link https://files.pythonhosted.org/packages/5b/ac/90c7617bfc48ae1265d2c0cc46aeb0a0d482e00577008d21b64efe9a2006/setuptools-40.7.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.0
2025-08-31T08:27:11,479     Found link https://files.pythonhosted.org/packages/8e/6a/bab79e7bf3ceede6c371d93c3ffc197b54b04a1e6f631b40cd1c71d656e4/setuptools-40.7.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.0
2025-08-31T08:27:11,480     Found link https://files.pythonhosted.org/packages/bf/ae/a23db1762646069742cc21393833577d3fa438eecaa59d11fb04fa57fcd5/setuptools-40.7.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.1
2025-08-31T08:27:11,481     Found link https://files.pythonhosted.org/packages/3b/17/81a4ab4c94e9c78f98dfaad0208994129213089361dc53a7cd8de177d1e3/setuptools-40.7.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.1
2025-08-31T08:27:11,482     Found link https://files.pythonhosted.org/packages/14/43/4f6ccba67890ad39c3d5c736dd0de3b122bf252ee4e5b4ea3d900990d64d/setuptools-40.7.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.2
2025-08-31T08:27:11,483     Found link https://files.pythonhosted.org/packages/cc/5e/7c7bbbfb0323a2e58b8ba45b4e082e40e195656394f30a70a6822c8c807f/setuptools-40.7.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.2
2025-08-31T08:27:11,484     Found link https://files.pythonhosted.org/packages/82/9c/e812a9838feaf76cd9a960ca4ced3be7f2db31e473677a621d006e128db2/setuptools-40.7.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.3
2025-08-31T08:27:11,485     Found link https://files.pythonhosted.org/packages/90/86/00ab839a8647e0fee435fe77f70795865ca4534387872a6c23b22fd85ac8/setuptools-40.7.3.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.3
2025-08-31T08:27:11,486     Found link https://files.pythonhosted.org/packages/d1/6a/4b2fcefd2ea0868810e92d519dacac1ddc64a2e53ba9e3422c3b62b378a6/setuptools-40.8.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.8.0
2025-08-31T08:27:11,487     Found link https://files.pythonhosted.org/packages/c2/f7/c7b501b783e5a74cf1768bc174ee4fb0a8a6ee5af6afa92274ff964703e0/setuptools-40.8.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.8.0
2025-08-31T08:27:11,488     Found link https://files.pythonhosted.org/packages/44/56/75e64a8fbbe9e0bd30cfdd58ca1856bc0dc15a43e41504a58d8373f34213/setuptools-40.9.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.9.0
2025-08-31T08:27:11,489     Found link https://files.pythonhosted.org/packages/ca/e6/97a6ea040026f2c86abb96827990ace8cdfdfa05967fc3f7dd7461ce4b39/setuptools-40.9.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.9.0
2025-08-31T08:27:11,490     Found link https://files.pythonhosted.org/packages/c8/b0/cc6b7ba28d5fb790cf0d5946df849233e32b8872b6baca10c9e002ff5b41/setuptools-41.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.0.0
2025-08-31T08:27:11,491     Found link https://files.pythonhosted.org/packages/ed/69/c805067de1feedbb98c53174b0f2df44cc05e0e9ee73bb85eebc59e508c6/setuptools-41.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.0.0
2025-08-31T08:27:11,492     Found link https://files.pythonhosted.org/packages/ec/51/f45cea425fd5cb0b0380f5b0f048ebc1da5b417e48d304838c02d6288a1e/setuptools-41.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.0.1
2025-08-31T08:27:11,493     Found link https://files.pythonhosted.org/packages/1d/64/a18a487b4391a05b9c7f938b94a16d80305bf0369c6b0b9509e86165e1d3/setuptools-41.0.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.0.1
2025-08-31T08:27:11,494     Found link https://files.pythonhosted.org/packages/75/b3/0a106dfaf7f48aef638da80b32608617cc8de4b24a22c8cd3759c32e5d30/setuptools-41.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.1.0
2025-08-31T08:27:11,495     Found link https://files.pythonhosted.org/packages/68/0c/e470db6866aedbff3c4c88faf7f81b90343d8ff32cd68b62db1b65037fb4/setuptools-41.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.1.0
2025-08-31T08:27:11,496     Found link https://files.pythonhosted.org/packages/b2/86/095d2f7829badc207c893dd4ac767e871f6cd547145df797ea26baea4e2e/setuptools-41.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.2.0
2025-08-31T08:27:11,497     Found link https://files.pythonhosted.org/packages/d9/ca/7279974e489e8b65003fe618a1a741d6350227fa2bf48d16be76c7422423/setuptools-41.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.2.0
2025-08-31T08:27:11,498     Found link https://files.pythonhosted.org/packages/84/14/d7aefed8d7d3c9eae31c43b830421afe4640f127daee2a193f7b7e6e5c88/setuptools-41.3.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.3.0
2025-08-31T08:27:11,499     Found link https://files.pythonhosted.org/packages/cf/af/1cbf2f4c78b5f6dcc5e3f387224302bb82c44ec7a00fd2dbfc482b673456/setuptools-41.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.3.0
2025-08-31T08:27:11,501     Found link https://files.pythonhosted.org/packages/6a/9a/50fadfd53ec909e4399b67c74cc7f4e883488035cfcdb90b685758fa8b34/setuptools-41.4.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.4.0
2025-08-31T08:27:11,502     Found link https://files.pythonhosted.org/packages/f4/d5/a6c19dcbcbc267aca376558797f036d9bcdff344c9f785fe7d0fe9a5f2a7/setuptools-41.4.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.4.0
2025-08-31T08:27:11,503     Found link https://files.pythonhosted.org/packages/ea/98/9db5ebb9c33716ab8c45ee355a300facb44575b9b6d68a95fa49e81a2f04/setuptools-41.5.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.5.0
2025-08-31T08:27:11,503     Found link https://files.pythonhosted.org/packages/cb/83/055c30a0d60b12aec280e41fa3b0b316ae9d655b11ff8decfe74c4395908/setuptools-41.5.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.5.0
2025-08-31T08:27:11,504     Found link https://files.pythonhosted.org/packages/db/3c/1065553af43e5f388cb5ae96f44867470063a2d04c02551104dcb12794bd/setuptools-41.5.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.5.1
2025-08-31T08:27:11,505     Found link https://files.pythonhosted.org/packages/e7/93/ee0ad1215dc5abe6cf43c988e270504670e41e90ae6625703699d8ffe10e/setuptools-41.5.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.5.1
2025-08-31T08:27:11,506     Found link https://files.pythonhosted.org/packages/d9/de/554b6310ac87c5b921bc45634b07b11394fe63bc4cb5176f5240addf18ab/setuptools-41.6.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.6.0
2025-08-31T08:27:11,507     Found link https://files.pythonhosted.org/packages/11/0a/7f13ef5cd932a107cd4c0f3ebc9d831d9b78e1a0e8c98a098ca17b1d7d97/setuptools-41.6.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.6.0
2025-08-31T08:27:11,508     Found link https://files.pythonhosted.org/packages/61/a2/82b506a6cdb42cc79a65d5a9e790112cf6b98ee7aba4a53a2b9c9c8047d0/setuptools-42.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 42.0.0
2025-08-31T08:27:11,509     Found link https://files.pythonhosted.org/packages/ab/41/ab6ae1937191de0c9cbc115d0e91e335f268aa1cd85524c86e5970fdb68a/setuptools-42.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 42.0.0
2025-08-31T08:27:11,510     Found link https://files.pythonhosted.org/packages/9e/d5/444a443d890f09fc1ca1a2c3c9fc7e84cb148177b05ac94fe5084e3d9abb/setuptools-42.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 42.0.1
2025-08-31T08:27:11,511     Found link https://files.pythonhosted.org/packages/ce/1d/96320b9784b04943c924a9f1c6fa49124a1542039ce098a5f9a369227bad/setuptools-42.0.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 42.0.1
2025-08-31T08:27:11,512     Found link https://files.pythonhosted.org/packages/54/28/c45d8b54c1339f9644b87663945e54a8503cfef59cf0f65b3ff5dd17cf64/setuptools-42.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 42.0.2
2025-08-31T08:27:11,513     Found link https://files.pythonhosted.org/packages/f7/b6/5b98441b6749ea1db1e41e5e6e7a93cbdd7ffd45e11fe1b22d45884bc777/setuptools-42.0.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 42.0.2
2025-08-31T08:27:11,514     Found link https://files.pythonhosted.org/packages/91/af/18d58ed8a8e7e6b91d71b0367034faf8ea41e1004018811388ed07a7f2d6/setuptools-43.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 43.0.0
2025-08-31T08:27:11,515     Found link https://files.pythonhosted.org/packages/06/51/8f2aa4b85f2fb394af0d440fc9a35747a1aeab27214f6e6f7d02e3b43719/setuptools-43.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 43.0.0
2025-08-31T08:27:11,518     Found link https://files.pythonhosted.org/packages/f9/d3/955738b20d3832dfa3cd3d9b07e29a8162edb480bf988332f5e6e48ca444/setuptools-44.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 44.0.0
2025-08-31T08:27:11,518     Found link https://files.pythonhosted.org/packages/b0/f3/44da7482ac6da3f36f68e253cb04de37365b3dba9036a3c70773b778b485/setuptools-44.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 44.0.0
2025-08-31T08:27:11,519     Found link https://files.pythonhosted.org/packages/ab/b5/3679d7c98be5b65fa5522671ef437b792d909cf3908ba54fe9eca5d2a766/setuptools-44.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 44.1.0
2025-08-31T08:27:11,520     Found link https://files.pythonhosted.org/packages/ed/7b/bbf89ca71e722b7f9464ebffe4b5ee20a9e5c9a555a56e2d3914bb9119a6/setuptools-44.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 44.1.0
2025-08-31T08:27:11,521     Found link https://files.pythonhosted.org/packages/e1/b7/182161210a13158cd3ccc41ee19aadef54496b74f2817cc147006ec932b4/setuptools-44.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 44.1.1
2025-08-31T08:27:11,522     Found link https://files.pythonhosted.org/packages/b2/40/4e00501c204b457f10fe410da0c97537214b2265247bc9a5bc6edd55b9e4/setuptools-44.1.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 44.1.1
2025-08-31T08:27:11,524     Found link https://files.pythonhosted.org/packages/af/e7/02db816dc88c598281bacebbb7ccf2c9f1a6164942e88f1a0fded8643659/setuptools-45.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 45.0.0
2025-08-31T08:27:11,525     Found link https://files.pythonhosted.org/packages/fd/76/3c7f726ed5c582019937f178d7478ce62716b7e8263344f1684cbe11ab3e/setuptools-45.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 45.0.0
2025-08-31T08:27:11,526     Found link https://files.pythonhosted.org/packages/a7/c5/6c1acea1b4ea88b86b03280f3fde1efa04fefecd4e7d2af13e602661cde4/setuptools-45.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 45.1.0
2025-08-31T08:27:11,527     Found link https://files.pythonhosted.org/packages/42/3e/2464120172859e5d103e5500315fb5555b1e908c0dacc73d80d35a9480ca/setuptools-45.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 45.1.0
2025-08-31T08:27:11,528     Found link https://files.pythonhosted.org/packages/3d/72/1c1498c1e908e0562b1e1cd30012580baa7d33b5b0ffdbeb5fde2462cc71/setuptools-45.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 45.2.0
2025-08-31T08:27:11,529     Found link https://files.pythonhosted.org/packages/68/75/d1d7b7340b9eb6e0388bf95729e63c410b381eb71fe8875cdfd949d8f9ce/setuptools-45.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 45.2.0
2025-08-31T08:27:11,529     Found link https://files.pythonhosted.org/packages/0e/8e/4d9a9009afeae48ec1301713d96b9ae901aa6e157637ddf37e844c1bf4ee/setuptools-45.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 45.3.0
2025-08-31T08:27:11,530     Found link https://files.pythonhosted.org/packages/c8/1f/178e51e013f42c5e16e6f7c22ffdaea54ac9b90cd0b13b217b1aba283dc0/setuptools-45.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 45.3.0
2025-08-31T08:27:11,531     Found link https://files.pythonhosted.org/packages/70/b8/b23170ddda9f07c3444d49accde49f2b92f97bb2f2ebc312618ef12e4bd6/setuptools-46.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.0.0
2025-08-31T08:27:11,532     Found link https://files.pythonhosted.org/packages/df/ed/bea598a87a8f7e21ac5bbf464102077c7102557c07db9ff4e207bd9f7806/setuptools-46.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.0.0
2025-08-31T08:27:11,533     Found link https://files.pythonhosted.org/packages/61/8e/95c01d39bddaf26e458dd4cc6759db5540b969fb3edede77a3b7e59d2c50/setuptools-46.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.0
2025-08-31T08:27:11,534     Found link https://files.pythonhosted.org/packages/4c/73/ce6a8775eae76ca0ce8a3f5fc6d857f49be657fb36edb51ec4334d4040e9/setuptools-46.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.0
2025-08-31T08:27:11,535     Found link https://files.pythonhosted.org/packages/1e/32/69e6ce8502a12af0cdcbb8de91f1cbafd4533f84d8fe17bf712f6200f21b/setuptools-46.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.1
2025-08-31T08:27:11,536     Found link https://files.pythonhosted.org/packages/bb/e7/28d295e0b3f3ddfea42843fb8528918c84cdaf26153242fac5ca6a212622/setuptools-46.1.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.1
2025-08-31T08:27:11,537     Found link https://files.pythonhosted.org/packages/c6/ca/e912015113aa194a69c0cd4c9e46ff278a0250f35f32ddcf1f096e7c5129/setuptools-46.1.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.2
2025-08-31T08:27:11,538     Found link https://files.pythonhosted.org/packages/18/bb/40d830614e0763df2e8315777f7be6bc164b2cf252ebb00f4ef7984b5dc6/setuptools-46.1.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.2
2025-08-31T08:27:11,539     Found link https://files.pythonhosted.org/packages/a0/df/635cdb901ee4a8a42ec68e480c49f85f4c59e8816effbf57d9e6ee8b3588/setuptools-46.1.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.3
2025-08-31T08:27:11,540     Found link https://files.pythonhosted.org/packages/b5/96/af1686ea8c1e503f4a81223d4a3410e7587fd52df03083de24161d0df7d4/setuptools-46.1.3.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.3
2025-08-31T08:27:11,541     Found link https://files.pythonhosted.org/packages/73/22/156aac338c4ac8ffb1c3c6c3d4841611fdd4e40a9be7518bf5be432fd38c/setuptools-46.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.2.0
2025-08-31T08:27:11,542     Found link https://files.pythonhosted.org/packages/96/42/5939499f45c1bfd1a8f61d031d28eed988158f957fe3bec99be2f11500b4/setuptools-46.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.2.0
2025-08-31T08:27:11,543     Found link https://files.pythonhosted.org/packages/09/27/98ef5f13ca9c63d9d8601e739817839dde55baeb105a6c32fc8f24daddc2/setuptools-46.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.3.0
2025-08-31T08:27:11,544     Found link https://files.pythonhosted.org/packages/68/91/cc0107f3b8aa90968d11ea3334d89d5c63a48b31236f40a80373cc3aec74/setuptools-46.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.3.0
2025-08-31T08:27:11,545     Found link https://files.pythonhosted.org/packages/01/6c/144e693dae0596db1aa5ab12df2d364b6266afbf85acd12b10774d2de029/setuptools-46.3.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.3.1
2025-08-31T08:27:11,546     Found link https://files.pythonhosted.org/packages/23/79/1601b04682bcfd9563f8b99d7b05d72605ca174c98851ba1d2155d021e10/setuptools-46.3.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.3.1
2025-08-31T08:27:11,547     Found link https://files.pythonhosted.org/packages/2c/c5/0d38afb961f83e0d51f319f7dc166195ebabc1ea3cb20a10a77f500f7156/setuptools-46.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.4.0
2025-08-31T08:27:11,548     Found link https://files.pythonhosted.org/packages/ac/d6/0f6c0d9d0b07bbb2085e94a71aded1e137c7c9002ac54924bc1c0adf748a/setuptools-46.4.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.4.0
2025-08-31T08:27:11,549     Found link https://files.pythonhosted.org/packages/a5/d6/8b19692730c5472178365289665bd1f47fe7381ec385fc51e31fd3541404/setuptools-47.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.0.0
2025-08-31T08:27:11,550     Found link https://files.pythonhosted.org/packages/95/d1/831c69ff38445fc0399794f7aac1d2ff17feccd5933b26bfe1187007c996/setuptools-47.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.0.0
2025-08-31T08:27:11,551     Found link https://files.pythonhosted.org/packages/db/26/7a2d60129e89914f47423e5b3339f0f50ecc9ef93c0894db5490b40b90ed/setuptools-47.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.1.0
2025-08-31T08:27:11,552     Found link https://files.pythonhosted.org/packages/26/56/5cf6861a36bcaee9239f99fd92ea3c7b802b2939e5fe1eddab01f5974302/setuptools-47.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.1.0
2025-08-31T08:27:11,553     Found link https://files.pythonhosted.org/packages/95/95/f657b6e17f00c3f35b5f68b10e46c3a43af353d8856bd57bfcfb1dbb3e92/setuptools-47.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.1.1
2025-08-31T08:27:11,554     Found link https://files.pythonhosted.org/packages/25/bf/a37e89d3148221fedd4def62bb68749041d79f3840d58a7943f81a6f6c6e/setuptools-47.1.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.1.1
2025-08-31T08:27:11,555     Found link https://files.pythonhosted.org/packages/68/6c/504404be24846206811fdb52a80ecaef2e5284870f6bb9f8181ef3fe4a32/setuptools-47.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.2.0
2025-08-31T08:27:11,556     Found link https://files.pythonhosted.org/packages/76/e3/dd0c8e57feec58ab44eb6de4abb62ecc89d3b457c0c3ec240d530098454a/setuptools-47.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.2.0
2025-08-31T08:27:11,557     Found link https://files.pythonhosted.org/packages/c4/f9/15ec4639c50f54043a6d385a89447f69b3ee3601f65cc7c17ab8c178f0a6/setuptools-47.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.3.0
2025-08-31T08:27:11,557     Found link https://files.pythonhosted.org/packages/12/86/59b9683467659dcaf2729d7bbfa1d05a83ec417863bca73367e68d299281/setuptools-47.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.3.0
2025-08-31T08:27:11,559     Found link https://files.pythonhosted.org/packages/e9/93/4860cebd5ad3ff2664ad3c966490ccb46e3b88458b2095145bca11727ca4/setuptools-47.3.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.3.1
2025-08-31T08:27:11,560     Found link https://files.pythonhosted.org/packages/95/fe/2687907be1d6291a84a9b51220595a4f89d9477032c57f21e7c633465540/setuptools-47.3.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.3.1
2025-08-31T08:27:11,561     Found link https://files.pythonhosted.org/packages/90/0f/1e97de8eebf9d3c61b92202e69dbd40a8c0022ae25db5f64e0f28d501dd8/setuptools-47.3.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.3.2
2025-08-31T08:27:11,562     Found link https://files.pythonhosted.org/packages/51/16/58e24b2b9dcae0cb77b9fa6601b123a9c6a3723d9d92b58d172754eab2f2/setuptools-47.3.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.3.2
2025-08-31T08:27:11,563     Found link https://files.pythonhosted.org/packages/52/b4/2b8decca516c7139f2d262b6a0c5dcd6388d0a2d2c760c6bbc830e49347e/setuptools-48.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 48.0.0
2025-08-31T08:27:11,563     Found link https://files.pythonhosted.org/packages/b4/28/cb684152691c3ba02dd8081b084b3d846b39bed11f922f289762bdee036e/setuptools-48.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 48.0.0
2025-08-31T08:27:11,564     Found link https://files.pythonhosted.org/packages/a1/61/64936a2a178908f17ac27e733b4cdeffab618072d9f29743fd346b6fdbb0/setuptools-49.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.0.0
2025-08-31T08:27:11,565     Found link https://files.pythonhosted.org/packages/43/fa/4105deb81a75458c120a77b72cbaa3f2a37f622fbdf0364d85eb340b0521/setuptools-49.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.0.0
2025-08-31T08:27:11,566     Found link https://files.pythonhosted.org/packages/e5/d8/5c49c696141e251c0b5ff9df5e83e56f13692aad0953d97b85ee5d9bc49e/setuptools-49.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.0.1
2025-08-31T08:27:11,567     Found link https://files.pythonhosted.org/packages/16/ea/02a0713b40f3e54b4804d7f51302df62a0e0c166396eda7869c3269500d4/setuptools-49.0.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.0.1
2025-08-31T08:27:11,568     Found link https://files.pythonhosted.org/packages/41/fa/60888a1d591db07bc9c17dce2bcfb9f00ac507c0a23ecb827e76feb8f816/setuptools-49.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.0
2025-08-31T08:27:11,569     Found link https://files.pythonhosted.org/packages/8b/0f/5f135746c4d0c95fcc3c9a30ac942330bbdf092879ccaae7e3dcba6ea214/setuptools-49.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.0
2025-08-31T08:27:11,570     Found link https://files.pythonhosted.org/packages/d4/2a/4963d195f9d539d6498b3efcd179aba4cf6c259ac3cacee7a397cbe8466a/setuptools-49.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.1
2025-08-31T08:27:11,571     Found link https://files.pythonhosted.org/packages/7b/a2/dd3f48637e928459410c471fc4ef0a31c6f96e68dec25b21741170768ad6/setuptools-49.1.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.1
2025-08-31T08:27:11,572     Found link https://files.pythonhosted.org/packages/bd/a3/dfa1fe840aac5ea628155ca2341416c397496ece599b633658773295d7f0/setuptools-49.1.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.2
2025-08-31T08:27:11,573     Found link https://files.pythonhosted.org/packages/48/e2/68a7f24fbeb842546abf1d4709ec8190bcd50dc023e1ba8d7781bc574384/setuptools-49.1.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.2
2025-08-31T08:27:11,574     Found link https://files.pythonhosted.org/packages/a1/64/dcccbe676d964a05ea8f07528818ace12c5da0a74ac165bd99ad3de2b84b/setuptools-49.1.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.3
2025-08-31T08:27:11,575     Found link https://files.pythonhosted.org/packages/d0/4a/22ee76842d8ffc123d4fc48d24a623c1d206b99968fe3960039f1efc2cbc/setuptools-49.1.3.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.3
2025-08-31T08:27:11,576     Found link https://files.pythonhosted.org/packages/8e/11/9e10f1cad4518cb307b484c255cae61e97f05b82f6d536932b1714e01b47/setuptools-49.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.2.0
2025-08-31T08:27:11,577     Found link https://files.pythonhosted.org/packages/2f/8e/38259f4a44944a92068d5ff77230511a4c685604b47a81318f9e5cf2cc24/setuptools-49.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.2.0
2025-08-31T08:27:11,578     Found link https://files.pythonhosted.org/packages/ed/16/e9f5c5b86696da09298ea10c32d68ad8ea21f888e45b11aa9e615adda6c9/setuptools-49.2.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.2.1
2025-08-31T08:27:11,579     Found link https://files.pythonhosted.org/packages/4f/20/b97449e107801263cf6df2eceaeed290ee63262ac2c6f736df6964a90879/setuptools-49.2.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.2.1
2025-08-31T08:27:11,580     Found link https://files.pythonhosted.org/packages/f9/d8/89848d7f341de2d2acf18e9c9b30ee69dcf6d87f839121c0564c0cf013bc/setuptools-49.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.3.0
2025-08-31T08:27:11,581     Found link https://files.pythonhosted.org/packages/14/ca/441729af4f3d11408c880fbca98c607a02bf4e00b332331d5cfa78259827/setuptools-49.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.3.0
2025-08-31T08:27:11,582     Found link https://files.pythonhosted.org/packages/cd/86/db096edd95e839f3fe123f78ae891efe9caf0e28f0333f2e9ac584bab9fd/setuptools-49.3.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.3.1
2025-08-31T08:27:11,583     Found link https://files.pythonhosted.org/packages/02/f7/6996956ac78bee9043ad1884a9c0ec5f069d538f76631435ac52286a2190/setuptools-49.3.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.3.1
2025-08-31T08:27:11,584     Found link https://files.pythonhosted.org/packages/fd/36/9fdefefb11902ca987dbd92c0fe869ed5e2a798822bb4cea843b2a8f7571/setuptools-49.3.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.3.2
2025-08-31T08:27:11,585     Found link https://files.pythonhosted.org/packages/ed/72/046e8d3ad9da774dee020f88964b159ab24697c001c776e76a85450d699d/setuptools-49.3.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.3.2
2025-08-31T08:27:11,586     Found link https://files.pythonhosted.org/packages/5b/01/866d11f9b92e920cab4c5c8c054862c1a0226026121a82c73b3cafb6a8a8/setuptools-49.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.4.0
2025-08-31T08:27:11,587     Found link https://files.pythonhosted.org/packages/d9/d5/8c0f83909f6054a587018dc10f3feff0d9e3315b1b5d519c790996cbd724/setuptools-49.4.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.4.0
2025-08-31T08:27:11,588     Found link https://files.pythonhosted.org/packages/b3/a1/047f84b8740d63e8fab2c92c4349039d53563c2e244378a8a7b857b94cc8/setuptools-49.5.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.5.0
2025-08-31T08:27:11,589     Found link https://files.pythonhosted.org/packages/7b/86/8d6cae997e2c9fedf9f805e386df6b8308106697533a9c1620fa1ec4bebe/setuptools-49.5.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.5.0
2025-08-31T08:27:11,590     Found link https://files.pythonhosted.org/packages/c3/a9/5dc32465951cf4812e9e93b4ad2d314893c2fa6d5f66ce5c057af6e76d85/setuptools-49.6.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.6.0
2025-08-31T08:27:11,590     Found link https://files.pythonhosted.org/packages/38/cc/db23dbe4efc464c3c0111fedf7d46de8888f05b09488d610f6f8ab6e2544/setuptools-49.6.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.6.0
2025-08-31T08:27:11,591     Found link https://files.pythonhosted.org/packages/b0/8b/379494d7dbd3854aa7b85b216cb0af54edcb7fce7d086ba3e35522a713cf/setuptools-50.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.0
2025-08-31T08:27:11,592     Found link https://files.pythonhosted.org/packages/b6/af/40f3587d4ebd54cdeb8f87ad7d189618e166e8057ebefd2acd4443aa94f4/setuptools-50.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.0
2025-08-31T08:27:11,593     Found link https://files.pythonhosted.org/packages/a3/7c/771a47323293921f9b08cd89f759a1230b460c9e40dd6af3c5462134c870/setuptools-50.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.1
2025-08-31T08:27:11,594     Found link https://files.pythonhosted.org/packages/3d/92/d5c1de1a3e9fdbe96fc92691baa20af301bc5ba4565d8057efb27bac565b/setuptools-50.0.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.1
2025-08-31T08:27:11,595     Found link https://files.pythonhosted.org/packages/4e/f4/725ac80eb45f46f971463d61fe0324ec6dce5da87bbe9dbf2e1294d5d410/setuptools-50.0.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.2
2025-08-31T08:27:11,596     Found link https://files.pythonhosted.org/packages/4e/55/6b55971ab84e9c4327e099e48fa38d116f64e1388e6a2cc08af240f9ad0c/setuptools-50.0.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.2
2025-08-31T08:27:11,597     Found link https://files.pythonhosted.org/packages/6d/ed/52e05469314a266f68d9f251a8c1ab7a21a03327b1724056e3eea654bfd1/setuptools-50.0.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.3
2025-08-31T08:27:11,598     Found link https://files.pythonhosted.org/packages/5f/6c/b965a61c73f49eec24fbd9494b3e6933aa92f4997f8ec7d201870f260bbf/setuptools-50.0.3.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.3
2025-08-31T08:27:11,599     Found link https://files.pythonhosted.org/packages/35/f7/f86e670ebd628f447845798aa3b6a1b6da235941a1591d664d718aac171c/setuptools-50.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.1.0
2025-08-31T08:27:11,600     Found link https://files.pythonhosted.org/packages/fd/53/a626e098cbbc443a5bba1e0f780d1fe97115218a8f5d1e2df6bfa1f47a31/setuptools-50.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.1.0
2025-08-31T08:27:11,601     Found link https://files.pythonhosted.org/packages/7d/53/cd47a7799c5e82de7e408fecd72266dcc6cd7be32629b6022d4d6d91a2fc/setuptools-50.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.2.0
2025-08-31T08:27:11,602     Found link https://files.pythonhosted.org/packages/02/49/3f7a2c9617e73107d38c7be98d953f39e46a1813d2113786da30511eddfc/setuptools-50.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.2.0
2025-08-31T08:27:11,603     Found link https://files.pythonhosted.org/packages/44/a6/7fb6e8b3f4a6051e72e4e2218889351f0ee484b9ee17e995f5ccff780300/setuptools-50.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.3.0
2025-08-31T08:27:11,604     Found link https://files.pythonhosted.org/packages/7c/1b/9b68465658cda69f33c31c4dbd511ac5648835680ea8de87ce05c81f95bf/setuptools-50.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.3.0
2025-08-31T08:27:11,605     Found link https://files.pythonhosted.org/packages/37/80/f13112921d93c656edaafeb344ff2969515e349351485274bca7d129d8ef/setuptools-50.3.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.3.1
2025-08-31T08:27:11,606     Found link https://files.pythonhosted.org/packages/ed/a9/891c9d088b353df30e315b66ba2b0594785f96433e3205b3eecace89a528/setuptools-50.3.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.3.1
2025-08-31T08:27:11,607     Found link https://files.pythonhosted.org/packages/6d/38/c21ef5034684ffc0412deefbb07d66678332290c14bb5269c85145fbd55e/setuptools-50.3.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.3.2
2025-08-31T08:27:11,608     Found link https://files.pythonhosted.org/packages/a7/e0/30642b9c2df516506d40b563b0cbd080c49c6b3f11a70b4c7a670f13a78b/setuptools-50.3.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.3.2
2025-08-31T08:27:11,609     Found link https://files.pythonhosted.org/packages/3d/f2/1489d3b6c72d68bf79cd0fba6b6c7497df4ebf7d40970e2d7eceb8d0ea9c/setuptools-51.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.0.0
2025-08-31T08:27:11,610     Found link https://files.pythonhosted.org/packages/12/e1/b9a2926a3c5a3fb055b8f85052f5baa890106a0e21b64a977c10affea751/setuptools-51.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.0.0
2025-08-31T08:27:11,611     Found link https://files.pythonhosted.org/packages/ce/3c/096ac70aeb74485a2e7ab6f8146ea41cb4cecd955fdb2f30d51b51d7d146/setuptools-51.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.0
2025-08-31T08:27:11,612     Found link https://files.pythonhosted.org/packages/ea/81/a7428efddb7bac2db7969cc02c94d89f57a98acdc0b6f760c7e123234ab5/setuptools-51.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.0
2025-08-31T08:27:11,613     Found link https://files.pythonhosted.org/packages/6e/77/e921ae5c370698762cf645797f42e6d4d7e679f705a8a9697234591808aa/setuptools-51.1.0.post20201221-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.0.post20201221
2025-08-31T08:27:11,614     Found link https://files.pythonhosted.org/packages/dc/10/903b6f02c98789b1341c9ba61f72ca2d37340f79239e8e8fe2cc9d79c2d7/setuptools-51.1.0.post20201221.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.0.post20201221
2025-08-31T08:27:11,615     Found link https://files.pythonhosted.org/packages/34/b6/33396512781ec5c40de2e70e8a68f2d0c4d91d6cc182410788c34a00002d/setuptools-51.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.1
2025-08-31T08:27:11,616     Found link https://files.pythonhosted.org/packages/94/23/e9e3d96500c063129a19feb854efbb01e6ffe7d913f1da8176692418ab8e/setuptools-51.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.1
2025-08-31T08:27:11,617     Found link https://files.pythonhosted.org/packages/aa/d4/0089d680a610c7b5afda26c1ae588eb363b9050ccf5f33a8c2d1164210f3/setuptools-51.1.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.2
2025-08-31T08:27:11,618     Found link https://files.pythonhosted.org/packages/82/2f/ef7afd98530d07c89deffec833b4b1a91a27a5db6d9f1a216599f5f0316e/setuptools-51.1.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.2
2025-08-31T08:27:11,619     Found link https://files.pythonhosted.org/packages/84/ad/45704c4b41308d54919d86835c3e2e8f77d0aefcb2cb20595ea41768431b/setuptools-51.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.2.0
2025-08-31T08:27:11,620     Found link https://files.pythonhosted.org/packages/d5/20/6c6898eb8d9e126bacce98822f40b21d36041fedbdd5dd6628ed7fb91cdd/setuptools-51.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.2.0
2025-08-31T08:27:11,621     Found link https://files.pythonhosted.org/packages/4e/e2/2d6d2bce8df4d5cd910ffb5aa41e8fc1feb9862bca7b0bfa252edb9165a8/setuptools-51.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.0
2025-08-31T08:27:11,622     Found link https://files.pythonhosted.org/packages/1a/8c/aee547aa130015cf87891f539d282823f1a00d4961d99b572f962d2fa40c/setuptools-51.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.0
2025-08-31T08:27:11,623     Found link https://files.pythonhosted.org/packages/66/6b/8a8a77498a6da8d78613cc4df7198736cca29a5b444eb551a64ccc72b4d6/setuptools-51.3.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.1
2025-08-31T08:27:11,623     Found link https://files.pythonhosted.org/packages/d5/14/f907bda525861b0b43105d55828b1efc04051ccd6efff612e5ce8c75bd6f/setuptools-51.3.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.1
2025-08-31T08:27:11,624     Found link https://files.pythonhosted.org/packages/6c/8e/0b3e3b7188c39757167790a4d0c5cc7fddc0626071dab3bb9e9f9f1c550e/setuptools-51.3.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.2
2025-08-31T08:27:11,625     Found link https://files.pythonhosted.org/packages/5e/39/976717079fbbb86d2633df45aa70577ec28bd74efbf8ec62d4602a2ab5bc/setuptools-51.3.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.2
2025-08-31T08:27:11,626     Found link https://files.pythonhosted.org/packages/b2/81/509db0082c0d2ca2af307c6652ea422865de1f83c14b1e1f3549e415cfac/setuptools-51.3.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.3
2025-08-31T08:27:11,627     Found link https://files.pythonhosted.org/packages/96/66/1138b7ec901e86139c07900ce906c2f1e5c3400ee1cfd1e7ab3c776248c9/setuptools-51.3.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.3
2025-08-31T08:27:11,628     Found link https://files.pythonhosted.org/packages/f7/30/f963996d7efea5a336455a3c727711469280c318e2711e295007dea04d7e/setuptools-52.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 52.0.0
2025-08-31T08:27:11,629     Found link https://files.pythonhosted.org/packages/84/48/5c99d8770fd0a9eb0f82654c3294aad6d0ba9f8600638c2e2ad74f2c5d52/setuptools-52.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 52.0.0
2025-08-31T08:27:11,630     Found link https://files.pythonhosted.org/packages/15/0e/255e3d57965f318973e417d5b7034223f1223de500d91b945ddfaef42a37/setuptools-53.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 53.0.0
2025-08-31T08:27:11,631     Found link https://files.pythonhosted.org/packages/12/68/95515eaff788370246dac534830ea9ccb0758e921ac9e9041996026ecaf2/setuptools-53.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 53.0.0
2025-08-31T08:27:11,632     Found link https://files.pythonhosted.org/packages/4e/ca/0456249eead852a957d306feb0cce454b823cbc3bea7821971febfa45f99/setuptools-53.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 53.1.0
2025-08-31T08:27:11,633     Found link https://files.pythonhosted.org/packages/8f/6b/0dcf95d95086ce459152e4c0ac306f2dbbcf984177a2b8b77b320ebfbf22/setuptools-53.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 53.1.0
2025-08-31T08:27:11,634     Found link https://files.pythonhosted.org/packages/70/06/849cc805ac6332210083f2114a95b22ee252ce81ed4e1be4f1d2b87c9108/setuptools-54.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.0.0
2025-08-31T08:27:11,635     Found link https://files.pythonhosted.org/packages/0b/bb/a212bcfd147edcbca13ba95691411d7843bfeeb5165857abf4e9a0822e99/setuptools-54.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.0.0
2025-08-31T08:27:11,636     Found link https://files.pythonhosted.org/packages/ae/4d/153a2cfab2ea03d4f4aee45d9badb52426db9e2275edfb4b825c5dc55a10/setuptools-54.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.0
2025-08-31T08:27:11,637     Found link https://files.pythonhosted.org/packages/f6/1c/1a76007a43500cbd118b126107e88fbfd59bbcdef276ade5175f7698e618/setuptools-54.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.0
2025-08-31T08:27:11,638     Found link https://files.pythonhosted.org/packages/60/6a/dd9533ae9367a1f35b1b704e2ac9554a61e6dfa4d97e1d86c3760e1e135d/setuptools-54.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.1
2025-08-31T08:27:11,639     Found link https://files.pythonhosted.org/packages/18/c0/36f3e535bf1fef10a8f0f6fbf5ea5f2a39e0a24b4b308058fc78af5237c5/setuptools-54.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.1
2025-08-31T08:27:11,640     Found link https://files.pythonhosted.org/packages/0c/12/18eda60a1b961e0248e1b1e3ec1ff417420596dc7edf3614ef58a7a8cf6a/setuptools-54.1.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.2
2025-08-31T08:27:11,641     Found link https://files.pythonhosted.org/packages/b8/d3/155ebd29b6e34ac283614d3a1e7f476ffb93f535aa0d8b3647fa014815aa/setuptools-54.1.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.2
2025-08-31T08:27:11,642     Found link https://files.pythonhosted.org/packages/0c/2a/a9a614415328b9ecadca58b8038c51988dd963a4c5dba6ebcadbc3b45f3c/setuptools-54.1.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.3
2025-08-31T08:27:11,643     Found link https://files.pythonhosted.org/packages/c4/b3/09e030ab858b2c59b79794280307ba0dc566bfa44eb56b8f4e54d78ac3d6/setuptools-54.1.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.3
2025-08-31T08:27:11,644     Found link https://files.pythonhosted.org/packages/9e/d4/b99a960314121a003e9f39c61dfde01a1010bb47661e193a7722f7f32d52/setuptools-54.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.2.0
2025-08-31T08:27:11,645     Found link https://files.pythonhosted.org/packages/94/75/05e1d69c61c4dfaf65ad12785cd18bedc1e0129976c55914d6aea59c7da8/setuptools-54.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.2.0
2025-08-31T08:27:11,646     Found link https://files.pythonhosted.org/packages/ae/42/2876a3a136f8bfa9bd703518441c8db78ff1eeaddf174baa85c083c1fd15/setuptools-56.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 56.0.0
2025-08-31T08:27:11,646     Found link https://files.pythonhosted.org/packages/f6/e9/19af16328705915233299f6f1f02db95899fb00c75ac9da4757aa1e5d1de/setuptools-56.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 56.0.0
2025-08-31T08:27:11,648     Found link https://files.pythonhosted.org/packages/11/1b/7012b145cb228aed20f9b2b8b259df49e7963d900799ea44791f54d06ab9/setuptools-56.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 56.1.0
2025-08-31T08:27:11,648     Found link https://files.pythonhosted.org/packages/71/a0/96ab4813ede181fa6c5d01c951dbf156b7d126f7589d0efa3f7861ce7a67/setuptools-56.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 56.1.0
2025-08-31T08:27:11,649     Found link https://files.pythonhosted.org/packages/d0/15/5041473f5d142ee93bf1593deb8f932e27a078f6f04e2020cf44044f72c5/setuptools-56.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 56.2.0
2025-08-31T08:27:11,650     Found link https://files.pythonhosted.org/packages/fc/0a/b486efab52f8ad03c3eca0c998dd3deafba0c39b29e0c49c68a7152c8b2d/setuptools-56.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 56.2.0
2025-08-31T08:27:11,651     Found link https://files.pythonhosted.org/packages/4e/78/56aa1b5f4d8ac548755ae767d84f0be54fdd9d404197a3d9e4659d272348/setuptools-57.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.0.0
2025-08-31T08:27:11,652     Found link https://files.pythonhosted.org/packages/88/fc/d17731c0cc67a5a8e385e4f47c3b0b186720e198b70f076ccb4676804a8f/setuptools-57.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.0.0
2025-08-31T08:27:11,653     Found link https://files.pythonhosted.org/packages/a2/e1/902fbc2f61ad6243cd3d57ffa195a9eb123021ec912ec5d811acf54a39f8/setuptools-57.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.1.0
2025-08-31T08:27:11,654     Found link https://files.pythonhosted.org/packages/cf/79/1a19c2f792da00cbead7b6caa176afdddf517522cb9163ce39576025b050/setuptools-57.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.1.0
2025-08-31T08:27:11,655     Found link https://files.pythonhosted.org/packages/47/32/fc8e244a008617adae684dafd28e24c61f4f7f19e9e40e915be72bdd0549/setuptools-57.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.2.0
2025-08-31T08:27:11,656     Found link https://files.pythonhosted.org/packages/1d/32/94680de1e9153e4fd9d15f82a919c732a046a851b2ccd0c5b05f4ece346b/setuptools-57.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.2.0
2025-08-31T08:27:11,657     Found link https://files.pythonhosted.org/packages/b8/62/fef49ecfb5b59e8138042056b2ebd7ed876bd7ff954d189739a431d01880/setuptools-57.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.3.0
2025-08-31T08:27:11,658     Found link https://files.pythonhosted.org/packages/9a/79/2b62dc9b272c8c28c0b67b0d49e75914d1e52a7b9b2ab46e61fa2396f606/setuptools-57.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.3.0
2025-08-31T08:27:11,659     Found link https://files.pythonhosted.org/packages/bd/25/5bdf7f1adeebd4e3fa76b2e2f045ae53ee208e40a4231ad0f0c3007e4353/setuptools-57.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.4.0
2025-08-31T08:27:11,660     Found link https://files.pythonhosted.org/packages/db/e2/c0ced9ccffb61432305665c22842ea120c0f649eec47ecf2a45c596707c4/setuptools-57.4.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.4.0
2025-08-31T08:27:11,661     Found link https://files.pythonhosted.org/packages/4b/b9/71687c5d2034c863db1db2e0704f5e27581ff3cb44d7f293968c5e08ceb3/setuptools-57.5.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.5.0
2025-08-31T08:27:11,662     Found link https://files.pythonhosted.org/packages/20/f7/205a71cc9cc68f23afd9f3083002d0fb0a8c2277baf41a528395552e13c0/setuptools-57.5.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.5.0
2025-08-31T08:27:11,663     Found link https://files.pythonhosted.org/packages/57/5a/80fd2846d0151aa81a13540afc97be49f8fa19752933172b76854ba90adc/setuptools-58.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.0
2025-08-31T08:27:11,664     Found link https://files.pythonhosted.org/packages/00/59/5a302942bd2e36194cc37a408989a87d6423e000859713dc3dd440c9dbae/setuptools-58.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.0
2025-08-31T08:27:11,665     Found link https://files.pythonhosted.org/packages/fe/06/4337a1a8067618fbd40f294117edb8960920eff3e31b9cc5e9de2602ff13/setuptools-58.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.1
2025-08-31T08:27:11,666     Found link https://files.pythonhosted.org/packages/c1/e5/8a450f10613b93bd53d59e11d8fe9d9b654b56a87282fd23311be5d19499/setuptools-58.0.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.1
2025-08-31T08:27:11,667     Found link https://files.pythonhosted.org/packages/56/0f/52135ff086dd42b10636a205170f50a0a8dcd0d648835abdd3a8c0bc06ac/setuptools-58.0.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.2
2025-08-31T08:27:11,668     Found link https://files.pythonhosted.org/packages/11/c6/9e16df5a5526f7dd2ad17284928e36fc341305fe74c7ab06bb5960a5da94/setuptools-58.0.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.2
2025-08-31T08:27:11,669     Found link https://files.pythonhosted.org/packages/37/72/18182298997d20e333d4bae0bead740add1b09ca99200eae65a73d9aa732/setuptools-58.0.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.3
2025-08-31T08:27:11,670     Found link https://files.pythonhosted.org/packages/6d/f2/85d487d516e7319fad8052a6bb4a4447244e59f830d17515fb40d3141072/setuptools-58.0.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.3
2025-08-31T08:27:11,671     Found link https://files.pythonhosted.org/packages/c4/c1/aed7dfedb18ea73d7713bf6ca034ab001a6425be49ffa7e79bbd5999f677/setuptools-58.0.4-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.4
2025-08-31T08:27:11,672     Found link https://files.pythonhosted.org/packages/9a/74/de4d8c69466b6413b1616048b39f8b73d65f98c15f6202b68ccfc9550f1f/setuptools-58.0.4.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.4
2025-08-31T08:27:11,673     Found link https://files.pythonhosted.org/packages/4e/2e/f8e006dbaaa46ed1e762c287585b92476deb8d3ccb79b720ed3b86bc6113/setuptools-58.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.1.0
2025-08-31T08:27:11,674     Found link https://files.pythonhosted.org/packages/59/b8/adeb445fa6c636f78c532f0dd6f847f0f90e709afa7d41396181d438be5a/setuptools-58.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.1.0
2025-08-31T08:27:11,675     Found link https://files.pythonhosted.org/packages/41/f4/a7ca4859317232b1efb64a826b8d2d7299bb77fb60bdb08e2bd1d61cf80d/setuptools-58.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.2.0
2025-08-31T08:27:11,676     Found link https://files.pythonhosted.org/packages/1e/5c/3d7b3d91a86d71faf5038c5d259ed36b5d05b7804648e2c43251d574a6e6/setuptools-58.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.2.0
2025-08-31T08:27:11,677     Found link https://files.pythonhosted.org/packages/46/a5/1949127a03a85aebf06ee809249239929d9ca7b2b6e90f236c52e17fc713/setuptools-58.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.3.0
2025-08-31T08:27:11,678     Found link https://files.pythonhosted.org/packages/80/98/8de0fd3e86d8286a2594e3fa6afc46d751130d26ebb7b1f34e9067992c6f/setuptools-58.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.3.0
2025-08-31T08:27:11,679     Found link https://files.pythonhosted.org/packages/a8/50/76fb9cfe521b531feecd932ab920cd6e32f6838527af7b34ef78d5f39a18/setuptools-58.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.4.0
2025-08-31T08:27:11,680     Found link https://files.pythonhosted.org/packages/02/b5/456e90af3712ca1b25c60ed74d0facb8b65cbaaa42cdceedf3b210580eef/setuptools-58.4.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.4.0
2025-08-31T08:27:11,681     Found link https://files.pythonhosted.org/packages/23/f9/c2aae8baddb100e01867c6ce27f4f1be3e57106e02c5f97550157826d437/setuptools-58.5.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.0
2025-08-31T08:27:11,681     Found link https://files.pythonhosted.org/packages/b1/91/b5daf855a39d4a803679124ca888b01ecfcd8beca7bb638072affd9dfa2d/setuptools-58.5.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.0
2025-08-31T08:27:11,682     Found link https://files.pythonhosted.org/packages/5f/9b/2220f81413d5a61d8b569bb0fedcb3a535105703a2a1b2d2bb1e967a8a42/setuptools-58.5.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.1
2025-08-31T08:27:11,683     Found link https://files.pythonhosted.org/packages/cb/c3/c2854129ab277d98b5dd3dae2163c5391928f0274840bef3df6379af852b/setuptools-58.5.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.1
2025-08-31T08:27:11,684     Found link https://files.pythonhosted.org/packages/83/0d/126a3f26770437a3755c383c9ffd43f1175fd03ce2d9b508ced58178c80d/setuptools-58.5.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.2
2025-08-31T08:27:11,685     Found link https://files.pythonhosted.org/packages/1d/d3/4e7e22c2e6f1cd7c31d78f573e44a83b45c013001c17ca53859d01155513/setuptools-58.5.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.2
2025-08-31T08:27:11,686     Found link https://files.pythonhosted.org/packages/70/e9/84e2865fddfaba4506bc5d293d2a535bf27e31b12ca16d31564f8ce28cdb/setuptools-58.5.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.3
2025-08-31T08:27:11,687     Found link https://files.pythonhosted.org/packages/1e/00/05f51ceab8d3b9be4295000d8be4c830c53e5477755888994e9825606cd9/setuptools-58.5.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.3
2025-08-31T08:27:11,688     Found link https://files.pythonhosted.org/packages/7e/73/83bce9ecff7270cc00dc145f1542078fb5cb5ffc5f8587d7f2fc51aad7af/setuptools-59.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.0.1
2025-08-31T08:27:11,689     Found link https://files.pythonhosted.org/packages/cd/9a/6fff2cee92de1d34c0e8d48bb2ccedb0899eebb2cfe7955584b53bdaded7/setuptools-59.0.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.0.1
2025-08-31T08:27:11,690     Found link https://files.pythonhosted.org/packages/9d/d2/182e27182d7f61274787e5f0a737f06ad6ad35f27e6b60fed6b8de23b6f5/setuptools-59.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.1.0
2025-08-31T08:27:11,691     Found link https://files.pythonhosted.org/packages/07/88/717b307b2c7833fb8d13457f6bc6a2b368070c9cfec3abbbab7693537776/setuptools-59.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.1.0
2025-08-31T08:27:11,692     Found link https://files.pythonhosted.org/packages/ed/60/15ee37d6d3385e6a432d39b5ac51f8467178ad989ba50f2b55681c1a038e/setuptools-59.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.1.1
2025-08-31T08:27:11,693     Found link https://files.pythonhosted.org/packages/33/68/e72f8c047e7f25b20c9df02163d925dc734bbee46597018e122a2bce9d3e/setuptools-59.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.1.1
2025-08-31T08:27:11,694     Found link https://files.pythonhosted.org/packages/18/ad/ec41343a49a0371ea40daf37b1ba2c11333cdd121cb378161635d14b9750/setuptools-59.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.2.0
2025-08-31T08:27:11,695     Found link https://files.pythonhosted.org/packages/a8/e7/1440b0d19054a5616e9e5beeaa22f68485aa9de20d187f04e52880b7ae7a/setuptools-59.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.2.0
2025-08-31T08:27:11,696     Found link https://files.pythonhosted.org/packages/29/e3/a1edb6bef52fd8d4cbe62cf2b6b444e7145edf89fae7ce9bffbfb92ae8b9/setuptools-59.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.3.0
2025-08-31T08:27:11,697     Found link https://files.pythonhosted.org/packages/14/f7/c064250ee08ab28cb6f55f09311ea0a1b05ac837eb7b51363ef1733c9168/setuptools-59.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.3.0
2025-08-31T08:27:11,698     Found link https://files.pythonhosted.org/packages/6f/ea/e12311dabc63a6a434be25e6011c1513cc95d0cf22e5f13036f75b3ec508/setuptools-59.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.4.0
2025-08-31T08:27:11,699     Found link https://files.pythonhosted.org/packages/6e/41/853fda5af9b4c336965ebcaf10009d3ede674a010961ec80afaf17519247/setuptools-59.4.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.4.0
2025-08-31T08:27:11,700     Found link https://files.pythonhosted.org/packages/40/a9/7deac76c58fa47c95360116a06b53b9b62f6db11336fe61b6ab53784d98b/setuptools-59.5.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.5.0
2025-08-31T08:27:11,701     Found link https://files.pythonhosted.org/packages/e6/e2/f2bfdf364e016f7a464db709ea40d1101c4c5a463dd7019dae0a42dbd1c6/setuptools-59.5.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.5.0
2025-08-31T08:27:11,702     Found link https://files.pythonhosted.org/packages/b0/3a/88b210db68e56854d0bcf4b38e165e03be377e13907746f825790f3df5bf/setuptools-59.6.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.6.0
2025-08-31T08:27:11,702     Found link https://files.pythonhosted.org/packages/6a/fa/5ec0fa9095c9b72cb1c31a8175c4c6745bf5927d1045d7a70df35d54944f/setuptools-59.6.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.6.0
2025-08-31T08:27:11,704     Found link https://files.pythonhosted.org/packages/4f/27/b51cc9cebfd53b168b8a187c844e7a67dc523dda76be9b46d532815df284/setuptools-59.7.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 59.7.0
2025-08-31T08:27:11,705     Found link https://files.pythonhosted.org/packages/99/61/f3b6c920f0e187368f4eeb57a7255afb428926beefba33f05f16214e66bb/setuptools-59.7.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 59.7.0
2025-08-31T08:27:11,706     Found link https://files.pythonhosted.org/packages/8d/25/88b377b99ffb4ad0fc44ff5735fd6be605b2183f743d1ff5c10b7790cea5/setuptools-59.8.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 59.8.0
2025-08-31T08:27:11,707     Found link https://files.pythonhosted.org/packages/ef/75/2bc7bef4d668f9caa9c6ed3f3187989922765403198243040d08d2a52725/setuptools-59.8.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 59.8.0
2025-08-31T08:27:11,708     Found link https://files.pythonhosted.org/packages/f9/73/a1e8254ee8604a7f8598f5b7c09d587b329ad2727f410a210f26c9595b7a/setuptools-60.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.0
2025-08-31T08:27:11,709     Found link https://files.pythonhosted.org/packages/57/e8/675eabec05702d8f3cddff494a4bb8c9cdb9e76d295705377b1eb73bfadf/setuptools-60.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.0
2025-08-31T08:27:11,710     Found link https://files.pythonhosted.org/packages/c1/b1/f775e1cce396e9e6905fc61af075f5b4110376306ed92e6dc1a4b79c91af/setuptools-60.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.1
2025-08-31T08:27:11,711     Found link https://files.pythonhosted.org/packages/6a/ee/0b2929a264a9a967d43321ca44c2ee27dfcc7c6b79a98d3f929433a97e62/setuptools-60.0.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.1
2025-08-31T08:27:11,712     Found link https://files.pythonhosted.org/packages/8a/ff/593e863da0712038adb7272172bb2d3ae61b1350094fee9d875674bd9ffd/setuptools-60.0.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.2
2025-08-31T08:27:11,713     Found link https://files.pythonhosted.org/packages/52/a6/f3ba38bb9994ab8bdbe9164b94ddb4d751ef3ca648ddbcccbff205cc6914/setuptools-60.0.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.2
2025-08-31T08:27:11,714     Found link https://files.pythonhosted.org/packages/df/0d/706cb6888df0dfe7f5a3dc4b1b8c39b949386ef28e66cd989d6d5c16b8ca/setuptools-60.0.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.3
2025-08-31T08:27:11,714     Found link https://files.pythonhosted.org/packages/7f/0c/df74ee211715db60b333eaa7bf1793b1b21c777ce53295a45a98b9b1a0fe/setuptools-60.0.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.3
2025-08-31T08:27:11,715     Found link https://files.pythonhosted.org/packages/4f/e6/8502336aa2f185b1d9ca56f2fb5048e138c2322262aa45c09c3b5b40012e/setuptools-60.0.4-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.4
2025-08-31T08:27:11,716     Found link https://files.pythonhosted.org/packages/3d/52/abcfab4e0f6dcf6b92df7559dce488eac4e3c82f01b82dfb3ac65c18379b/setuptools-60.0.4.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.4
2025-08-31T08:27:11,717     Found link https://files.pythonhosted.org/packages/ff/27/92a1a57aff92dac23df4a6867be19e29449f52fb05e17de9b1d64e61ebe1/setuptools-60.0.5-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.5
2025-08-31T08:27:11,718     Found link https://files.pythonhosted.org/packages/05/ab/69076a67f4f0588838e3afa2adeea837ca58ffc39977a77038ff373d2b3d/setuptools-60.0.5.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.5
2025-08-31T08:27:11,719     Found link https://files.pythonhosted.org/packages/75/cd/178028262e067ed10011779e8de4c12821de3dc1598de42920988ebd412d/setuptools-60.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.1.0
2025-08-31T08:27:11,720     Found link https://files.pythonhosted.org/packages/80/d3/2954b9ac8ad256f352d941453c44d2d2b219aafeb95277e9282bef606329/setuptools-60.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.1.0
2025-08-31T08:27:11,721     Found link https://files.pythonhosted.org/packages/d3/6b/9ba419f861fef1eb624f77fcb2c081ccac6f11e363bcf47bee6a4d2d5e0d/setuptools-60.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.1.1
2025-08-31T08:27:11,722     Found link https://files.pythonhosted.org/packages/15/8f/cf533796488c53b4824be97b79b86ac161bcc011af9613bec6027f52e78d/setuptools-60.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.1.1
2025-08-31T08:27:11,723     Found link https://files.pythonhosted.org/packages/8e/16/8f64922c8d7cd7ec193b145c9b11ad281064ff8604452ba19a6d5bbd7ed9/setuptools-60.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.2.0
2025-08-31T08:27:11,724     Found link https://files.pythonhosted.org/packages/9b/be/13f54335c7dba713b0e97e11e7a41db3df4a85073d6c5a6e7f6468b22ee2/setuptools-60.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.2.0
2025-08-31T08:27:11,725     Found link https://files.pythonhosted.org/packages/eb/0a/d86dd882b2087570ab9cb86c67e720e1bef7532597b467c2909b3930af3c/setuptools-60.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.3.0
2025-08-31T08:27:11,726     Found link https://files.pythonhosted.org/packages/af/34/508a2cc1af07a20ec7542f489734917d15ccaddb67fa09358ea34a4d749b/setuptools-60.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.3.0
2025-08-31T08:27:11,727     Found link https://files.pythonhosted.org/packages/04/e0/2fb461b22be560d2a1f630346bfafde0029205484ccfc4f1046e79f599a3/setuptools-60.3.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.3.1
2025-08-31T08:27:11,728     Found link https://files.pythonhosted.org/packages/d9/15/0c48951d6fe38d7b3396401f2cfc43c86bc32408ed6c637ce1a9c6df1bdd/setuptools-60.3.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.3.1
2025-08-31T08:27:11,729     Found link https://files.pythonhosted.org/packages/95/85/1a132ab9f13bbdaba34144ce47e106539ce5480b795f68b7bad2321b56e4/setuptools-60.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.4.0
2025-08-31T08:27:11,730     Found link https://files.pythonhosted.org/packages/b0/4a/bdfc4b6309af6b0a69066bae6e10fd77848a423b173432babf5f11a079eb/setuptools-60.4.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.4.0
2025-08-31T08:27:11,731     Found link https://files.pythonhosted.org/packages/eb/53/0dd4c7960579da8be13fa9b2c2591643d37f323e3d79f8bc8b1b6c8e6217/setuptools-60.5.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.5.0
2025-08-31T08:27:11,732     Found link https://files.pythonhosted.org/packages/69/77/aee1ecacea4d0db740046ce1785e81d16c4b1755af50eceac4ca1a1f8bfd/setuptools-60.5.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.5.0
2025-08-31T08:27:11,733     Found link https://files.pythonhosted.org/packages/11/b9/adac241e2c4aca7ae4ddd86d3c18227667665b6e7eac550695bfc50c7e3d/setuptools-60.6.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.6.0
2025-08-31T08:27:11,734     Found link https://files.pythonhosted.org/packages/8f/89/9fec81ec84737c925a1ee992af2c6c7153aec4051c26afeadd6b822354d2/setuptools-60.6.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.6.0
2025-08-31T08:27:11,735     Found link https://files.pythonhosted.org/packages/fa/cb/25e80b7edc9e2d0d49b3c05ee8992220978591290d88d71c595cf1e7d3ad/setuptools-60.7.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.7.0
2025-08-31T08:27:11,736     Found link https://files.pythonhosted.org/packages/29/dd/48d662bb93e5e51e72265ef612f869947d4ae4126328d7156824cd50d440/setuptools-60.7.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.7.0
2025-08-31T08:27:11,737     Found link https://files.pythonhosted.org/packages/3d/93/903f1a10b3c4651d363b559acc4017b05f082b8461928d0b842a8b5d182a/setuptools-60.7.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.7.1
2025-08-31T08:27:11,737     Found link https://files.pythonhosted.org/packages/1b/78/c0316b86d692e3c7f0905bc5506292e2d8ee810d188544c48865a0335c2c/setuptools-60.7.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.7.1
2025-08-31T08:27:11,739     Found link https://files.pythonhosted.org/packages/c2/14/69df4fd998811fd41c74fab6584ad8576524c87c4da1028a759da655eb39/setuptools-60.8.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.8.0
2025-08-31T08:27:11,740     Found link https://files.pythonhosted.org/packages/d3/a6/ae5e0a6ea3592af875c838c00decb00f1e6f2d0a3bf7604a8cb797eed767/setuptools-60.8.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.8.0
2025-08-31T08:27:11,741     Found link https://files.pythonhosted.org/packages/2d/5c/e09f0ce3961663aa323508440796d64f3ca6a874470be76bb2b59acbb26b/setuptools-60.8.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.8.1
2025-08-31T08:27:11,741     Found link https://files.pythonhosted.org/packages/56/4a/8ba3babea25b807d6f65258437d8d3bed6a820e4a7166f322ebb60d2d127/setuptools-60.8.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.8.1
2025-08-31T08:27:11,742     Found link https://files.pythonhosted.org/packages/ad/65/7b98718c0ecebbdae5a5251fffc43dd3800ff3d1a6f7cc1aa09cfbcf17a5/setuptools-60.8.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.8.2
2025-08-31T08:27:11,743     Found link https://files.pythonhosted.org/packages/ae/0b/e458b0d07dced3d7fa2d21d828e708f374ef82040f2012c05d35f47f9af3/setuptools-60.8.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.8.2
2025-08-31T08:27:11,744     Found link https://files.pythonhosted.org/packages/1e/23/d9d5e23c8001f3614aace339b699d4d05fda9f1ec8be9155048d6613ed33/setuptools-60.9.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.0
2025-08-31T08:27:11,745     Found link https://files.pythonhosted.org/packages/3e/d3/e85cd0d84cf52054caed83b64dd8c922bbf0e33071689d7e3da3f96caabd/setuptools-60.9.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.0
2025-08-31T08:27:11,746     Found link https://files.pythonhosted.org/packages/42/1f/154a2f2eeaa319a313636a052a3a6cf5ac35ee2aa49ad30f0216ad695678/setuptools-60.9.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.1
2025-08-31T08:27:11,747     Found link https://files.pythonhosted.org/packages/e9/84/a1171328f0a8789a1963e301be7c27163ff67da389b94588ab37a55c49f9/setuptools-60.9.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.1
2025-08-31T08:27:11,748     Found link https://files.pythonhosted.org/packages/7d/c4/33822b323a5d2f6239ea668ad04261b6965c309953880a32ce373caf22c7/setuptools-60.9.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.2
2025-08-31T08:27:11,749     Found link https://files.pythonhosted.org/packages/bf/b0/b4599baf535aff5a8675f038a9b4b380df7e5de33c78a155e0883da05403/setuptools-60.9.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.2
2025-08-31T08:27:11,750     Found link https://files.pythonhosted.org/packages/3b/02/8d4d27b1cacaac2d129a27d17a22d92a2a5eedcb7817d4ed8ab0d4daf5c4/setuptools-60.9.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.3
2025-08-31T08:27:11,751     Found link https://files.pythonhosted.org/packages/14/74/54890935244ce053abcc4fa01ef4982a84743a8d128d4cf5eae56e2d156c/setuptools-60.9.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.3
2025-08-31T08:27:11,752     Found link https://files.pythonhosted.org/packages/7c/5b/3d92b9f0f7ca1645cba48c080b54fe7d8b1033a4e5720091d1631c4266db/setuptools-60.10.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.10.0
2025-08-31T08:27:11,753     Found link https://files.pythonhosted.org/packages/af/e8/894c71e914dfbe01276a42dfad40025cd96119f2eefc39c554b6e8b9df86/setuptools-60.10.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.10.0
2025-08-31T08:27:11,754     Found link https://files.pythonhosted.org/packages/50/09/2e7557fff6a272e795930229f17a0a0bc62e11069f0f859ebf961c19ed62/setuptools-61.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.0.0
2025-08-31T08:27:11,755     Found link https://files.pythonhosted.org/packages/cf/68/bc4babfa1f0853d9164ed8f9fc97e3cc8293fa6e77277fb1a72b4de75ba5/setuptools-61.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.0.0
2025-08-31T08:27:11,756     Found link https://files.pythonhosted.org/packages/4b/44/4a59818106036bbbbe0fda2a78852077164394b5d842832e254a910d3ae4/setuptools-61.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.1.0
2025-08-31T08:27:11,757     Found link https://files.pythonhosted.org/packages/27/01/6d721dbe597bd8234d978270b99717d017cafb6b1115e0eaafd373eaaa68/setuptools-61.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.1.0
2025-08-31T08:27:11,758     Found link https://files.pythonhosted.org/packages/0d/2f/3d6bdf48b8ef7b915a2f62568dc3cb856a9afea14adb447ab9585d8dd58c/setuptools-61.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.1.1
2025-08-31T08:27:11,759     Found link https://files.pythonhosted.org/packages/81/37/815cc2b7e708d522ccf8051fad1fb278a438fd0e94bcb0a3c2337ee573ce/setuptools-61.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.1.1
2025-08-31T08:27:11,760     Found link https://files.pythonhosted.org/packages/65/d1/1590f71a3ea7ed5f392ba4a7725205048b52e85102e48cbdc7cae3be8f4b/setuptools-61.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.2.0
2025-08-31T08:27:11,760     Found link https://files.pythonhosted.org/packages/a2/fc/f988372c4cdaaf6151ec4270be4e8ca45f0603256d979f81774fca73ad10/setuptools-61.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.2.0
2025-08-31T08:27:11,761     Found link https://files.pythonhosted.org/packages/7a/bb/3d7f9f61d002a4831e0aa4fa7dd7dfb552e48f50e2a0cfef316b9036de19/setuptools-61.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.3.0
2025-08-31T08:27:11,762     Found link https://files.pythonhosted.org/packages/0e/29/8fdaa8081e885e01923f518095ae0f52953844ade373f7105c441e09bc7b/setuptools-61.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.3.0
2025-08-31T08:27:11,763     Found link https://files.pythonhosted.org/packages/66/e7/5a78a242b3a0f4cad3a9a9376bcf0d2b1f2bfb54871d9e46f46cb0ed0914/setuptools-61.3.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.3.1
2025-08-31T08:27:11,764     Found link https://files.pythonhosted.org/packages/c9/42/16ac560057f5e74aa39754a3811334cc60908f59183c336ba5097369a81d/setuptools-61.3.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.3.1
2025-08-31T08:27:11,765     Found link https://files.pythonhosted.org/packages/0c/3c/548d361162702df85a0301f0cd0c47d05176b20bb086077a0fda740daf41/setuptools-62.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.0.0
2025-08-31T08:27:11,766     Found link https://files.pythonhosted.org/packages/a2/13/229d17002cbab8c8f07b46f8a9adc6bfdd127733a7457f10da06756e1cc3/setuptools-62.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.0.0
2025-08-31T08:27:11,767     Found link https://files.pythonhosted.org/packages/fb/58/9efbfe68482dab9557c49d433a60fff9efd7ed8835f829eba8297c2c124a/setuptools-62.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.1.0
2025-08-31T08:27:11,768     Found link https://files.pythonhosted.org/packages/ea/a3/3d3cbbb7150f90c4cf554048e1dceb7c6ab330e4b9138a40e130a4cc79e1/setuptools-62.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.1.0
2025-08-31T08:27:11,769     Found link https://files.pythonhosted.org/packages/ee/0f/dba055d3696c63fff7430bbc5f337454ac66711d91965f08146784afecad/setuptools-62.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.2.0
2025-08-31T08:27:11,770     Found link https://files.pythonhosted.org/packages/b1/77/75f6543eafdffc0b3f07f99682497bea817ef0b6c361fe72b932eb82459c/setuptools-62.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.2.0
2025-08-31T08:27:11,771     Found link https://files.pythonhosted.org/packages/4a/f3/cf2d1deafeb98bcc9b84ddc432db1881e5a49696994719c6bdcd21f2e597/setuptools-62.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.0
2025-08-31T08:27:11,772     Found link https://files.pythonhosted.org/packages/2b/ca/795fe59736dcc0bd7ff85239ebd017aec6c294983c469b40ee4ef44ca950/setuptools-62.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.0
2025-08-31T08:27:11,773     Found link https://files.pythonhosted.org/packages/fc/d6/764e0cf61f1456b974d9d71b696d483fe269ab31466d76007def02bc4739/setuptools-62.3.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.1
2025-08-31T08:27:11,774     Found link https://files.pythonhosted.org/packages/87/db/d840e1b888bd82b0b826b8864d1674df52f6d9d909177e1d144ab38a8c50/setuptools-62.3.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.1
2025-08-31T08:27:11,775     Found link https://files.pythonhosted.org/packages/e9/1c/ec080fde54ab30a738c92f794eab7f5d2f354f2b619ee95b2efe353e0766/setuptools-62.3.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.2
2025-08-31T08:27:11,776     Found link https://files.pythonhosted.org/packages/4a/25/ec29a23ef38b9456f9965c57a9e1221e6c246d87abbf2a31158799bca201/setuptools-62.3.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.2
2025-08-31T08:27:11,777     Found link https://files.pythonhosted.org/packages/27/0b/cb81bc3a06a242c7626fca8aa9ce82453af3bc44e72a39666bb4052ac302/setuptools-62.3.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.3
2025-08-31T08:27:11,778     Found link https://files.pythonhosted.org/packages/fb/50/005826d31d58a7b90585b5510f2f597c5406ae34df884f4f5d63abfb6ca7/setuptools-62.3.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.3
2025-08-31T08:27:11,779     Found link https://files.pythonhosted.org/packages/8d/67/614c3c236f2b638b503aa388302bd1eba67b9a10c34caa046e4352e5b825/setuptools-62.3.4-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.4
2025-08-31T08:27:11,780     Found link https://files.pythonhosted.org/packages/7f/49/7c3f041fa83a28137f8945c025795d749292a1ab643d4d52cf63a3413849/setuptools-62.3.4.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.4
2025-08-31T08:27:11,781     Found link https://files.pythonhosted.org/packages/d0/12/412167a1f80290555c557a556fb1fc294a6e889924fcf2b2db3a789b11a4/setuptools-62.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.4.0
2025-08-31T08:27:11,782     Found link https://files.pythonhosted.org/packages/0c/f0/f11edc0efc7b00e26a28225621ce7584636bb3a76b1862829d42bc146fbf/setuptools-62.4.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.4.0
2025-08-31T08:27:11,783     Found link https://files.pythonhosted.org/packages/83/ef/d167612e69d6d708d6d1c7932d5731596cc1f7e5285b8b4f6897a867b9bb/setuptools-62.5.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.5.0
2025-08-31T08:27:11,784     Found link https://files.pythonhosted.org/packages/6d/72/4d4b2aa376f39e954be948e3e3e2ce3b6d8e2faa1caabfdb4fec207b5456/setuptools-62.5.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.5.0
2025-08-31T08:27:11,785     Found link https://files.pythonhosted.org/packages/e9/86/b2ede1d87122a6d4da86d84cc35d0e48b4aa2476e4281d06101c772c1961/setuptools-62.6.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.6.0
2025-08-31T08:27:11,786     Found link https://files.pythonhosted.org/packages/dc/73/88920663229023b724a854d1ab7e3e50a1a28b63eeec399a604ba30f9242/setuptools-62.6.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.6.0
2025-08-31T08:27:11,787     Found link https://files.pythonhosted.org/packages/66/a6/564c67366105c34fd75980a8b1a339e2d98bafc36d0b6c5837b85d75467b/setuptools-63.0.0b1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.0.0b1
2025-08-31T08:27:11,788     Found link https://files.pythonhosted.org/packages/1f/90/439fb6f4ecd969b9e2da514cf7773e5480f8480d715be7374fc9aca65781/setuptools-63.0.0b1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.0.0b1
2025-08-31T08:27:11,789     Found link https://files.pythonhosted.org/packages/df/80/4620a4849ed16c5b0498963e3180d2c3e649660191f8d7d9be5a4bc8a773/setuptools-63.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.0.0
2025-08-31T08:27:11,789     Found link https://files.pythonhosted.org/packages/01/86/85e708ae56bbedbe9935338113421323169cf8b2450229e541a2f5744b73/setuptools-63.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.0.0
2025-08-31T08:27:11,790     Found link https://files.pythonhosted.org/packages/ae/7f/6d816941769a7783be4258dd35e28bbf1a64bb36b1b7e0c773eff07fb0a8/setuptools-63.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.1.0
2025-08-31T08:27:11,791     Found link https://files.pythonhosted.org/packages/67/25/42e2d6664c3e106c33ecad8356a55e3ae5d81708c89098061a97fbff7cee/setuptools-63.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.1.0
2025-08-31T08:27:11,792     Found link https://files.pythonhosted.org/packages/a4/53/bfc6409447ca024558b8b19d055de94c813c3e32c0296c48a0873a161cf5/setuptools-63.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.2.0
2025-08-31T08:27:11,793     Found link https://files.pythonhosted.org/packages/0a/ba/52611dc8278828eb9ec339e6914a0f865f9e2af967214905927835dfac0a/setuptools-63.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.2.0
2025-08-31T08:27:11,794     Found link https://files.pythonhosted.org/packages/22/59/ab3469c21ff2e16011c53dbe3b9b64325bf397625a60f7368347db9bc5e6/setuptools-63.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.3.0
2025-08-31T08:27:11,795     Found link https://files.pythonhosted.org/packages/a8/d9/28490a9ef6592c3471bd1bcacaf5bd0dee2bb05c8a8bcf901e673b2f1732/setuptools-63.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.3.0
2025-08-31T08:27:11,796     Found link https://files.pythonhosted.org/packages/85/c6/1ffbdc6b831ff295a4d6371c87786f254a5283cd4015b6844c28efc136cc/setuptools-63.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.0
2025-08-31T08:27:11,797     Found link https://files.pythonhosted.org/packages/48/b7/92671fba6952de2f0240e6a3251bf9674b2ed0cc6e3d5f756d753404ee15/setuptools-63.4.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.0
2025-08-31T08:27:11,798     Found link https://files.pythonhosted.org/packages/90/2e/109766d7f3cb854a083dd66bfc0bf2bf9e40f373829efedb4b5e0d104aa3/setuptools-63.4.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.1
2025-08-31T08:27:11,799     Found link https://files.pythonhosted.org/packages/63/2e/e1f3e1b02d7ff0baa356413e93ad8a88706accd6b3538e18204a8a00c42d/setuptools-63.4.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.1
2025-08-31T08:27:11,800     Found link https://files.pythonhosted.org/packages/10/9f/e6b3ae7c925399e5d210fda0be141cfff052bbb935c2d762019067f52d2e/setuptools-63.4.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.2
2025-08-31T08:27:11,801     Found link https://files.pythonhosted.org/packages/00/26/6c26b879cbd65b3c4daf7327a4cb205f8541c695e5d44b0c2c65892c20d1/setuptools-63.4.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.2
2025-08-31T08:27:11,802     Found link https://files.pythonhosted.org/packages/2a/a3/49c29680d6118273b992b40ebe881e8e899b8e26a4e951f37f223da8f862/setuptools-63.4.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.3
2025-08-31T08:27:11,803     Found link https://files.pythonhosted.org/packages/5b/ff/69fd395c5237da934753752b71c38e95e137bd0603d5640df70ddaea8038/setuptools-63.4.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.3
2025-08-31T08:27:11,804     Found link https://files.pythonhosted.org/packages/3e/83/e206edff58159a927c76bbfeef1bf8b39cb12bbb32ae3c6227deb16d0121/setuptools-64.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.0
2025-08-31T08:27:11,805     Found link https://files.pythonhosted.org/packages/55/53/9227eb446c4e5a185bc577a52b00634996206a6411dfed9c78f4c3218a3e/setuptools-64.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.0
2025-08-31T08:27:11,806     Found link https://files.pythonhosted.org/packages/98/71/6db7ed66f195e05baa1f13d0bf8d7a70a2db92f9bb2b2d138997d1429346/setuptools-64.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.1
2025-08-31T08:27:11,807     Found link https://files.pythonhosted.org/packages/95/d0/fdd5d7386308b1b05dbcf7a8c9315379ac8a6187c4171d936d9a506f1428/setuptools-64.0.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.1
2025-08-31T08:27:11,808     Found link https://files.pythonhosted.org/packages/e4/c3/2fe50dbd45118e02951d8f3207d738d68f271a728bdd33b3a117782692ef/setuptools-64.0.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.2
2025-08-31T08:27:11,809     Found link https://files.pythonhosted.org/packages/5b/2d/e9188faa5e5350ffe59d200260f73db2525c51734df212cd048b6c8ca0ce/setuptools-64.0.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.2
2025-08-31T08:27:11,810     Found link https://files.pythonhosted.org/packages/6f/a9/1d019cf4d87be67e4d156f95f258e206833aa6d45c183014d091ef9cb0d3/setuptools-64.0.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.3
2025-08-31T08:27:11,810     Found link https://files.pythonhosted.org/packages/c1/9c/67d1cb3ede2b167ee271ff22c398e7067715f294994fb18164f40ac981e4/setuptools-64.0.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.3
2025-08-31T08:27:11,811     Found link https://files.pythonhosted.org/packages/a2/dd/d8cdd14320106ff58d4eb6e6553bae7a822e174ad5b05db486332d50d4ec/setuptools-65.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.0.0
2025-08-31T08:27:11,812     Found link https://files.pythonhosted.org/packages/e2/ed/749424fd3cc1b55bb4836878e86b981e85a6fa7db462f6b6577ce1ad62a7/setuptools-65.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.0.0
2025-08-31T08:27:11,813     Found link https://files.pythonhosted.org/packages/9d/b9/48de2d69a45354b20ca754e6c61736f1db3707c208ea04908766b184fd23/setuptools-65.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.0.1
2025-08-31T08:27:11,814     Found link https://files.pythonhosted.org/packages/02/10/be08cf9b821236bcc312a6104fb586bbeb692a50b1714ade91b9e28c2db4/setuptools-65.0.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.0.1
2025-08-31T08:27:11,815     Found link https://files.pythonhosted.org/packages/02/70/40276081ce5d29e7610618a857909e4eba264c0c9cfb4ecb613a4f7ad0ef/setuptools-65.0.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.0.2
2025-08-31T08:27:11,816     Found link https://files.pythonhosted.org/packages/96/c2/8c6605094cb9a27b593e14377fb89a934342051bc7316a0ce21d47029481/setuptools-65.0.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.0.2
2025-08-31T08:27:11,817     Found link https://files.pythonhosted.org/packages/18/1e/7cd4bf0d0c4e109595b5e69621f72c4e01079c533ccb94003dfe361c62ea/setuptools-65.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.1.0
2025-08-31T08:27:11,818     Found link https://files.pythonhosted.org/packages/45/8d/00ecdc169f2ed7d95e1076c63cdf4315d92c875e9cff2e595b6b410fb8d6/setuptools-65.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.1.0
2025-08-31T08:27:11,819     Found link https://files.pythonhosted.org/packages/6d/1e/ff7c90e2a0514cef2ed4fb7d49944d45674fe7c7a305d6553a5025ae09fa/setuptools-65.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.1.1
2025-08-31T08:27:11,820     Found link https://files.pythonhosted.org/packages/a6/0f/a0c589e2ae4aa45000d6917d248e64c8805ef3a35c134a43194e6d7abbd0/setuptools-65.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.1.1
2025-08-31T08:27:11,821     Found link https://files.pythonhosted.org/packages/e5/6f/942e63ec2a5c881df147782b97dc4715ca082dec9de41f43e1013faef710/setuptools-65.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.2.0
2025-08-31T08:27:11,822     Found link https://files.pythonhosted.org/packages/15/a7/b4cab9eca586ed17c66b3aced23ccf945312c50742614039d0cd71c870bd/setuptools-65.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.2.0
2025-08-31T08:27:11,823     Found link https://files.pythonhosted.org/packages/d9/5f/2daccd14278b6b780ae6799f85998377c06019354982391245f4b58a927d/setuptools-65.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.3.0
2025-08-31T08:27:11,824     Found link https://files.pythonhosted.org/packages/cc/83/7ea9d9b3a6ff3225aca2fce5e4df373bee7e0a74c539711a4fbfda53374f/setuptools-65.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.3.0
2025-08-31T08:27:11,825     Found link https://files.pythonhosted.org/packages/d5/e6/e3a70a77dda22766b9ef4ff47ff8320720311e78d11d1401baffca3f6879/setuptools-65.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.4.0
2025-08-31T08:27:11,826     Found link https://files.pythonhosted.org/packages/4c/61/86c94ae2cccb05749abfb1b2961125d40368c8f03ac59275550c45e634f1/setuptools-65.4.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.4.0
2025-08-31T08:27:11,827     Found link https://files.pythonhosted.org/packages/bd/b4/f120561bc94a04bae5d71ea86fe2c7d97f57ab89635b4739ec4abceda92d/setuptools-65.4.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.4.1
2025-08-31T08:27:11,828     Found link https://files.pythonhosted.org/packages/03/c9/7b050ea4cc4144d0328f15e0b43c839e759c6c639370a3b932ecf4c6358f/setuptools-65.4.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.4.1
2025-08-31T08:27:11,829     Found link https://files.pythonhosted.org/packages/41/82/7f54bbfe5c247a8c9f78d8d1d7c051847bcb78843c397b866dba335c1e88/setuptools-65.5.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.5.0
2025-08-31T08:27:11,830     Found link https://files.pythonhosted.org/packages/c5/41/247814d8b7a044717164c74080725a6c8f3d2b5fc82b34bd825b617df663/setuptools-65.5.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.5.0
2025-08-31T08:27:11,831     Found link https://files.pythonhosted.org/packages/b6/40/353c051f77ee5618adaf1fd96f4f6bae9714ed0a22c7142c01c24eb77fe4/setuptools-65.5.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.5.1
2025-08-31T08:27:11,832     Found link https://files.pythonhosted.org/packages/26/f4/ca5cb6df512f453ad50f78900bf7ec6a5491ee44bb49d0f6f76802dbdd43/setuptools-65.5.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.5.1
2025-08-31T08:27:11,833     Found link https://files.pythonhosted.org/packages/1f/97/c03668380f278f1f8b0486d820c142cf224bba1bd78416e1797b52e0e81c/setuptools-65.6.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.0
2025-08-31T08:27:11,834     Found link https://files.pythonhosted.org/packages/09/b6/33512596fb92ba68f7c45e9bbc5e1bb9b24fbd941f9aece250fb420c2f5c/setuptools-65.6.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.0
2025-08-31T08:27:11,835     Found link https://files.pythonhosted.org/packages/b2/0f/945bdfe5007ebd4a7ead88d8e95f6f1326d8f3ad206bbb5824b515c61dcd/setuptools-65.6.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.1
2025-08-31T08:27:11,835     Found link https://files.pythonhosted.org/packages/61/1f/3947ca9808e3a31d94afb775b774991721efcc0b96e2fe66e47e3a77a400/setuptools-65.6.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.1
2025-08-31T08:27:11,836     Found link https://files.pythonhosted.org/packages/45/0a/0d9b81fa11d177e057b7f761b367dc409077ffd7ba3dc46d79c78444961c/setuptools-65.6.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.2
2025-08-31T08:27:11,837     Found link https://files.pythonhosted.org/packages/f8/b8/fe1dfb94342906c65acfda3d8f35984c87e0511bf574942c22aed756d0f6/setuptools-65.6.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.2
2025-08-31T08:27:11,838     Found link https://files.pythonhosted.org/packages/ef/e3/29d6e1a07e8d90ace4a522d9689d03e833b67b50d1588e693eec15f26251/setuptools-65.6.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.3
2025-08-31T08:27:11,839     Found link https://files.pythonhosted.org/packages/b6/21/cb9a8d0b2c8597c83fce8e9c02884bce3d4951e41e807fc35791c6b23d9a/setuptools-65.6.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.3
2025-08-31T08:27:11,840     Found link https://files.pythonhosted.org/packages/ff/97/9dc902414912192d68364cc01cf17e826d259ef9753504b7ae1a256f2e35/setuptools-65.7.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.7.0
2025-08-31T08:27:11,841     Found link https://files.pythonhosted.org/packages/a1/29/f2ad3b78b9ebd24afa282eed9add27b47ef52b37291198021154b4b65166/setuptools-65.7.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.7.0
2025-08-31T08:27:11,842     Found link https://files.pythonhosted.org/packages/bd/ef/76cffd20061a0c6512dad4ba3537314904c6350738b99526c2f48992ff58/setuptools-66.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 66.0.0
2025-08-31T08:27:11,843     Found link https://files.pythonhosted.org/packages/67/ba/27235b9eebee2492fbf03ac1828a997d3d686031445d491f9cfa36a7085e/setuptools-66.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 66.0.0
2025-08-31T08:27:11,844     Found link https://files.pythonhosted.org/packages/c5/94/00e3d21daa5a47c4f13d278ff08c1b3dbd167231e4a1c4b2c99e4616790e/setuptools-66.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 66.1.0
2025-08-31T08:27:11,845     Found link https://files.pythonhosted.org/packages/34/4d/5c3547ed1dd4cb8623ec6843a49a6a0598b37ec5358551e84b97bc4f5ee8/setuptools-66.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 66.1.0
2025-08-31T08:27:11,846     Found link https://files.pythonhosted.org/packages/c2/8b/abb577ca6ab2c71814d535b1ed1464c5f4aaefe1a31bbeb85013eb9b2401/setuptools-66.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 66.1.1
2025-08-31T08:27:11,847     Found link https://files.pythonhosted.org/packages/3c/7b/00030a938499c8f8345be02ab5b7d748d359ea59c2f020b7b0a21b82f832/setuptools-66.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 66.1.1
2025-08-31T08:27:11,848     Found link https://files.pythonhosted.org/packages/bf/27/969c914650fdf0d08b0b92bdbddfc08bea9df6d86aeefd75ba4730f50bc9/setuptools-67.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.0.0
2025-08-31T08:27:11,849     Found link https://files.pythonhosted.org/packages/fe/db/68d856066c59bd9f05e827c3cf80164d870b8b6af37dc5ad6c87a71d20f2/setuptools-67.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.0.0
2025-08-31T08:27:11,850     Found link https://files.pythonhosted.org/packages/c8/24/157fed9a57108b3e1b6ccd86e95823327f231ef12464b0eca13650eb33ac/setuptools-67.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.1.0
2025-08-31T08:27:11,851     Found link https://files.pythonhosted.org/packages/bf/7c/3a0bb8db53f6b6dec4cb162d307cc5d37162dee65458b2be42817de30fda/setuptools-67.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.1.0
2025-08-31T08:27:11,852     Found link https://files.pythonhosted.org/packages/34/6a/d89fe6b83a7fa4c39686d8a5cda83b48da0b117a13484f0e294c2cc2c337/setuptools-67.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.2.0
2025-08-31T08:27:11,853     Found link https://files.pythonhosted.org/packages/5f/36/7374297692bb9dbd7569a0f84887c7e5e314c41d5d9518cb76fbb130620d/setuptools-67.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.2.0
2025-08-31T08:27:11,854     Found link https://files.pythonhosted.org/packages/87/24/947bdd86115a19054af1c2cdca844340f7e49c5bba0dd82d9b3a4c4061ab/setuptools-67.3.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.3.1
2025-08-31T08:27:11,855     Found link https://files.pythonhosted.org/packages/9f/48/c22cae4aa8f5ed6a64fd9d5be995b740230abab7affa31176af34a6e56ce/setuptools-67.3.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.3.1
2025-08-31T08:27:11,856     Found link https://files.pythonhosted.org/packages/86/7b/f35d72b7a6acbc27732e88d7ceb7f224b3e0683bf645e1c9e2ac2cd96c0d/setuptools-67.3.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.3.2
2025-08-31T08:27:11,857     Found link https://files.pythonhosted.org/packages/a3/56/f49e7877e8d8a09faaeecde5ca61169e9cfd46d014def474daa31bf217ca/setuptools-67.3.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.3.2
2025-08-31T08:27:11,858     Found link https://files.pythonhosted.org/packages/cf/c4/76600761f528b66389955ca299049c8414152712825bb8200eb855d82e89/setuptools-67.3.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.3.3
2025-08-31T08:27:11,859     Found link https://files.pythonhosted.org/packages/d6/6f/9d257b50d60f67d0b54b88fb39d4a9bade8406d4a926da3e4f05bf04f38b/setuptools-67.3.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.3.3
2025-08-31T08:27:11,860     Found link https://files.pythonhosted.org/packages/2c/3a/e0340041dad00234d1fe569ed55b602d24eb11a4939b0a2ec844e970a87d/setuptools-67.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.4.0
2025-08-31T08:27:11,861     Found link https://files.pythonhosted.org/packages/fe/31/2c88d37d4f8036c6648745e74ec51f73a6ba945a06e069601900f81fe00a/setuptools-67.4.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.4.0
2025-08-31T08:27:11,862     Found link https://files.pythonhosted.org/packages/f8/1e/9f5d850734b5acb29b7616b9faa1b59ab6dd159b53b36d305abb8eb416e2/setuptools-67.5.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.5.0
2025-08-31T08:27:11,862     Found link https://files.pythonhosted.org/packages/1c/d2/03de0cd0d9b8c45a014da08a74419350c127b7c87b794c08d4af1549988c/setuptools-67.5.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.5.0
2025-08-31T08:27:11,863     Found link https://files.pythonhosted.org/packages/99/02/d6ac140d446e939959e80b7e0c55774fa7a22376847ff5fe191674fd1862/setuptools-67.5.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.5.1
2025-08-31T08:27:11,864     Found link https://files.pythonhosted.org/packages/a4/3a/d60ed296ff8bbc6157ce818765c4c02df8b02fe70c310b7d29127962c5ae/setuptools-67.5.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.5.1
2025-08-31T08:27:11,865     Found link https://files.pythonhosted.org/packages/c3/9e/8a7ba2c9984a060daa6c6f9fff4d576b7ace3936239d6b771541eab972ed/setuptools-67.6.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.6.0
2025-08-31T08:27:11,866     Found link https://files.pythonhosted.org/packages/25/f3/d68c20919bc774c6cb127f1762f2f2f999d700a58198556e883dd3700e58/setuptools-67.6.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.6.0
2025-08-31T08:27:11,867     Found link https://files.pythonhosted.org/packages/0b/fc/8781442def77b0aa22f63f266d4dadd486ebc0c5371d6290caf4320da4b7/setuptools-67.6.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.6.1
2025-08-31T08:27:11,868     Found link https://files.pythonhosted.org/packages/cb/46/22ec35f286a77e6b94adf81b4f0d59f402ed981d4251df0ba7b992299146/setuptools-67.6.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.6.1
2025-08-31T08:27:11,869     Found link https://files.pythonhosted.org/packages/17/76/1c4a5644126f4fa9ebf27ae9c353d8068b08d20c171389995134467e2ca7/setuptools-67.7.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.7.0
2025-08-31T08:27:11,870     Found link https://files.pythonhosted.org/packages/68/86/d82a2a8f3f63f0dad4cb287dbae0cac178efb6267b07e0aef8b072866032/setuptools-67.7.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.7.0
2025-08-31T08:27:11,871     Found link https://files.pythonhosted.org/packages/47/6a/dfaf9838b6dd1f04537c0a66cf880dd24acd829f8a39d468c11fc0b7d8c6/setuptools-67.7.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.7.1
2025-08-31T08:27:11,872     Found link https://files.pythonhosted.org/packages/01/18/73f7ca619f72b22300493451350214d3a035e7fa8f17ce31db2da24fe0c9/setuptools-67.7.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.7.1
2025-08-31T08:27:11,873     Found link https://files.pythonhosted.org/packages/2f/8c/f336a966d4097c7cef6fc699b2ecb83b5fb63fd698198c1b5c7905a74f0f/setuptools-67.7.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.7.2
2025-08-31T08:27:11,874     Found link https://files.pythonhosted.org/packages/fd/53/e5d7ae40d03e4ed20b7cba317cf9c0c97097c8debb39f9d72d182a6578a2/setuptools-67.7.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.7.2
2025-08-31T08:27:11,875     Found link https://files.pythonhosted.org/packages/f5/2c/074ab1c5be9c7d523d8d6d69d1f46f450fe7f11713147dc9e779aa4ca4ea/setuptools-67.8.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.8.0
2025-08-31T08:27:11,876     Found link https://files.pythonhosted.org/packages/03/20/630783571e76e5fa5f3e9f29398ca3ace377207b8196b54e0ffdf09f12c1/setuptools-67.8.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.8.0
2025-08-31T08:27:11,877     Found link https://files.pythonhosted.org/packages/c7/42/be1c7bbdd83e1bfb160c94b9cafd8e25efc7400346cf7ccdbdb452c467fa/setuptools-68.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 68.0.0
2025-08-31T08:27:11,878     Found link https://files.pythonhosted.org/packages/dc/98/5f896af066c128669229ff1aa81553ac14cfb3e5e74b6b44594132b8540e/setuptools-68.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 68.0.0
2025-08-31T08:27:11,879     Found link https://files.pythonhosted.org/packages/b8/49/b3b29c52b09075fb77f69309763a563b4054d5808a3f3b95df3a62ef3d3f/setuptools-68.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 68.1.0
2025-08-31T08:27:11,880     Found link https://files.pythonhosted.org/packages/83/b0/18310b45f6eec3757c0554dbc1e03f2f7685c8a87831aea6adc1276faacc/setuptools-68.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 68.1.0
2025-08-31T08:27:11,881     Found link https://files.pythonhosted.org/packages/4f/ab/0bcfebdfc3bfa8554b2b2c97a555569c4c1ebc74ea288741ea8326c51906/setuptools-68.1.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 68.1.2
2025-08-31T08:27:11,882     Found link https://files.pythonhosted.org/packages/19/20/d8dd9d8becaf3e2d6fdc17cc41870d5ada5ceda518996cf5968c2ca71bd8/setuptools-68.1.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 68.1.2
2025-08-31T08:27:11,883     Found link https://files.pythonhosted.org/packages/82/3b/0715493246eb08e93506f4da0efe1d05a3c9d9ac3b76e97cc362890e6adf/setuptools-68.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 68.2.0
2025-08-31T08:27:11,884     Found link https://files.pythonhosted.org/packages/ac/e0/4ccbb616e5f30d3595fa44ccc66ba5ac38e68885bcd888916d39f8ba480a/setuptools-68.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 68.2.0
2025-08-31T08:27:11,885     Found link https://files.pythonhosted.org/packages/95/79/6b47c6a872b40743a480687dc0c79ffb4202710789f3e4d54a84fff8b550/setuptools-68.2.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 68.2.1
2025-08-31T08:27:11,886     Found link https://files.pythonhosted.org/packages/e9/37/c6a6eb1ebeea919e4f394d811f234322d8a99eb58d5ee0f6089dbf06c488/setuptools-68.2.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 68.2.1
2025-08-31T08:27:11,887     Found link https://files.pythonhosted.org/packages/bb/26/7945080113158354380a12ce26873dd6c1ebd88d47f5bc24e2c5bb38c16a/setuptools-68.2.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 68.2.2
2025-08-31T08:27:11,888     Found link https://files.pythonhosted.org/packages/ef/cc/93f7213b2ab5ed383f98ce8020e632ef256b406b8569606c3f160ed8e1c9/setuptools-68.2.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 68.2.2
2025-08-31T08:27:11,889     Found link https://files.pythonhosted.org/packages/0f/93/daae527a7ad3ea3a4f7d84d05fd74b7cc637360a7e7b4df1df9a5046be17/setuptools-69.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.0
2025-08-31T08:27:11,890     Found link https://files.pythonhosted.org/packages/91/43/4121cf96ed3a2d68d862663552d8044e1d987d716b6a065ab53cd4d4640f/setuptools-69.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.0
2025-08-31T08:27:11,891     Found link https://files.pythonhosted.org/packages/f9/59/701df637517d6af0434cbb580bfc35a9c536aa7f47e0c2e222f1ef83547c/setuptools-69.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.1
2025-08-31T08:27:11,892     Found link https://files.pythonhosted.org/packages/fb/d0/d5744a7190a984ab728c7d2bd7e39bae2ff523538b233246fd34e2148566/setuptools-69.0.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.1
2025-08-31T08:27:11,893     Found link https://files.pythonhosted.org/packages/bb/e1/ed2dd0850446b8697ad28d118df885ad04140c64ace06c4bd559f7c8a94f/setuptools-69.0.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.2
2025-08-31T08:27:11,894     Found link https://files.pythonhosted.org/packages/4b/d9/d0cf66484b7e28a9c42db7e3929caed46f8b80478cd8c9bd38b7be059150/setuptools-69.0.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.2
2025-08-31T08:27:11,895     Found link https://files.pythonhosted.org/packages/55/3a/5121b58b578a598b269537e09a316ad2a94fdd561a2c6eb75cd68578cc6b/setuptools-69.0.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.3
2025-08-31T08:27:11,896     Found link https://files.pythonhosted.org/packages/fc/c9/b146ca195403e0182a374e0ea4dbc69136bad3cd55bc293df496d625d0f7/setuptools-69.0.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.3
2025-08-31T08:27:11,897     Found link https://files.pythonhosted.org/packages/bb/0a/203797141ec9727344c7649f6d5f6cf71b89a6c28f8f55d4f18de7a1d352/setuptools-69.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.1.0
2025-08-31T08:27:11,898     Found link https://files.pythonhosted.org/packages/c9/3d/74c56f1c9efd7353807f8f5fa22adccdba99dc72f34311c30a69627a0fad/setuptools-69.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.1.0
2025-08-31T08:27:11,899     Found link https://files.pythonhosted.org/packages/c0/7a/3da654f49c95d0cc6e9549a855b5818e66a917e852ec608e77550c8dc08b/setuptools-69.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.1.1
2025-08-31T08:27:11,899     Found link https://files.pythonhosted.org/packages/c8/1f/e026746e5885a83e1af99002ae63650b7c577af5c424d4c27edcf729ab44/setuptools-69.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.1.1
2025-08-31T08:27:11,901     Found link https://files.pythonhosted.org/packages/92/e1/1c8bb3420105e70bdf357d57dd5567202b4ef8d27f810e98bb962d950834/setuptools-69.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.2.0
2025-08-31T08:27:11,901     Found link https://files.pythonhosted.org/packages/4d/5b/dc575711b6b8f2f866131a40d053e30e962e633b332acf7cd2c24843d83d/setuptools-69.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.2.0
2025-08-31T08:27:11,902     Found link https://files.pythonhosted.org/packages/9a/4b/7b8a217633a4eda8fdf06233a38804adf3c281287728daddef031d15b635/setuptools-69.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.3.0
2025-08-31T08:27:11,903     Found link https://files.pythonhosted.org/packages/5f/dd/50c569f342bc5d22142e2fc5fab1822d256202f404a384f05541f703f2ff/setuptools-69.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.3
2025-08-31T08:27:11,904     Found link https://files.pythonhosted.org/packages/44/d5/f4be34fee66db92c97ad44589dcc939fabaf63520fc47a575576c46e93c1/setuptools-69.3.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.3.1
2025-08-31T08:27:11,905     Found link https://files.pythonhosted.org/packages/43/10/240651b2ba22f3efe75468437350b8ce4ec8ef03243dc8ed92971c2d4343/setuptools-69.3.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.3.1
2025-08-31T08:27:11,906     Found link https://files.pythonhosted.org/packages/cf/2e/988b6fb453899ed638bd99a48f97c3fb57897b8c6b83e439ad781733ef7d/setuptools-69.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.4.0
2025-08-31T08:27:11,907     Found link https://files.pythonhosted.org/packages/7a/12/dc02a2401dac87cb2d3ea8d3b23eab30db4cd2948d5b048bf912b9fe959a/setuptools-69.4.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.4
2025-08-31T08:27:11,908     Found link https://files.pythonhosted.org/packages/2e/86/de057c6e64a115bbbfbef676b6410f206d3994ea43d08015e8ae4803fb2a/setuptools-69.4.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.4.1
2025-08-31T08:27:11,909     Found link https://files.pythonhosted.org/packages/16/ee/02117b0fd589be4ec35883f58fcfd647ac9ab765e8aaa1ededfda1dc79ce/setuptools-69.4.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.4.1
2025-08-31T08:27:11,910     Found link https://files.pythonhosted.org/packages/3f/f8/c2a873f02af7ab6ce670e47816d7cfbbaed5fa259cec4210797395c34616/setuptools-69.4.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.4.2
2025-08-31T08:27:11,911     Found link https://files.pythonhosted.org/packages/8e/26/26c3359c930147a6b745a03c608b9e2a71a05119d38279fdb40d981e9097/setuptools-69.4.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.4.2
2025-08-31T08:27:11,912     Found link https://files.pythonhosted.org/packages/9a/dd/5be5c6958d2d8fccf26b0274303f2c960a0eba88b84980e71e6f795cdd87/setuptools-69.5.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.5.0
2025-08-31T08:27:11,913     Found link https://files.pythonhosted.org/packages/76/6c/a1e240d85b63e04b2f6786a39e32ea78ad9ec7a9e8193b5510b63b5add94/setuptools-69.5.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.5.0
2025-08-31T08:27:11,914     Found link https://files.pythonhosted.org/packages/f7/29/13965af254e3373bceae8fb9a0e6ea0d0e571171b80d6646932131d6439b/setuptools-69.5.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.5.1
2025-08-31T08:27:11,915     Found link https://files.pythonhosted.org/packages/d6/4f/b10f707e14ef7de524fe1f8988a294fb262a29c9b5b12275c7e188864aed/setuptools-69.5.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.5.1
2025-08-31T08:27:11,916     Found link https://files.pythonhosted.org/packages/de/88/70c5767a0e43eb4451c2200f07d042a4bcd7639276003a9c54a68cfcc1f8/setuptools-70.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 70.0.0
2025-08-31T08:27:11,917     Found link https://files.pythonhosted.org/packages/aa/60/5db2249526c9b453c5bb8b9f6965fcab0ddb7f40ad734420b3b421f7da44/setuptools-70.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 70.0.0
2025-08-31T08:27:11,918     Found link https://files.pythonhosted.org/packages/55/b3/b3a3415d2debd837106ed417f8681d8af63037fed367fa1b85dbfef081f1/setuptools-70.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 70.1.0
2025-08-31T08:27:11,919     Found link https://files.pythonhosted.org/packages/1c/1c/8a56622f2fc9ebb0df743373ef1a96c8e20410350d12f44ef03c588318c3/setuptools-70.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 70.1.0
2025-08-31T08:27:11,920     Found link https://files.pythonhosted.org/packages/b3/7a/629889a5d76200287aa5483d753811bd247bbd1b03175186f759e0c7d3a7/setuptools-70.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 70.1.1
2025-08-31T08:27:11,920     Found link https://files.pythonhosted.org/packages/0d/9d/c587bea18a7e40099857015baee4cece7aca32cd404af953bdeb95ac8e47/setuptools-70.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 70.1.1
2025-08-31T08:27:11,922     Found link https://files.pythonhosted.org/packages/42/54/2a8ecfcc9a714a6fbf86559a4b0f50b126a4ac4269ea8134f2c75c3e73de/setuptools-70.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 70.2.0
2025-08-31T08:27:11,923     Found link https://files.pythonhosted.org/packages/8d/e6/2fc95aec377988ff3ca882aa58d4f6ab35ff59a12b1611a9fe3075eb3019/setuptools-70.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 70.2.0
2025-08-31T08:27:11,924     Found link https://files.pythonhosted.org/packages/ef/15/88e46eb9387e905704b69849618e699dc2f54407d8953cc4ec4b8b46528d/setuptools-70.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 70.3.0
2025-08-31T08:27:11,924     Found link https://files.pythonhosted.org/packages/65/d8/10a70e86f6c28ae59f101a9de6d77bf70f147180fbf40c3af0f64080adc3/setuptools-70.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 70.3.0
2025-08-31T08:27:11,925     Found link https://files.pythonhosted.org/packages/01/82/a2c6c0a1612c89bdb21dc4d9196ba9e7dcbc2e285afda93ebdf663ba2ada/setuptools-71.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.0
2025-08-31T08:27:11,926     Found link https://files.pythonhosted.org/packages/32/37/8751819aebb61ff15cc438e9d80d7b32d6cef4f266a1145a7037cbbfd693/setuptools-71.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.0
2025-08-31T08:27:11,927     Found link https://files.pythonhosted.org/packages/39/11/6159cc30f99dbdccac3c74d67277505d0e0bfc059e6cc57ef2eefc9b8751/setuptools-71.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.1
2025-08-31T08:27:11,928     Found link https://files.pythonhosted.org/packages/55/a2/640f943c98800be626d5e4d48070e35bb891733218cf6ce562a8df53b9af/setuptools-71.0.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.1
2025-08-31T08:27:11,929     Found link https://files.pythonhosted.org/packages/ed/d0/0994fa8fed8eb3c1d4c151e650f87d3e2a9aedb6aaf1aebe8dbf018f984c/setuptools-71.0.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.2
2025-08-31T08:27:11,930     Found link https://files.pythonhosted.org/packages/0e/ae/4a643fdc3b2fe390a6accd55117d5c5af9fbe5da7d2d300c8dd52aa35555/setuptools-71.0.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.2
2025-08-31T08:27:11,931     Found link https://files.pythonhosted.org/packages/32/10/e72bb221cdd2f11e649cf38bd7ba8ea6d527c77f330366e10ae9bb798730/setuptools-71.0.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.3
2025-08-31T08:27:11,932     Found link https://files.pythonhosted.org/packages/d1/8e/1d0b941ce1151009c6d98a0a590a608f346d4d272ce95ca09ee2bbb592cd/setuptools-71.0.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.3
2025-08-31T08:27:11,933     Found link https://files.pythonhosted.org/packages/d2/93/40d9bd9c7cf5d5e556894cc2a2c492e6e4ef4eda6ce9806bd1a8c47ae351/setuptools-71.0.4-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.4
2025-08-31T08:27:11,934     Found link https://files.pythonhosted.org/packages/b2/9b/c154d7694227ff8f5ee5bdff2f8cf8a529ba8f53e80806dd984737c59b19/setuptools-71.0.4.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.4
2025-08-31T08:27:11,935     Found link https://files.pythonhosted.org/packages/51/a0/ee460cc54e68afcf33190d198299c9579a5eafeadef0016ae8563237ccb6/setuptools-71.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.1.0
2025-08-31T08:27:11,936     Found link https://files.pythonhosted.org/packages/32/c0/5b8013b5a812701c72e3b1e2b378edaa6514d06bee6704a5ab0d7fa52931/setuptools-71.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.1.0
2025-08-31T08:27:11,937     Found link https://files.pythonhosted.org/packages/2f/83/06edd551b4fdf6170dcbafeeed588a8909819e943905c182ebdc98835be8/setuptools-72.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 72.0.0
2025-08-31T08:27:11,938     Found link https://files.pythonhosted.org/packages/8a/8b/ae50f468cdd5e1dc6e6969397bb76e75ca0fd39f7ab8e5a6e8b58ea7102f/setuptools-72.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 72.0.0
2025-08-31T08:27:11,939     Found link https://files.pythonhosted.org/packages/e1/58/e0ef3b9974a04ce9cde2a7a33881ddcb2d68450803745804545cdd8d258f/setuptools-72.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 72.1.0
2025-08-31T08:27:11,940     Found link https://files.pythonhosted.org/packages/5e/11/487b18cc768e2ae25a919f230417983c8d5afa1b6ee0abd8b6db0b89fa1d/setuptools-72.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 72.1.0
2025-08-31T08:27:11,941     Found link https://files.pythonhosted.org/packages/6e/ec/06715d912351edc453e37f93f3fc80dcffd5ca0e70386c87529aca296f05/setuptools-72.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 72.2.0
2025-08-31T08:27:11,942     Found link https://files.pythonhosted.org/packages/ce/ef/013ded5b0d259f3fa636bf35de186f0061c09fbe124020ce6b8db68c83af/setuptools-72.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 72.2.0
2025-08-31T08:27:11,943     Found link https://files.pythonhosted.org/packages/09/e3/93b516fab8b8f420acc7bb75e29759d009df26c093d8de1c70993b13bf25/setuptools-73.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 73.0.0
2025-08-31T08:27:11,944     Found link https://files.pythonhosted.org/packages/98/0b/56dabcf2b37d9152090bcd5d42e28ad312c9ba54fb1446b22dcc809dd84a/setuptools-73.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 73.0.0
2025-08-31T08:27:11,945     Found link https://files.pythonhosted.org/packages/07/6a/0270e295bf30c37567736b7fca10167640898214ff911273af37ddb95770/setuptools-73.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 73.0.1
2025-08-31T08:27:11,946     Found link https://files.pythonhosted.org/packages/8d/37/f4d4ce9bc15e61edba3179f9b0f763fc6d439474d28511b11f0d95bab7a2/setuptools-73.0.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 73.0.1
2025-08-31T08:27:11,947     Found link https://files.pythonhosted.org/packages/df/b5/168cec9a10bf93b60b8f9af7f4e61d526e31e1aad8b9be0e30837746d700/setuptools-74.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 74.0.0
2025-08-31T08:27:11,947     Found link https://files.pythonhosted.org/packages/6a/21/8fd457d5a979109603e0e460c73177c3a9b6b7abcd136d0146156da95895/setuptools-74.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 74.0.0
2025-08-31T08:27:11,948     Found link https://files.pythonhosted.org/packages/f1/2e/19fefb8477d869bd1d09466542a38410f53288c946046342066cf2905b72/setuptools-74.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.0
2025-08-31T08:27:11,949     Found link https://files.pythonhosted.org/packages/ac/11/0a953274017ca5c33a9831bc5e052e825d174a3551bd18924777794c8162/setuptools-74.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.0
2025-08-31T08:27:11,950     Found link https://files.pythonhosted.org/packages/48/f3/e30ee63caefa90716afdffd7d9ae959cd8d0dbd2d0a0eb9fe1d73ddf806b/setuptools-74.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.1
2025-08-31T08:27:11,951     Found link https://files.pythonhosted.org/packages/27/cb/e754933c1ca726b0d99980612dc9da2886e76c83968c246cfb50f491a96b/setuptools-74.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.1
2025-08-31T08:27:11,952     Found link https://files.pythonhosted.org/packages/cb/9c/9ad11ac06b97e55ada655f8a6bea9d1d3f06e120b178cd578d80e558191d/setuptools-74.1.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.2
2025-08-31T08:27:11,953     Found link https://files.pythonhosted.org/packages/3e/2c/f0a538a2f91ce633a78daaeb34cbfb93a54bd2132a6de1f6cec028eee6ef/setuptools-74.1.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.2
2025-08-31T08:27:11,954     Found link https://files.pythonhosted.org/packages/14/37/166aba5a70924e574eb0aec9f7ec227ac0d7ae72dd2f823675365172120d/setuptools-74.1.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.3
2025-08-31T08:27:11,955     Found link https://files.pythonhosted.org/packages/cd/01/e30d66bbb6403b7d41ac1ac0e3c51727c5e8f3558d8f9a9efe4282e90308/setuptools-74.1.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.3
2025-08-31T08:27:11,956     Found link https://files.pythonhosted.org/packages/8e/69/f90971743a7cc451b93be8f5eb60b7e506896b7e81e6be6272858b2a9d46/setuptools-75.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 75.0.0
2025-08-31T08:27:11,957     Found link https://files.pythonhosted.org/packages/a7/17/133e1cd1e24373e1898ca3c7330f5c385b46c7091f0451e678f37245591b/setuptools-75.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 75.0.0
2025-08-31T08:27:11,958     Found link https://files.pythonhosted.org/packages/ff/ae/f19306b5a221f6a436d8f2238d5b80925004093fa3edea59835b514d9057/setuptools-75.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 75.1.0
2025-08-31T08:27:11,959     Found link https://files.pythonhosted.org/packages/27/b8/f21073fde99492b33ca357876430822e4800cdf522011f18041351dfa74b/setuptools-75.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 75.1.0
2025-08-31T08:27:11,960     Found link https://files.pythonhosted.org/packages/31/2d/90165d51ecd38f9a02c6832198c13a4e48652485e2ccf863ebb942c531b6/setuptools-75.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 75.2.0
2025-08-31T08:27:11,961     Found link https://files.pythonhosted.org/packages/07/37/b31be7e4b9f13b59cde9dcaeff112d401d49e0dc5b37ed4a9fc8fb12f409/setuptools-75.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 75.2.0
2025-08-31T08:27:11,962     Found link https://files.pythonhosted.org/packages/90/12/282ee9bce8b58130cb762fbc9beabd531549952cac11fc56add11dcb7ea0/setuptools-75.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 75.3.0
2025-08-31T08:27:11,963     Found link https://files.pythonhosted.org/packages/ed/22/a438e0caa4576f8c383fa4d35f1cc01655a46c75be358960d815bfbb12bd/setuptools-75.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 75.3.0
2025-08-31T08:27:11,964     Found link https://files.pythonhosted.org/packages/44/35/d7223a1748341c320957eaaad1787e129abe6ae481aa83fb4f02c9560925/setuptools-75.3.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 75.3.1
2025-08-31T08:27:11,965     Found link https://files.pythonhosted.org/packages/5f/3b/7b611c8bf332eaf04c9aa1c7bc9e6908d4741ec93c85f487248fc684d02c/setuptools-75.3.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 75.3.1
2025-08-31T08:27:11,966     Found link https://files.pythonhosted.org/packages/15/65/3f0dba35760d902849d39d38c0a72767794b1963227b69a587f8a336d08c/setuptools-75.3.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 75.3.2
2025-08-31T08:27:11,967     Found link https://files.pythonhosted.org/packages/5c/01/771ea46cce201dd42cff043a5eea929d1c030fb3d1c2ee2729d02ca7814c/setuptools-75.3.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 75.3.2
2025-08-31T08:27:11,968     Found link https://files.pythonhosted.org/packages/21/df/7c6bb83dcb45b35dc35b310d752f254211cde0bcd2a35290ea6e2862b2a9/setuptools-75.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.4.0
2025-08-31T08:27:11,969     Found link https://files.pythonhosted.org/packages/e2/73/c1ccf3e057ef6331cc6861412905dc218203bde46dfe8262c1631aa7fb11/setuptools-75.4.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.4.0
2025-08-31T08:27:11,970     Found link https://files.pythonhosted.org/packages/fe/df/88ccbee85aefbca071db004fdc8f8d2507d55d5a9dc27ebb93c92edb1bd8/setuptools-75.5.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.5.0
2025-08-31T08:27:11,971     Found link https://files.pythonhosted.org/packages/c8/db/722a42ffdc226e950c4757b3da7b56ff5c090bb265dccd707f7b8a3c6fee/setuptools-75.5.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.5.0
2025-08-31T08:27:11,972     Found link https://files.pythonhosted.org/packages/55/21/47d163f615df1d30c094f6c8bbb353619274edccf0327b185cc2493c2c33/setuptools-75.6.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.6.0
2025-08-31T08:27:11,973     Found link https://files.pythonhosted.org/packages/43/54/292f26c208734e9a7f067aea4a7e282c080750c4546559b58e2e45413ca0/setuptools-75.6.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.6.0
2025-08-31T08:27:11,974     Found link https://files.pythonhosted.org/packages/4e/6e/abdfaaf5c294c553e7a81cf5d801fbb4f53f5c5b6646de651f92a2667547/setuptools-75.7.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.7.0
2025-08-31T08:27:11,975     Found link https://files.pythonhosted.org/packages/ac/57/e6f0bde5a2c333a32fbcce201f906c1fd0b3a7144138712a5e9d9598c5ec/setuptools-75.7.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.7.0
2025-08-31T08:27:11,976     Found link https://files.pythonhosted.org/packages/69/8a/b9dc7678803429e4a3bc9ba462fa3dd9066824d3c607490235c6a796be5a/setuptools-75.8.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.8.0
2025-08-31T08:27:11,977     Found link https://files.pythonhosted.org/packages/92/ec/089608b791d210aec4e7f97488e67ab0d33add3efccb83a056cbafe3a2a6/setuptools-75.8.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.8.0
2025-08-31T08:27:11,978     Found link https://files.pythonhosted.org/packages/da/bd/ac215d31c2904e47ec5332897442bdc19fd6b21a82068d057152f4e9c1cf/setuptools-75.8.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.8.1
2025-08-31T08:27:11,979     Found link https://files.pythonhosted.org/packages/e8/42/0e5f75d734f181367de4acd9aba8f875453a5905169c5485ca8416b015ae/setuptools-75.8.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.8.1
2025-08-31T08:27:11,980     Found link https://files.pythonhosted.org/packages/a9/38/7d7362e031bd6dc121e5081d8cb6aa6f6fedf2b67bf889962134c6da4705/setuptools-75.8.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.8.2
2025-08-31T08:27:11,981     Found link https://files.pythonhosted.org/packages/d1/53/43d99d7687e8cdef5ab5f9ec5eaf2c0423c2b35133a2b7e7bc276fc32b21/setuptools-75.8.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.8.2
2025-08-31T08:27:11,982     Found link https://files.pythonhosted.org/packages/e2/82/23e063d15ecb1484cd0bf713b36ef916bdc30aa153b71828e8b22a5b2d7b/setuptools-75.9.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.9.0
2025-08-31T08:27:11,983     Found link https://files.pythonhosted.org/packages/f5/38/6cafe2b3d55661b5d72dc12c038d83f6347d889853697cb98b5e4a5d853d/setuptools-75.9.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.9.0
2025-08-31T08:27:11,984     Found link https://files.pythonhosted.org/packages/8d/28/19ad82a0549d73ec6feffa6711eacf9246035a9426b8a8b528440c9959d2/setuptools-75.9.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.9.1
2025-08-31T08:27:11,985     Found link https://files.pythonhosted.org/packages/d0/df/ec5ad16b0ec305081c372bd0550fd638fa96e472cd5a03049c344076ea76/setuptools-75.9.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.9.1
2025-08-31T08:27:11,986     Found link https://files.pythonhosted.org/packages/37/66/d2d7e6ad554f3a7c7297c3f8ef6e22643ad3d35ef5c63bf488bc89f32f31/setuptools-76.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 76.0.0
2025-08-31T08:27:11,986     Found link https://files.pythonhosted.org/packages/32/d2/7b171caf085ba0d40d8391f54e1c75a1cda9255f542becf84575cfd8a732/setuptools-76.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 76.0.0
2025-08-31T08:27:11,987     Found link https://files.pythonhosted.org/packages/62/fb/47dc84839f2743553075c80d08543b3d0f498f42329141b6717504abcdfd/setuptools-76.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 76.1.0
2025-08-31T08:27:11,988     Found link https://files.pythonhosted.org/packages/fa/2b/287ade3a580869e6178cb37d045f54272b1f006f2c0ff6fad08db258d027/setuptools-76.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 76.1.0
2025-08-31T08:27:11,989     Found link https://files.pythonhosted.org/packages/40/50/bc3d02829a3babd70b7f1414c93cf6acd198976f0469a07d0e7b813c5002/setuptools-77.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 77.0.1
2025-08-31T08:27:11,990     Found link https://files.pythonhosted.org/packages/ea/df/9f719dc48f64284be8bd99e2e0bb0dd6e9f8e2c2c3c7bf7a685bc5adf2c7/setuptools-77.0.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 77.0.1
2025-08-31T08:27:11,991     Found link https://files.pythonhosted.org/packages/a9/07/99f2cefae815c66eb23148f15d79ec055429c38fa8986edcc712ab5f3223/setuptools-77.0.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 77.0.3
2025-08-31T08:27:11,992     Found link https://files.pythonhosted.org/packages/81/ed/7101d53811fd359333583330ff976e5177c5e871ca8b909d1d6c30553aa3/setuptools-77.0.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 77.0.3
2025-08-31T08:27:11,993     Found link https://files.pythonhosted.org/packages/42/c8/3faed884acdb2c1f2eb353cbacdd1ee4943de89a199d1f622ebefb6170e5/setuptools-78.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 78.0.1
2025-08-31T08:27:11,994     Found link https://files.pythonhosted.org/packages/47/42/55a8f24bd1287676b23e56a6d94e416be390ca6e0ee30fa46a782d038f80/setuptools-78.0.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 78.0.1
2025-08-31T08:27:11,995     Found link https://files.pythonhosted.org/packages/aa/db/2fd473dfe436ad19fda190f4079162d400402aedfcc41e048d38c0a375c6/setuptools-78.0.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 78.0.2
2025-08-31T08:27:11,996     Found link https://files.pythonhosted.org/packages/4c/f4/aa8d364f0dc1f33b2718938648c31202e2db5cd6479a73f0a9ca5a88372d/setuptools-78.0.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 78.0.2
2025-08-31T08:27:11,997     Found link https://files.pythonhosted.org/packages/54/21/f43f0a1fa8b06b32812e0975981f4677d28e0f3271601dc88ac5a5b83220/setuptools-78.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 78.1.0
2025-08-31T08:27:11,998     Found link https://files.pythonhosted.org/packages/a9/5a/0db4da3bc908df06e5efae42b44e75c81dd52716e10192ff36d0c1c8e379/setuptools-78.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 78.1.0
2025-08-31T08:27:11,999     Found link https://files.pythonhosted.org/packages/90/99/158ad0609729111163fc1f674a5a42f2605371a4cf036d0441070e2f7455/setuptools-78.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 78.1.1
2025-08-31T08:27:12,000     Found link https://files.pythonhosted.org/packages/81/9c/42314ee079a3e9c24b27515f9fbc7a3c1d29992c33451779011c74488375/setuptools-78.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 78.1.1
2025-08-31T08:27:12,001     Found link https://files.pythonhosted.org/packages/cc/ea/d53f2f8897c46a36df085964d07761ea4c2d1f2cf92019693b6742b7aabb/setuptools-79.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 79.0.0
2025-08-31T08:27:12,002     Found link https://files.pythonhosted.org/packages/7d/19/fecb7e2825616270f34512b3394cdcf6f45a79b5b6d94fdbd86a509e67b5/setuptools-79.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 79.0.0
2025-08-31T08:27:12,003     Found link https://files.pythonhosted.org/packages/0d/6d/b4752b044bf94cb802d88a888dc7d288baaf77d7910b7dedda74b5ceea0c/setuptools-79.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 79.0.1
2025-08-31T08:27:12,004     Found link https://files.pythonhosted.org/packages/bb/71/b6365e6325b3290e14957b2c3a804a529968c77a049b2ed40c095f749707/setuptools-79.0.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 79.0.1
2025-08-31T08:27:12,005     Found link https://files.pythonhosted.org/packages/23/63/5517029d6696ddf2bd378d46f63f479be001c31b462303170a1da57650cb/setuptools-80.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.0.0
2025-08-31T08:27:12,006     Found link https://files.pythonhosted.org/packages/44/80/97e25f0f1e4067677806084b7382a6ff9979f3d15119375c475c288db9d7/setuptools-80.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.0.0
2025-08-31T08:27:12,007     Found link https://files.pythonhosted.org/packages/2a/8e/2ee81652472f3c11503d1780c41844a9a9656989b69c29811a4631e4aeb9/setuptools-80.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.0.1
2025-08-31T08:27:12,007     Found link https://files.pythonhosted.org/packages/26/da/7a7021c150030617f90aa4a90a5b23f7b49af877f70ca46967e991645117/setuptools-80.0.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.0.1
2025-08-31T08:27:12,008     Found link https://files.pythonhosted.org/packages/8b/f6/126c9309c8fe93e5d6bb850593cd58d591daf2da45cc78b61e48d8d95879/setuptools-80.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.1.0
2025-08-31T08:27:12,009     Found link https://files.pythonhosted.org/packages/aa/b2/bd26ed086b842b68c8fe9aac380ad7e5118cf84fa7abd45bb059a88368a8/setuptools-80.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.1.0
2025-08-31T08:27:12,010     Found link https://files.pythonhosted.org/packages/51/95/522fb99f76ecf2efe0a372ee02665a3cda1e5653b37514fd05c98f05a9cf/setuptools-80.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.2.0
2025-08-31T08:27:12,011     Found link https://files.pythonhosted.org/packages/24/65/19a02e93da9d9f118ecb311419a353ae68a8e236c057bf164c866daa227f/setuptools-80.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.2.0
2025-08-31T08:27:12,012     Found link https://files.pythonhosted.org/packages/e6/61/a6239ff35d64e55def020335626894895847cc6659c0f8e1b676c58aad3b/setuptools-80.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.3.0
2025-08-31T08:27:12,013     Found link https://files.pythonhosted.org/packages/51/6c/a3f892949418b5b9aced7396919c75ffb57e38f08b712b565f5eb10677ee/setuptools-80.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.3.0
2025-08-31T08:27:12,014     Found link https://files.pythonhosted.org/packages/53/7e/5d8af3317ddbf9519b687bd1c39d8737fde07d97f54df65553faca5cffb1/setuptools-80.3.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.3.1
2025-08-31T08:27:12,015     Found link https://files.pythonhosted.org/packages/70/dc/3976b322de9d2e87ed0007cf04cc7553969b6c7b3f48a565d0333748fbcd/setuptools-80.3.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.3.1
2025-08-31T08:27:12,016     Found link https://files.pythonhosted.org/packages/b1/93/dba5ed08c2e31ec7cdc2ce75705a484ef0be1a2fecac8a58272489349de8/setuptools-80.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.4.0
2025-08-31T08:27:12,017     Found link https://files.pythonhosted.org/packages/95/32/0cc40fe41fd2adb80a2f388987f4f8db3c866c69e33e0b4c8b093fdf700e/setuptools-80.4.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.4.0
2025-08-31T08:27:12,018     Found link https://files.pythonhosted.org/packages/57/28/46ef5c181f4aa677d0d773da770a8c111e29f21ad67ed1d1b8e414d3fa0b/setuptools-80.6.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.6.0
2025-08-31T08:27:12,019     Found link https://files.pythonhosted.org/packages/bb/c6/4af6938e3c7321dab335c384d2ce4f604adc81099f124257de71599e301b/setuptools-80.6.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.6.0
2025-08-31T08:27:12,020     Found link https://files.pythonhosted.org/packages/70/78/ca86603790f24a597427bfedbc73a2aac5762b7c0b60a9d68631bc7e9a0e/setuptools-80.7.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.7.0
2025-08-31T08:27:12,021     Found link https://files.pythonhosted.org/packages/2b/22/2e66d286bf92bc5f0d0822346e53fc856b5e6ad38b2a53bcde7ea5eb1299/setuptools-80.7.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.7.0
2025-08-31T08:27:12,022     Found link https://files.pythonhosted.org/packages/a1/18/0e835c3a557dc5faffc8f91092f62fc337c1dab1066715842e7a4b318ec4/setuptools-80.7.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.7.1
2025-08-31T08:27:12,023     Found link https://files.pythonhosted.org/packages/9e/8b/dc1773e8e5d07fd27c1632c45c1de856ac3dbf09c0147f782ca6d990cf15/setuptools-80.7.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.7.1
2025-08-31T08:27:12,024     Found link https://files.pythonhosted.org/packages/58/29/93c53c098d301132196c3238c312825324740851d77a8500a2462c0fd888/setuptools-80.8.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.8.0
2025-08-31T08:27:12,025     Found link https://files.pythonhosted.org/packages/8d/d2/ec1acaaff45caed5c2dedb33b67055ba9d4e96b091094df90762e60135fe/setuptools-80.8.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.8.0
2025-08-31T08:27:12,026     Found link https://files.pythonhosted.org/packages/a3/dc/17031897dae0efacfea57dfd3a82fdd2a2aeb58e0ff71b77b87e44edc772/setuptools-80.9.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.9.0
2025-08-31T08:27:12,026     Found link https://files.pythonhosted.org/packages/18/5d/3bf57dcd21979b887f014ea83c24ae194cfcd12b9e0fda66b957c69d1fca/setuptools-80.9.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 80.9.0
2025-08-31T08:27:12,028   Fetching project page and analyzing links: https://www.piwheels.org/simple/setuptools/
2025-08-31T08:27:12,029   Getting page https://www.piwheels.org/simple/setuptools/
2025-08-31T08:27:12,030   Found index url https://www.piwheels.org/simple/
2025-08-31T08:27:12,032   Looking up "https://www.piwheels.org/simple/setuptools/" in the cache
2025-08-31T08:27:12,032   Request header has "max_age" as 0, cache bypassed
2025-08-31T08:27:12,037   Starting new HTTPS connection (1): www.piwheels.org:443
2025-08-31T08:27:12,223   https://www.piwheels.org:443 "GET /simple/setuptools/ HTTP/1.1" 200 29027
2025-08-31T08:27:12,229   Updating cache with response from "https://www.piwheels.org/simple/setuptools/"
2025-08-31T08:27:12,229   etag object cached for 1209600 seconds
2025-08-31T08:27:12,230   Caching due to etag
2025-08-31T08:27:12,239   Fetched page https://www.piwheels.org/simple/setuptools/ as text/html
2025-08-31T08:27:12,347     Found link https://www.piwheels.org/simple/setuptools/setuptools-80.9.0-py3-none-any.whl#sha256=3d209672d008f035ec80af944dfa381396b57754a83983d30d0bab717e7407e4 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 80.9.0
2025-08-31T08:27:12,348     Found link https://www.piwheels.org/simple/setuptools/setuptools-80.8.0-py3-none-any.whl#sha256=7dfbb7c1a04413cb493c6bc947055aee012bc2f701e3b55108bfb2ec6fe34603 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 80.8.0
2025-08-31T08:27:12,349     Found link https://www.piwheels.org/simple/setuptools/setuptools-80.7.1-py3-none-any.whl#sha256=d61372de837d00499b2e1bd58a20d797d8dc6526b54e4eeb58f3d1affe3ad4f1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 80.7.1
2025-08-31T08:27:12,350     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-80.7.0-py3-none-any.whl#sha256=4b4913bfc730a75b2aceb6feb6c1bc0f50e5978b2985fcad3db651d465161ef9 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 80.7.0
2025-08-31T08:27:12,351     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-80.6.0-py3-none-any.whl#sha256=ea026908310d9e870cc4e73af737d2b9e16407a5641971fb6590ebeff3e51cc9 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 80.6.0
2025-08-31T08:27:12,352     Found link https://www.piwheels.org/simple/setuptools/setuptools-80.4.0-py3-none-any.whl#sha256=f86da47f60fa56ac0cc0207b51412df781aefc964d9f6f50372992cd053e003e (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 80.4.0
2025-08-31T08:27:12,353     Found link https://www.piwheels.org/simple/setuptools/setuptools-80.3.1-py3-none-any.whl#sha256=6bb1b558e373528a29393d4d78a5bc172eb038ad1f5ec99dd297068173f0c40b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 80.3.1
2025-08-31T08:27:12,354     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-80.3.0-py3-none-any.whl#sha256=007c4a1c17d1fce1193b590f5a65ea4c8020bee37a6e256699b60ad4d95dd1ed (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 80.3.0
2025-08-31T08:27:12,355     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-80.2.0-py3-none-any.whl#sha256=cdf98466e7ebe4570ce9491bce8854d4d14e2996660ca3bdb23cda546070be7f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 80.2.0
2025-08-31T08:27:12,356     Found link https://www.piwheels.org/simple/setuptools/setuptools-80.1.0-py3-none-any.whl#sha256=9bf3713b236eb6628aae919f9ba33a1de8fc63de723bc3ed86d253de4a944bbb (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 80.1.0
2025-08-31T08:27:12,357     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-80.0.1-py3-none-any.whl#sha256=e9350f30a78977d8adba7e81d033e98bc4f68c8acb3e7eabb3a9461cdecaf56b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 80.0.1
2025-08-31T08:27:12,359     Found link https://www.piwheels.org/simple/setuptools/setuptools-80.0.0-py3-none-any.whl#sha256=da688112f24d0e336aaa4ff87c2601aac63e4809456dccad7fe871a9f884276f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 80.0.0
2025-08-31T08:27:12,360     Found link https://www.piwheels.org/simple/setuptools/setuptools-79.0.1-py3-none-any.whl#sha256=997118c9bdae99ea6f2b9fdaee202768591c4ef82924c02a8dd34667799389ab (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 79.0.1
2025-08-31T08:27:12,361     Found link https://www.piwheels.org/simple/setuptools/setuptools-79.0.0-py3-none-any.whl#sha256=116665526266df546ce2f6a957f0297d5f579b4fd9a3b38d0ba07f966acf515a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 79.0.0
2025-08-31T08:27:12,362     Found link https://www.piwheels.org/simple/setuptools/setuptools-78.1.1-py3-none-any.whl#sha256=a951f9a67c92c9c09cb6ed464869c513784028f97f182e395bf96e88b7bab131 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 78.1.1
2025-08-31T08:27:12,363     Found link https://www.piwheels.org/simple/setuptools/setuptools-78.1.0-py3-none-any.whl#sha256=e685d301a4a576a9811067b9a421d14ff8f3f8349ef3056bcc6cd4e9316aabc9 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 78.1.0
2025-08-31T08:27:12,364     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-78.0.2-py3-none-any.whl#sha256=ac96042dc2246d80f9e6d22e28f626c40598e369a9074b8cbc318ae2eb6542d8 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 78.0.2
2025-08-31T08:27:12,365     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-78.0.1-py3-none-any.whl#sha256=8e9a4e39ecab67790bef8e55e27daab0d13b41b3d4bc064bbe147405b7a4c10a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 78.0.1
2025-08-31T08:27:12,367     Found link https://www.piwheels.org/simple/setuptools/setuptools-77.0.3-py3-none-any.whl#sha256=943890ec93ddf21e155264c7dd5bd9b9178be69d0114560b4d1285c676d31894 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 77.0.3
2025-08-31T08:27:12,368     Found link https://www.piwheels.org/simple/setuptools/setuptools-77.0.1-py3-none-any.whl#sha256=758d56831837b548cf1e81ed7be58f088ccfef5976fa2a5171c6a4be82ac69a4 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 77.0.1
2025-08-31T08:27:12,369     Found link https://www.piwheels.org/simple/setuptools/setuptools-76.1.0-py3-none-any.whl#sha256=521ffeb4156b350e986471d00d4c256e7734d630a47f1fcc177e7c4bf24030d5 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 76.1.0
2025-08-31T08:27:12,370     Found link https://www.piwheels.org/simple/setuptools/setuptools-76.0.0-py3-none-any.whl#sha256=5308e1f0e67eb9f5d48620f7b05eb720073fb4a338b1c08f31b803a970806eca (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 76.0.0
2025-08-31T08:27:12,371     Found link https://www.piwheels.org/simple/setuptools/setuptools-75.9.1-py3-none-any.whl#sha256=39e003411906c23ed3954f64e57234962e522f150aac4f9088f812461c5577cb (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 75.9.1
2025-08-31T08:27:12,372     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-75.9.0-py3-none-any.whl#sha256=94734e065ac154d03394130b4943d14c01c15579fb4d6f20b9c990aba1adede0 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 75.9.0
2025-08-31T08:27:12,374     Found link https://www.piwheels.org/simple/setuptools/setuptools-75.8.2-py3-none-any.whl#sha256=418b56bea2574d507a5cc12fe4c1f3dc87b7682c0283072cd4e7eb8e309d7b03 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 75.8.2
2025-08-31T08:27:12,375     Found link https://www.piwheels.org/simple/setuptools/setuptools-75.8.1-py3-none-any.whl#sha256=37d4de3b3a10178f8243ee625b341f6e074d52005e9b02930d255619a436ad4e (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 75.8.1
2025-08-31T08:27:12,376     Found link https://www.piwheels.org/simple/setuptools/setuptools-75.8.0-py3-none-any.whl#sha256=34835c03a8d0dee2399df2a9b1f7498fc9f1566155840004972cdf963c171650 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 75.8.0
2025-08-31T08:27:12,377     Found link https://www.piwheels.org/simple/setuptools/setuptools-75.7.0-py3-none-any.whl#sha256=c7b0014fd40b9641925111f20b4913541f054a7f516a689caddbbfa2a606c47d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 75.7.0
2025-08-31T08:27:12,378     Found link https://www.piwheels.org/simple/setuptools/setuptools-75.6.0-py3-none-any.whl#sha256=3b3008f2ed24323391b703117a8029399121f9c97f5ca9ac3ab2082e508f9e7c (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 75.6.0
2025-08-31T08:27:12,379     Found link https://www.piwheels.org/simple/setuptools/setuptools-75.5.0-py3-none-any.whl#sha256=67888d86072f29091e65eed27758c12aa965d11b989107f62822a8beb3a4ca75 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 75.5.0
2025-08-31T08:27:12,381     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-75.4.0-py3-none-any.whl#sha256=705652fd13a759bb3ef1f3248d0b3b2ecf5b9b6cea7e2373ce812ffb82b3e913 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 75.4.0
2025-08-31T08:27:12,382     Found link https://www.piwheels.org/simple/setuptools/setuptools-75.3.2-py3-none-any.whl#sha256=a11a917f51dffca6a4d270e44c94e6f3cba13b334d5275ded9386c412b1c02f6 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 75.3.2
2025-08-31T08:27:12,383     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-75.3.1-py3-none-any.whl#sha256=4cc77b170c131e3cacae0f28fd6a3be5882c4064c23a93e8f564ddefc9573081 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 75.3.1
2025-08-31T08:27:12,384     Found link https://www.piwheels.org/simple/setuptools/setuptools-75.3.0-py3-none-any.whl#sha256=3f56facc65e6ab888f2efb59bc8edc3a469d88721f7c7e6d09eeca5a42b72399 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 75.3.0
2025-08-31T08:27:12,385     Found link https://www.piwheels.org/simple/setuptools/setuptools-75.2.0-py3-none-any.whl#sha256=aebdaff49fd7fba199ed9d0f21676b753b2164a0a3ac7e7f6ac90dc4cbadb056 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 75.2.0
2025-08-31T08:27:12,386     Found link https://www.piwheels.org/simple/setuptools/setuptools-75.1.0-py3-none-any.whl#sha256=8d32e2f72308958f2609687a4278931d414ce02ddce193c6d725808d6634b084 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 75.1.0
2025-08-31T08:27:12,388     Found link https://www.piwheels.org/simple/setuptools/setuptools-75.0.0-py3-none-any.whl#sha256=7da87ff4c1a1b0630cb66e3cf15b782e725eac59ea8d1555d57ed78e86a72066 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 75.0.0
2025-08-31T08:27:12,389     Found link https://www.piwheels.org/simple/setuptools/setuptools-74.1.3-py3-none-any.whl#sha256=db1e7b6b298f056e87ace5154d0cc76d438eddeda7350550b5cf4dcaa005a1c7 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.3
2025-08-31T08:27:12,390     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-74.1.2-py3-none-any.whl#sha256=c1717712ec78b05605032dfc135b09e78095037e7f42777c5ca379c541f6ef67 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.2
2025-08-31T08:27:12,391     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-74.1.1-py3-none-any.whl#sha256=8c5b1e50d573c6eaa4322765fa682dbeb03c932233a70ff150089efc3d1ace91 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.1
2025-08-31T08:27:12,392     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-74.1.0-py3-none-any.whl#sha256=c7a717e6746d74148a607ca82ddb89a0162fb3760bf10b9c8f2433adeb5dd653 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.0
2025-08-31T08:27:12,394     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-74.0.0-py3-none-any.whl#sha256=fbb38813927e76df332aec1df8166e93993dbb28caa5c573e49332250b59b514 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 74.0.0
2025-08-31T08:27:12,395     Found link https://www.piwheels.org/simple/setuptools/setuptools-73.0.1-py3-none-any.whl#sha256=35c334b2ea49061b8b59f65baefe7eb78ecec78e23f5da628535e69893175c10 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 73.0.1
2025-08-31T08:27:12,396     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-73.0.0-py3-none-any.whl#sha256=b7380b457e1f5940fccbe7a961cedb06e1de1abaac9119b17ad5e0a989c56778 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 73.0.0
2025-08-31T08:27:12,397     Found link https://www.piwheels.org/simple/setuptools/setuptools-72.2.0-py3-none-any.whl#sha256=8c98ae591e6ec049535c48a2b89691b9c2fd509aae376af8c22b6b5e13af92e0 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 72.2.0
2025-08-31T08:27:12,398     Found link https://www.piwheels.org/simple/setuptools/setuptools-72.1.0-py3-none-any.whl#sha256=ef1aeae97fefcf6c3f9846fd7208c6259b759dc7bc68f8799a7289bfe05d9e86 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 72.1.0
2025-08-31T08:27:12,399     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-72.0.0-py3-none-any.whl#sha256=3ccfb3ac604ec39dc0993d46b0e800f915c29d5471a1dbe78067b0570dc01af7 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 72.0.0
2025-08-31T08:27:12,401     Found link https://www.piwheels.org/simple/setuptools/setuptools-71.1.0-py3-none-any.whl#sha256=c606958cf2ecd5bdfb1fb48f24a8cb10248e97117c72af3885675df7471e1ad2 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 71.1.0
2025-08-31T08:27:12,402     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-71.0.4-py3-none-any.whl#sha256=e14b598fa8fc722a3b68243ffc5b0464d034c7dd75471617086f4b899ddb7ee6 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.4
2025-08-31T08:27:12,403     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-71.0.3-py3-none-any.whl#sha256=b8f1570fb277c22e08268ae93908c3492c99dabb3a6b83a5c1ab4b6711ff920a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.3
2025-08-31T08:27:12,404     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-71.0.2-py3-none-any.whl#sha256=2471774980010487516e5968bb004a8ddddd111b385b0886342a6a2ef99dd542 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.2
2025-08-31T08:27:12,405     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-71.0.1-py3-none-any.whl#sha256=ef66aec820d3fc22d55fe8e8cbdaefc6c010636c13036ec568c82d9b746b53f1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.1
2025-08-31T08:27:12,406     Found link https://www.piwheels.org/simple/setuptools/setuptools-71.0.0-py3-none-any.whl#sha256=b4c56736158b35fb4867239458ff61421efaa263405bb7038e31ec7d5e0c06f7 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.0
2025-08-31T08:27:12,408     Found link https://www.piwheels.org/simple/setuptools/setuptools-70.3.0-py3-none-any.whl#sha256=3b17f8ad4b19cec9bdacfde99ed6530c4e9da921a41323bad8ee0098f843bdaf (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 70.3.0
2025-08-31T08:27:12,409     Found link https://www.piwheels.org/simple/setuptools/setuptools-70.2.0-py3-none-any.whl#sha256=b14e608024e29376e42ce47c916af02fe3007cf4e50969150676f2df55f7a124 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 70.2.0
2025-08-31T08:27:12,410     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-70.1.1-py3-none-any.whl#sha256=22ab0d7b799b566fe06add0812f4d0cf9e74c3cfc16690f331f0f4b7fe5e0029 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 70.1.1
2025-08-31T08:27:12,411     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-70.1.0-py3-none-any.whl#sha256=62c63878b01cfd61d365bfdf7862df588010ef5fb997afaa162c077f1567cfa3 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 70.1.0
2025-08-31T08:27:12,412     Found link https://www.piwheels.org/simple/setuptools/setuptools-70.0.0-py3-none-any.whl#sha256=37027def66f082d87279a1581910acd05d752735c48c7894e3b423c1d54715c9 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 70.0.0
2025-08-31T08:27:12,413     Found link https://www.piwheels.org/simple/setuptools/setuptools-69.5.1-py3-none-any.whl#sha256=a7097063ac8aae9f33f7d7758397ec86a8bf1b7baa1b893376485883eac4aa2b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.5.1
2025-08-31T08:27:12,415     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-69.5.0-py3-none-any.whl#sha256=7e508e59fcf57a01e36ebba5dc46842e453efd0abcae0f9dfb91399dc1f6ccb7 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.5.0
2025-08-31T08:27:12,416     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-69.4.2-py3-none-any.whl#sha256=ca55f9726d0a755da5a53bb058e6ec8ea1a15a41085bf081c63613d12f071d26 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.4.2
2025-08-31T08:27:12,417     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-69.4.1-py3-none-any.whl#sha256=3c580955a03c7fa132f7a3b2186b0572d9b7c77018811aaf7a3ccd606e250e12 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.4.1
2025-08-31T08:27:12,418     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-69.4.0-py3-none-any.whl#sha256=70e3afa31eb643e247c21f711562b990bdf22d1684caa311a8cdf71abb52200f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.4.0
2025-08-31T08:27:12,419     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-69.3.1-py3-none-any.whl#sha256=5823290f0feaba2b00a866bee4ced4324b4ce96258c4e3aaa86aaae42ddc2b99 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.3.1
2025-08-31T08:27:12,420     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-69.3.0-py3-none-any.whl#sha256=d9b24501058598b4655c531d67cde43a55d65dd1db0913dfaa3fef814606b466 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.3.0
2025-08-31T08:27:12,422     Found link https://www.piwheels.org/simple/setuptools/setuptools-69.2.0-py3-none-any.whl#sha256=d279ffc6227266fdba425aa9742a3e6d0ba4dacfa2b1312f1b65ed3890082e6a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.2.0
2025-08-31T08:27:12,423     Found link https://www.piwheels.org/simple/setuptools/setuptools-69.1.1-py3-none-any.whl#sha256=e80cddb27be3c47ed49d9f27cbe2316414fd14e5be5143f84f8f7d7b89402173 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.1.1
2025-08-31T08:27:12,424     Found link https://www.piwheels.org/simple/setuptools/setuptools-69.1.0-py3-none-any.whl#sha256=0ae54af345d2e69f9bab0d7ef302ead7b2533a361619db78e98c952a35a0165f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.1.0
2025-08-31T08:27:12,425     Found link https://www.piwheels.org/simple/setuptools/setuptools-69.0.3-py3-none-any.whl#sha256=55a27b1207ffd06fc72552920c9ea1ce81541b8b651ae406bf3d3bb153bf316f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.3
2025-08-31T08:27:12,427     Found link https://www.piwheels.org/simple/setuptools/setuptools-69.0.2-py3-none-any.whl#sha256=3bc5ad43195a9eb1e8c3a2ebab28a9c3202db9d1f8e59b29971aa35abb3e0bfc (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.2
2025-08-31T08:27:12,428     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-69.0.1-py3-none-any.whl#sha256=9c4d043933771b03b0e86846a984b24281a40689d433f11691455b8bce7be14a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.1
2025-08-31T08:27:12,429     Found link https://www.piwheels.org/simple/setuptools/setuptools-69.0.0-py3-none-any.whl#sha256=7a44b57685847980bb37b08c098242577e0acb1a941ae1e01b6b42db9c9bc24b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.0
2025-08-31T08:27:12,430     Found link https://www.piwheels.org/simple/setuptools/setuptools-68.2.2-py3-none-any.whl#sha256=f0df733ea47683814b07dbe33306d759b45214648a1b5f03bdf033f43f653193 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 68.2.2
2025-08-31T08:27:12,431     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-68.2.1-py3-none-any.whl#sha256=de31ae572b523d234b51ec033bb5a28a4636b450819ef59ff98866b0ea1283d5 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 68.2.1
2025-08-31T08:27:12,432     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-68.2.0-py3-none-any.whl#sha256=21c44bd2b10d2e118de5c29f18cfc80305dcc5587cef781523ae9e08376d222a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 68.2.0
2025-08-31T08:27:12,433     Found link https://www.piwheels.org/simple/setuptools/setuptools-68.1.2-py3-none-any.whl#sha256=9e076b8e4f5535e0e67305a15e9eb418006751b9bf0bb8d0a367d09ad0adf3a1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 68.1.2
2025-08-31T08:27:12,434     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-68.1.0-py3-none-any.whl#sha256=0637a8df7f9d79ffffa7010fdd3db5ca70836acda6994af5f7edb9524838aa23 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 68.1.0
2025-08-31T08:27:12,436     Found link https://www.piwheels.org/simple/setuptools/setuptools-68.0.0-py3-none-any.whl#sha256=8c01015dfe356dcf94962ba8c870437b79e7c7b439cc8706190f0fc1d7595ec1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 68.0.0
2025-08-31T08:27:12,437     Found link https://www.piwheels.org/simple/setuptools/setuptools-67.8.0-py3-none-any.whl#sha256=303b3c7de392e325625b35018195fc49c847a4d3d525dcf465e7ab891c2a9dab (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.8.0
2025-08-31T08:27:12,438     Found link https://www.piwheels.org/simple/setuptools/setuptools-67.7.2-py3-none-any.whl#sha256=38313c1c1dc95bada2ed81cf05fc4dac288884d547e66865f2aaff6afa5c6256 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.7.2
2025-08-31T08:27:12,439     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-67.7.1-py3-none-any.whl#sha256=ec553575f60b6c86ab540dda4b08e04af907b4e8eef44857480e0f77f9ce4c70 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.7.1
2025-08-31T08:27:12,440     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-67.7.0-py3-none-any.whl#sha256=924ff064f0e1236ba70eebba688ac6303465e3f9c3518440f13b7f886b959785 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.7.0
2025-08-31T08:27:12,442     Found link https://www.piwheels.org/simple/setuptools/setuptools-67.6.1-py3-none-any.whl#sha256=ae060e31efa47ebd031bdf444908164a9c54dbfe734c97afd5d8e52afbad723a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.6.1
2025-08-31T08:27:12,443     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-67.6.0-py3-none-any.whl#sha256=cf7b2327bdfd9bdbdab13c4633de611ecfaee72baadfde36d00683b47cefbb50 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.6.0
2025-08-31T08:27:12,444     Found link https://www.piwheels.org/simple/setuptools/setuptools-67.5.1-py3-none-any.whl#sha256=0bc5663e192c983a1cdc2a9b0f048cf2fc2cf7e7a709032b3921aa804958884e (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.5.1
2025-08-31T08:27:12,445     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-67.5.0-py3-none-any.whl#sha256=dfba5c5181e728ce87b236088260e3779d700a5dabeb22c6b85fd0395a63cf5a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.5.0
2025-08-31T08:27:12,446     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-67.4.0-py3-none-any.whl#sha256=a45e29e9bd6090eae5f86d1f0cd5f100ff116493604131fd919dc83c7a9a29e3 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.4.0
2025-08-31T08:27:12,447     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-67.3.3-py3-none-any.whl#sha256=b06abe490aa88b8b4fb41e886c286b6db453acd8589dc3bf794bd441317bf711 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.3.3
2025-08-31T08:27:12,449     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-67.3.2-py3-none-any.whl#sha256=fd35e968f165c0184e9f20420b2e301b8dd5e839e4884edd96e6a770cdbd6525 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.3.2
2025-08-31T08:27:12,450     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-67.3.1-py3-none-any.whl#sha256=78d8bc509762dfdd6f5bd096a543960d8eb9913875d7e50c79593f84ebea3518 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.3.1
2025-08-31T08:27:12,451     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-67.2.0-py3-none-any.whl#sha256=5cd4f6b868a5a5dc1074b06d43af1d61524a2774f2bde32af234142236fb5819 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.2.0
2025-08-31T08:27:12,452     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-67.1.0-py3-none-any.whl#sha256=8e12f43c46760f7743d74ca8a9b3b0a45cf95cef50ad740958fc084f391cabe8 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.1.0
2025-08-31T08:27:12,453     Found link https://www.piwheels.org/simple/setuptools/setuptools-67.0.0-py3-none-any.whl#sha256=111b43bda59bd9d87d8b1e4437a6d847e0a0e842e59005b7b399c8941a89c6c9 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.0.0
2025-08-31T08:27:12,454     Found link https://www.piwheels.org/simple/setuptools/setuptools-66.1.1-py3-none-any.whl#sha256=845d2eb3d1e303745a3e2557c130aa5abba834dd6913be3657d1db6dec0ad06a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 66.1.1
2025-08-31T08:27:12,456     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-66.1.0-py3-none-any.whl#sha256=d306ad7243f8ef8decb0769bd717893617c2e93e9a74a34eda22c8f789d5ff11 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 66.1.0
2025-08-31T08:27:12,457     Found link https://www.piwheels.org/simple/setuptools/setuptools-66.0.0-py3-none-any.whl#sha256=3ddef51d2ef82b1a084aad40047d6756cb0e98df10459c47dae93aa11eeb02e0 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 66.0.0
2025-08-31T08:27:12,458     Found link https://www.piwheels.org/simple/setuptools/setuptools-65.7.0-py3-none-any.whl#sha256=6de9315cd4b26897a25e4f4c377e43826c738c2aaa279f6f850406db542fc65b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.7.0
2025-08-31T08:27:12,459     Found link https://www.piwheels.org/simple/setuptools/setuptools-65.6.3-py3-none-any.whl#sha256=ad515432e028cbf9bf9073ec89d24ca2cc6731522022b62d909e1312461977fd (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.3
2025-08-31T08:27:12,461     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-65.6.2-py3-none-any.whl#sha256=ce009b77629ef2d71f9c5f66752ba4cff23a3efdfa61974fa7f5d6876773e5ba (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.2
2025-08-31T08:27:12,462     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-65.6.1-py3-none-any.whl#sha256=14fd3094867f9b9b9add924e4ac0d7147ae1b58fa87bc5123874eef8c7b3b022 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.1
2025-08-31T08:27:12,463     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-65.6.0-py3-none-any.whl#sha256=b784e7f69dfd0c649dcdc7959618fa0796b3def39ade52ea6c9e2ed680e27c49 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.0
2025-08-31T08:27:12,464     Found link https://www.piwheels.org/simple/setuptools/setuptools-65.5.1-py3-none-any.whl#sha256=5142de54f515d937b0989408c6b980e8ad5f50bad7c07aa32309c5c83f6606fc (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.5.1
2025-08-31T08:27:12,465     Found link https://www.piwheels.org/simple/setuptools/setuptools-65.5.0-py3-none-any.whl#sha256=04857c3412f611c4f286e0be7cc372cf1174dcba5dc122beca133813e2e6ae6f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.5.0
2025-08-31T08:27:12,466     Found link https://www.piwheels.org/simple/setuptools/setuptools-65.4.1-py3-none-any.whl#sha256=dedd3ff536626958f1723c8150f4ac12b5e973476eaf1bdad5fdf28268b9607d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.4.1
2025-08-31T08:27:12,468     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-65.4.0-py3-none-any.whl#sha256=907a376f73d880cf77245c549660cee1bf74aa69fb368df6c99869d5880f4c3a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.4.0
2025-08-31T08:27:12,469     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-65.3.0-py3-none-any.whl#sha256=d4921bf4a5242141989d842094e055a49641e1496040e23b028d8239df3c62fe (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.3.0
2025-08-31T08:27:12,470     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-65.2.0-py3-none-any.whl#sha256=f13beaf3a31bd6de991b65b3868758a57d5442f4d8b2bd74acad8ef6f7f66a26 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.2.0
2025-08-31T08:27:12,471     Found link https://www.piwheels.org/simple/setuptools/setuptools-65.1.1-py3-none-any.whl#sha256=396ad2a204eaa1c522535fbe0857864760ba412a44504a2a7d46778358b6df44 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.1.1
2025-08-31T08:27:12,472     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-65.1.0-py3-none-any.whl#sha256=252a29fd5e070717fccffe1494c5fea023564a353be143247fb3401e17332fe9 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.1.0
2025-08-31T08:27:12,473     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-65.0.2-py3-none-any.whl#sha256=5c084d9b55869bcb7c2939d1328413145357da96f36344b0dfe068ae45b51989 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.0.2
2025-08-31T08:27:12,475     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-65.0.1-py3-none-any.whl#sha256=8d85581843d74c553a0b1454f9d692b3de8ebd5416306fc027018086825c0cee (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.0.1
2025-08-31T08:27:12,476     Found link https://www.piwheels.org/simple/setuptools/setuptools-65.0.0-py3-none-any.whl#sha256=b9ef0377a0ec63d8e106343d7c136115f86e774fe0f5a9aba10dbdce970894ce (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.0.0
2025-08-31T08:27:12,477     Found link https://www.piwheels.org/simple/setuptools/setuptools-64.0.3-py3-none-any.whl#sha256=3dfd94364bfe7530a39b4421edd58693e8a17ea0368201459954474789630bd1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.3
2025-08-31T08:27:12,478     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-64.0.2-py3-none-any.whl#sha256=6b731c76cb4a7359688613f77ddc7482f477916f381bfe90e625979d08db82a8 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.2
2025-08-31T08:27:12,479     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-64.0.1-py3-none-any.whl#sha256=640386b48109ce3ad4b478b46a28238476507a43f19226f644f147f1c9235938 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.1
2025-08-31T08:27:12,480     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-64.0.0-py3-none-any.whl#sha256=28f8efce8c1213978700b4931c14fe1d8667c5e7e08473c83d806845e0aa92bf (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.0
2025-08-31T08:27:12,481     Found link https://www.piwheels.org/simple/setuptools/setuptools-63.4.3-py3-none-any.whl#sha256=c86891e1e64a371c1851e969089039bfdd2f32d26cd249be165ba2514303a050 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.3
2025-08-31T08:27:12,482     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-63.4.2-py3-none-any.whl#sha256=0ea0d5b13ac5e61ad533bd7561000c9d47357e4e06a20cbdb2e3e46eab3e7f6d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.2
2025-08-31T08:27:12,483     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-63.4.1-py3-none-any.whl#sha256=dc3f7556da9048e44775e0bc09b0b6385db8d008ad16eb3b84abe105a5f3d89b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.1
2025-08-31T08:27:12,484     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-63.4.0-py3-none-any.whl#sha256=4e149a2bf1bada168dc3ded5f4c9e5a555818b4aaa9210673168e79ab2d374a1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.0
2025-08-31T08:27:12,485     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-63.3.0-py3-none-any.whl#sha256=f36d25ad984eed0506f3d7a21261eab18d72674edcc1c6772640a77e9edeeca1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 63.3.0
2025-08-31T08:27:12,486     Found link https://www.piwheels.org/simple/setuptools/setuptools-63.2.0-py3-none-any.whl#sha256=f52e972b9c0b6bfea416c7b29431a49a01307523063fcaa995823263d188531a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 63.2.0
2025-08-31T08:27:12,488     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-63.1.0-py3-none-any.whl#sha256=39c0bbcad329e30ba00526a60aedd1e81dc7ad080179a815ec94c49c5a8e588b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 63.1.0
2025-08-31T08:27:12,489     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-63.0.0-py3-none-any.whl#sha256=e12b84a34cc5b9d9416d03776608700af1778e82059eeb10271f0ffd2e11810b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 63.0.0
2025-08-31T08:27:12,490     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-63.0.0b1-py3-none-any.whl#sha256=67625af0d6d1dcf48f99cedc838df8fb676ce12aab67ed33bcc99219f629850e (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 63.0.0b1
2025-08-31T08:27:12,491     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-62.6.0-py3-none-any.whl#sha256=44a1be236d6775c1c2ccb2dab1c7a8a38f155a0e8c705e5dbeb395985e7e7b23 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 62.6.0
2025-08-31T08:27:12,492     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-62.5.0-py3-none-any.whl#sha256=99779f6035f17d8d20b7a748d50ca09569ce2453d6c1b6c10a44e5be64a86610 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 62.5.0
2025-08-31T08:27:12,493     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-62.4.0-py3-none-any.whl#sha256=cd258b3e442ef2af923131a75c9c3c3b2e70f6bb6e12aef32c40eb477276f0c7 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 62.4.0
2025-08-31T08:27:12,494     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-62.3.4-py3-none-any.whl#sha256=f902791900be9160683eead2c814b3848787bc067c4ff753cc5503dc765188a4 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.4
2025-08-31T08:27:12,495     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-62.3.3-py3-none-any.whl#sha256=b5da250995f799c9fe48932ecc3c8e49a9761183b760af203b08283709970458 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.3
2025-08-31T08:27:12,497     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-62.3.2-py3-none-any.whl#sha256=2142251486ec1881efb6bf2b9987157588b73b3e98ea32cb97131ed8ed99853c (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.2
2025-08-31T08:27:12,498     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-62.3.1-py3-none-any.whl#sha256=1d10b39674a5ff5cb7e38d124cc8809d994ccfee50bcaa70c274d520530d84ba (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.1
2025-08-31T08:27:12,498     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-62.3.0-py3-none-any.whl#sha256=5870c465ea841be542f2ffc17a01f6a5ec01dc43f4bc52160d93763ab6f80f45 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.0
2025-08-31T08:27:12,499     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-62.2.0-py3-none-any.whl#sha256=a03c617aa41275b807183d5bb3f916d83c5a3cd989da1000cb492d9318688efd (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 62.2.0
2025-08-31T08:27:12,500     Found link https://www.piwheels.org/simple/setuptools/setuptools-62.1.0-py3-none-any.whl#sha256=96593b29c29afe0b91eb7a5227cb2c05c251913b48ece2ccb5c150141a7b102f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 62.1.0
2025-08-31T08:27:12,501     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-62.0.0-py3-none-any.whl#sha256=4d7307657f96775965f70d197cc7a51237ce9e03fc370a697a16df4d18bf6b5a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 62.0.0
2025-08-31T08:27:12,502     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-61.3.1-py3-none-any.whl#sha256=0873be1e8694e4aa4680aba6640df2705ada94b95a9299a1eb84c6b586e8f965 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 61.3.1
2025-08-31T08:27:12,503     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-61.3.0-py3-none-any.whl#sha256=18e0b7c6aaab34206b7cc321bf6e22bcb791893afeb8c18670d287f3febf5c88 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 61.3.0
2025-08-31T08:27:12,504     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-61.2.0-py3-none-any.whl#sha256=4a4588fb8d170de868d9fe89de1c315ef9313d5ea877e791de0884abe263715d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 61.2.0
2025-08-31T08:27:12,505     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-61.1.1-py3-none-any.whl#sha256=e92a5de11ef918b360a507ac7751f1eca39b90e05db4fae333c900d7df8cfa01 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 61.1.1
2025-08-31T08:27:12,506     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-61.1.0-py3-none-any.whl#sha256=cecf340b4c4013592f482bd59d445beb5a5695bacb18a18455834e774ec209d2 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 61.1.0
2025-08-31T08:27:12,508     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-61.0.0-py3-none-any.whl#sha256=1369b7b0664867a75f7a5766fe68dcfb7dd44cd192b58d9396d547af4e88df60 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 61.0.0
2025-08-31T08:27:12,509     Found link https://www.piwheels.org/simple/setuptools/setuptools-60.10.0-py3-none-any.whl#sha256=7bd3384b3e8203d42c64efa4acc388892c5a183a65ee581689d15225ae18e5ea (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.10.0
2025-08-31T08:27:12,510     Found link https://www.piwheels.org/simple/setuptools/setuptools-60.9.3-py3-none-any.whl#sha256=c05b08e7725495dc61f3045db23246554f6ffeb939896b3d694b3cb31c4ec08e (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.3
2025-08-31T08:27:12,511     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-60.9.2-py3-none-any.whl#sha256=6fc29ef21c841d87835dc47a2632fee908218b86f9ba3747e345e98ad9e2351f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.2
2025-08-31T08:27:12,512     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-60.9.1-py3-none-any.whl#sha256=096cba68ed18ff33c729c0018473e678f014f439c3837fc339e2d29a233dd307 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.1
2025-08-31T08:27:12,513     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-60.9.0-py3-none-any.whl#sha256=e6c8df111443eeef4e17993edee8717025745459598a309fb007682b7ce4fa77 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.0
2025-08-31T08:27:12,514     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-60.8.2-py3-none-any.whl#sha256=121c3d7b9f51bdabfead1218dbc0eb255d3e2bfe6d641c33ab97d168bec171b6 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.8.2
2025-08-31T08:27:12,515     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-60.8.1-py3-none-any.whl#sha256=54a0afb242ca7daec744ac74ca756accfd850aa4da4cf482fbeaab581e45b261 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.8.1
2025-08-31T08:27:12,516     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-60.8.0-py3-none-any.whl#sha256=ea15bc59757f59fdbba48d762cee1af31b4e3c8837dc391ef1ffffa015858c30 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.8.0
2025-08-31T08:27:12,517     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-60.7.1-py3-none-any.whl#sha256=1edd7488fa9164584008b980106cea0103ae0db09b450cdf9d494afc1a0144aa (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.7.1
2025-08-31T08:27:12,518     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-60.7.0-py3-none-any.whl#sha256=98dce8fa7c52a97c5826e0f6b7b5e1fc3271f344387cd40da16ad855ac673999 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.7.0
2025-08-31T08:27:12,519     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-60.6.0-py3-none-any.whl#sha256=000ac6ced41920b6d29f614dae82619c3db15cd8c74848882db78f37d103f103 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.6.0
2025-08-31T08:27:12,520     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-60.5.0-py3-none-any.whl#sha256=dac82fcac9068cd04127f607b870a0f568f642147796e84ce93ae53960e6c5b4 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.5.0
2025-08-31T08:27:12,521     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-60.4.0-py3-none-any.whl#sha256=b8328f765f59b4bbd2241fe5d20049a4eeda8bd95cbfb6daec7bf7ee35854d09 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.4.0
2025-08-31T08:27:12,522     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-60.3.1-py3-none-any.whl#sha256=300df52f3d20d690205ef7de0ce25707c1779a25534a1650e5cbecb35fa3b644 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.3.1
2025-08-31T08:27:12,523     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-60.3.0-py3-none-any.whl#sha256=67e182811c1c5ba41850138a1186389125ba9b296bf960b3e468914ef750da65 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.3.0
2025-08-31T08:27:12,524     Found link https://www.piwheels.org/simple/setuptools/setuptools-60.2.0-py3-none-any.whl#sha256=2998e8445bb4032d0284ded398418e67952824b8303cfc5a1bf86213586f861f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.2.0
2025-08-31T08:27:12,525     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-60.1.1-py3-none-any.whl#sha256=11b988f014f910142f82796d94454227d1705091348e5507edf000fd53d6f27f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.1.1
2025-08-31T08:27:12,526     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-60.1.0-py3-none-any.whl#sha256=bb58dc83b6b79dd9f9ed05a8b7ad4da5226c0946f53408148f23f5221a127a49 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.1.0
2025-08-31T08:27:12,527     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-60.0.5-py3-none-any.whl#sha256=ba300793890e3ec28937a0e264f204f25db3cf0546c8bdca420dd847629b8a3d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.5
2025-08-31T08:27:12,529     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-60.0.4-py3-none-any.whl#sha256=721d328f0741ea7669f4e95fbae6bffa9814f5260db3a3fa486e2b05c749bed6 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.4
2025-08-31T08:27:12,530     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-60.0.3-py3-none-any.whl#sha256=311b91c673b1a37c8424d9e71680c6d09283bd74cc708437a144ec618f03ff20 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.3
2025-08-31T08:27:12,531     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-60.0.2-py3-none-any.whl#sha256=d4d1ffd6295303f4974b754c20976e985bad1ac05699d8eaa4fa6fe1023f4583 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.2
2025-08-31T08:27:12,532     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-60.0.1-py3-none-any.whl#sha256=83d1d70106a00905a1ade474d3e7d434a2ca9a45e97a542bd8b0dcf438b2eae6 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.1
2025-08-31T08:27:12,533     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-60.0.0-py3-none-any.whl#sha256=745ba258677c51a11038d09e80360f068955b491c30b698351fe57e3e76d2eba (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.0
2025-08-31T08:27:12,534     Found link https://www.piwheels.org/simple/setuptools/setuptools-59.8.0-py3-none-any.whl#sha256=88ab606e4039e60c5b2e9bed062e2ec9ce212b8b3ac47c8cadb5af850a42acb4 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 59.8.0
2025-08-31T08:27:12,535     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-59.7.0-py3-none-any.whl#sha256=dfac689d028e811da6312f56b33b66d27d0502ba28192dfc5b59726b73cc143c (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 59.7.0
2025-08-31T08:27:12,536     Found link https://www.piwheels.org/simple/setuptools/setuptools-59.6.0-py3-none-any.whl#sha256=9292604944daf6aafbaed7c9a30d95688ae83ffdf71ba3cf4629a67664f534e0 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 59.6.0
2025-08-31T08:27:12,537     Found link https://www.piwheels.org/simple/setuptools/setuptools-59.5.0-py3-none-any.whl#sha256=817f259cf47a714d6bafd8c2c5da4c0347929cf2cb5165e061b9357db65fff4c (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 59.5.0
2025-08-31T08:27:12,538     Found link https://www.piwheels.org/simple/setuptools/setuptools-59.4.0-py3-none-any.whl#sha256=60b0db188f9c2c5efa183d0eb0c4ac70c2ee5806c09bcdf404a8cd22c5cc7591 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 59.4.0
2025-08-31T08:27:12,539     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-59.3.0-py3-none-any.whl#sha256=6650c8fe370deb7a7c3900ec0fd538a7f9c0785acfb665e78b40e06183335f17 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 59.3.0
2025-08-31T08:27:12,541     Found link https://www.piwheels.org/simple/setuptools/setuptools-59.2.0-py3-none-any.whl#sha256=0fba77cca05f3c7ee7fba4e28e6afff4a2ff2f17ba7beadace2818f8681c1b97 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 59.2.0
2025-08-31T08:27:12,542     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-59.1.1-py3-none-any.whl#sha256=85272a5bc29a0cdf7db98b7e1bf05bcae3cc90dda06e0bb809fd37d07b90a9dd (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 59.1.1
2025-08-31T08:27:12,543     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-59.1.0-py3-none-any.whl#sha256=f32e58cd4c603d4430cfbce838d7432b91db9835fa3fbcb9dacb971ea6b44762 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 59.1.0
2025-08-31T08:27:12,544     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-59.0.1-py3-none-any.whl#sha256=776f808675e112a7999ce83eb33e9e2a86850a3d281a9933333880ebedbb8773 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 59.0.1
2025-08-31T08:27:12,545     Found link https://www.piwheels.org/simple/setuptools/setuptools-58.5.3-py3-none-any.whl#sha256=0bc9c11341c16578dcc0a2b63ebc3c45b84cf4bf2a5e50fb04de196a894e5142 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.3
2025-08-31T08:27:12,546     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-58.5.2-py3-none-any.whl#sha256=b9edfa579d4783d721c5f01590b8c81d65aee0c7670431d8978d29f1e434d195 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.2
2025-08-31T08:27:12,548     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-58.5.1-py3-none-any.whl#sha256=6375972d00bb2c556da60624a61665ad0b99808fb74a555864e389c3807e5379 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.1
2025-08-31T08:27:12,549     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-58.5.0-py3-none-any.whl#sha256=1670d87ebab9f576d3ebe7cafc59457f12a4d21564b6211d4ab9ecd6cf75e690 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.0
2025-08-31T08:27:12,550     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-58.4.0-py3-none-any.whl#sha256=b128a113375d654673e02285c9e56560e4790e7ca3163d911f1524d055a98a8e (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.4.0
2025-08-31T08:27:12,551     Found link https://www.piwheels.org/simple/setuptools/setuptools-58.3.0-py3-none-any.whl#sha256=7518d58efefd802cada4299d55b45f5fe4080dfde2b65106d1e2e631e75cbb1b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.3.0
2025-08-31T08:27:12,552     Found link https://www.piwheels.org/simple/setuptools/setuptools-58.2.0-py3-none-any.whl#sha256=eac3ebf8d55717fc2729fdebdc2fda45950cd37e7254d4559357b989d23bc0b4 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.2.0
2025-08-31T08:27:12,553     Found link https://www.piwheels.org/simple/setuptools/setuptools-58.1.0-py3-none-any.whl#sha256=5901389799c041b5456aac82eae09a54007cf74181f836e88ce9ae6497f3c390 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.1.0
2025-08-31T08:27:12,555     Found link https://www.piwheels.org/simple/setuptools/setuptools-58.0.4-py3-none-any.whl#sha256=8a81e0430874a40f4addcd502efc9d526a0691a5f2d26c26995f13defdbe2515 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.4
2025-08-31T08:27:12,556     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-58.0.3-py3-none-any.whl#sha256=1f38b559490c40d05ede3073b9fb846ae076eda09bdcbd61ca0c56125db80f4b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.3
2025-08-31T08:27:12,557     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-58.0.2-py3-none-any.whl#sha256=1f112ffa4d1a59c6672a55b34fc4fd6e7cab0de2bc81fe61843412958661dd2b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.2
2025-08-31T08:27:12,558     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-58.0.1-py3-none-any.whl#sha256=d5d08d98dbe8873871fa170b0fbcf675ab659d1e7fc58f38378f92f3166b1ff8 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.1
2025-08-31T08:27:12,559     Found link https://www.piwheels.org/simple/setuptools/setuptools-58.0.0-py3-none-any.whl#sha256=c21767220657e2600b1df1100dc53c3866f84390a772034a843ae853b3c628aa (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.0
2025-08-31T08:27:12,560     Found link https://www.piwheels.org/simple/setuptools/setuptools-57.5.0-py3-none-any.whl#sha256=291778f86d138ddf51d0e032a5fc7c8ca30e07548deeafb898f4bfde1c408904 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 57.5.0
2025-08-31T08:27:12,561     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-57.4.0-py3-none-any.whl#sha256=8291152a0c291614911887d1067691a1584a0366baaa2540f4f9f2ca48bda277 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 57.4.0
2025-08-31T08:27:12,562     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-57.3.0-py3-none-any.whl#sha256=f2ae98c6be779bfbcc101f831f54c676711a704f5313e10bf84f24c25301da08 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 57.3.0
2025-08-31T08:27:12,563     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-57.2.0-py3-none-any.whl#sha256=b4bb42f3123fbb01e4f5f5ea9ed6d6b5f7021d18b3bc64236477a82aedf2190e (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 57.2.0
2025-08-31T08:27:12,564     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-57.1.0-py3-none-any.whl#sha256=ddae4c1b9220daf1e32ba9d4e3714df6019c5b583755559be84ff8199f7e1fe3 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 57.1.0
2025-08-31T08:27:12,565     Found link https://www.piwheels.org/simple/setuptools/setuptools-57.0.0-py3-none-any.whl#sha256=c8b9f1a457949002e358fea7d3f2a1e1b94ddc0354b2e40afc066bf95d21bf7b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 57.0.0
2025-08-31T08:27:12,567     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-56.2.0-py3-none-any.whl#sha256=bc30153eec47d82f20c6f5e1a13d4ee725c6deb7013a67557f89bfe5d25235c4 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 56.2.0
2025-08-31T08:27:12,568     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-56.1.0-py3-none-any.whl#sha256=9ceb15de17f8e99dd4903f88e05e04285fa60f364f67bdcc4334aa71604b7a39 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 56.1.0
2025-08-31T08:27:12,569     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-56.0.0-py3-none-any.whl#sha256=7430499900e443375ba9449a9cc5d78506b801e929fef4a186496012f93683b5 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 56.0.0
2025-08-31T08:27:12,570     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-54.2.0-py3-none-any.whl#sha256=b726461910b9ba30f077880c228bea22121aec50b172edf39eb7ff026c054a11 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 54.2.0
2025-08-31T08:27:12,571     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-54.1.3-py3-none-any.whl#sha256=14e36b76e7b4c7e2fe847de59e4c65ec2f7c918c596a4a62c844fe70a21d9e9f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.3
2025-08-31T08:27:12,572     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-54.1.2-py3-none-any.whl#sha256=dd20743f36b93cbb8724f4d2ccd970dce8b6e6e823a13aa7e5751bb4e674c20b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.2
2025-08-31T08:27:12,574     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-54.1.1-py3-none-any.whl#sha256=75c5c4479f4961f1ffdb597c98aa4e4077e6813685025e8bdebf7598aa84e859 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.1
2025-08-31T08:27:12,575     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-54.1.0-py3-none-any.whl#sha256=8c39e8581eb1e70bcfd0acc403cc83b24be02ac544f35f6714edf80beb1087de (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.0
2025-08-31T08:27:12,576     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-54.0.0-py3-none-any.whl#sha256=d85b57c41e88b69ab87065c964134ec85b7573cbab0fdaa7ef32330ed764600a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 54.0.0
2025-08-31T08:27:12,577     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-53.1.0-py3-none-any.whl#sha256=487f7a3e5040445b687f1eadcebcbbd11e83da95cad5e755304e38a3b7a93207 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 53.1.0
2025-08-31T08:27:12,578     Found link https://www.piwheels.org/simple/setuptools/setuptools-53.0.0-py3-none-any.whl#sha256=0e86620d658c5ca87a71a283bd308fcaeb4c33e17792ef6f081aec17c171347f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 53.0.0
2025-08-31T08:27:12,579     Found link https://www.piwheels.org/simple/setuptools/setuptools-52.0.0-py3-none-any.whl#sha256=0a6f1f18249f78cffdad842efadf1ed7b039fa3355d93f3890f56bd66a48cf27 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 52.0.0
2025-08-31T08:27:12,580     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-51.3.3-py3-none-any.whl#sha256=9f341a0ce18d9fac647177e19cbaef87a49ad3192231290342db2da6ab570d25 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.3
2025-08-31T08:27:12,581     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-51.3.2-py3-none-any.whl#sha256=c3db0ee767fc63767aab29468193e4d9727bd30bc54dbff1f56d2eda40b3fd63 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.2
2025-08-31T08:27:12,582     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-51.3.1-py3-none-any.whl#sha256=c40e4153c5143957fffdd9d8989725610ff76a5fc4d52a596c66bb0b3f351e6a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.1
2025-08-31T08:27:12,583     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-51.3.0-py3-none-any.whl#sha256=215f0003ac42f7bd9044239764f3b8b26946dc544b423de44c072a51c98e464b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.0
2025-08-31T08:27:12,584     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-51.2.0-py3-none-any.whl#sha256=56948bf25c682e166cf2bfe7c1ad63e5745849b50d1ae7b0f8bff5decdcf34f2 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 51.2.0
2025-08-31T08:27:12,585     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-51.1.2-py3-none-any.whl#sha256=67d8af2fc9f33e48f8f4387321700a79b27090a5cff154e5ce1a8c72c2eea54f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.2
2025-08-31T08:27:12,586     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-51.1.1-py3-none-any.whl#sha256=6d119767443a0f770bab9738b86ce9c0a699a7759ff4f61af583ee73d2e528a0 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.1
2025-08-31T08:27:12,587     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-51.1.0.post20201221-py3-none-any.whl#sha256=b19bdbc197e43337d350cc3806497ab6022802175dfb1abea16c0c3afd233f03 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.0.post20201221
2025-08-31T08:27:12,588     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-51.1.0-py3-none-any.whl#sha256=12b5544f6f31292b4cb4490d608baebb0583d3702e05cf569dbd5993714aa5ae (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.0
2025-08-31T08:27:12,589     Found link https://www.piwheels.org/simple/setuptools/setuptools-51.0.0-py3-none-any.whl#sha256=8c177936215945c9a37ef809ada0fab365191952f7a123618432bbfac353c529 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 51.0.0
2025-08-31T08:27:12,590     Found link https://www.piwheels.org/simple/setuptools/setuptools-50.3.2-py3-none-any.whl#sha256=2c242a0856fbad7efbe560df4a7add9324f340cf48df43651e9604924466794a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 50.3.2
2025-08-31T08:27:12,591     Found link https://www.piwheels.org/simple/setuptools/setuptools-50.3.1-py3-none-any.whl#sha256=8d057d7a928a82cdc985654355fc9e5431def7b6bdfc9e0f32d1e388a63c8ec6 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 50.3.1
2025-08-31T08:27:12,592     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-50.3.0-py3-none-any.whl#sha256=c77b3920663a435c9450d9d971c48f5a7478fca8881b2cd2564e59f970f03536 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 50.3.0
2025-08-31T08:27:12,593     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-50.2.0-py3-none-any.whl#sha256=b4936e805c5cdf13b8b8494a7ce803f030898e1e02ca6f10a062b1e5e6563c10 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 50.2.0
2025-08-31T08:27:12,595     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-50.1.0-py3-none-any.whl#sha256=4537c77e6e7dc170081f8547564551d4ff4e4999717434e1257600bbd3a23296 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 50.1.0
2025-08-31T08:27:12,596     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-50.0.3-py3-none-any.whl#sha256=bb3522bc8120a0eaeb209677c0a001df2c9b95054c4ea945710655a07a3bba9f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.3
2025-08-31T08:27:12,597     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-50.0.2-py3-none-any.whl#sha256=6993f5ddabd29f3a135a54de5a6bad4333a43338eeb81b85cc776a95c86b4142 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.2
2025-08-31T08:27:12,598     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-50.0.1-py3-none-any.whl#sha256=868105b87d32d3b96bf636e7b6d6b975c7ccad56b134bbe1e08b727ce3065b44 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.1
2025-08-31T08:27:12,599     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-50.0.0-py3-none-any.whl#sha256=1e842b6dc37a1282f95a05551efe2c4bd09ddca8dd506ed3aa635a9fb6d15309 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.0
2025-08-31T08:27:12,600     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-49.6.0-py3-none-any.whl#sha256=4dd5bb0a0a0cff77b46ca5dd3a84857ee48c83e8223886b556613c724994073f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.6.0
2025-08-31T08:27:12,601     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-49.5.0-py3-none-any.whl#sha256=2275e3ea824991fa5485c59ba718c25013d24da53a44f3757b3c89159e7e381a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.5.0
2025-08-31T08:27:12,602     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-49.4.0-py3-none-any.whl#sha256=967c4f532255deea2d1f0a4f534d2f230d0d9f2b1205521849b0225ecd0ee3eb (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.4.0
2025-08-31T08:27:12,603     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-49.3.2-py3-none-any.whl#sha256=c312ba1fcfaf9611ebafb9d65decdb7bb8ed07a715098685f490f4ce4bd2912f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.3.2
2025-08-31T08:27:12,604     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-49.3.1-py3-none-any.whl#sha256=b90e630c5d6b118357392245a9a3b34d22e06fe94538b4b0830a7b4b693a0e5c (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.3.1
2025-08-31T08:27:12,605     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-49.3.0-py3-none-any.whl#sha256=a0565ae167027d0ea0df80daae5f5d0676fa5f85c8cef039ed431c33f21378c0 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.3.0
2025-08-31T08:27:12,606     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-49.2.1-py3-none-any.whl#sha256=a3c99716b007e6dddf4fce473841f8231535422cbc9e4e3c0d914db83d461360 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.2.1
2025-08-31T08:27:12,607     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-49.2.0-py3-none-any.whl#sha256=1b98f48187e44dacf4f4a6c7d76c88a36f6f89797a0363e29265b4af05fda951 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.2.0
2025-08-31T08:27:12,608     Found link https://www.piwheels.org/simple/setuptools/setuptools-49.1.3-py3-none-any.whl#sha256=e7a489ec4683a1c93f2ca66ac40480965e482cef7d39f21fa33ea44547bfaa8c (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.3
2025-08-31T08:27:12,609     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-49.1.2-py3-none-any.whl#sha256=911a76cdd8ba8ecaeae4492722e0531fe072729f240fb888016acb3da9f3008d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.2
2025-08-31T08:27:12,610     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-49.1.1-py3-none-any.whl#sha256=182f2ae75f141ec9c98e3e58c8bc8b9a09b42f6161f210386913497e1ecaa766 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.1
2025-08-31T08:27:12,611     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-49.1.0-py3-none-any.whl#sha256=0b4bb5c7ac2521ba71a8ab66d8371cbf6f5c98e9d7929f4b56e86e15b33ba920 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.0
2025-08-31T08:27:12,612     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-49.0.1-py3-none-any.whl#sha256=a3e01629a5b825c1207ec9996eb2b3d62fa8b2f0a959e1f22d5a914d5da0e4f7 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.0.1
2025-08-31T08:27:12,613     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-49.0.0-py3-none-any.whl#sha256=0621227dc6beddef7ead90e1127cc05a7790eacf6a5874076da8afc34ea20a0c (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.0.0
2025-08-31T08:27:12,615     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-48.0.0-py3-none-any.whl#sha256=229784bd05c38d1d0cf06e6d6adb241ced7e7b883db4edb7a71f9e425b71f8e3 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 48.0.0
2025-08-31T08:27:12,616     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-47.3.2-py3-none-any.whl#sha256=320a31aebad9d4933ee294b960aacd501767694feee3900ec323f091504a383b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 47.3.2
2025-08-31T08:27:12,617     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-47.3.1-py3-none-any.whl#sha256=4ba6f9789ea243a6b8ba57da81f75a53494456117810436fd9277a74d1c915d1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 47.3.1
2025-08-31T08:27:12,618     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-47.3.0-py3-none-any.whl#sha256=4c9d0e2973a448216ea85a245ac34ffea6566b626c8796758e572217630b312b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 47.3.0
2025-08-31T08:27:12,619     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-47.2.0-py3-none-any.whl#sha256=5da578f0979a9a9458e4975a90356e4b5796bf118419f934f68ab529ef480a96 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 47.2.0
2025-08-31T08:27:12,620     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-47.1.1-py3-none-any.whl#sha256=17123a2987c433e8ddaec6fbdf5d760a9ec0e45c6e5d57f54a7099bef458d179 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 47.1.1
2025-08-31T08:27:12,621     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-47.1.0-py3-none-any.whl#sha256=0e6ed68d292666370a4052af104cef4e027b4da823505b2a326f4dc1cb8eb269 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 47.1.0
2025-08-31T08:27:12,622     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-47.0.0-py3-none-any.whl#sha256=32233ece56e0fa5e864f87376a025ab2872dafeeea179b095c1ce84915d9ed3b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 47.0.0
2025-08-31T08:27:12,623     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-46.4.0-py3-none-any.whl#sha256=473a89080ef08f09d323b130fcb46e8c879c797b09dec82455225f643f2fdbea (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 46.4.0
2025-08-31T08:27:12,625     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-46.3.1-py3-none-any.whl#sha256=3e5cbf7376b83ff99c251a7ecfeae2149240d4c9fcad20137e528cb1880d008d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 46.3.1
2025-08-31T08:27:12,626     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-46.3.0-py3-none-any.whl#sha256=c5ea7a129a2875dc5f9eb2cf335d7b4b98777153b5be9ef63ceb30193b38f8a0 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 46.3.0
2025-08-31T08:27:12,627     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-46.2.0-py3-none-any.whl#sha256=c3ca05451d860388f38572f9ff5f4f354ac9c2a1a69b2ba9dfb45a600761a481 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 46.2.0
2025-08-31T08:27:12,628     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-46.1.3-py3-none-any.whl#sha256=4fe404eec2738c20ab5841fa2d791902d2a645f32318a7850ef26f8d7215a8ee (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.3
2025-08-31T08:27:12,629     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-46.1.2-py3-none-any.whl#sha256=62fd202dea4dd78827a72c0c4eccd364f5faf64d438e2124c288bb3ef61e12de (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.2
2025-08-31T08:27:12,630     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-46.1.1-py3-none-any.whl#sha256=935dcf0e5f967f84187d9abf6f1ba2d8b2e791ae25f915cb43a2e44d21421758 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.1
2025-08-31T08:27:12,631     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-46.1.0-py3-none-any.whl#sha256=55453a174d4ebe609240ce8e459e993b6e075ca992cb2db014e442ccb9ce0ec0 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.0
2025-08-31T08:27:12,632     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-46.0.0-py3-none-any.whl#sha256=693e0504490ed8420522bf6bc3aa4b0da6a9f1c80c68acfb4e959275fd04cd82 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 46.0.0
2025-08-31T08:27:12,633     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-45.3.0-py3-none-any.whl#sha256=2200fd1d64496f6dd0a43f25e259cffcf13305a350e0583273fe4008c06e1ef1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 45.3.0
2025-08-31T08:27:12,634     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-45.2.0-py3-none-any.whl#sha256=316484eebff54cc18f322dea09ed031b7e3eb00811b19dcedb09bc09bba7d93d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 45.2.0
2025-08-31T08:27:12,635     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-45.1.0-py3-none-any.whl#sha256=68e7fd3508687f94367f1aa090a3ed921cd045a60b73d8b0aa1f305199a0ca28 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 45.1.0
2025-08-31T08:27:12,636     Found link https://www.piwheels.org/simple/setuptools/setuptools-44.1.1-py2.py3-none-any.whl#sha256=27a714c09253134e60a6fa68130f78c7037e5562c4f21f8f318f2ae900d152d5 (from https://www.piwheels.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 44.1.1
2025-08-31T08:27:12,637     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-44.1.0-py2.py3-none-any.whl#sha256=992728077ca19db6598072414fb83e0a284aca1253aaf2e24bb1e55ee6db1a30 (from https://www.piwheels.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 44.1.0
2025-08-31T08:27:12,638     Found link https://www.piwheels.org/simple/setuptools/setuptools-44.0.0-py2.py3-none-any.whl#sha256=180081a244d0888b0065e18206950d603f6550721bd6f8c0a10221ed467dd78e (from https://www.piwheels.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 44.0.0
2025-08-31T08:27:12,639     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-43.0.0-py2.py3-none-any.whl#sha256=a67faa51519ef28cd8261aff0e221b6e4c370f8fb8bada8aa3e7ad8945199963 (from https://www.piwheels.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 43.0.0
2025-08-31T08:27:12,640     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-42.0.2-py2.py3-none-any.whl#sha256=c8abd0f3574bc23afd2f6fd2c415ba7d9e097c8a99b845473b0d957ba1e2dac6 (from https://www.piwheels.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 42.0.2
2025-08-31T08:27:12,641     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-42.0.1-py2.py3-none-any.whl#sha256=409547a87530bd8a20582a2f0996c2a6651c5855b3a614af05020b35c3867dcb (from https://www.piwheels.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 42.0.1
2025-08-31T08:27:12,642     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-42.0.0-py2.py3-none-any.whl#sha256=4248cb506794bececcddeddb1678bc722f9cfcacf02f98f7c0af6b9ed893caf2 (from https://www.piwheels.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 42.0.0
2025-08-31T08:27:12,643     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-41.6.0-py2.py3-none-any.whl#sha256=3e8e8505e563631e7cb110d9ad82d135ee866b8146d5efe06e42be07a72db20a (from https://www.piwheels.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.6.0
2025-08-31T08:27:12,644     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-41.5.1-py2.py3-none-any.whl#sha256=9f1b3c6a6b862cf994c47c5b5a212a75cf0a11912d1cd11abfdfe03a4f49f5b2 (from https://www.piwheels.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.5.1
2025-08-31T08:27:12,645     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-41.5.0-py2.py3-none-any.whl#sha256=1aaf68966c16fe31be9a87f7c02f4393355159bf96396068f380b70b1fc6860d (from https://www.piwheels.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.5.0
2025-08-31T08:27:12,646     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-41.4.0-py2.py3-none-any.whl#sha256=8d01f7ee4191d9fdcd9cc5796f75199deccb25b154eba82d44d6a042cf873670 (from https://www.piwheels.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.4.0
2025-08-31T08:27:12,647     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-41.3.0-py2.py3-none-any.whl#sha256=e9832acd9be6f3174f4c34b40e7d913a146727920cbef6465c1c1bd2d21a4ec4 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.3.0
2025-08-31T08:27:12,648     Found link https://www.piwheels.org/simple/setuptools/setuptools-41.2.0-py2.py3-none-any.whl#sha256=4380abcf2a4ffd1a5ba22d687c6d690dce83b2b51c70e9c6d09f7e8c7e8040dc (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.2.0
2025-08-31T08:27:12,649     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-41.1.0-py2.py3-none-any.whl#sha256=bce3560fae29e9efa45fdb6e9fceddb1cde0cccebb050ee134262283b3ccbc7b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.1.0
2025-08-31T08:27:12,650     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-41.0.1-py2.py3-none-any.whl#sha256=c7769ce668c7a333d84e17fe8b524b1c45e7ee9f7908ad0a73e1eda7e6a5aebf (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.0.1
2025-08-31T08:27:12,651     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-41.0.0-py2.py3-none-any.whl#sha256=e67486071cd5cdeba783bd0b64f5f30784ff855b35071c8670551fd7fc52d4a1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.0.0
2025-08-31T08:27:12,653     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-40.9.0-py2.py3-none-any.whl#sha256=a96b1bef41915307025ae357fde45c1ccbd2bb0d37b3a8bc239dddd55bd01ca3 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.9.0
2025-08-31T08:27:12,654     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-40.8.0-py2.py3-none-any.whl#sha256=e8496c0079f3ac30052ffe69b679bd876c5265686127a3159cfa415669b7f9ab (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.8.0
2025-08-31T08:27:12,655     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-40.7.3-py2.py3-none-any.whl#sha256=4f4acaf06d617dccfd3fbbc9fbd83cf4749759a1fa2bdf589206a3278e0d537a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.3
2025-08-31T08:27:12,656     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-40.7.2-py2.py3-none-any.whl#sha256=0e81ddffd54b39c5beaff2e198d30c86631ebf0c0af6a0bbbc7441148c596831 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.2
2025-08-31T08:27:12,657     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-40.7.1-py2.py3-none-any.whl#sha256=252520b7969fb4f2fcaf08c014b2891041d56f31180ec0d581297a28597205ff (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.1
2025-08-31T08:27:12,658     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-40.7.0-py2.py3-none-any.whl#sha256=5d29d6d5ca47f370959a15f39fddad7ae94a02dadaf0ef5e907f17ef8e518de1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.0
2025-08-31T08:27:12,659     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-40.6.3-py2.py3-none-any.whl#sha256=e2c1ce9a832f34cf7a31ed010aabcab5008eb65ce8f2aadc04622232c14bdd0b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.3
2025-08-31T08:27:12,661     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-40.6.2-py2.py3-none-any.whl#sha256=88ee6bcd5decec9bd902252e02e641851d785c6e5e75677d2744a9d13fed0b0a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.2
2025-08-31T08:27:12,662     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-40.6.1-py2.py3-none-any.whl#sha256=d691b548b1faad074630635edc86422896bff80ce1f17ef155d67d9558c12c8b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.1
2025-08-31T08:27:12,663     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-40.6.0-py2.py3-none-any.whl#sha256=3135d047e1f02c5baffd7a671e07c274f18727455408bc3af6d7b0f0c59e80f4 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.0
2025-08-31T08:27:12,664     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-40.5.0-py2.py3-none-any.whl#sha256=e329a5c458c6acb5edc2b5c4ad44280c053ba827dc82fd5e84a83e22bb05460d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.5.0
2025-08-31T08:27:12,665     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-40.4.3-py2.py3-none-any.whl#sha256=ce4137d58b444bac11a31d4e0c1805c69d89e8ed4e91fde1999674ecc2f6f9ff (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.3
2025-08-31T08:27:12,666     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-40.4.2-py2.py3-none-any.whl#sha256=c3a8ff6bf3fd43d27242db824c871fc4752fea907c5ce59e00a9c5bb7da908d8 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.2
2025-08-31T08:27:12,667     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-40.4.1-py2.py3-none-any.whl#sha256=822054653e22ef38eef400895b8ada55657c8db7ad88f7ec954bccff2b3b9b52 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.1
2025-08-31T08:27:12,669     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-40.4.0-py2.py3-none-any.whl#sha256=22f3247d7009e4d73589184fbf18a52dd703ed4fe0e20e1d59935bdfd355350e (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.0
2025-08-31T08:27:12,670     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-40.3.0-py2.py3-none-any.whl#sha256=a61433987d64d2966d4fc246ec405cb84a75118521116082cb12f30a4f13d46a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.3.0
2025-08-31T08:27:12,671     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-40.2.0-py2.py3-none-any.whl#sha256=ea3796a48a207b46ea36a9d26de4d0cc87c953a683a7b314ea65d666930ea8e6 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.2.0
2025-08-31T08:27:12,672     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-40.1.1-py2.py3-none-any.whl#sha256=92e126c856d02c544e928854ce70a1af062ff1f7343e86c2805261ed8a9c9333 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.1.1
2025-08-31T08:27:12,673     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-40.1.0-py2.py3-none-any.whl#sha256=6322a764908e4bfcaba35e45224d55098a17c506b655c52c277ddf42b8b18eae (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.1.0
2025-08-31T08:27:12,674     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-40.0.0-py2.py3-none-any.whl#sha256=d68abee4eed409fbe8c302ac4d8429a1ffef912cd047a903b5701c024048dd49 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.0.0
2025-08-31T08:27:12,675     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-39.2.0-py2.py3-none-any.whl#sha256=8fca9275c89964f13da985c3656cb00ba029d7f3916b37990927ffdf264e7926 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.2.0
2025-08-31T08:27:12,676     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-39.1.0-py2.py3-none-any.whl#sha256=0cb8b8625bfdcc2d43ea4b9cdba0b39b2b7befc04f3088897031082aa16ce186 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.1.0
2025-08-31T08:27:12,677     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-39.0.1-py2.py3-none-any.whl#sha256=8010754433e3211b9cdbbf784b50f30e80bf40fc6b05eb5f865fab83300599b8 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.0.1
2025-08-31T08:27:12,678     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-39.0.0-py2.py3-none-any.whl#sha256=510ec09e1e2c0cf8cffba7f0480800007f4405a20473893619142ee6b2fa90eb (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.0.0
2025-08-31T08:27:12,679     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-38.7.0-py2.py3-none-any.whl#sha256=e39b4b7c772dc94d3037c002db21ffc429e47059a133e060d5eaa9d613b466df (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.7.0
2025-08-31T08:27:12,680     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-38.6.1-py2.py3-none-any.whl#sha256=1425a44a8d0c640d607c0941424f6ee8740b15a783c54d7596c8e6189b8c8f2a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.6.1
2025-08-31T08:27:12,681     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-38.6.0-py2.py3-none-any.whl#sha256=020ca62e457d006b02e69de0b199c26bab9cc9d0d225b6faa2574ad347017ff1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.6.0
2025-08-31T08:27:12,682     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-38.5.2-py2.py3-none-any.whl#sha256=a69c829c65d733197ab410accbc9f6817bfda52b092217a5e873850e536c6b6b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.5.2
2025-08-31T08:27:12,683     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-38.5.1-py2.py3-none-any.whl#sha256=7ffe771abfae419fd104f93400b61c935b5af10bfe4dfeec7a1bd495694eea35 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.5.1
2025-08-31T08:27:12,684     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-38.5.0-py2.py3-none-any.whl#sha256=8d6cb73008693d835da37865657d52335e3cf778fa6ba7fcfa8aecdeaec9fe55 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.5.0
2025-08-31T08:27:12,685     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-38.4.1-py2.py3-none-any.whl#sha256=22f8bcff5ce7fd1867785701769eaba42b79331d0abf890974a9288787dc015b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.4.1
2025-08-31T08:27:12,686     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-38.4.0-py2.py3-none-any.whl#sha256=155c2ec9fdcc00c3973d966b416e1cf3a1e7ce75f4c09fb760b23f94b935926e (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.4.0
2025-08-31T08:27:12,687     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-38.3.0-py2.py3-none-any.whl#sha256=fda35bd4d6d6047cc4aa66e381c836e8d57d396df97eb577bfca9fbaaf757dc1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.3.0
2025-08-31T08:27:12,688     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-38.2.5-py2.py3-none-any.whl#sha256=bcf0d4f3e2f7890e658db11e218b8643afffb905a0e2f2a7d5a6a3e949bb87e6 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.5
2025-08-31T08:27:12,689     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-38.2.4-py2.py3-none-any.whl#sha256=ca69216173b631cc29314bbce4d0b7e8a69784c8b6d7ea6b9e4952ac9ec0897d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.4
2025-08-31T08:27:12,691     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-38.2.3-py2.py3-none-any.whl#sha256=da7567c948c9459842b85dbbb2e3dbef6a90ae8d7476b2db0a10301ea31c9230 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.3
2025-08-31T08:27:12,692     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-38.2.1-py2.py3-none-any.whl#sha256=4684a40555c8bc108866dac60f663e5a9a2bff8daf4a7ff4bf4338564368cddf (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.1
2025-08-31T08:27:12,693     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-38.2.0-py2.py3-none-any.whl#sha256=10ef0af745e40fb46ff81d677696096158f0495318db99c0131d33440bb9bb20 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.0
2025-08-31T08:27:12,694     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-38.1.0-py2.py3-none-any.whl#sha256=0e7b1736a524950ad832d5763238a54ea06c055a0f45cfefa3ca92d34d21041c (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.1.0
2025-08-31T08:27:12,695     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-38.0.0-py2.py3-none-any.whl#sha256=3f66cd359dd836fdfa5f2a9540fdbfcc2f97449ad555324513a8d115b9706a1f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.0.0
2025-08-31T08:27:12,696     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-37.0.0-py2.py3-none-any.whl#sha256=a1d38d97b3759b3fede089e240b6aefaae50d21361c2c2d4ac92c3de4ebe3d50 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 37.0.0
2025-08-31T08:27:12,697     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-36.8.0-py2.py3-none-any.whl#sha256=4b5551b995cf69741c15259612221fdbffa2635182fe2cb92392fda318b7a636 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.8.0
2025-08-31T08:27:12,698     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-36.7.2-py2.py3-none-any.whl#sha256=bae92a71c82f818deb0b60ff1f7d764b8902cfc24187746b1aa6186918a70db3 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.7.2
2025-08-31T08:27:12,699     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-36.7.1-py2.py3-none-any.whl#sha256=eaacfa35eb11199d0b017df416421781a75209817bff3f94820556e36c49bd77 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.7.1
2025-08-31T08:27:12,700     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-36.7.0-py2.py3-none-any.whl#sha256=9072de898007cb11b3b0eec5b4c4db7faea2e7ad8c095b5157ae951fbec6b1da (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.7.0
2025-08-31T08:27:12,701     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-36.6.1-py2.py3-none-any.whl#sha256=198c23b395440c4915621e5fb689757c20a129096b55833a9c82cb1e8792ff12 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.6.1
2025-08-31T08:27:12,702     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-36.6.0-py2.py3-none-any.whl#sha256=904356c95cf90e6fdc21915afafbc9ad3d11409c7afeee7c85156f469b353efb (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.6.0
2025-08-31T08:27:12,703     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-36.5.0-py2.py3-none-any.whl#sha256=ef824aefbd20dc364891836b75a19386dcf2f4235bf7d80531a8517ab29d0602 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.5.0
2025-08-31T08:27:12,704     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-36.4.0-py2.py3-none-any.whl#sha256=4d54c0bfee283e78609169213f9c075827d5837086f58b588b417b093c23464b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.4.0
2025-08-31T08:27:12,705     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-36.3.0-py2.py3-none-any.whl#sha256=42bafe9efb8f771f6c96bb8e052e1de7474270719d471d596b9d91e53e8befd4 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.3.0
2025-08-31T08:27:12,706     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-36.2.7-py2.py3-none-any.whl#sha256=02b5f3869777dfbfbe3786a057bc6d523445a3e541a0abdf85adbe0b091e96b9 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.7
2025-08-31T08:27:12,707     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-36.2.6-py2.py3-none-any.whl#sha256=d0ac4095a275ad4238f9b10d10421e124847f09342e38e16a715fcbf756000ef (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.6
2025-08-31T08:27:12,708     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-36.2.5-py2.py3-none-any.whl#sha256=3d218acbc5bbade2c44edbd020bf8720e4f86c5961cfe799c79165df68702b96 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.5
2025-08-31T08:27:12,709     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-36.2.4-py2.py3-none-any.whl#sha256=88355a63434a5e3c8e1dfb26a2227744512958434c7332c7a4a8847f128f364e (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.4
2025-08-31T08:27:12,710     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-36.2.3-py2.py3-none-any.whl#sha256=92401b0bfee8585dcbe2ef60256d7354ab1986752378014ed25e2fde480ffa59 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.3
2025-08-31T08:27:12,711     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-36.2.2-py2.py3-none-any.whl#sha256=63bdc8ef07b4c99ff4c265ab9042333807fa66d60eea87df402f3a470fc10d7d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.2
2025-08-31T08:27:12,712     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-36.2.1-py2.py3-none-any.whl#sha256=493695b7a6913067570b4e23c22b678c7ada44711d7b3c27652df64fd9e2f114 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.1
2025-08-31T08:27:12,713     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-36.2.0-py2.py3-none-any.whl#sha256=8dbfb44a16b73ea756edfe8805a25338eead94bd2426b64374a7f6a7a125028d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.0
2025-08-31T08:27:12,714     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-36.1.1-py2.py3-none-any.whl#sha256=96f772b7112e6b45e3ec9094ff7621b1fc42654d6c25bfe19713f282c1b82d6e (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.1.1
2025-08-31T08:27:12,715     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-36.1.0-py2.py3-none-any.whl#sha256=b5bb0222a2414c2b27750cd35d368fd071c91d412a363bf155f5a3474f62aae5 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.1.0
2025-08-31T08:27:12,716     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-36.0.1-py2.py3-none-any.whl#sha256=f2900e560efc479938a219433c48f15a4ff4ecfe575a65de385eeb44f2425587 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.0.1
2025-08-31T08:27:12,717     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-35.0.2-py2.py3-none-any.whl#sha256=19d753940f8cdbee7548da318f8b56159aead279ef811a6efc8b8a33d89c86a4 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 35.0.2
2025-08-31T08:27:12,718     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-35.0.1-py2.py3-none-any.whl#sha256=33a7b7910651bea57164c6c6dd66a2b1c5196c0f78ee2ff7319ce7bd031714c0 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 35.0.1
2025-08-31T08:27:12,719     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-35.0.0-py2.py3-none-any.whl#sha256=b427014a0cf196e57727e141899c20381051233094783aa6274780a100eb65d9 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 35.0.0
2025-08-31T08:27:12,720     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-34.4.1-py2.py3-none-any.whl#sha256=1f7aac8b778446406ec5dcd5cc9305b375e7935e38f2fd3b1b70168c21a079d0 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.4.1
2025-08-31T08:27:12,721     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-34.4.0-py2.py3-none-any.whl#sha256=ef21066d478573a7f92bebb759b6d6fac4c1a4ace08d79f61103eb294337f2df (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.4.0
2025-08-31T08:27:12,722     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-34.3.3-py2.py3-none-any.whl#sha256=e436d8c9dcf67ea8902bfa7cce1ef698f36bf303f13b4f62a5668891ecd380dd (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.3
2025-08-31T08:27:12,723     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-34.3.2-py2.py3-none-any.whl#sha256=6483f8412313ec787fa71379147a4605d3b1cc303c3648d02542a9160d3db72b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.2
2025-08-31T08:27:12,724     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-34.3.1-py2.py3-none-any.whl#sha256=9349b47bcdef2e695065791260f9416b7aae8739fd30c6849f807bce5281d046 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.1
2025-08-31T08:27:12,726     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-34.3.0-py2.py3-none-any.whl#sha256=ef40d2d360ba1be284a47c51a5a489afa7d8cde5ca39f2321876e00e93fe04cd (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.0
2025-08-31T08:27:12,727     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-34.2.0-py2.py3-none-any.whl#sha256=75d352eeeddd96a3fb702b1da9f8b89e5f8c045dbd86e3894516733eb5f99713 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.2.0
2025-08-31T08:27:12,728     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-34.1.1-py2.py3-none-any.whl#sha256=5f74aabe68c441b99dca68c22796d5cbf532cb38b0aeada17d1d3988809de6e6 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.1.1
2025-08-31T08:27:12,729     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-34.1.0-py2.py3-none-any.whl#sha256=edd9d39782fe38b9c533002b2e6fdf06498793cbd29266accdcc519431d4b7ba (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.1.0
2025-08-31T08:27:12,730     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-34.0.3-py2.py3-none-any.whl#sha256=0af5ba75a129cf082d629d074fb7bf3c8391b62fdfa7b0cff2b6ef5563a15605 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.3
2025-08-31T08:27:12,731     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-34.0.2-py2.py3-none-any.whl#sha256=f9ac44de8b36a13ce35d2989052a295a548c9fe5a161fb066dff53592200aa12 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.2
2025-08-31T08:27:12,732     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-34.0.1-py2.py3-none-any.whl#sha256=ccb91bdfd63edd5aca37508d0a5b3097e57f504a0463a9e0e476d85af8e422ea (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.1
2025-08-31T08:27:12,733     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-34.0.0-py2.py3-none-any.whl#sha256=b2beb0ae830afe12b164bfdc035797c32ceb2463ba3d5ead0dc4d2778b780f60 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.0
2025-08-31T08:27:12,734     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-33.1.1-py2.py3-none-any.whl#sha256=4ed8f634b11fbba8c0ba9db01a8d24ad464f97a615889e9780fc74ddec956711 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 33.1.1
2025-08-31T08:27:12,735     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-33.1.0-py2.py3-none-any.whl#sha256=5aa4f254f89fefe431684fceee2086a636a85001cfc796436b1084d62ce8d367 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 33.1.0
2025-08-31T08:27:12,736     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-32.3.1-py2.py3-none-any.whl#sha256=1876d17325e5157751e004d7911c0a0c3bb257d509d9d23483ff9f2f12c84315 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.3.1
2025-08-31T08:27:12,737     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-32.3.0-py2.py3-none-any.whl#sha256=4645615979950bb5b5bc9101582856f2cbdf78480bf8c2ebc9563307f38aa650 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.3.0
2025-08-31T08:27:12,738     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-32.2.0-py2.py3-none-any.whl#sha256=e18ef9fd6b8742f5007ff1e169a4e7b7c6654038235fab846ce3dcbf82fcdadf (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.2.0
2025-08-31T08:27:12,739     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-32.1.3-py2.py3-none-any.whl#sha256=8fbb2c58e03eda5a0bf813994dc58c55aa4cff630bf39dae70029d1ed08dfeca (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.3
2025-08-31T08:27:12,740     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-32.1.2-py2.py3-none-any.whl#sha256=ad1ad62e5ae270469d65ec04641643e68737259454132b7a3c32a29990016b86 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.2
2025-08-31T08:27:12,741     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-32.1.1-py2.py3-none-any.whl#sha256=3bdd17676c4697af2de5099b12843ef8a71ffc1c08ddbbde5e455823d6a09874 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.1
2025-08-31T08:27:12,742     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-32.1.0-py2.py3-none-any.whl#sha256=96807339fd9d5611f720d8957dc97df33dfba2fe1ecd33f4907626b52e8b140a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.0
2025-08-31T08:27:12,743     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-32.0.0-py2.py3-none-any.whl#sha256=e1d5a1fd8e7ac66e8f9ed2f0e5c08ac3c8d45a389c167ac0270b6580f365b558 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.0.0
2025-08-31T08:27:12,744     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-31.0.1-py2.py3-none-any.whl#sha256=5ee299f0af69b1ec02afca34603ed89cfd7df0a32b9979b1f06371718385295b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 31.0.1
2025-08-31T08:27:12,745     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-31.0.0-py2.py3-none-any.whl#sha256=55ca82d7224c7ebae3f8530ca7aaac6d0aaf68131a268f625ac1a98f115c2097 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 31.0.0
2025-08-31T08:27:12,746     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-30.4.0-py2.py3-none-any.whl#sha256=2a951eefe8619f3071a5b43f851471e3e09ce5ab1128f700fe91df6b546bce15 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.4.0
2025-08-31T08:27:12,747     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-30.3.0-py2.py3-none-any.whl#sha256=de75ec99622f1808a4ee625d7144b5294bbc2cd2abc723b83b146b93fc76a4de (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.3.0
2025-08-31T08:27:12,748     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-30.2.1-py2.py3-none-any.whl#sha256=cecbce2822b9756fa2b34dbf511b1c5e26247892bb6387c55396271d1e2ca58a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.2.1
2025-08-31T08:27:12,749     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-30.2.0-py2.py3-none-any.whl#sha256=b7e7b28d6a728ea38953d66e12ef400c3c153c523539f1b3997c5a42f3770ff1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.2.0
2025-08-31T08:27:12,750     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-30.1.0-py2.py3-none-any.whl#sha256=3861f9b31fb4c6e9bdf6e485adcaf982d12dbd45a9108cea7b08817d6fdea18d (from https://www.piwheels.org/simple/setuptools/), version: 30.1.0
2025-08-31T08:27:12,751     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-30.0.0-py2.py3-none-any.whl#sha256=e7e9afac52a92598bdec609946886d91660fe9f0618634d26de0b785b0a35906 (from https://www.piwheels.org/simple/setuptools/), version: 30.0.0
2025-08-31T08:27:12,752     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-29.0.1-py2.py3-none-any.whl#sha256=2b55dc2fe3cc72b5d6769f6099af35b061d5a76b4a907cadf8aaae4b41176252 (from https://www.piwheels.org/simple/setuptools/), version: 29.0.1
2025-08-31T08:27:12,753     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-29.0.0-py2.py3-none-any.whl#sha256=a10889a6d3f6e7dbb9190a07b4ba7086a3cce295d3dc67b114f245d61b107a95 (from https://www.piwheels.org/simple/setuptools/), version: 29.0.0
2025-08-31T08:27:12,755     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-28.8.1-py2.py3-none-any.whl#sha256=0b15383c7070720e0780ccd75a96b2be1717505c0dd8904a8b69ae30ba0c0615 (from https://www.piwheels.org/simple/setuptools/), version: 28.8.1
2025-08-31T08:27:12,756     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-28.8.0-py2.py3-none-any.whl#sha256=2e59d06ac798efce29c567ee0e0687514efca529a665b8f364cf497cd10d21b2 (from https://www.piwheels.org/simple/setuptools/), version: 28.8.0
2025-08-31T08:27:12,757     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-28.7.1-py2.py3-none-any.whl#sha256=5bd5d77813a5b8e30ad84161b3b3262e2b6a6cddc22568d88c5b7fedb404b762 (from https://www.piwheels.org/simple/setuptools/), version: 28.7.1
2025-08-31T08:27:12,758     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-28.7.0-py2.py3-none-any.whl#sha256=85d983ffe32c6123af7fbcad471af55b44ba8aa1c6e019dbc1bf97e42e43fcb4 (from https://www.piwheels.org/simple/setuptools/), version: 28.7.0
2025-08-31T08:27:12,759     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-28.6.1-py2.py3-none-any.whl#sha256=2b94b5d44914e8ade6c537678c6a0143a1d7038989b2330c8f3c69b6d839e311 (from https://www.piwheels.org/simple/setuptools/), version: 28.6.1
2025-08-31T08:27:12,760     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-28.6.0-py2.py3-none-any.whl#sha256=1d2da66e50b74e8c5c925af52b38e18d4373c7969c5ed3c26eb1c3baca8222f9 (from https://www.piwheels.org/simple/setuptools/), version: 28.6.0
2025-08-31T08:27:12,761     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-28.5.0-py2.py3-none-any.whl#sha256=212eebc95772a3fef67677490d6e0e805af8c36f53e1452d300a57dcfd5799ca (from https://www.piwheels.org/simple/setuptools/), version: 28.5.0
2025-08-31T08:27:12,762     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-28.4.0-py2.py3-none-any.whl#sha256=4f48567fd9f9fcb8f048fd16012a7fe4e9f8135718964161a876d1547d2f1783 (from https://www.piwheels.org/simple/setuptools/), version: 28.4.0
2025-08-31T08:27:12,763     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-28.3.0-py2.py3-none-any.whl#sha256=873b8e61eba51c38266ad8499ec10f669ea9299a2e8d217b086cead83194a495 (from https://www.piwheels.org/simple/setuptools/), version: 28.3.0
2025-08-31T08:27:12,764     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-28.2.0-py2.py3-none-any.whl#sha256=944dc170b3e378c30416c99b51cb7ef2a6d9ab8d5ebd139f7ee0f3d74b5ce3c1 (from https://www.piwheels.org/simple/setuptools/), version: 28.2.0
2025-08-31T08:27:12,765     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-28.1.0-py2.py3-none-any.whl#sha256=5497cc872ab2c11eddaeab86526f4d4c219f0d89e06cf9d3472fdbcb94d8f579 (from https://www.piwheels.org/simple/setuptools/), version: 28.1.0
2025-08-31T08:27:12,766     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-28.0.0-py2.py3-none-any.whl#sha256=a622eeec9eff4c9b293e08160c912d5c87f326b54f58365eca1c60ee01a4a62f (from https://www.piwheels.org/simple/setuptools/), version: 28.0.0
2025-08-31T08:27:12,767     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-27.3.1-py2.py3-none-any.whl#sha256=4c6fb205bdbc4944a3adbd44c81319add3e267844c047f6f4c25324ee1250538 (from https://www.piwheels.org/simple/setuptools/), version: 27.3.1
2025-08-31T08:27:12,768     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-27.3.0-py2.py3-none-any.whl#sha256=b8a5dd094d4c6d9e5f04094475a164ec1b99f56ac8df63bdd989f320d1d762f8 (from https://www.piwheels.org/simple/setuptools/), version: 27.3.0
2025-08-31T08:27:12,769     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-27.2.0-py2.py3-none-any.whl#sha256=2b7a63bf9a3645bb4cabe3b04dc97f9e0ac330723626070bc874e0f02830c09a (from https://www.piwheels.org/simple/setuptools/), version: 27.2.0
2025-08-31T08:27:12,770     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-27.1.2-py2.py3-none-any.whl#sha256=0fd2677f62585315a4e04fdf055e898511c61954dfd488461853928927184e11 (from https://www.piwheels.org/simple/setuptools/), version: 27.1.2
2025-08-31T08:27:12,771     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-27.1.0-py2.py3-none-any.whl#sha256=1247b7fc94b8db8223a0b8174600d3393bff45f0f7a43b609408ff9546bde4af (from https://www.piwheels.org/simple/setuptools/), version: 27.1.0
2025-08-31T08:27:12,772     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-27.0.0-py2.py3-none-any.whl#sha256=79f5574164220b07235aa48fa528329a4bc1725e6b62c04b36e0ae455066489a (from https://www.piwheels.org/simple/setuptools/), version: 27.0.0
2025-08-31T08:27:12,773     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-26.1.1-py2.py3-none-any.whl#sha256=226c9ce65e76c6069e805982b036f36dc4b227b37dd87fc219aef721ec8604ae (from https://www.piwheels.org/simple/setuptools/), version: 26.1.1
2025-08-31T08:27:12,774     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-26.1.0-py2.py3-none-any.whl#sha256=a59a0e2890b1ca450618b13e1a0bdb14feee6d88653d624d4156f3564303782f (from https://www.piwheels.org/simple/setuptools/), version: 26.1.0
2025-08-31T08:27:12,775     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-26.0.0-py2.py3-none-any.whl#sha256=9d7e503229e75fd0361d59dcefba232d06b95f20153d4e27c6e77917aec375e6 (from https://www.piwheels.org/simple/setuptools/), version: 26.0.0
2025-08-31T08:27:12,776     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-25.4.0-py2.py3-none-any.whl#sha256=001a63383f7efae833f46c59cc6b70c96bc9b8f91db80ce83ebb9de3e1d79c01 (from https://www.piwheels.org/simple/setuptools/), version: 25.4.0
2025-08-31T08:27:12,777     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-25.3.0-py2.py3-none-any.whl#sha256=983fa4b85394e9c386b9bcf2c803a082f78cf213823d30c57cfcfb6ac9435511 (from https://www.piwheels.org/simple/setuptools/), version: 25.3.0
2025-08-31T08:27:12,778     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-25.2.0-py2.py3-none-any.whl#sha256=2845247c359bb91097ccf8f6be8a69edfa44847f3d2d5def39aa43c3d7f615ca (from https://www.piwheels.org/simple/setuptools/), version: 25.2.0
2025-08-31T08:27:12,779     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-25.1.6-py2.py3-none-any.whl#sha256=e61bfdbde3bfa53a7cff3a0eed10cc276338ce226a9eab6837db7f632403de7f (from https://www.piwheels.org/simple/setuptools/), version: 25.1.6
2025-08-31T08:27:12,780     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-25.1.5-py2.py3-none-any.whl#sha256=133810ee71ca699f5960a6d49e55209551ed1ecf9e66abce16d84ef8d8445e26 (from https://www.piwheels.org/simple/setuptools/), version: 25.1.5
2025-08-31T08:27:12,781     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-25.1.4-py2.py3-none-any.whl#sha256=206e3a787c222ce7c0fa489c594378e37030c4917a4c1dd9f8123a0d0c57302d (from https://www.piwheels.org/simple/setuptools/), version: 25.1.4
2025-08-31T08:27:12,782     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-25.1.3-py2.py3-none-any.whl#sha256=3aff2272730f806c00fc195bec9bf716ecfd363697721f02d833ffc880dae24d (from https://www.piwheels.org/simple/setuptools/), version: 25.1.3
2025-08-31T08:27:12,783     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-25.1.2-py2.py3-none-any.whl#sha256=931aba9fe7289ee40ca31324102e0af24086d56adbcf40be0d5896d9941a5ccc (from https://www.piwheels.org/simple/setuptools/), version: 25.1.2
2025-08-31T08:27:12,784     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-25.1.1-py2.py3-none-any.whl#sha256=1cce93150e00ae1153a2fc0f5d8032d79f0519b0e28fd7c56928daa84ff3213c (from https://www.piwheels.org/simple/setuptools/), version: 25.1.1
2025-08-31T08:27:12,785     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-25.1.0-py2.py3-none-any.whl#sha256=c7d1ef7e78f19e90d0282f04ebd284d33fbb16eeed4dd9efa7af8975732f9cdb (from https://www.piwheels.org/simple/setuptools/), version: 25.1.0
2025-08-31T08:27:12,786     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-25.0.2-py2.py3-none-any.whl#sha256=fe014903099c61bf1f30db1573322d7354027a33fd87432541d45b8835d0db99 (from https://www.piwheels.org/simple/setuptools/), version: 25.0.2
2025-08-31T08:27:12,787     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-25.0.1-py2.py3-none-any.whl#sha256=c91e0d7c383c04d39cc37a7d3c827ae80a7766ccc12d1a8fd845330b2c73ce37 (from https://www.piwheels.org/simple/setuptools/), version: 25.0.1
2025-08-31T08:27:12,788     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-25.0.0-py2.py3-none-any.whl#sha256=eae82804db00b368f347de98020f5a1c85eef771479dbf6b3844b8d0538a23e3 (from https://www.piwheels.org/simple/setuptools/), version: 25.0.0
2025-08-31T08:27:12,789     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-24.3.1-py2.py3-none-any.whl#sha256=d5d40e29686c0f37c7c8ef7566d9606f1f3f9697e10410882d46151c0ea918c2 (from https://www.piwheels.org/simple/setuptools/), version: 24.3.1
2025-08-31T08:27:12,790     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-24.3.0-py2.py3-none-any.whl#sha256=98e67c7215bb3df4d408f0ea6e5826d8a4b3b3b5184e70550f3a77f670b366eb (from https://www.piwheels.org/simple/setuptools/), version: 24.3.0
2025-08-31T08:27:12,791     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-24.2.1-py2.py3-none-any.whl#sha256=036b07815eb2ea462bc1746cb32366bc414505fa900a40f305124e7d7c6a2fd1 (from https://www.piwheels.org/simple/setuptools/), version: 24.2.1
2025-08-31T08:27:12,792     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-24.2.0-py2.py3-none-any.whl#sha256=d30e49279709d48a6469f27bea12bc7b6d457f96dd8ee911d8cda28e8c106088 (from https://www.piwheels.org/simple/setuptools/), version: 24.2.0
2025-08-31T08:27:12,793     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-24.1.1-py2.py3-none-any.whl#sha256=42ef0cb570cdeb04e84b1d846b6f383b0dac45ca4886fc784679d946a1d3edaa (from https://www.piwheels.org/simple/setuptools/), version: 24.1.1
2025-08-31T08:27:12,794     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-24.1.0-py2.py3-none-any.whl#sha256=ae84c91cd69b0e84fe2b69902954a7f6144e2bbcf100282b21309bf88f77fb86 (from https://www.piwheels.org/simple/setuptools/), version: 24.1.0
2025-08-31T08:27:12,796     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-24.0.3-py2.py3-none-any.whl#sha256=2c215f4d49eee249b734e6f44499262110f60118cd4055aeed7fd6f03602aad3 (from https://www.piwheels.org/simple/setuptools/), version: 24.0.3
2025-08-31T08:27:12,797     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-24.0.2-py2.py3-none-any.whl#sha256=7a4c6f7cd44d1ab93392c8cdb9e24cd3b46f650be4fc20f0abd127fdf3fb9623 (from https://www.piwheels.org/simple/setuptools/), version: 24.0.2
2025-08-31T08:27:12,798     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-24.0.1-py2.py3-none-any.whl#sha256=2d3a49bab23ac66963d41e0ba7be577e37ebdb8802dceca7c472a4367c751e13 (from https://www.piwheels.org/simple/setuptools/), version: 24.0.1
2025-08-31T08:27:12,799     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-24.0.0-py2.py3-none-any.whl#sha256=a6a661c88e65e2c87b052961df6e28909b6b6fc7c8f6a9f78d6f18710a6104e7 (from https://www.piwheels.org/simple/setuptools/), version: 24.0.0
2025-08-31T08:27:12,800     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-23.2.1-py2.py3-none-any.whl#sha256=f33a3a67ae0e6db7d1d7835223de5307a10effce8add50bcce8874428e4791c0 (from https://www.piwheels.org/simple/setuptools/), version: 23.2.1
2025-08-31T08:27:12,801     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-23.2.0-py2.py3-none-any.whl#sha256=189626aee717ff18bda5e8d417edb1857204e9da1476c61c3506f0b7eb1d2797 (from https://www.piwheels.org/simple/setuptools/), version: 23.2.0
2025-08-31T08:27:12,802     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-23.1.0-py2.py3-none-any.whl#sha256=1188de44d57e476f5ab485407b38692f75077a0eae490e1204c61576b278a153 (from https://www.piwheels.org/simple/setuptools/), version: 23.1.0
2025-08-31T08:27:12,803     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-23.0.0-py2.py3-none-any.whl#sha256=034d5fdd7d2bf32e88218ffe86cde8af5ecbaa3361d334b2bd48a4060eac3816 (from https://www.piwheels.org/simple/setuptools/), version: 23.0.0
2025-08-31T08:27:12,804     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-22.0.5-py2.py3-none-any.whl#sha256=d12a016baac1c7451dad0048f5777f99c4e91e9d9724004a9cf447c062e15a33 (from https://www.piwheels.org/simple/setuptools/), version: 22.0.5
2025-08-31T08:27:12,805     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-22.0.4-py2.py3-none-any.whl#sha256=7ca8ae5283b443a0edbbf1ac8d721b4a3ab874140d0173e217b7a92bceb81bc8 (from https://www.piwheels.org/simple/setuptools/), version: 22.0.4
2025-08-31T08:27:12,806     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-22.0.2-py2.py3-none-any.whl#sha256=b09ac13b7d40cfedf8cf5c6011d56452fa0310f87d0779b07bce2bd0773554fe (from https://www.piwheels.org/simple/setuptools/), version: 22.0.2
2025-08-31T08:27:12,807     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-22.0.1-py2.py3-none-any.whl#sha256=5ed3225aec88589ac50ba0f667c01fcb3d135537f160d95438b75dea3faa47b4 (from https://www.piwheels.org/simple/setuptools/), version: 22.0.1
2025-08-31T08:27:12,808     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-22.0.0-py2.py3-none-any.whl#sha256=e2ca74d691e1797139483c4a77d7e4ee8e4722dc94b13022ae322782f0c1a4fe (from https://www.piwheels.org/simple/setuptools/), version: 22.0.0
2025-08-31T08:27:12,809     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-21.2.2-py2.py3-none-any.whl#sha256=5f1d8fc7d5208dd6d490a697b3319045118d6f2ce518a7dfe72f02adae1ff13a (from https://www.piwheels.org/simple/setuptools/), version: 21.2.2
2025-08-31T08:27:12,810     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-21.2.1-py2.py3-none-any.whl#sha256=a2ecb2a5723f6ecb8140f182f6514edc5f5da7dec47f0be65d24aef18c09a746 (from https://www.piwheels.org/simple/setuptools/), version: 21.2.1
2025-08-31T08:27:12,811     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-21.2.0-py2.py3-none-any.whl#sha256=eb294525cc40dab2d0a66cb0ed840c51604b13b70063d0e125b78563aae3a928 (from https://www.piwheels.org/simple/setuptools/), version: 21.2.0
2025-08-31T08:27:12,812     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-21.1.0-py2.py3-none-any.whl#sha256=3c0996dfe854075ba944a28380b6768236374eb3c59fb3f7125c04344ac29c3b (from https://www.piwheels.org/simple/setuptools/), version: 21.1.0
2025-08-31T08:27:12,813     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-21.0.0-py2.py3-none-any.whl#sha256=fb6378f65eb630281227720ae80276f38c1a1f16969eca499435c0ff2a815fe6 (from https://www.piwheels.org/simple/setuptools/), version: 21.0.0
2025-08-31T08:27:12,814     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-20.10.1-py2.py3-none-any.whl#sha256=a037098401257659ec664ad0818a041b8b29f69172c274e2013d4399326bcb70 (from https://www.piwheels.org/simple/setuptools/), version: 20.10.1
2025-08-31T08:27:12,815     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-20.9.0-py2.py3-none-any.whl#sha256=f8e38d3002085052bcc934053745152bac9979e6aa5649115794b34cde5fb180 (from https://www.piwheels.org/simple/setuptools/), version: 20.9.0
2025-08-31T08:27:12,816     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-20.8.1-py2.py3-none-any.whl#sha256=d5bbc1929feeaa81233bdadc0c720d35ac27a3ca7a1f9641f632af822419114d (from https://www.piwheels.org/simple/setuptools/), version: 20.8.1
2025-08-31T08:27:12,817     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-20.8.0-py2.py3-none-any.whl#sha256=e5e721c335a658db0bb68d03f94dac3d9de873a928fbd7bcbe3a1ec9e0f88102 (from https://www.piwheels.org/simple/setuptools/), version: 20.8.0
2025-08-31T08:27:12,818     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-20.7.0-py2.py3-none-any.whl#sha256=8917a52aa3a389893221b173a89dae0471022d32bff3ebc31a1072988aa8039d (from https://www.piwheels.org/simple/setuptools/), version: 20.7.0
2025-08-31T08:27:12,819     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-20.6.8-py2.py3-none-any.whl#sha256=01bb4420af29e5c1799482ede72e38e1242459c21049f6407dd526bd6459e167 (from https://www.piwheels.org/simple/setuptools/), version: 20.6.8
2025-08-31T08:27:12,820     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-20.6.7-py2.py3-none-any.whl#sha256=9982ee4d279a2541dc1a7efee994ff9c535cfc05315e121e09df7f93da48c442 (from https://www.piwheels.org/simple/setuptools/), version: 20.6.7
2025-08-31T08:27:12,821     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-20.6.6-py2.py3-none-any.whl#sha256=318a28cea28e00d47fed4fcc0f0be8c933bb963b9d8e21c1047a5b657c967e5f (from https://www.piwheels.org/simple/setuptools/), version: 20.6.6
2025-08-31T08:27:12,822     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-20.4-py2.py3-none-any.whl#sha256=8c110e7116d78933ab656a850971ba53b20d936e48fb493db1c5afa75051eefa (from https://www.piwheels.org/simple/setuptools/), version: 20.4
2025-08-31T08:27:12,823     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-20.3.1-py2.py3-none-any.whl#sha256=9553b654fbfef3338c15e9c6751ea4032c3d9f28ef0ed4f73c64c7403cd37b18 (from https://www.piwheels.org/simple/setuptools/), version: 20.3.1
2025-08-31T08:27:12,824     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-20.3-py2.py3-none-any.whl#sha256=8cf051b5885971d5e5895bf5633257e5864785f062d566002292f1276ec0a92a (from https://www.piwheels.org/simple/setuptools/), version: 20.3
2025-08-31T08:27:12,825     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-20.2.2-py2.py3-none-any.whl#sha256=fc03457fb87abad49dc09f9c3133863693e7ddb6ca82bb50a739a77379ce5a9a (from https://www.piwheels.org/simple/setuptools/), version: 20.2.2
2025-08-31T08:27:12,826     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-20.1.1-py2.py3-none-any.whl#sha256=dfdbc643f8900d9e617e48a42ae389aa18fd6fbd2846f24f2a4678b8d9412acb (from https://www.piwheels.org/simple/setuptools/), version: 20.1.1
2025-08-31T08:27:12,827     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-20.1-py2.py3-none-any.whl#sha256=c54c0d9473139a5c7a70a752b7322a651e0d611e3e5f0ea95632db0024ed64f4 (from https://www.piwheels.org/simple/setuptools/), version: 20.1
2025-08-31T08:27:12,828     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-20.0-py2.py3-none-any.whl#sha256=4c15b00b76fbb296d7fdee314f21e339fc5f9b913264ce07a9ab2445a3d594a7 (from https://www.piwheels.org/simple/setuptools/), version: 20.0
2025-08-31T08:27:12,829     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-19.7-py2.py3-none-any.whl#sha256=5bf6fb535b1d7dd73ad15c4c63144b0fe700cfb6014d7c5001e33803c2ba9792 (from https://www.piwheels.org/simple/setuptools/), version: 19.7
2025-08-31T08:27:12,830     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-19.6.2-py2.py3-none-any.whl#sha256=5e637486db1147880bf6868f861e9339dba8d3452813a330c9feb75104e64b2d (from https://www.piwheels.org/simple/setuptools/), version: 19.6.2
2025-08-31T08:27:12,831     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-19.6.1-py2.py3-none-any.whl#sha256=056939fdb00377e4043b221bb508afba4b561f9fea04a526a17a4b7c50ea0e39 (from https://www.piwheels.org/simple/setuptools/), version: 19.6.1
2025-08-31T08:27:12,832     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-19.6-py2.py3-none-any.whl#sha256=57c63a363b37ffa2d64db4ffee26844e3ab81441fc02da4cd5e8cafcff9acb3a (from https://www.piwheels.org/simple/setuptools/), version: 19.6
2025-08-31T08:27:12,833     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-19.5-py2.py3-none-any.whl#sha256=ec11d91d2a5306be9590b1478eed1772f8868688871d80383f928dc953283f2c (from https://www.piwheels.org/simple/setuptools/), version: 19.5
2025-08-31T08:27:12,834     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-19.4.1-py2.py3-none-any.whl#sha256=20a0ae47c44790874aaeedaca077e50041c8ea1ccd4ea5c5c715e115f07f3f1b (from https://www.piwheels.org/simple/setuptools/), version: 19.4.1
2025-08-31T08:27:12,835     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-19.4-py2.py3-none-any.whl#sha256=0801e6d862ca4ce24d918420d62f07ee2fe736dc016e3afa99d2103e7a02e9a6 (from https://www.piwheels.org/simple/setuptools/), version: 19.4
2025-08-31T08:27:12,836     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-19.3-py2.py3-none-any.whl#sha256=efd3423dc12a494e66fc3d60c6ef136bf1e1ebdf56225257a878fa78e6978054 (from https://www.piwheels.org/simple/setuptools/), version: 19.3
2025-08-31T08:27:12,837     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-19.2-py2.py3-none-any.whl#sha256=f93207fe24cb3b701ab575a18443dd291546cee7f840c3f7f900c8cda2e0156f (from https://www.piwheels.org/simple/setuptools/), version: 19.2
2025-08-31T08:27:12,838     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-19.1.1-py2.py3-none-any.whl#sha256=07ec70d6f6d8e3e4e6144bf251188ce8f3a49e564e37e27a710852703e577e33 (from https://www.piwheels.org/simple/setuptools/), version: 19.1.1
2025-08-31T08:27:12,839     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-19.1-py2.py3-none-any.whl#sha256=91839f2b15ab024ccf662b55a807eb8886ffb3430cbe5ff5ddd52e96d1f14c7f (from https://www.piwheels.org/simple/setuptools/), version: 19.1
2025-08-31T08:27:12,841     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-19.0-py2.py3-none-any.whl#sha256=af3bde6478ca42257e0f957ab12aeb7dc4a89d9a6b5dcebe3a317c4364309533 (from https://www.piwheels.org/simple/setuptools/), version: 19.0
2025-08-31T08:27:12,842     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-18.8.1-py2.py3-none-any.whl#sha256=ac794a30440f95b88626c8ece032e8f28bb220127e847b17c230b0c4ef8c13fd (from https://www.piwheels.org/simple/setuptools/), version: 18.8.1
2025-08-31T08:27:12,843     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-18.8-py2.py3-none-any.whl#sha256=a6335e649ed0e2d3f3f4606fa05efcde457bbc65a962d6ad2344ff13675dc757 (from https://www.piwheels.org/simple/setuptools/), version: 18.8
2025-08-31T08:27:12,844     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-18.7.1-py2.py3-none-any.whl#sha256=624c3c0462540a18d5930bea79a6ccc3a7eb968e41264c187bf4755078ea2937 (from https://www.piwheels.org/simple/setuptools/), version: 18.7.1
2025-08-31T08:27:12,845     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-18.7-py2.py3-none-any.whl#sha256=5b80aeba78227e98d51d11684551f2f26cc77192181ffa63a7fa334bfc186473 (from https://www.piwheels.org/simple/setuptools/), version: 18.7
2025-08-31T08:27:12,846     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-18.6.1-py2.py3-none-any.whl#sha256=5300d684179b43d4294a76cffd23121283ac31a98e8ed9bcc8dc1adcc8bd4c8b (from https://www.piwheels.org/simple/setuptools/), version: 18.6.1
2025-08-31T08:27:12,847     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-18.6-py2.py3-none-any.whl#sha256=a90688d8a89aedf34945cf3dd97d08bc2684b7aa34997698dd175ceccb093f47 (from https://www.piwheels.org/simple/setuptools/), version: 18.6
2025-08-31T08:27:12,848     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-18.5-py2.py3-none-any.whl#sha256=fe3f645fbb713949de444504477a71e8ce3219b172220af1a17d1ed92440b469 (from https://www.piwheels.org/simple/setuptools/), version: 18.5
2025-08-31T08:27:12,849     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-18.4-py2.py3-none-any.whl#sha256=ba3b4ea51ddec70c0977cf16a12c5c578b8d1f8921e59d0b4888378942e5ac79 (from https://www.piwheels.org/simple/setuptools/), version: 18.4
2025-08-31T08:27:12,850     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-18.3.2-py2.py3-none-any.whl#sha256=818de28dbc4da380ca43c5c8d48d155891a6e10bb0e7ac103feee6b31be2dd25 (from https://www.piwheels.org/simple/setuptools/), version: 18.3.2
2025-08-31T08:27:12,851     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-18.3.1-py2.py3-none-any.whl#sha256=08e2b4c6d4bd2fa9b75d41d4bb8903967dec91d9ec215bab0c9c2624c54b251b (from https://www.piwheels.org/simple/setuptools/), version: 18.3.1
2025-08-31T08:27:12,852     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-18.3-py2.py3-none-any.whl#sha256=66747a68dec0dadc8e56b5611330b7c47742da81754af0f3b73e46744b28499e (from https://www.piwheels.org/simple/setuptools/), version: 18.3
2025-08-31T08:27:12,853     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-18.2-py2.py3-none-any.whl#sha256=04fe25dcc2affa9845518f7df0d98d35b384238665c5405fec88c9ca11750a4a (from https://www.piwheels.org/simple/setuptools/), version: 18.2
2025-08-31T08:27:12,854     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-18.1-py2.py3-none-any.whl#sha256=5fbb87a9402bdb9a8fc3625463abdb1f0ea6655cc41c71f29fdcec3c4ff9c35d (from https://www.piwheels.org/simple/setuptools/), version: 18.1
2025-08-31T08:27:12,855     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-18.0.1-py2.py3-none-any.whl#sha256=825814864707c12e3eb7878c9d9cc7189507022d53476b71ef833b3d28df0c9c (from https://www.piwheels.org/simple/setuptools/), version: 18.0.1
2025-08-31T08:27:12,856     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-18.0-py2.py3-none-any.whl#sha256=e34882c2529a84bd0d66a4e0273300f8080bbfe30bd82bb39935c247731bfda7 (from https://www.piwheels.org/simple/setuptools/), version: 18.0
2025-08-31T08:27:12,857     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-17.1.1-py2.py3-none-any.whl#sha256=42dc3d14631bb088a20a80761bad6671f8ed819f96cb5b65831fcdcfe5e7676a (from https://www.piwheels.org/simple/setuptools/), version: 17.1.1
2025-08-31T08:27:12,858     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-17.1-py2.py3-none-any.whl#sha256=f4c0fc949ca92232227559f9e1ccc62f576a9c7e2c6da04a264ddfaa0e4e0e91 (from https://www.piwheels.org/simple/setuptools/), version: 17.1
2025-08-31T08:27:12,859     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-17.0-py2.py3-none-any.whl#sha256=7c3e88a7cf77a537a8313471c2ea04d6f26f1e53acfcc48210ca7b5cde355aec (from https://www.piwheels.org/simple/setuptools/), version: 17.0
2025-08-31T08:27:12,860     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-16.0-py2.py3-none-any.whl#sha256=58e31b159cdabf42aced83820981967b1adfd797c1dd55dcfa30e92f8ed931a0 (from https://www.piwheels.org/simple/setuptools/), version: 16.0
2025-08-31T08:27:12,861     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-15.2-py2.py3-none-any.whl#sha256=6c6157c8268191003743dcf68b548ef5ba7bc836af1ec91123f2c832da620d25 (from https://www.piwheels.org/simple/setuptools/), version: 15.2
2025-08-31T08:27:12,862     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-15.1-py2.py3-none-any.whl#sha256=86318384560ceca05687e6ff67299b697c4ea4125b9a6b62873efc07d41cbf60 (from https://www.piwheels.org/simple/setuptools/), version: 15.1
2025-08-31T08:27:12,863     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-15.0-py2.py3-none-any.whl#sha256=225c09cae4f9b80db3fb3d3b211e2af0ad4c501c6f09df38fea9b25c65991f9a (from https://www.piwheels.org/simple/setuptools/), version: 15.0
2025-08-31T08:27:12,864     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-14.3.1-py2.py3-none-any.whl#sha256=f2c2d184bac05d491fc59e82ddcbf6fa0458faf4ac8f5c86c48ab0bd6956ef21 (from https://www.piwheels.org/simple/setuptools/), version: 14.3.1
2025-08-31T08:27:12,865     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-14.3-py2.py3-none-any.whl#sha256=86e23bc914e9962f888df9db2c8cd079c88ad51cc3f88068dcf551e4d81273fb (from https://www.piwheels.org/simple/setuptools/), version: 14.3
2025-08-31T08:27:12,866     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-14.2-py2.py3-none-any.whl#sha256=59d3a2dcb53c58b603a0f2594970f44943fcdd29f15fb079d161e8269cc40627 (from https://www.piwheels.org/simple/setuptools/), version: 14.2
2025-08-31T08:27:12,867     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-14.1.1-py2.py3-none-any.whl#sha256=ec323c5e29cbfbbe1f988cc2860ed08c63def908150c3d2866e5ef57ed1448c6 (from https://www.piwheels.org/simple/setuptools/), version: 14.1.1
2025-08-31T08:27:12,868     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-14.1-py2.py3-none-any.whl#sha256=5acff003ca0ebba6f39ef3f339c8caf6e6bfa4ff7acb8968af99c1e46b9bf594 (from https://www.piwheels.org/simple/setuptools/), version: 14.1
2025-08-31T08:27:12,869     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-14.0-py2.py3-none-any.whl#sha256=057ece816dc7be65dac7d2f3bcece7940013e66491644ac01623003ddad87252 (from https://www.piwheels.org/simple/setuptools/), version: 14.0
2025-08-31T08:27:12,870     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-13.0.2-py2.py3-none-any.whl#sha256=a89234c23285b3effaea9413afabc527cb937317bbd2e7d66e649ae54c0cdfa5 (from https://www.piwheels.org/simple/setuptools/), version: 13.0.2
2025-08-31T08:27:12,871     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-13.0.1-py2.py3-none-any.whl#sha256=cf62e27369352ec4d609cd1b157ae0348d32e1d97db8e3a6dc55a32c3c43688d (from https://www.piwheels.org/simple/setuptools/), version: 13.0.1
2025-08-31T08:27:12,872     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-12.4-py2.py3-none-any.whl#sha256=f3ce0ee03c9af6331f68ed9577a99540d312dbd419c9834dc34c6909ca741bd5 (from https://www.piwheels.org/simple/setuptools/), version: 12.4
2025-08-31T08:27:12,873     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-12.3-py2.py3-none-any.whl#sha256=b2dd9cbcab51330ef7103dab8835ee762143cc7d6ab973948522463194036096 (from https://www.piwheels.org/simple/setuptools/), version: 12.3
2025-08-31T08:27:12,874     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-12.2-py2.py3-none-any.whl#sha256=818308bc29880c13e82bbc192cfe1c3e2cb0c245111bb184b04b7990eefcaa7d (from https://www.piwheels.org/simple/setuptools/), version: 12.2
2025-08-31T08:27:12,875     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-12.1-py2.py3-none-any.whl#sha256=d99879e786656d61e8e6dc91a29c4c838d27cb8008dc760433d3b1e3db9a0c8b (from https://www.piwheels.org/simple/setuptools/), version: 12.1
2025-08-31T08:27:12,876     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-12.0.5-py2.py3-none-any.whl#sha256=8fe96cb82abceb5bdae864641469d941bedd14b993a90ecdf54e0425a83952c1 (from https://www.piwheels.org/simple/setuptools/), version: 12.0.5
2025-08-31T08:27:12,877     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-12.0.4-py2.py3-none-any.whl#sha256=6f4e3036ce3edd0d218cbf59026892528dc43951748c684fdf0c08fe21344f6f (from https://www.piwheels.org/simple/setuptools/), version: 12.0.4
2025-08-31T08:27:12,878     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-12.0.3-py2.py3-none-any.whl#sha256=04fbfe87a72638a4c4dc43db6b3b6cca9b6d8c06354dee6058a2986a35a930a2 (from https://www.piwheels.org/simple/setuptools/), version: 12.0.3
2025-08-31T08:27:12,879     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-12.0.2-py2.py3-none-any.whl#sha256=3901bc6d3ec8b8fe6a75b1ecd24d7a9046fcd06e1b3aa7a4b1522f7e1803bf72 (from https://www.piwheels.org/simple/setuptools/), version: 12.0.2
2025-08-31T08:27:12,880     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-12.0.1-py2.py3-none-any.whl#sha256=2528465702121db95f6a5235eb3e0ed6cf9526ad40d05a9898afb53b44a04397 (from https://www.piwheels.org/simple/setuptools/), version: 12.0.1
2025-08-31T08:27:12,882     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-12.0-py2.py3-none-any.whl#sha256=78b43c5c9e7b60ef524e1bfeea6a4c065e40ad9f80d7af2f0ae88e4b122735b1 (from https://www.piwheels.org/simple/setuptools/), version: 12.0
2025-08-31T08:27:12,883     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-11.3.1-py2.py3-none-any.whl#sha256=8207d09210de058fca832c4636c9bc650047e9566848c7e489257bbce59b24cc (from https://www.piwheels.org/simple/setuptools/), version: 11.3.1
2025-08-31T08:27:12,884     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-11.3-py2.py3-none-any.whl#sha256=088434bdfa3a0280b8f92d86b4bb496131caacb01d955005253b36216a73e008 (from https://www.piwheels.org/simple/setuptools/), version: 11.3
2025-08-31T08:27:12,885     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-11.2-py2.py3-none-any.whl#sha256=22352c4e2ed175ad12d5082e26e0f06cfa3802640169726736a94158b19a8b69 (from https://www.piwheels.org/simple/setuptools/), version: 11.2
2025-08-31T08:27:12,886     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-11.1-py2.py3-none-any.whl#sha256=6abc3a03d4c3168c31fc88c7a584d3bcf6783b5366f3dde77b34d0ac8cee52f9 (from https://www.piwheels.org/simple/setuptools/), version: 11.1
2025-08-31T08:27:12,887     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-11.0-py2.py3-none-any.whl#sha256=2120692cd49873eaa5b359b3d690d02d4a989ab9c0065d5a39f00f2b6fe5bd21 (from https://www.piwheels.org/simple/setuptools/), version: 11.0
2025-08-31T08:27:12,888     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-10.2.1-py2.py3-none-any.whl#sha256=ced9c5cbd9a1126a9058f3dfd864835cde05a7fdd87b4275f609091c0726fe74 (from https://www.piwheels.org/simple/setuptools/), version: 10.2.1
2025-08-31T08:27:12,889     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-10.2-py2.py3-none-any.whl#sha256=42e737877de374a7594350b42dbf15325363ac56ec14417b89cf230d52eeb92d (from https://www.piwheels.org/simple/setuptools/), version: 10.2
2025-08-31T08:27:12,890     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-10.1-py2.py3-none-any.whl#sha256=cc1ae4ab6c610df8f4041867a0785a22b62320a2a8290986093e6a13ebe2f33d (from https://www.piwheels.org/simple/setuptools/), version: 10.1
2025-08-31T08:27:12,891     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-10.0.1-py2.py3-none-any.whl#sha256=fccc3d1663533d269fbdeff61921083609cb4d0dc215201df884c94408eb2314 (from https://www.piwheels.org/simple/setuptools/), version: 10.0.1
2025-08-31T08:27:12,892     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-10.0-py2.py3-none-any.whl#sha256=1b57e7326d6d62af4ce6bfb5f914455da14b156fa6def0fe50fb3b13f5cee513 (from https://www.piwheels.org/simple/setuptools/), version: 10.0
2025-08-31T08:27:12,893     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-9.1-py2.py3-none-any.whl#sha256=958e42d4f1ea13bd90fc963816eaa840df33cd349f2e05446e60a4f160e3b54e (from https://www.piwheels.org/simple/setuptools/), version: 9.1
2025-08-31T08:27:12,894     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-9.0.1-py2.py3-none-any.whl#sha256=acab7553c7c75261ad4c32ba058244a188a6fa9a988187ce4d1522962319fa23 (from https://www.piwheels.org/simple/setuptools/), version: 9.0.1
2025-08-31T08:27:12,895     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-9.0-py2.py3-none-any.whl#sha256=3e53620c4b1794ad449bd8647578b7f87c7761fa2cee1ce207a4e8b54f239a91 (from https://www.piwheels.org/simple/setuptools/), version: 9.0
2025-08-31T08:27:12,896     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-8.3-py2.py3-none-any.whl#sha256=525457fc79543234a99aca787b43e23a25eb4f4dfd87afa51667b6766a02fcb4 (from https://www.piwheels.org/simple/setuptools/), version: 8.3
2025-08-31T08:27:12,897     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-8.2.1-py2.py3-none-any.whl#sha256=16f658027b9e3dc2cbc5c5d3084ebe6a0f845bf7cf248f0f41f19282b458e9c5 (from https://www.piwheels.org/simple/setuptools/), version: 8.2.1
2025-08-31T08:27:12,898     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-8.2-py2.py3-none-any.whl#sha256=7060f908c42e6cde9b12a4311722ba243d8a5670c33ad620d84098267e867670 (from https://www.piwheels.org/simple/setuptools/), version: 8.2
2025-08-31T08:27:12,899     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-8.1-py2.py3-none-any.whl#sha256=bce61812d77f68e484653e523f713a16ba53e012a0eb2a0eb61507363a2f8abf (from https://www.piwheels.org/simple/setuptools/), version: 8.1
2025-08-31T08:27:12,900     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-8.0.4-py2.py3-none-any.whl#sha256=8eadb148a033f13543bfb94da8dd532f59c2032353fb1419a4f21b6ea29cab0a (from https://www.piwheels.org/simple/setuptools/), version: 8.0.4
2025-08-31T08:27:12,901     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-8.0.3-py2.py3-none-any.whl#sha256=9968af3d938e2ac73a75120b84233f6584610cf64b5be2566438e63b75df93a7 (from https://www.piwheels.org/simple/setuptools/), version: 8.0.3
2025-08-31T08:27:12,902     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-8.0.2-py2.py3-none-any.whl#sha256=50373b5fa0ffcf9757522af8c6be44427524ac82b0985f9c6e7701ddb182d624 (from https://www.piwheels.org/simple/setuptools/), version: 8.0.2
2025-08-31T08:27:12,903     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-8.0.1-py2.py3-none-any.whl#sha256=2c88b0c4288ca55cb1fc8dc9b28e0c157d1b10deb11d956942151e115c961737 (from https://www.piwheels.org/simple/setuptools/), version: 8.0.1
2025-08-31T08:27:12,904     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-8.0-py2.py3-none-any.whl#sha256=5fd965e705e8aa78979b0c0bb17e01e01f6940056ba96e35039963631e41dfcf (from https://www.piwheels.org/simple/setuptools/), version: 8.0
2025-08-31T08:27:12,905     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-7.0-py2.py3-none-any.whl#sha256=dc1ff5558d0e4dd8c422a4639350f6748f0811cfae5f0aa219401f3a35306a20 (from https://www.piwheels.org/simple/setuptools/), version: 7.0
2025-08-31T08:27:12,906     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-6.1-py2.py3-none-any.whl#sha256=aff52519bce6009b34ba6394484e118503a6c884feaaa3d7ae92d74facbe370e (from https://www.piwheels.org/simple/setuptools/), version: 6.1
2025-08-31T08:27:12,907     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-6.0.2-py2.py3-none-any.whl#sha256=7d86cdb76057f4d237050e552a8aa372fa8a1214327d8e8ad66a11920e734d16 (from https://www.piwheels.org/simple/setuptools/), version: 6.0.2
2025-08-31T08:27:12,908     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-6.0.1-py2.py3-none-any.whl#sha256=7f0740d6dbf8aafd397d43a4eecd72ce6c0fbd007e6877ab9a5ffe6d896b95b7 (from https://www.piwheels.org/simple/setuptools/), version: 6.0.1
2025-08-31T08:27:12,909     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-5.8-py2.py3-none-any.whl#sha256=487cfc157fc7a26b1467a2ce793a7769f066c2ad814a110cdcde876675fcb7cb (from https://www.piwheels.org/simple/setuptools/), version: 5.8
2025-08-31T08:27:12,910     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-5.7-py2.py3-none-any.whl#sha256=fb97faa2ec56b9e14df4d10b1ca07117ef396dcd820c3b11f554c5599aafe1a4 (from https://www.piwheels.org/simple/setuptools/), version: 5.7
2025-08-31T08:27:12,911     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-5.6-py2.py3-none-any.whl#sha256=387fb155aa9a11dbbfa34cce6c8eca0b2d91490f6c48075efe27acf7d6fb1c9f (from https://www.piwheels.org/simple/setuptools/), version: 5.6
2025-08-31T08:27:12,912     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-5.5.1-py2.py3-none-any.whl#sha256=36c4a1e29cb7cfb0fb517993208d8b4d83a1ced92e3f075e46653e8248828d05 (from https://www.piwheels.org/simple/setuptools/), version: 5.5.1
2025-08-31T08:27:12,913     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-5.5-py2.py3-none-any.whl#sha256=888b1bbc2de1b3efbcb3ae4ebe8c47ec7ab9e4577a1e56064ac7cccd38013a88 (from https://www.piwheels.org/simple/setuptools/), version: 5.5
2025-08-31T08:27:12,914     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-5.4.2-py2.py3-none-any.whl#sha256=343d6635c50de94a5d640c9eb8d9531676bc0ef6bbc32cc216ce2b2f8e5a8e61 (from https://www.piwheels.org/simple/setuptools/), version: 5.4.2
2025-08-31T08:27:12,915     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-5.4.1-py2.py3-none-any.whl#sha256=4f2e50cb2f2585e90637dd0dce289ea7c3b42d549a89fc8e9420a160fc8d5f34 (from https://www.piwheels.org/simple/setuptools/), version: 5.4.1
2025-08-31T08:27:12,916     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-5.4-py2.py3-none-any.whl#sha256=a1c22b481962d230d62b3b2200a231151dd9d0f7cb6346bb9fe5aea97bbe5a95 (from https://www.piwheels.org/simple/setuptools/), version: 5.4
2025-08-31T08:27:12,917     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-5.3-py2.py3-none-any.whl#sha256=993b7cfb4a73b7f16054a27547ad3d1ccc6040446a8cde13c9860cdaf51f6525 (from https://www.piwheels.org/simple/setuptools/), version: 5.3
2025-08-31T08:27:12,918     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-5.2-py2.py3-none-any.whl#sha256=df9f3e7a4b0030dd747b5d0db0db1db6595d6d3839df13d356d9e91dd6076ae8 (from https://www.piwheels.org/simple/setuptools/), version: 5.2
2025-08-31T08:27:12,919     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-5.1-py2.py3-none-any.whl#sha256=cf73ae34664926a6d7dfb225682751a1e10daad28e343a49339d0bf315c7a158 (from https://www.piwheels.org/simple/setuptools/), version: 5.1
2025-08-31T08:27:12,920     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-5.0.2-py2.py3-none-any.whl#sha256=057386b5c4cfd2c648c89333378cdd51bf045635dea5b99d4df3dab72f187979 (from https://www.piwheels.org/simple/setuptools/), version: 5.0.2
2025-08-31T08:27:12,921     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-5.0.1-py2.py3-none-any.whl#sha256=1b7ac064ca58494c96805333cbf5b0bc8123589d8d01a7119e47effdf8933c46 (from https://www.piwheels.org/simple/setuptools/), version: 5.0.1
2025-08-31T08:27:12,922     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-5.0-py2.py3-none-any.whl#sha256=ec5f6a89f285af6b1582b1ed3e34be46b44d99946eb196c63fc45ce40b0bc6f4 (from https://www.piwheels.org/simple/setuptools/), version: 5.0
2025-08-31T08:27:12,923     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-4.0.1-py2.py3-none-any.whl#sha256=6bf65ee21c7a0cdda1af58725ef7b4ce69dc58ae3719e9bda97b8fd3832ec52a (from https://www.piwheels.org/simple/setuptools/), version: 4.0.1
2025-08-31T08:27:12,924     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-4.0-py2.py3-none-any.whl#sha256=27e5bc1fe77161dd8ff5c6fcf9d427abeaa6d077b1c13febf422a035c05e9780 (from https://www.piwheels.org/simple/setuptools/), version: 4.0
2025-08-31T08:27:12,925     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-3.8.1-py2.py3-none-any.whl#sha256=4523f87032f91ee2fab6a368ca002ac73fafe3987e923fbdaf465ab8269eb5de (from https://www.piwheels.org/simple/setuptools/), version: 3.8.1
2025-08-31T08:27:12,926     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-3.8-py2.py3-none-any.whl#sha256=d325c3412a34b33e30d4f3c1f7f8e15f4e1e331e46c5a85bab0aaf9c751331ae (from https://www.piwheels.org/simple/setuptools/), version: 3.8
2025-08-31T08:27:12,927     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-3.7.1-py2.py3-none-any.whl#sha256=0612e99e260fe8936e4da3aa798b3e0707e161542a3070827be0b10543de0e52 (from https://www.piwheels.org/simple/setuptools/), version: 3.7.1
2025-08-31T08:27:12,928     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-3.7-py2.py3-none-any.whl#sha256=d90b7b46c6894115e7ab32f6d3af8fd6d9cabeb10a6a91d51afee2bd4703b0f6 (from https://www.piwheels.org/simple/setuptools/), version: 3.7
2025-08-31T08:27:12,930     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-3.6-py2.py3-none-any.whl#sha256=32708c733c231d0bf2b5c1b5203410efdea80d97979249389f776a085d3b6d6e (from https://www.piwheels.org/simple/setuptools/), version: 3.6
2025-08-31T08:27:12,931     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-3.5.2-py2.py3-none-any.whl#sha256=00fc3cd7f7e205699c51aedc4141fa22cc52b8a336c888a21ec5322210569be8 (from https://www.piwheels.org/simple/setuptools/), version: 3.5.2
2025-08-31T08:27:12,932     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-3.5.1-py2.py3-none-any.whl#sha256=61aefd4283245fcd844b24fc5bfe38c1be0f42fd37b0a65a08ab2f6b1e8801bb (from https://www.piwheels.org/simple/setuptools/), version: 3.5.1
2025-08-31T08:27:12,933     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-3.5-py2.py3-none-any.whl#sha256=bca9bae73ee13ff9a071634431735dd08f643cebc47dcbc0e1401d5c11b3fdb7 (from https://www.piwheels.org/simple/setuptools/), version: 3.5
2025-08-31T08:27:12,934     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-3.4.4-py2.py3-none-any.whl#sha256=0e6b645d6ceadc0182ceed9b0c60e3ab40372dba4e22d108731ccbd9a82669c4 (from https://www.piwheels.org/simple/setuptools/), version: 3.4.4
2025-08-31T08:27:12,935     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-3.4.3-py2.py3-none-any.whl#sha256=705345e8f8136daac132e03d6d9b3a1fb733d0fe1740b7666a64e376b062f5a6 (from https://www.piwheels.org/simple/setuptools/), version: 3.4.3
2025-08-31T08:27:12,936     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-3.4.2-py2.py3-none-any.whl#sha256=233c0c47afa2684d5686597fd67476869c6184acf718c7bda44757b86d561e66 (from https://www.piwheels.org/simple/setuptools/), version: 3.4.2
2025-08-31T08:27:12,937     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-3.4.1-py2.py3-none-any.whl#sha256=6cb23adbf91ad6153b400e3ce4a8518073087fc1713d3398f47abfa4fa9675bd (from https://www.piwheels.org/simple/setuptools/), version: 3.4.1
2025-08-31T08:27:12,938     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-3.4-py2.py3-none-any.whl#sha256=a9ad18120dc79d95020d36b3e1d2fa64d427380be5e01df0d621de5c502e9eb0 (from https://www.piwheels.org/simple/setuptools/), version: 3.4
2025-08-31T08:27:12,939     Found link https://www.piwheels.org/simple/setuptools/setuptools-3.3-py2.py3-none-any.whl#sha256=4705222d7b1d308f67bd4a34ff2fb8a35b8a42f68ccb4a60586a2dd979665875 (from https://www.piwheels.org/simple/setuptools/), version: 3.3
2025-08-31T08:27:12,940     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-3.2-py2.py3-none-any.whl#sha256=900a1d2cc619603ab456b4d1e3ee050ddd99515ebc81335de6431b469d6cbbda (from https://www.piwheels.org/simple/setuptools/), version: 3.2
2025-08-31T08:27:12,941     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-3.1-py2.py3-none-any.whl#sha256=9779604672ce638b155bf0e99612e70ef54432e049494c05caa6269c1cd1bc68 (from https://www.piwheels.org/simple/setuptools/), version: 3.1
2025-08-31T08:27:12,942     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-3.0.2-py2.py3-none-any.whl#sha256=5dea82cde5d879826c679fed99f6702553149e60fdae8a09b34406995527e99f (from https://www.piwheels.org/simple/setuptools/), version: 3.0.2
2025-08-31T08:27:12,943     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-3.0.1-py2.py3-none-any.whl#sha256=c654a89a39737f262892073f1401376b8e56b353674018aa85c722c013f3d40f (from https://www.piwheels.org/simple/setuptools/), version: 3.0.1
2025-08-31T08:27:12,944     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-3.0-py2.py3-none-any.whl#sha256=e597098d2dbd0d725ddd1d2b176291cc48befa1b27aebe3240c875c7f3a809ea (from https://www.piwheels.org/simple/setuptools/), version: 3.0
2025-08-31T08:27:12,945     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-2.2-py2.py3-none-any.whl#sha256=1703355d9dc055415b41955cede439962cf857709649b51fe29c193c8d78ed61 (from https://www.piwheels.org/simple/setuptools/), version: 2.2
2025-08-31T08:27:12,946     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-2.1.2-py2.py3-none-any.whl#sha256=c1cb8c6df460f849757bfb9de768eafb1ee053c4bf0ce488e6972ea4a4bd35ac (from https://www.piwheels.org/simple/setuptools/), version: 2.1.2
2025-08-31T08:27:12,947     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-2.1.1-py2.py3-none-any.whl#sha256=10f9e8b54cfb47d85cad42be3f89ed3c086a0ce8800ac85d59c7903690afeaf1 (from https://www.piwheels.org/simple/setuptools/), version: 2.1.1
2025-08-31T08:27:12,948     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-2.1-py2.py3-none-any.whl#sha256=2a826d4e7b02699ce7e6152800a7befa4451b7e69c9dedc31fdc406e51fb8009 (from https://www.piwheels.org/simple/setuptools/), version: 2.1
2025-08-31T08:27:12,949     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-2.0.2-py2.py3-none-any.whl#sha256=d2d0cfd92521be413693a47aef47f3c1b166841a0f00afa95d67bb8737ec5c76 (from https://www.piwheels.org/simple/setuptools/), version: 2.0.2
2025-08-31T08:27:12,950     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-2.0.1-py2.py3-none-any.whl#sha256=0d951adc315091e44adae71ed89923642a9d5bd0a6e5abdc1775369e715cce9a (from https://www.piwheels.org/simple/setuptools/), version: 2.0.1
2025-08-31T08:27:12,951     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-2.0-py2.py3-none-any.whl#sha256=dc4393cf8750f275d66423eecc3a07b79c20544cf5a0922c393f1a1c44f2944c (from https://www.piwheels.org/simple/setuptools/), version: 2.0
2025-08-31T08:27:12,952     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-1.4.2-py2.py3-none-any.whl#sha256=12ed8d497220eff8b0898444e241fde164c6f22f0924a34e44158223e081683a (from https://www.piwheels.org/simple/setuptools/), version: 1.4.2
2025-08-31T08:27:12,953     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-1.4.1-py2.py3-none-any.whl#sha256=de082c454445c500c6a496b897fae83ebbb37a4a7c1f90394680b58bd33ca068 (from https://www.piwheels.org/simple/setuptools/), version: 1.4.1
2025-08-31T08:27:12,954     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-1.4-py2.py3-none-any.whl#sha256=63933d1d44f58e2022f63e582691e2760e870d6441bee2c878cc5907f6841a78 (from https://www.piwheels.org/simple/setuptools/), version: 1.4
2025-08-31T08:27:12,955     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-1.3.2-py2.py3-none-any.whl#sha256=5a42a408f155eae1ab72ede1d0655ef928c0f7f08534834b84545e9e0fbfde88 (from https://www.piwheels.org/simple/setuptools/), version: 1.3.2
2025-08-31T08:27:12,956     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-1.3.1-py2.py3-none-any.whl#sha256=3d312aa90f8e64427a85a3550bb6fe07ddf720f5f733bc6a26c6b21c5957d5f8 (from https://www.piwheels.org/simple/setuptools/), version: 1.3.1
2025-08-31T08:27:12,957     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-1.3-py2.py3-none-any.whl#sha256=5c6c4244bf43fbdc7e8121069387e1d294ff8c34c0112c5d64ef840d2fcf57bc (from https://www.piwheels.org/simple/setuptools/), version: 1.3
2025-08-31T08:27:12,958     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-1.2-py2.py3-none-any.whl#sha256=9c2febf9ddc39f91c58c60ff65717fc59d4950bcbb7ef06b236c7e16f667b102 (from https://www.piwheels.org/simple/setuptools/), version: 1.2
2025-08-31T08:27:12,959     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-1.1.7-py2.py3-none-any.whl#sha256=e60a653aa95e8a92ceb8010bff005ed5410f5ff4cdfa10f5efd431728aea2e41 (from https://www.piwheels.org/simple/setuptools/), version: 1.1.7
2025-08-31T08:27:12,960     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-1.1.6-py2.py3-none-any.whl#sha256=8372714e9de5d39847f49eecc3f077217211aa6990c27533df5dc707a085c5c3 (from https://www.piwheels.org/simple/setuptools/), version: 1.1.6
2025-08-31T08:27:12,961     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-1.1.5-py2.py3-none-any.whl#sha256=56b41669b9736e15cf2df0436437755d6725a2228bc48cc7c0875f03626ceea0 (from https://www.piwheels.org/simple/setuptools/), version: 1.1.5
2025-08-31T08:27:12,962     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-1.1.4-py2.py3-none-any.whl#sha256=6969f7478d9169acf562ff9249acd0b8c7b66c214b4fc1dffb1356d4010950a2 (from https://www.piwheels.org/simple/setuptools/), version: 1.1.4
2025-08-31T08:27:12,963     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-1.1.3-py2.py3-none-any.whl#sha256=eaf4094fc630031095bdedc12a112dd6d59529ef025cffabce2c74c8c42a3578 (from https://www.piwheels.org/simple/setuptools/), version: 1.1.3
2025-08-31T08:27:12,964     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-1.1.2-py2.py3-none-any.whl#sha256=ad7c7204f6f2ff606a4c70e675a6ca8e9e5fe30c5bd02f5f0d6dc66f42da587e (from https://www.piwheels.org/simple/setuptools/), version: 1.1.2
2025-08-31T08:27:12,965     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-1.1.1-py2.py3-none-any.whl#sha256=8ec837cc3209c54bb275c937c43103a2d42be2909ccfabdec445c5ce06ee2413 (from https://www.piwheels.org/simple/setuptools/), version: 1.1.1
2025-08-31T08:27:12,966     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-1.1-py2.py3-none-any.whl#sha256=d5b91db3ddfd99ed5ccdccbfedd2e0f0d0b4b18f15a96f01f6970a42cf06cf7c (from https://www.piwheels.org/simple/setuptools/), version: 1.1
2025-08-31T08:27:12,967     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-1.0-py2.py3-none-any.whl#sha256=51599758af4090dd95abc67815806e7af4a85dc533452a6f31a66f98e8927afd (from https://www.piwheels.org/simple/setuptools/), version: 1.0
2025-08-31T08:27:12,968     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-0.9.8-py2.py3-none-any.whl#sha256=bf8e39b012d0146a4aeaf541353f5b9b9630bbcb5ac27505849ac896bcff2f6a (from https://www.piwheels.org/simple/setuptools/), version: 0.9.8
2025-08-31T08:27:12,969     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-0.9.7-py3-none-any.whl#sha256=f6b58d0a10e855fb85432c9cc51cab71af61ecc772387e0bb2a8bdb93c5914ed (from https://www.piwheels.org/simple/setuptools/), version: 0.9.7
2025-08-31T08:27:12,970     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-0.9.5-py3-none-any.whl#sha256=022f89fe01d35ce6630a20130d7456e71e5ba95d656e1d7df5cbdb6c83445886 (from https://www.piwheels.org/simple/setuptools/), version: 0.9.5
2025-08-31T08:27:12,971     Found link https://archive1.piwheels.org/simple/setuptools/setuptools-0.8-py3-none-any.whl#sha256=1794daaa2a7dba56071c2609dbac21aac2d8b55f96180e0cdb62735685d2dfa2 (from https://www.piwheels.org/simple/setuptools/), version: 0.8
2025-08-31T08:27:12,972   Skipping link: not a file: https://www.piwheels.org/simple/setuptools/
2025-08-31T08:27:12,973   Skipping link: not a file: https://pypi.org/simple/setuptools/
2025-08-31T08:27:13,188   Given no hashes to check 833 links for project 'setuptools': discarding no candidates
2025-08-31T08:27:13,322   Collecting setuptools>=40.8.0
2025-08-31T08:27:13,323     Created temporary directory: /tmp/pip-unpack-u5qb3r50
2025-08-31T08:27:13,325     Found index url https://www.piwheels.org/simple/
2025-08-31T08:27:13,326     Looking up "https://www.piwheels.org/simple/setuptools/setuptools-80.9.0-py3-none-any.whl" in the cache
2025-08-31T08:27:13,329     Current age based on date: 22
2025-08-31T08:27:13,337     https://www.piwheels.org:443 "GET /simple/setuptools/setuptools-80.9.0-py3-none-any.whl HTTP/1.1" 304 0
2025-08-31T08:27:13,346     Using cached https://www.piwheels.org/simple/setuptools/setuptools-80.9.0-py3-none-any.whl (1.2 MB)
2025-08-31T08:27:13,428   2 location(s) to search for versions of wheel:
2025-08-31T08:27:13,429   * https://pypi.org/simple/wheel/
2025-08-31T08:27:13,429   * https://www.piwheels.org/simple/wheel/
2025-08-31T08:27:13,430   Fetching project page and analyzing links: https://pypi.org/simple/wheel/
2025-08-31T08:27:13,431   Getting page https://pypi.org/simple/wheel/
2025-08-31T08:27:13,433   Found index url https://pypi.org/simple/
2025-08-31T08:27:13,434   Looking up "https://pypi.org/simple/wheel/" in the cache
2025-08-31T08:27:13,435   Request header has "max_age" as 0, cache bypassed
2025-08-31T08:27:13,442   https://pypi.org:443 "GET /simple/wheel/ HTTP/1.1" 304 0
2025-08-31T08:27:13,450   Fetched page https://pypi.org/simple/wheel/ as application/vnd.pypi.simple.v1+json
2025-08-31T08:27:13,466     Found link https://files.pythonhosted.org/packages/51/15/d31364732deb6e7d1490f8a08f011997b52b4b106d592d36e917404be613/wheel-0.1.tar.gz (from https://pypi.org/simple/wheel/), version: 0.1
2025-08-31T08:27:13,468     Found link https://files.pythonhosted.org/packages/e2/1e/aedf6a9c6c0a588f96e9fe6e953de0c9f9084baad05f3ed0bd4a9b4a469f/wheel-0.2.tar.gz (from https://pypi.org/simple/wheel/), version: 0.2
2025-08-31T08:27:13,469     Found link https://files.pythonhosted.org/packages/87/cc/7e2672fda46ece9fd8880fe8784ec8013f87879fc35b785cbc53e7e85700/wheel-0.3.tar.gz (from https://pypi.org/simple/wheel/), version: 0.3
2025-08-31T08:27:13,470     Found link https://files.pythonhosted.org/packages/c4/27/39e87b69a9a65cc89b6d83d21e7deca97bc31c7d0de492e63b4139890d11/wheel-0.4.tar.gz (from https://pypi.org/simple/wheel/), version: 0.4
2025-08-31T08:27:13,471     Found link https://files.pythonhosted.org/packages/91/9f/23da62e10213c4a9e7b6a41913bca5592f7bf14de5181f07eed6ea65dedb/wheel-0.4.1.tar.gz (from https://pypi.org/simple/wheel/), version: 0.4.1
2025-08-31T08:27:13,472     Found link https://files.pythonhosted.org/packages/37/81/ed812d6e0cb7b75e184015601ab4a83fed37606899595ba28d511ba349ee/wheel-0.4.2.tar.gz (from https://pypi.org/simple/wheel/), version: 0.4.2
2025-08-31T08:27:13,474     Found link https://files.pythonhosted.org/packages/a6/58/3ecc315c7809b9b44de37b615498b4fb51982c37d92be1b83640ddf94323/wheel-0.5.tar.gz (from https://pypi.org/simple/wheel/), version: 0.5
2025-08-31T08:27:13,475     Found link https://files.pythonhosted.org/packages/53/26/1880f84340dd8717105fc3e5c199479829fcfb3108b2afea92b5b0ae0e09/wheel-0.6.tar.gz (from https://pypi.org/simple/wheel/), version: 0.6
2025-08-31T08:27:13,476     Found link https://files.pythonhosted.org/packages/1d/79/49416a92ca1ae8c30f9a489b6349c795794aa209cde2e7d0afd5614cbfa6/wheel-0.7.tar.gz (from https://pypi.org/simple/wheel/), version: 0.7
2025-08-31T08:27:13,478     Skipping link: none of the wheel's tags (py27-none-any) are compatible (run pip debug --verbose to show compatible tags): https://files.pythonhosted.org/packages/0b/86/3c1687aba2d15cec12ed2dc9bb5276e9fb6d3d43ce7376e91fabdb400c0a/wheel-0.8-py27-none-any.whl (from https://pypi.org/simple/wheel/)
2025-08-31T08:27:13,479     Found link https://files.pythonhosted.org/packages/27/22/83e4db59ad3ef6a1616c5db5c712b1d19803808d1e84001eae8e38c88db1/wheel-0.8.tar.gz (from https://pypi.org/simple/wheel/), version: 0.8
2025-08-31T08:27:13,480     Skipping link: none of the wheel's tags (py27-none-any) are compatible (run pip debug --verbose to show compatible tags): https://files.pythonhosted.org/packages/98/53/d87853d5490feb0ec9295e645ce0fa631ed95c2020d3411103561563e045/wheel-0.9-py27-none-any.whl (from https://pypi.org/simple/wheel/)
2025-08-31T08:27:13,481     Found link https://files.pythonhosted.org/packages/34/4b/aa762fd3c034baa7fdc266bf8f54e442c9d1b0aedce74ff32d287af25db3/wheel-0.9-py32-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.9
2025-08-31T08:27:13,483     Found link https://files.pythonhosted.org/packages/fc/62/48c826c3d7c15367a855ebab08b37a72ee9f33f41d4536fb16b6aa124acd/wheel-0.9.tar.gz (from https://pypi.org/simple/wheel/), version: 0.9
2025-08-31T08:27:13,484     Found link https://files.pythonhosted.org/packages/2a/52/28470f5d856acec391d04cf4570664d4174ee5e0482f3d3cab584c5e2ea5/wheel-0.9.1.tar.gz (from https://pypi.org/simple/wheel/), version: 0.9.1
2025-08-31T08:27:13,485     Found link https://files.pythonhosted.org/packages/a9/cf/8223ae8f72eac39e409d555da52a1b744b27f632da4dcb1513312a3ff570/wheel-0.9.2.tar.gz (from https://pypi.org/simple/wheel/), version: 0.9.2
2025-08-31T08:27:13,486     Found link https://files.pythonhosted.org/packages/b6/54/617e21cd9d8151f6cfc9f9bf1b6cde2f430f70ff2b66ccef477ada7f0c12/wheel-0.9.3.tar.gz (from https://pypi.org/simple/wheel/), version: 0.9.3
2025-08-31T08:27:13,488     Found link https://files.pythonhosted.org/packages/16/84/d42d28af9502073272b59c52dfc90091bf8efa1277dac1b8730aaa3eb867/wheel-0.9.4.tar.gz (from https://pypi.org/simple/wheel/), version: 0.9.4
2025-08-31T08:27:13,489     Found link https://files.pythonhosted.org/packages/28/46/8ebdfe69b7ad35adf20b0e9335a0ec5790f9999d7c99fe5d180a55f9f963/wheel-0.9.5-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.9.5
2025-08-31T08:27:13,490     Found link https://files.pythonhosted.org/packages/cf/04/7cd10c6b78b55972a651e04affebc02fa4c0b45d943996540033b246eb42/wheel-0.9.5.tar.gz (from https://pypi.org/simple/wheel/), version: 0.9.5
2025-08-31T08:27:13,492     Skipping link: none of the wheel's tags (py27-none-any) are compatible (run pip debug --verbose to show compatible tags): https://files.pythonhosted.org/packages/34/da/0fb28917ed602bda9807eda0e9a9202a53d97a2b2ae4b0392fd9015dbcfd/wheel-0.9.6-py27-none-any.whl (from https://pypi.org/simple/wheel/)
2025-08-31T08:27:13,493     Found link https://files.pythonhosted.org/packages/02/c5/0f17dc19cc58f15bc3e1d8d0ccf68277180b3898028e16ba15bda2010545/wheel-0.9.6.tar.gz (from https://pypi.org/simple/wheel/), version: 0.9.6
2025-08-31T08:27:13,494     Skipping link: none of the wheel's tags (py27-none-any) are compatible (run pip debug --verbose to show compatible tags): https://files.pythonhosted.org/packages/9a/2a/4a9de088db2a97bf5eec6f274875c369c50d634eb2096efccf80902e6d33/wheel-0.9.7-py27-none-any.whl (from https://pypi.org/simple/wheel/)
2025-08-31T08:27:13,495     Found link https://files.pythonhosted.org/packages/8d/47/0398c7707a3c6fe46d4d326bc063ce698beac7e6ab5af505f462bf50602d/wheel-0.9.7.tar.gz (from https://pypi.org/simple/wheel/), version: 0.9.7
2025-08-31T08:27:13,497     Found link https://files.pythonhosted.org/packages/55/c3/6147192b7e74f476b529aa56d2a68d1decfffae084276869b990a70b3053/wheel-0.10.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.10.0
2025-08-31T08:27:13,498     Found link https://files.pythonhosted.org/packages/7d/23/7b42140d7c5de5cf184c99b9921066494fd1ac5049864aba84031df97447/wheel-0.10.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.10.0
2025-08-31T08:27:13,499     Found link https://files.pythonhosted.org/packages/bf/46/446356d9ee7bbcac41b9784720fe8d2312e62db7639a3cb37d3c35e766b2/wheel-0.10.1-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.10.1
2025-08-31T08:27:13,500     Found link https://files.pythonhosted.org/packages/48/67/928da8e188fb605c6723cb597dc2bcc269dad9aca725411f4e351bf84c0e/wheel-0.10.1.tar.gz (from https://pypi.org/simple/wheel/), version: 0.10.1
2025-08-31T08:27:13,502     Found link https://files.pythonhosted.org/packages/cd/09/5471330c7f308a02256964f8935d1e5e95824f814c14b5396d7970c38378/wheel-0.10.2-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.10.2
2025-08-31T08:27:13,503     Found link https://files.pythonhosted.org/packages/47/cc/2b9c2ec868d1dcefb995b6689f4fd7ecd271bd4e6572fbb046a8b126c20d/wheel-0.10.2.tar.gz (from https://pypi.org/simple/wheel/), version: 0.10.2
2025-08-31T08:27:13,504     Found link https://files.pythonhosted.org/packages/54/8c/cde887de967cd0cffa166b01ad763171930ca86015a009427ba3fb7925ea/wheel-0.10.3-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.10.3
2025-08-31T08:27:13,505     Found link https://files.pythonhosted.org/packages/db/9e/7a4ceefae0950a291ff1cdf9aa927bbe61d5a67b187ae3aa11eba61a8138/wheel-0.10.3.tar.gz (from https://pypi.org/simple/wheel/), version: 0.10.3
2025-08-31T08:27:13,506     Found link https://files.pythonhosted.org/packages/f0/c8/53fa58a736b1f842bf4e29e61fd89f97bbf75b9bef09c06575fe31f660e0/wheel-0.11.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.11.0
2025-08-31T08:27:13,507     Found link https://files.pythonhosted.org/packages/00/6c/c02fa934c0df8f8aa870f25cccff1c041afba456e659e655feb2b7cdb050/wheel-0.11.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.11.0
2025-08-31T08:27:13,509     Found link https://files.pythonhosted.org/packages/fc/44/c7fabd874dc798e1734637b04aaba0d4c0cec1364fd3b09ca91f9372d866/wheel-0.12.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.12.0
2025-08-31T08:27:13,510     Found link https://files.pythonhosted.org/packages/04/c4/98dc250c85a6a7807236cc11c0ae154326797b4ee654445ad817645915b7/wheel-0.12.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.12.0
2025-08-31T08:27:13,511     Found link https://files.pythonhosted.org/packages/d0/f9/16c9e3f338309ee4d88435b4ed23aa43d8719b1c7d2ed9281aec6146d678/wheel-0.13.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.13.0
2025-08-31T08:27:13,512     Found link https://files.pythonhosted.org/packages/62/41/93774ef38ee9805ee46411873f53eea0a15cfc31f6bb9b8fbe58cdc1ba30/wheel-0.13.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.13.0
2025-08-31T08:27:13,513     Found link https://files.pythonhosted.org/packages/49/1e/64bd498334aa061ecc281b92285d0eb6cbf8cedd12ed9ac8c9723362ef86/wheel-0.14.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.14.0
2025-08-31T08:27:13,514     Found link https://files.pythonhosted.org/packages/6a/ea/df18b5c87d11e29401af01320a2e3613effd4de3dfafe4353d9187fe5d8d/wheel-0.14.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.14.0
2025-08-31T08:27:13,515     Found link https://files.pythonhosted.org/packages/4d/ae/38ff18147dc73de82fd5dd4fd1f2ecdaef6dccc0365ae2e460c404e83ef7/wheel-0.15.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.15.0
2025-08-31T08:27:13,516     Found link https://files.pythonhosted.org/packages/82/07/d9680d331deb1247cf28804422a0e3050870481ac43234437f72547aacb4/wheel-0.15.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.15.0
2025-08-31T08:27:13,517     Found link https://files.pythonhosted.org/packages/16/7b/f4e0e59f5b8bd3756d9d2d4a4493700b420991cfd20218fd7b9077f95e83/wheel-0.16.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.16.0
2025-08-31T08:27:13,518     Found link https://files.pythonhosted.org/packages/4d/31/bcc5270aa8f08764ab73de32bdc1b95a16b043bff42e8f808da3b344ff80/wheel-0.16.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.16.0
2025-08-31T08:27:13,519     Found link https://files.pythonhosted.org/packages/92/9c/6c4474034690084808c05c1bde6bd00d37ae777f7f94beb40aeb98b3a9e0/wheel-0.17.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.17.0
2025-08-31T08:27:13,520     Found link https://files.pythonhosted.org/packages/16/f8/b06811f631f11f892ec88f6c073b96ab1c1a34f2993e7a460334f44b3637/wheel-0.17.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.17.0
2025-08-31T08:27:13,521     Found link https://files.pythonhosted.org/packages/ca/8e/f363a37db72b9ba3ae0eea72ba380a38d3e5b966adfd8c7a78eb0c54234c/wheel-0.18.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.18.0
2025-08-31T08:27:13,522     Found link https://files.pythonhosted.org/packages/a3/eb/b4eb495e767d5f6be823f27d9e891eee154d4cded6d97941a1361468421c/wheel-0.18.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.18.0
2025-08-31T08:27:13,523     Found link https://files.pythonhosted.org/packages/b8/58/9130ace9b544470908a68abcfb9201c383d2f734426bf7892badb37c5541/wheel-0.19.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.19.0
2025-08-31T08:27:13,524     Found link https://files.pythonhosted.org/packages/b9/28/1ce455559c7502c082ccc876a22ec6fd61cc6910da0bc620d910cbe8fa11/wheel-0.19.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.19.0
2025-08-31T08:27:13,525     Found link https://files.pythonhosted.org/packages/0d/e6/60c6e03ae967d076e72ec5298cd136d658e4b8eb6773d6aef3ff1abc8d04/wheel-0.21.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.21.0
2025-08-31T08:27:13,526     Found link https://files.pythonhosted.org/packages/2a/a3/7a0a7d058bcaf0b08a50e7d55d5426522374ee466316489cc853d0d26dc1/wheel-0.21.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.21.0
2025-08-31T08:27:13,527     Found link https://files.pythonhosted.org/packages/d0/2f/dd989a40d4e1b85cf0826eb79b630efa52389eae5ee2760a74848156aa9a/wheel-0.22.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.22.0
2025-08-31T08:27:13,528     Found link https://files.pythonhosted.org/packages/df/cc/212d1a8cb8fadc3a6b923b1a1392cf2911d606117537ac62ae6897bde95b/wheel-0.22.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.22.0
2025-08-31T08:27:13,529     Found link https://files.pythonhosted.org/packages/a9/67/43036e2db1a344ad24ba468b6262826b3837ce629b7b4c09c18d3e2b5800/wheel-0.23.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.23.0
2025-08-31T08:27:13,530     Found link https://files.pythonhosted.org/packages/24/dc/2b7134bce04139b67727bfc441ef77e8558df07103c12275e3617ffe6c57/wheel-0.23.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.23.0
2025-08-31T08:27:13,531     Found link https://files.pythonhosted.org/packages/e8/14/eaaac12b0432c984a27ad0050a5a0bedc6135df35a0f5f1f35228faf12d4/wheel-0.24.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.24.0
2025-08-31T08:27:13,532     Found link https://files.pythonhosted.org/packages/aa/35/b7d0fcdfcf2151327afa6bea68839aed1f1914a4225b24750bb8baf057c8/wheel-0.24.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.24.0
2025-08-31T08:27:13,533     Found link https://files.pythonhosted.org/packages/2d/14/a561f8a503bd62bb1df33694b183cf3f280f6fba7bda589670efe65f09e9/wheel-0.25.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.25.0
2025-08-31T08:27:13,534     Found link https://files.pythonhosted.org/packages/59/7b/00b6746e26e7c4ed9a2628418f5ff0d45c5e02b5317e65128173515739a2/wheel-0.25.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.25.0
2025-08-31T08:27:13,535     Found link https://files.pythonhosted.org/packages/d9/6f/cfb45d489703e4843b30c28e01ab39c87b0648bfa11a6c4a959f426fe217/wheel-0.26.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.26.0
2025-08-31T08:27:13,536     Found link https://files.pythonhosted.org/packages/91/66/ddc9410feba81767f53c87e78f958f884536cf37ca991b90ec2890706dcf/wheel-0.26.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.26.0
2025-08-31T08:27:13,537     Found link https://files.pythonhosted.org/packages/d9/e0/f0fd2f9d4777c56766752a03bc0e420dc65d50186c71ebaf73255156bd9a/wheel-0.27.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.27.0
2025-08-31T08:27:13,537     Found link https://files.pythonhosted.org/packages/be/3d/73e36a9f4afaea62c4d91b858d061e8c7e0074dd67e5e80618b644756dc7/wheel-0.27.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.27.0
2025-08-31T08:27:13,538     Found link https://files.pythonhosted.org/packages/c8/72/d51052bb24c9e551e292e87fc7376bad9ae5fa198b294f4ab4e2619f530c/wheel-0.28.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.28.0
2025-08-31T08:27:13,539     Found link https://files.pythonhosted.org/packages/8f/c6/c524fe41283b2820f85a8e38cedd19ebb6454365281549dcf98ae32feb85/wheel-0.28.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.28.0
2025-08-31T08:27:13,540     Found link https://files.pythonhosted.org/packages/8a/e9/8468cd68b582b06ef554be0b96b59f59779627131aad48f8a5bce4b13450/wheel-0.29.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.29.0
2025-08-31T08:27:13,541     Found link https://files.pythonhosted.org/packages/c9/1d/bd19e691fd4cfe908c76c429fe6e4436c9e83583c4414b54f6c85471954a/wheel-0.29.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.29.0
2025-08-31T08:27:13,542     Found link https://files.pythonhosted.org/packages/83/53/e120833aa2350db333df89a40dea3b310dd9dabf6f29eaa18934a597dc79/wheel-0.30.0a0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.30.0a0
2025-08-31T08:27:13,543     Found link https://files.pythonhosted.org/packages/a7/37/947b4329c4a3c72093b6c8e9b4be8c7f10c32dbb78848d3a234ce01c059d/wheel-0.30.0a0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.30.0a0
2025-08-31T08:27:13,544     Found link https://files.pythonhosted.org/packages/0c/80/16a85b47702a1f47a63c104c91abdd0a6704ee8ae3b4ce4afc49bc39f9d9/wheel-0.30.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.30.0
2025-08-31T08:27:13,545     Found link https://files.pythonhosted.org/packages/fa/b4/f9886517624a4dcb81a1d766f68034344b7565db69f13d52697222daeb72/wheel-0.30.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.30.0
2025-08-31T08:27:13,547     Found link https://files.pythonhosted.org/packages/1b/d2/22cde5ea9af055f81814f9f2545f5ed8a053eb749c08d186b369959189a8/wheel-0.31.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.31.0
2025-08-31T08:27:13,548     Found link https://files.pythonhosted.org/packages/5d/c1/45947333669b31bc6b4933308dd07c2aa2fedcec0a95b14eedae993bd449/wheel-0.31.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.31.0
2025-08-31T08:27:13,549     Found link https://files.pythonhosted.org/packages/81/30/e935244ca6165187ae8be876b6316ae201b71485538ffac1d718843025a9/wheel-0.31.1-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.31.1
2025-08-31T08:27:13,550     Found link https://files.pythonhosted.org/packages/2a/fb/aefe5d5dbc3f4fe1e815bcdb05cbaab19744d201bbc9b59cfa06ec7fc789/wheel-0.31.1.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.31.1
2025-08-31T08:27:13,550     Found link https://files.pythonhosted.org/packages/b3/bb/42354ce8c08f66ae0cd0f4a841f40ed41d709ac9c28f292bfeb383236a4a/wheel-0.32.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.0
2025-08-31T08:27:13,551     Found link https://files.pythonhosted.org/packages/68/f0/545cbeae75f248c4ad7c2d062672cd7e046dd325a81b74fc02c62450d133/wheel-0.32.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.0
2025-08-31T08:27:13,552     Found link https://files.pythonhosted.org/packages/fc/e9/05316a1eec70c2bfc1c823a259546475bd7636ba6d27ec80575da523bc34/wheel-0.32.1-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.1
2025-08-31T08:27:13,553     Found link https://files.pythonhosted.org/packages/e2/d0/bb5eedd650e777039d984b209d229b97fa2161916c920245a85c1ef07667/wheel-0.32.1.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.1
2025-08-31T08:27:13,554     Found link https://files.pythonhosted.org/packages/5a/9b/6aebe9e2636d35d1a93772fa644c828303e1d5d124e8a88f156f42ac4b87/wheel-0.32.2-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.2
2025-08-31T08:27:13,555     Found link https://files.pythonhosted.org/packages/c2/00/21e3ecc8a9d484f9de995471c061aa3d8f02ae54bdfd9cbdddb59138c809/wheel-0.32.2.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.2
2025-08-31T08:27:13,556     Found link https://files.pythonhosted.org/packages/ff/47/1dfa4795e24fd6f93d5d58602dd716c3f101cfd5a77cd9acbe519b44a0a9/wheel-0.32.3-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.3
2025-08-31T08:27:13,557     Found link https://files.pythonhosted.org/packages/d8/55/221a530d66bf78e72996453d1e2dedef526063546e131d70bed548d80588/wheel-0.32.3.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.3
2025-08-31T08:27:13,558     Found link https://files.pythonhosted.org/packages/7c/d7/20bd3c501f53fdb0b7387e75c03bd1fce748a1c3dd342fc53744e28e3de1/wheel-0.33.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.0
2025-08-31T08:27:13,559     Found link https://files.pythonhosted.org/packages/d9/7d/86df15e317027f6e87aa68ea854abf8437e796b4c0fadd3ae5ee67b77cb2/wheel-0.33.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.0
2025-08-31T08:27:13,560     Found link https://files.pythonhosted.org/packages/96/ba/a4702cbb6a3a485239fbe9525443446203f00771af9ac000fa3ef2788201/wheel-0.33.1-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.1
2025-08-31T08:27:13,561     Found link https://files.pythonhosted.org/packages/b7/cf/1ea0f5b3ce55cacde1e84cdde6cee1ebaff51bd9a3e6c7ba4082199af6f6/wheel-0.33.1.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.1
2025-08-31T08:27:13,562     Found link https://files.pythonhosted.org/packages/bb/10/44230dd6bf3563b8f227dbf344c908d412ad2ff48066476672f3a72e174e/wheel-0.33.4-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.4
2025-08-31T08:27:13,563     Found link https://files.pythonhosted.org/packages/1d/b0/f478e80aeace42fe251225a86752799174a94314c4a80ebfc5bf0ab1153a/wheel-0.33.4.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.4
2025-08-31T08:27:13,564     Found link https://files.pythonhosted.org/packages/65/55/8d1fab74c43c0b4bcfcaad988888b4bd03234dde245f9536d165f26e103f/wheel-0.33.5-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.5
2025-08-31T08:27:13,565     Found link https://files.pythonhosted.org/packages/18/50/3289ccedef5251e9b1de59946038aacc46da1c7810589c9271381f7d1d0b/wheel-0.33.5.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.5
2025-08-31T08:27:13,566     Found link https://files.pythonhosted.org/packages/00/83/b4a77d044e78ad1a45610eb88f745be2fd2c6d658f9798a15e384b7d57c9/wheel-0.33.6-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.6
2025-08-31T08:27:13,567     Found link https://files.pythonhosted.org/packages/59/b0/11710a598e1e148fb7cbf9220fd2a0b82c98e94efbdecb299cb25e7f0b39/wheel-0.33.6.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.6
2025-08-31T08:27:13,569     Found link https://files.pythonhosted.org/packages/58/2b/2a307602a01ade0a4ef1774213f978aac87d1f4b9a875942c8cead888871/wheel-0.34.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.34.0
2025-08-31T08:27:13,570     Found link https://files.pythonhosted.org/packages/15/39/728ccb81172c73f14084948b2d4561d5e51649dcf4b21d1f207b7363b1d7/wheel-0.34.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.34.0
2025-08-31T08:27:13,572     Found link https://files.pythonhosted.org/packages/81/44/db78754a73d9a88c5bd1bb692b40004410970e88aa0c5dff20b57f231505/wheel-0.34.1-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, !=3.4.*), version: 0.34.1
2025-08-31T08:27:13,573     Found link https://files.pythonhosted.org/packages/f9/85/120a5ad1565398efb1184eacaa597e925abbf8fff8cc748877add71257f1/wheel-0.34.1.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, !=3.4.*), version: 0.34.1
2025-08-31T08:27:13,574     Found link https://files.pythonhosted.org/packages/8c/23/848298cccf8e40f5bbb59009b32848a4c38f4e7f3364297ab3c3e2e2cd14/wheel-0.34.2-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, !=3.4.*), version: 0.34.2
2025-08-31T08:27:13,575     Found link https://files.pythonhosted.org/packages/75/28/521c6dc7fef23a68368efefdcd682f5b3d1d58c2b90b06dc1d0b805b51ae/wheel-0.34.2.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, !=3.4.*), version: 0.34.2
2025-08-31T08:27:13,576     Found link https://files.pythonhosted.org/packages/85/37/7252beacf7e60cffe3bc5a97f94e3ccf22a927e87697d377cfe16abea7cf/wheel-0.35.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.35.0
2025-08-31T08:27:13,577     Found link https://files.pythonhosted.org/packages/5b/e1/fa6dccd0d461520fbaa98d47cdf1ba26d5a2666e24b454d0e27387420e4b/wheel-0.35.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.35.0
2025-08-31T08:27:13,578     Found link https://files.pythonhosted.org/packages/a7/00/3df031b3ecd5444d572141321537080b40c1c25e1caa3d86cdd12e5e919c/wheel-0.35.1-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.35.1
2025-08-31T08:27:13,579     Found link https://files.pythonhosted.org/packages/83/72/611c121b6bd15479cb62f1a425b2e3372e121b324228df28e64cc28b01c2/wheel-0.35.1.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.35.1
2025-08-31T08:27:13,580     Found link https://files.pythonhosted.org/packages/84/e8/3caa0d932d0edd9c9611065831fd06cf05c53671f78a0fa553a635da7e2f/wheel-0.36.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.0
2025-08-31T08:27:13,581     Found link https://files.pythonhosted.org/packages/57/73/1911bfa69482de2a6327db4ca5eda87ae7599160018910007d6d6a1d3ada/wheel-0.36.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.0
2025-08-31T08:27:13,582     Found link https://files.pythonhosted.org/packages/c9/0b/e0fd299d93cd9331657f415085a4956422959897b333e3791dde40bd711d/wheel-0.36.1-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.1
2025-08-31T08:27:13,582     Found link https://files.pythonhosted.org/packages/d4/cf/732e05dce1e37b63d54d1836160b6e24fb36eeff2313e93315ad047c7d90/wheel-0.36.1.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.1
2025-08-31T08:27:13,583     Found link https://files.pythonhosted.org/packages/65/63/39d04c74222770ed1589c0eaba06c05891801219272420b40311cd60c880/wheel-0.36.2-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.2
2025-08-31T08:27:13,584     Found link https://files.pythonhosted.org/packages/ed/46/e298a50dde405e1c202e316fa6a3015ff9288423661d7ea5e8f22f589071/wheel-0.36.2.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.2
2025-08-31T08:27:13,585     Found link https://files.pythonhosted.org/packages/04/80/cad93b40262f5d09f6de82adbee452fd43cdff60830b56a74c5930f7e277/wheel-0.37.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.37.0
2025-08-31T08:27:13,586     Found link https://files.pythonhosted.org/packages/4e/be/8139f127b4db2f79c8b117c80af56a3078cc4824b5b94250c7f81a70e03b/wheel-0.37.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.37.0
2025-08-31T08:27:13,587     Found link https://files.pythonhosted.org/packages/27/d6/003e593296a85fd6ed616ed962795b2f87709c3eee2bca4f6d0fe55c6d00/wheel-0.37.1-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.37.1
2025-08-31T08:27:13,588     Found link https://files.pythonhosted.org/packages/c0/6c/9f840c2e55b67b90745af06a540964b73589256cb10cc10057c87ac78fc2/wheel-0.37.1.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.37.1
2025-08-31T08:27:13,589     Found link https://files.pythonhosted.org/packages/bb/ae/02bad7c64ca060e037869584242729796a5eda0376bb944a3e03f4d9491b/wheel-0.38.0-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.0
2025-08-31T08:27:13,590     Found link https://files.pythonhosted.org/packages/46/57/f39f082f448205ec06a771fe30eec77ed650c0c8e3f7d7f193e12efb4fd4/wheel-0.38.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.0
2025-08-31T08:27:13,591     Found link https://files.pythonhosted.org/packages/84/a8/4dab22a963a756e5b54ce0ab5c900c54329cff38e163fe3c67c858240ec6/wheel-0.38.1-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.1
2025-08-31T08:27:13,592     Found link https://files.pythonhosted.org/packages/7a/b0/29c0c8c6f8cebeb0de4c17bc44365cba0b35cb4246e4a27a7e12ecf92d73/wheel-0.38.1.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.1
2025-08-31T08:27:13,594     Found link https://files.pythonhosted.org/packages/46/3a/73fcaf6487aa9a9b02ee9df30a24bdc2c1f0292fe559811936d67a9053c1/wheel-0.38.2-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.2
2025-08-31T08:27:13,595     Found link https://files.pythonhosted.org/packages/a4/5b/0718aa11e3360f97feb81ddcb19cbb9306df0a17bef7c360f8939d2629b8/wheel-0.38.2.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.2
2025-08-31T08:27:13,596     Found link https://files.pythonhosted.org/packages/3b/48/7a4e6e610cfbc71d727ac58ddc9abe0daf5772b81d5630a4aef9e919ad46/wheel-0.38.3-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.3
2025-08-31T08:27:13,597     Found link https://files.pythonhosted.org/packages/2e/c6/af5def6796940a8bd602d815f7f495f32d833c81b38d055ca0b23ab3b804/wheel-0.38.3.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.3
2025-08-31T08:27:13,598     Found link https://files.pythonhosted.org/packages/bd/7c/d38a0b30ce22fc26ed7dbc087c6d00851fb3395e9d0dac40bec1f905030c/wheel-0.38.4-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.4
2025-08-31T08:27:13,599     Found link https://files.pythonhosted.org/packages/a2/b8/6a06ff0f13a00fc3c3e7d222a995526cbca26c1ad107691b6b1badbbabf1/wheel-0.38.4.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.4
2025-08-31T08:27:13,600     Found link https://files.pythonhosted.org/packages/61/86/cc8d1ff2ca31a312a25a708c891cf9facbad4eae493b3872638db6785eb5/wheel-0.40.0-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.40.0
2025-08-31T08:27:13,601     Found link https://files.pythonhosted.org/packages/fc/ef/0335f7217dd1e8096a9e8383e1d472aa14717878ffe07c4772e68b6e8735/wheel-0.40.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.40.0
2025-08-31T08:27:13,602     Found link https://files.pythonhosted.org/packages/17/11/f139e25018ea2218aeedbedcf85cd0dd8abeed29a38ac1fda7f5a8889382/wheel-0.41.0-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.0
2025-08-31T08:27:13,603     Found link https://files.pythonhosted.org/packages/ec/34/903929e15b2657335b2ce8723d92fc804d3569b7ac0f1f8877ed1a7b2024/wheel-0.41.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.0
2025-08-31T08:27:13,605     Found link https://files.pythonhosted.org/packages/28/f5/6955d7b3a5d71ce6bac104f9cf98c1b0513ad656cdaca8ea7d579196f771/wheel-0.41.1-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.1
2025-08-31T08:27:13,605     Found link https://files.pythonhosted.org/packages/c9/3d/02a14af2b413d7abf856083f327744d286f4468365cddace393a43d9d540/wheel-0.41.1.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.1
2025-08-31T08:27:13,606     Found link https://files.pythonhosted.org/packages/b8/8b/31273bf66016be6ad22bb7345c37ff350276cfd46e389a0c2ac5da9d9073/wheel-0.41.2-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.2
2025-08-31T08:27:13,607     Found link https://files.pythonhosted.org/packages/a4/99/78c4f3bd50619d772168bec6a0f34379b02c19c9cced0ed833ecd021fd0d/wheel-0.41.2.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.2
2025-08-31T08:27:13,608     Found link https://files.pythonhosted.org/packages/fa/7f/4c07234086edbce4a0a446209dc0cb08a19bb206a3ea53b2f56a403f983b/wheel-0.41.3-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.3
2025-08-31T08:27:13,609     Found link https://files.pythonhosted.org/packages/fb/d0/0b4c18a0b85c20233b0c3bc33f792aefd7f12a5832b4da77419949ff6fd9/wheel-0.41.3.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.3
2025-08-31T08:27:13,610     Found link https://files.pythonhosted.org/packages/c7/c3/55076fc728723ef927521abaa1955213d094933dc36d4a2008d5101e1af5/wheel-0.42.0-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.42.0
2025-08-31T08:27:13,611     Found link https://files.pythonhosted.org/packages/b0/b4/bc2baae3970c282fae6c2cb8e0f179923dceb7eaffb0e76170628f9af97b/wheel-0.42.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.42.0
2025-08-31T08:27:13,612     Found link https://files.pythonhosted.org/packages/7d/cd/d7460c9a869b16c3dd4e1e403cce337df165368c71d6af229a74699622ce/wheel-0.43.0-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.8), version: 0.43.0
2025-08-31T08:27:13,612     Found link https://files.pythonhosted.org/packages/b8/d6/ac9cd92ea2ad502ff7c1ab683806a9deb34711a1e2bd8a59814e8fc27e69/wheel-0.43.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.8), version: 0.43.0
2025-08-31T08:27:13,613     Found link https://files.pythonhosted.org/packages/1b/d1/9babe2ccaecff775992753d8686970b1e2755d21c8a63be73aba7a4e7d77/wheel-0.44.0-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.8), version: 0.44.0
2025-08-31T08:27:13,614     Found link https://files.pythonhosted.org/packages/b7/a0/95e9e962c5fd9da11c1e28aa4c0d8210ab277b1ada951d2aee336b505813/wheel-0.44.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.8), version: 0.44.0
2025-08-31T08:27:13,615     Found link https://files.pythonhosted.org/packages/92/81/65ae90d584a73ca976d8f1eb83e2f58447a4055a9fb3ae69b28721070bdf/wheel-0.45.0-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.8), version: 0.45.0
2025-08-31T08:27:13,616     Found link https://files.pythonhosted.org/packages/e7/52/fd4516fb8f7d11a08e3f9cd69eb1558f098ab67e79f32d920c4974ee550f/wheel-0.45.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.8), version: 0.45.0
2025-08-31T08:27:13,617     Found link https://files.pythonhosted.org/packages/0b/2c/87f3254fd8ffd29e4c02732eee68a83a1d3c346ae39bc6822dcbcb697f2b/wheel-0.45.1-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.8), version: 0.45.1
2025-08-31T08:27:13,618     Found link https://files.pythonhosted.org/packages/8a/98/2d9906746cdc6a6ef809ae6338005b3f21bb568bea3165cfc6a243fdc25c/wheel-0.45.1.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.8), version: 0.45.1
2025-08-31T08:27:13,619     Found link https://files.pythonhosted.org/packages/f2/67/b488d1c2408bc619bdd9f8c929e67d7743087dfa00bbdc0c0c5db70161f9/wheel-0.46.0-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.9), version: 0.46.0
2025-08-31T08:27:13,620     Found link https://files.pythonhosted.org/packages/11/d9/f16ef50f69f8b85961f8df7a2bdad08a98a32e79dfabf9f14f250fc0324d/wheel-0.46.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.9), version: 0.46.0
2025-08-31T08:27:13,621     Found link https://files.pythonhosted.org/packages/af/44/31d964a260fcda6bf2f59384231bbf4962ac796a5d36c554162b5411b8db/wheel-0.46.1-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.9), version: 0.46.1
2025-08-31T08:27:13,622     Found link https://files.pythonhosted.org/packages/fb/62/e90918c4558b002726ab930863c0cbd3e7cf9a7befa1d4a1a240cecdb379/wheel-0.46.1.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.9), version: 0.46.1
2025-08-31T08:27:13,623   Fetching project page and analyzing links: https://www.piwheels.org/simple/wheel/
2025-08-31T08:27:13,623   Getting page https://www.piwheels.org/simple/wheel/
2025-08-31T08:27:13,625   Found index url https://www.piwheels.org/simple/
2025-08-31T08:27:13,626   Looking up "https://www.piwheels.org/simple/wheel/" in the cache
2025-08-31T08:27:13,627   Request header has "max_age" as 0, cache bypassed
2025-08-31T08:27:13,636   https://www.piwheels.org:443 "GET /simple/wheel/ HTTP/1.1" 200 4210
2025-08-31T08:27:13,639   Updating cache with response from "https://www.piwheels.org/simple/wheel/"
2025-08-31T08:27:13,639   etag object cached for 1209600 seconds
2025-08-31T08:27:13,640   Caching due to etag
2025-08-31T08:27:13,647   Fetched page https://www.piwheels.org/simple/wheel/ as text/html
2025-08-31T08:27:13,662     Found link https://www.piwheels.org/simple/wheel/wheel-0.46.1-py3-none-any.whl#sha256=f796f65d72750ccde090663e466d0ca37cd72b62870f7520b96d34cdc07d86d8 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.9), version: 0.46.1
2025-08-31T08:27:13,663     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.46.0-py3-none-any.whl#sha256=8c1909305dc5a40979693cece1ec872eed10cc49af2038201213461b0688b7b4 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.9), version: 0.46.0
2025-08-31T08:27:13,664     Found link https://www.piwheels.org/simple/wheel/wheel-0.45.1-py3-none-any.whl#sha256=708e7481cc80179af0e556bbf0cc00b8444c7321e2700b8d8580231d13017248 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.8), version: 0.45.1
2025-08-31T08:27:13,665     Found link https://www.piwheels.org/simple/wheel/wheel-0.45.0-py3-none-any.whl#sha256=52f0baa5e6522155090a09c6bd95718cc46956d1b51d537ea5454249edb671c7 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.8), version: 0.45.0
2025-08-31T08:27:13,666     Found link https://www.piwheels.org/simple/wheel/wheel-0.44.0-py3-none-any.whl#sha256=2376a90c98cc337d18623527a97c31797bd02bad0033d41547043a1cbfbe448f (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.8), version: 0.44.0
2025-08-31T08:27:13,667     Found link https://www.piwheels.org/simple/wheel/wheel-0.43.0-py3-none-any.whl#sha256=55c570405f142630c6b9f72fe09d9b67cf1477fcf543ae5b8dcb1f5b7377da81 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.8), version: 0.43.0
2025-08-31T08:27:13,668     Found link https://www.piwheels.org/simple/wheel/wheel-0.42.0-py3-none-any.whl#sha256=177f9c9b0d45c47873b619f5b650346d632cdc35fb5e4d25058e09c9e581433d (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.7), version: 0.42.0
2025-08-31T08:27:13,669     Found link https://www.piwheels.org/simple/wheel/wheel-0.41.3-py3-none-any.whl#sha256=488609bc63a29322326e05560731bf7bfea8e48ad646e1f5e40d366607de0942 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.3
2025-08-31T08:27:13,670     Found link https://www.piwheels.org/simple/wheel/wheel-0.41.2-py3-none-any.whl#sha256=75909db2664838d015e3d9139004ee16711748a52c8f336b52882266540215d8 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.2
2025-08-31T08:27:13,671     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.41.1-py3-none-any.whl#sha256=473219bd4cbedc62cea0cb309089b593e47c15c4a2531015f94e4e3b9a0f6981 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.1
2025-08-31T08:27:13,672     Found link https://www.piwheels.org/simple/wheel/wheel-0.41.0-py3-none-any.whl#sha256=7e9be3bbd0078f6147d82ed9ed957e323e7708f57e134743d2edef3a7b7972a9 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.0
2025-08-31T08:27:13,673     Found link https://www.piwheels.org/simple/wheel/wheel-0.40.0-py3-none-any.whl#sha256=d236b20e7cb522daf2390fa84c55eea81c5c30190f90f29ae2ca1ad8355bf247 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.7), version: 0.40.0
2025-08-31T08:27:13,674     Found link https://www.piwheels.org/simple/wheel/wheel-0.38.4-py3-none-any.whl#sha256=d39864d37aca18cbff3fdc1bef75e6e7a96278d4e1935fb8d6387c4a35900577 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.4
2025-08-31T08:27:13,675     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.38.3-py3-none-any.whl#sha256=be9b37cb7550f11224d0442525944a08ee9bb92edd441232c49f6bf9b27022da (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.3
2025-08-31T08:27:13,676     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.38.2-py3-none-any.whl#sha256=021900d9c142cbedc1a7e31f5988a358ba2f0d7a2147b2122f0f493884b4495f (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.2
2025-08-31T08:27:13,677     Found link https://www.piwheels.org/simple/wheel/wheel-0.38.1-py3-none-any.whl#sha256=2d48d4de56433936bec89b8389c5784c736ccd3c23f9507d8dc8359655c31ce9 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.1
2025-08-31T08:27:13,679     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.38.0-py3-none-any.whl#sha256=08ee5812b1b7a10d6aaebeb1268ef409cd24204b2020e8bd8d69b2f7894f27fe (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.0
2025-08-31T08:27:13,680     Found link https://www.piwheels.org/simple/wheel/wheel-0.37.1-py2.py3-none-any.whl#sha256=d322578b482f35eefbbfa86aabf139a6b3b806b4bd19f9d909b6ccf2a8f9684d (from https://www.piwheels.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.37.1
2025-08-31T08:27:13,681     Found link https://www.piwheels.org/simple/wheel/wheel-0.37.0-py2.py3-none-any.whl#sha256=48c6df128edf9d8137efa9dcd8dc0217a276f0828db5eec9a36f3e5abe5b7f9a (from https://www.piwheels.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.37.0
2025-08-31T08:27:13,682     Found link https://www.piwheels.org/simple/wheel/wheel-0.36.2-py2.py3-none-any.whl#sha256=78b5b185f0e5763c26ca1e324373aadd49182ca90e825f7853f4b2509215dc0e (from https://www.piwheels.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.2
2025-08-31T08:27:13,683     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.36.1-py2.py3-none-any.whl#sha256=906864fb722c0ab5f2f9c35b2c65e3af3c009402c108a709c0aca27bc2c9187b (from https://www.piwheels.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.1
2025-08-31T08:27:13,684     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.36.0-py2.py3-none-any.whl#sha256=645f81da70dcd993844005762acbb7e8628306bec414c90539d276fbd4fc7cbe (from https://www.piwheels.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.0
2025-08-31T08:27:13,685     Found link https://www.piwheels.org/simple/wheel/wheel-0.35.1-py2.py3-none-any.whl#sha256=497add53525d16c173c2c1c733b8f655510e909ea78cc0e29d374243544b77a2 (from https://www.piwheels.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.35.1
2025-08-31T08:27:13,686     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.35.0-py2.py3-none-any.whl#sha256=64a0d73747636637479b8b8741f9304bee7a568c80e4029eeb9529ef134b471d (from https://www.piwheels.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.35.0
2025-08-31T08:27:13,687     Found link https://www.piwheels.org/simple/wheel/wheel-0.34.2-py2.py3-none-any.whl#sha256=df277cb51e61359aba502208d680f90c0493adec6f0e848af94948778aed386e (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, !=3.4.*), version: 0.34.2
2025-08-31T08:27:13,688     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.34.1-py2.py3-none-any.whl#sha256=48e082fac9a549bb30abcb71360db41e9e999f63bfc9933fdb7339ba7205330f (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, !=3.4.*), version: 0.34.1
2025-08-31T08:27:13,689     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.34.0-py2.py3-none-any.whl#sha256=98a7bd648493d21da3463c52c437e81061c61b4dcca63d56c6d041c9f747abeb (from https://www.piwheels.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.34.0
2025-08-31T08:27:13,690     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.33.6-py2.py3-none-any.whl#sha256=f4da1763d3becf2e2cd92a14a7c920f0f00eca30fdde9ea992c836685b9faf28 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.6
2025-08-31T08:27:13,691     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.33.5-py2.py3-none-any.whl#sha256=fd85f7f5ba5b13376fc0ba78dc34f7d7dd2ee944b15d4bac7a34b7a25ee226af (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.5
2025-08-31T08:27:13,692     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.33.4-py2.py3-none-any.whl#sha256=5e79117472686ac0c4aef5bad5172ea73a1c2d1646b808c35926bd26bdfb0c08 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.4
2025-08-31T08:27:13,693     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.33.1-py2.py3-none-any.whl#sha256=8eb4a788b3aec8abf5ff68d4165441bc57420c9f64ca5f471f58c3969fe08668 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.1
2025-08-31T08:27:13,694     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.33.0-py2.py3-none-any.whl#sha256=b79ffea026bc0dbd940868347ae9eee36789b6496b6623bd2dec7c7c540a8f99 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.0
2025-08-31T08:27:13,695     Found link https://www.piwheels.org/simple/wheel/wheel-0.32.3-py2.py3-none-any.whl#sha256=1e53cdb3f808d5ccd0df57f964263752aa74ea7359526d3da6c02114ec1e1d44 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.3
2025-08-31T08:27:13,696     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.32.2-py2.py3-none-any.whl#sha256=c93e2d711f5f9841e17f53b0e6c0ff85593f3b416b6eec7a9452041a59a42688 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.2
2025-08-31T08:27:13,697     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.32.1-py2.py3-none-any.whl#sha256=9fa1f772f1a2df2bd00ddb4fa57e1cc349301e1facb98fbe62329803a9ff1196 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.1
2025-08-31T08:27:13,698     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.32.0-py2.py3-none-any.whl#sha256=3970f4130b7f8bf8167ca09215c8cc2f49a87c3d46506adfc60cb08c47ab0949 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.0
2025-08-31T08:27:13,699     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.31.1-py2.py3-none-any.whl#sha256=80044e51ec5bbf6c894ba0bc48d26a8c20a9ba629f4ca19ea26ecfcf87685f5f (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.31.1
2025-08-31T08:27:13,700     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.31.0-py2.py3-none-any.whl#sha256=9cdc8ab2cc9c3c2e2727a4b67c22881dbb0e1c503d592992594c5e131c867107 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.31.0
2025-08-31T08:27:13,701     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.30.0-py2.py3-none-any.whl#sha256=e721e53864f084f956f40f96124a74da0631ac13fbbd1ba99e8e2b5e9cafdf64 (from https://www.piwheels.org/simple/wheel/), version: 0.30.0
2025-08-31T08:27:13,702     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.30.0a0-py2.py3-none-any.whl#sha256=cd19aa9325d3af1c641b0a23502b12696159171d2a2f4b84308df9a075c2a4a0 (from https://www.piwheels.org/simple/wheel/), version: 0.30.0a0
2025-08-31T08:27:13,703     Found link https://www.piwheels.org/simple/wheel/wheel-0.29.0-py2.py3-none-any.whl#sha256=ea8033fc9905804e652f75474d33410a07404c1a78dd3c949a66863bd1050ebd (from https://www.piwheels.org/simple/wheel/), version: 0.29.0
2025-08-31T08:27:13,705     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.28.0-py2.py3-none-any.whl#sha256=7a83f0fd22ccf4137673f21a4fbd6b522e3c826add9568adbf63eb17fb9ec90c (from https://www.piwheels.org/simple/wheel/), version: 0.28.0
2025-08-31T08:27:13,706     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.27.0-py2.py3-none-any.whl#sha256=b2e5cf1b3e5ca7873956bea1fadc160850a89fdb96a22515e72b5e3b61bb9c6a (from https://www.piwheels.org/simple/wheel/), version: 0.27.0
2025-08-31T08:27:13,707     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.26.0-py2.py3-none-any.whl#sha256=c92ed3a2dd87c54a9e20024fb0a206fe591c352c745fff21e8f8c6cdac2086ea (from https://www.piwheels.org/simple/wheel/), version: 0.26.0
2025-08-31T08:27:13,708     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.25.0-py2.py3-none-any.whl#sha256=11d74730000531808916fcc069fb7bb5906caa0dba978b126cc807be8d4319f4 (from https://www.piwheels.org/simple/wheel/), version: 0.25.0
2025-08-31T08:27:13,709     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.24.0-py2.py3-none-any.whl#sha256=53a8b47d3db4ded8db41a1e9bbb77a1625074e7a4879bd0ebf97d6cb01576383 (from https://www.piwheels.org/simple/wheel/), version: 0.24.0
2025-08-31T08:27:13,710     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.23.0-py2.py3-none-any.whl#sha256=cbc6b2e274557b5e8ee8b61ca4c0c781702956a80cdbeb7ec0446834b5078082 (from https://www.piwheels.org/simple/wheel/), version: 0.23.0
2025-08-31T08:27:13,711     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.22.0-py2.py3-none-any.whl#sha256=4ac0ec6404ef2dd3412fcdb1560206eaca86a4c73ff29895989320faca54be61 (from https://www.piwheels.org/simple/wheel/), version: 0.22.0
2025-08-31T08:27:13,712     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.21.0-py2.py3-none-any.whl#sha256=b0798123cd67a763637991812ab866f609a81516228273e89270d4bc91b276cd (from https://www.piwheels.org/simple/wheel/), version: 0.21.0
2025-08-31T08:27:13,713     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.19.0-py2.py3-none-any.whl#sha256=c4393edc51986db56f4ee7ef542e1e183caef570d5e5a6b9021333b21a40683e (from https://www.piwheels.org/simple/wheel/), version: 0.19.0
2025-08-31T08:27:13,714     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.18.0-py2.py3-none-any.whl#sha256=50464317d6baf354a78df94b7a842ce1fe4e5752c9dd3a97c38e3219eeb5fbe8 (from https://www.piwheels.org/simple/wheel/), version: 0.18.0
2025-08-31T08:27:13,715     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.17.0-py2.py3-none-any.whl#sha256=b5affc730154325831d35b4fec11cc2647846443fbbca85dcb056cc0e5f015c7 (from https://www.piwheels.org/simple/wheel/), version: 0.17.0
2025-08-31T08:27:13,716     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.16.0-py2.py3-none-any.whl#sha256=1451499fcc03da0de54eb0d8803f96b2cc94e1cb1f4294e260516442d64531d5 (from https://www.piwheels.org/simple/wheel/), version: 0.16.0
2025-08-31T08:27:13,717     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.15.0-py2.py3-none-any.whl#sha256=c719c414d4a192ee70c85e330421bd022fda91552e40ab74078cfeeeda3a35a1 (from https://www.piwheels.org/simple/wheel/), version: 0.15.0
2025-08-31T08:27:13,718     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.14.0-py2.py3-none-any.whl#sha256=41a973fa2d0a3b007d8afdfa6ca39f6b2f48b336a642c020ea2ffe5ea2ebf426 (from https://www.piwheels.org/simple/wheel/), version: 0.14.0
2025-08-31T08:27:13,719     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.13.0-py2.py3-none-any.whl#sha256=e22c0ee13924fa775a62d493da2abdc5fd8a1f757fa5ca012d4a0c892f5c76ce (from https://www.piwheels.org/simple/wheel/), version: 0.13.0
2025-08-31T08:27:13,720     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.12.0-py2.py3-none-any.whl#sha256=351b5f218032c8822410ecc419e41f5e7c40df4813dc9b17f9bd51a5688225f6 (from https://www.piwheels.org/simple/wheel/), version: 0.12.0
2025-08-31T08:27:13,721     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.11.0-py2.py3-none-any.whl#sha256=10a60ecaff2bde8bc58a04c3bd3e7518fefa4a6d7e7a297780c637f4c75530e9 (from https://www.piwheels.org/simple/wheel/), version: 0.11.0
2025-08-31T08:27:13,722     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.10.3-py2.py3-none-any.whl#sha256=456f150509b57b16a2dfd9c882d8204990fafa55ad9f6410cd6cbb8795237c40 (from https://www.piwheels.org/simple/wheel/), version: 0.10.3
2025-08-31T08:27:13,723     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.10.2-py2.py3-none-any.whl#sha256=abfdc3fb4427901d7faff5c570508089c382ef750a39a520c6ce0f2e2d0b6c94 (from https://www.piwheels.org/simple/wheel/), version: 0.10.2
2025-08-31T08:27:13,724     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.10.1-py2.py3-none-any.whl#sha256=28f16c298102f35850945fad51d46fd094e6c2ba50bd8cdd4e2a7ec1093afbc1 (from https://www.piwheels.org/simple/wheel/), version: 0.10.1
2025-08-31T08:27:13,725     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.10.0-py2.py3-none-any.whl#sha256=dbdb989fd7a99eace561be0443f1c00784a46ac6f6e10233877919a95af3c05a (from https://www.piwheels.org/simple/wheel/), version: 0.10.0
2025-08-31T08:27:13,725     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.9.7-py34-none-any.whl#sha256=2406406008b1d0da37317df1909a155c1cf96a9ae4a3e663823f1a90d5aec89c (from https://www.piwheels.org/simple/wheel/), version: 0.9.7
2025-08-31T08:27:13,726     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.9.5-py2.py3-none-any.whl#sha256=2fafe3ab14e79a5cd4e3e3c8ec901a16e69ba9977ff528e1357afb79fd6adbf4 (from https://www.piwheels.org/simple/wheel/), version: 0.9.5
2025-08-31T08:27:13,727     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.9.4-py34-none-any.whl#sha256=8ff3695583cc355e20d14dfaf74816de5fc2c8b99ae2d7190bd5d37a98698d24 (from https://www.piwheels.org/simple/wheel/), version: 0.9.4
2025-08-31T08:27:13,728     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.9.3-py34-none-any.whl#sha256=c0b9af7ba84a118d162ec37fc78d0c58b823578a82d4c3813d00ee678bf0562c (from https://www.piwheels.org/simple/wheel/), version: 0.9.3
2025-08-31T08:27:13,729     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.9.2-py34-none-any.whl#sha256=27d25bc64b16359de9488c4523b59de2bf609c9e507a7596847e4daaf2c2a2b9 (from https://www.piwheels.org/simple/wheel/), version: 0.9.2
2025-08-31T08:27:13,730     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.9.1-py34-none-any.whl#sha256=c5b5b97b7eba57e6adf1223dd97221321dd75776d403e0394911491f35341195 (from https://www.piwheels.org/simple/wheel/), version: 0.9.1
2025-08-31T08:27:13,731     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.9-py32-none-any.whl#sha256=4698c1d702ca4aa52225920ca53bce0f29576574cf5b7bfa06396487e6deca57 (from https://www.piwheels.org/simple/wheel/), version: 0.9
2025-08-31T08:27:13,732     Found link https://archive1.piwheels.org/simple/wheel/wheel-0.8-py34-none-any.whl#sha256=5c7cbf9b2fc839a7858a7bceb9788f87829ca7963806e0d6a50e7f61c9cab83d (from https://www.piwheels.org/simple/wheel/), version: 0.8
2025-08-31T08:27:13,733     Skipping link: none of the wheel's tags (py34-noabi-noarch) are compatible (run pip debug --verbose to show compatible tags): https://archive1.piwheels.org/simple/wheel/wheel-0.7-py34-noabi-noarch.whl#sha256=19a8d0d2ed586b8b67c22b4c865aeeed398ea1214113179d256b14078a8c0e78 (from https://www.piwheels.org/simple/wheel/)
2025-08-31T08:27:13,734     Skipping link: none of the wheel's tags (py34-noabi-noarch) are compatible (run pip debug --verbose to show compatible tags): https://archive1.piwheels.org/simple/wheel/wheel-0.6-py34-noabi-noarch.whl#sha256=905534a6b3bec28519ad305b902eeefe4f8e4c524c1f8dc2a671c59ca286e7fb (from https://www.piwheels.org/simple/wheel/)
2025-08-31T08:27:13,734     Skipping link: none of the wheel's tags (py34-noabi-noarch) are compatible (run pip debug --verbose to show compatible tags): https://archive1.piwheels.org/simple/wheel/wheel-0.5-py34-noabi-noarch.whl#sha256=83f89c21452c9c6ad964d4cce90d41885273b0a95c7b8c44c1ba89fd89c47b7f (from https://www.piwheels.org/simple/wheel/)
2025-08-31T08:27:13,736     Skipping link: none of the wheel's tags (py34-noabi-noarch) are compatible (run pip debug --verbose to show compatible tags): https://archive1.piwheels.org/simple/wheel/wheel-0.4.2-py34-noabi-noarch.whl#sha256=d9fa12e187f892153b8d544eea6efdfe3454c98ebc5fc55ef678721c8b5c8c42 (from https://www.piwheels.org/simple/wheel/)
2025-08-31T08:27:13,736     Skipping link: invalid wheel filename: https://archive1.piwheels.org/simple/wheel/wheel_0.4.1-py34-noabi-noarch.whl#sha256=cab5b976203de1a697913a41e64252a352e26734a30c8b49700673f4a8e8f46c (from https://www.piwheels.org/simple/wheel/)
2025-08-31T08:27:13,737     Skipping link: invalid wheel filename: https://archive1.piwheels.org/simple/wheel/wheel_0.4-py34-noabi-noarch.whl#sha256=84fdd11c0d960611e5821a93b6d041bd6af3c07863a075b8026f10dcd675624d (from https://www.piwheels.org/simple/wheel/)
2025-08-31T08:27:13,738     Skipping link: none of the wheel's tags (py34-noabi-noarch) are compatible (run pip debug --verbose to show compatible tags): https://archive1.piwheels.org/simple/wheel/wheel-0.3-py34-noabi-noarch.whl#sha256=3a90e79b373e2478c9f126c2a5b922bbeb15010b7381d0fafedfc8a3c56ede9c (from https://www.piwheels.org/simple/wheel/)
2025-08-31T08:27:13,739     Skipping link: none of the wheel's tags (py34-noabi-noarch) are compatible (run pip debug --verbose to show compatible tags): https://archive1.piwheels.org/simple/wheel/wheel-0.2-py34-noabi-noarch.whl#sha256=0a939ef0343814a3321be3f624fbb14c88e6a2c148e56dd6c19e3f0cc6f550c8 (from https://www.piwheels.org/simple/wheel/)
2025-08-31T08:27:13,740     Skipping link: none of the wheel's tags (py34-noabi-noarch) are compatible (run pip debug --verbose to show compatible tags): https://archive1.piwheels.org/simple/wheel/wheel-0.1-py34-noabi-noarch.whl#sha256=2925b4da54f70d40cead292dc7921052acbfff72bb331b93237ccc839bff06c9 (from https://www.piwheels.org/simple/wheel/)
2025-08-31T08:27:13,740   Skipping link: not a file: https://www.piwheels.org/simple/wheel/
2025-08-31T08:27:13,741   Skipping link: not a file: https://pypi.org/simple/wheel/
2025-08-31T08:27:13,750   Given no hashes to check 211 links for project 'wheel': discarding no candidates
2025-08-31T08:27:13,792   Collecting wheel
2025-08-31T08:27:13,794     Created temporary directory: /tmp/pip-unpack-fyfthlpo
2025-08-31T08:27:13,796     Found index url https://www.piwheels.org/simple/
2025-08-31T08:27:13,798     Looking up "https://www.piwheels.org/simple/wheel/wheel-0.45.1-py3-none-any.whl" in the cache
2025-08-31T08:27:13,801     Current age based on date: 21
2025-08-31T08:27:13,808     https://www.piwheels.org:443 "GET /simple/wheel/wheel-0.45.1-py3-none-any.whl HTTP/1.1" 304 0
2025-08-31T08:27:13,817     Using cached https://www.piwheels.org/simple/wheel/wheel-0.45.1-py3-none-any.whl (72 kB)
2025-08-31T08:27:13,840   Created temporary directory: /tmp/pip-unpack-bw3my0wv
2025-08-31T08:27:14,420   Installing collected packages: wheel, setuptools
2025-08-31T08:27:14,489     Creating /tmp/pip-build-env-mluu0onl/overlay/local/bin
2025-08-31T08:27:14,492     changing mode of /tmp/pip-build-env-mluu0onl/overlay/local/bin/wheel to 755

2025-08-31T08:27:15,448   Successfully installed setuptools-80.9.0 wheel-0.45.1
2025-08-31T08:27:15,450   Removed build tracker: '/tmp/pip-build-tracker-7y_9rtrp'
2025-08-31T08:27:15,669   Installing build dependencies: finished with status 'done'
2025-08-31T08:27:15,673   Getting requirements to build wheel: started
2025-08-31T08:27:15,674   Running command Getting requirements to build wheel
2025-08-31T08:27:17,550   /tmp/pip-build-env-mluu0onl/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated
2025-08-31T08:27:17,551   !!

2025-08-31T08:27:17,552           ********************************************************************************
2025-08-31T08:27:17,552           Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0).

2025-08-31T08:27:17,553           By 2026-Feb-18, you need to update your project and remove deprecated calls
2025-08-31T08:27:17,554           or your builds will no longer be supported.

2025-08-31T08:27:17,555           See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details.
2025-08-31T08:27:17,555           ********************************************************************************

2025-08-31T08:27:17,556   !!
2025-08-31T08:27:17,557     corresp(dist, value, root_dir)
2025-08-31T08:27:17,893   /tmp/pip-build-env-mluu0onl/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:61: SetuptoolsDeprecationWarning: License classifiers are deprecated.
2025-08-31T08:27:17,894   !!

2025-08-31T08:27:17,895           ********************************************************************************
2025-08-31T08:27:17,896           Please consider removing the following classifiers in favor of a SPDX license expression:

2025-08-31T08:27:17,897           License :: OSI Approved :: MIT License

2025-08-31T08:27:17,898           See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details.
2025-08-31T08:27:17,898           ********************************************************************************

2025-08-31T08:27:17,899   !!
2025-08-31T08:27:17,900     dist._finalize_license_expression()
2025-08-31T08:27:17,901   /tmp/pip-build-env-mluu0onl/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated.
2025-08-31T08:27:17,901   !!

2025-08-31T08:27:17,902           ********************************************************************************
2025-08-31T08:27:17,903           Please consider removing the following classifiers in favor of a SPDX license expression:

2025-08-31T08:27:17,904           License :: OSI Approved :: MIT License

2025-08-31T08:27:17,905           See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details.
2025-08-31T08:27:17,906           ********************************************************************************

2025-08-31T08:27:17,907   !!
2025-08-31T08:27:17,908     self._finalize_license_expression()
2025-08-31T08:27:17,909   running egg_info
2025-08-31T08:27:17,916   writing lm_eval.egg-info/PKG-INFO
2025-08-31T08:27:18,169   writing dependency_links to lm_eval.egg-info/dependency_links.txt
2025-08-31T08:27:18,171   writing entry points to lm_eval.egg-info/entry_points.txt
2025-08-31T08:27:18,189   writing requirements to lm_eval.egg-info/requires.txt
2025-08-31T08:27:18,191   writing top-level names to lm_eval.egg-info/top_level.txt
2025-08-31T08:27:21,431   reading manifest file 'lm_eval.egg-info/SOURCES.txt'
2025-08-31T08:27:22,051   reading manifest template 'MANIFEST.in'
2025-08-31T08:27:22,051   warning: manifest_maker: MANIFEST.in, line 1: 'recursive-include' expects <dir> <pattern1> <pattern2> ...

2025-08-31T08:27:22,052   adding license file 'LICENSE.md'
2025-08-31T08:27:22,736   writing manifest file 'lm_eval.egg-info/SOURCES.txt'
2025-08-31T08:27:22,862   Getting requirements to build wheel: finished with status 'done'
2025-08-31T08:27:22,865   Created temporary directory: /tmp/pip-modern-metadata-o49akqp0
2025-08-31T08:27:22,868   Preparing metadata (pyproject.toml): started
2025-08-31T08:27:22,869   Running command Preparing metadata (pyproject.toml)
2025-08-31T08:27:23,687   /tmp/pip-build-env-mluu0onl/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated
2025-08-31T08:27:23,687   !!

2025-08-31T08:27:23,689           ********************************************************************************
2025-08-31T08:27:23,689           Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0).

2025-08-31T08:27:23,690           By 2026-Feb-18, you need to update your project and remove deprecated calls
2025-08-31T08:27:23,690           or your builds will no longer be supported.

2025-08-31T08:27:23,691           See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details.
2025-08-31T08:27:23,692           ********************************************************************************

2025-08-31T08:27:23,693   !!
2025-08-31T08:27:23,694     corresp(dist, value, root_dir)
2025-08-31T08:27:23,794   /tmp/pip-build-env-mluu0onl/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:61: SetuptoolsDeprecationWarning: License classifiers are deprecated.
2025-08-31T08:27:23,795   !!

2025-08-31T08:27:23,796           ********************************************************************************
2025-08-31T08:27:23,796           Please consider removing the following classifiers in favor of a SPDX license expression:

2025-08-31T08:27:23,797           License :: OSI Approved :: MIT License

2025-08-31T08:27:23,799           See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details.
2025-08-31T08:27:23,799           ********************************************************************************

2025-08-31T08:27:23,800   !!
2025-08-31T08:27:23,801     dist._finalize_license_expression()
2025-08-31T08:27:23,803   /tmp/pip-build-env-mluu0onl/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated.
2025-08-31T08:27:23,804   !!

2025-08-31T08:27:23,805           ********************************************************************************
2025-08-31T08:27:23,805           Please consider removing the following classifiers in favor of a SPDX license expression:

2025-08-31T08:27:23,807           License :: OSI Approved :: MIT License

2025-08-31T08:27:23,808           See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details.
2025-08-31T08:27:23,808           ********************************************************************************

2025-08-31T08:27:23,809   !!
2025-08-31T08:27:23,810     self._finalize_license_expression()
2025-08-31T08:27:23,812   running dist_info
2025-08-31T08:27:23,825   creating /tmp/pip-modern-metadata-o49akqp0/lm_eval.egg-info
2025-08-31T08:27:23,826   writing /tmp/pip-modern-metadata-o49akqp0/lm_eval.egg-info/PKG-INFO
2025-08-31T08:27:23,857   writing dependency_links to /tmp/pip-modern-metadata-o49akqp0/lm_eval.egg-info/dependency_links.txt
2025-08-31T08:27:23,859   writing entry points to /tmp/pip-modern-metadata-o49akqp0/lm_eval.egg-info/entry_points.txt
2025-08-31T08:27:23,876   writing requirements to /tmp/pip-modern-metadata-o49akqp0/lm_eval.egg-info/requires.txt
2025-08-31T08:27:23,879   writing top-level names to /tmp/pip-modern-metadata-o49akqp0/lm_eval.egg-info/top_level.txt
2025-08-31T08:27:23,883   writing manifest file '/tmp/pip-modern-metadata-o49akqp0/lm_eval.egg-info/SOURCES.txt'
2025-08-31T08:27:29,072   reading manifest file '/tmp/pip-modern-metadata-o49akqp0/lm_eval.egg-info/SOURCES.txt'
2025-08-31T08:27:29,074   reading manifest template 'MANIFEST.in'
2025-08-31T08:27:29,075   warning: manifest_maker: MANIFEST.in, line 1: 'recursive-include' expects <dir> <pattern1> <pattern2> ...

2025-08-31T08:27:29,076   adding license file 'LICENSE.md'
2025-08-31T08:27:29,505   writing manifest file '/tmp/pip-modern-metadata-o49akqp0/lm_eval.egg-info/SOURCES.txt'
2025-08-31T08:27:29,531   creating '/tmp/pip-modern-metadata-o49akqp0/lm_eval-0.4.9.1.dist-info'
2025-08-31T08:27:29,710   Preparing metadata (pyproject.toml): finished with status 'done'
2025-08-31T08:27:29,719   Source in /tmp/pip-wheel-y3v679ro/lm-eval_1d7aa0c4e9c146d1a5f933b6c45268bf has version 0.4.9.1, which satisfies requirement lm-eval==0.4.9.1 from https://files.pythonhosted.org/packages/b9/81/943efd4d008080625ddb135d961fc40e78fa75c61f4ce1b4b1244c667571/lm_eval-0.4.9.1.tar.gz
2025-08-31T08:27:29,720   Removed lm-eval==0.4.9.1 from https://files.pythonhosted.org/packages/b9/81/943efd4d008080625ddb135d961fc40e78fa75c61f4ce1b4b1244c667571/lm_eval-0.4.9.1.tar.gz from build tracker '/tmp/pip-build-tracker-7y_9rtrp'
2025-08-31T08:27:29,796 Created temporary directory: /tmp/pip-unpack-oppohh62
2025-08-31T08:27:29,797 Created temporary directory: /tmp/pip-unpack-f5ocsmzv
2025-08-31T08:27:29,797 Building wheels for collected packages: lm-eval
2025-08-31T08:27:29,802   Created temporary directory: /tmp/pip-wheel-kdnoe99r
2025-08-31T08:27:29,802   Destination directory: /tmp/pip-wheel-kdnoe99r
2025-08-31T08:27:29,805   Building wheel for lm-eval (pyproject.toml): started
2025-08-31T08:27:29,806   Running command Building wheel for lm-eval (pyproject.toml)
2025-08-31T08:27:31,160   /tmp/pip-build-env-mluu0onl/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated
2025-08-31T08:27:31,160   !!

2025-08-31T08:27:31,161           ********************************************************************************
2025-08-31T08:27:31,162           Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0).

2025-08-31T08:27:31,163           By 2026-Feb-18, you need to update your project and remove deprecated calls
2025-08-31T08:27:31,164           or your builds will no longer be supported.

2025-08-31T08:27:31,165           See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details.
2025-08-31T08:27:31,165           ********************************************************************************

2025-08-31T08:27:31,166   !!
2025-08-31T08:27:31,167     corresp(dist, value, root_dir)
2025-08-31T08:27:31,264   /tmp/pip-build-env-mluu0onl/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:61: SetuptoolsDeprecationWarning: License classifiers are deprecated.
2025-08-31T08:27:31,265   !!

2025-08-31T08:27:31,266           ********************************************************************************
2025-08-31T08:27:31,266           Please consider removing the following classifiers in favor of a SPDX license expression:

2025-08-31T08:27:31,268           License :: OSI Approved :: MIT License

2025-08-31T08:27:31,269           See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details.
2025-08-31T08:27:31,269           ********************************************************************************

2025-08-31T08:27:31,270   !!
2025-08-31T08:27:31,270     dist._finalize_license_expression()
2025-08-31T08:27:31,272   /tmp/pip-build-env-mluu0onl/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated.
2025-08-31T08:27:31,273   !!

2025-08-31T08:27:31,273           ********************************************************************************
2025-08-31T08:27:31,274           Please consider removing the following classifiers in favor of a SPDX license expression:

2025-08-31T08:27:31,275           License :: OSI Approved :: MIT License

2025-08-31T08:27:31,276           See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details.
2025-08-31T08:27:31,276           ********************************************************************************

2025-08-31T08:27:31,277   !!
2025-08-31T08:27:31,278     self._finalize_license_expression()
2025-08-31T08:27:31,278   running bdist_wheel
2025-08-31T08:27:31,295   running build
2025-08-31T08:27:31,296   running build_py
2025-08-31T08:27:31,303   creating build/lib/lm_eval
2025-08-31T08:27:31,305   copying lm_eval/evaluator.py -> build/lib/lm_eval
2025-08-31T08:27:31,309   copying lm_eval/__main__.py -> build/lib/lm_eval
2025-08-31T08:27:31,312   copying lm_eval/utils.py -> build/lib/lm_eval
2025-08-31T08:27:31,315   copying lm_eval/__init__.py -> build/lib/lm_eval
2025-08-31T08:27:31,317   copying lm_eval/evaluator_utils.py -> build/lib/lm_eval
2025-08-31T08:27:31,321   creating build/lib/lm_eval/api
2025-08-31T08:27:31,322   copying lm_eval/api/filter.py -> build/lib/lm_eval/api
2025-08-31T08:27:31,324   copying lm_eval/api/group.py -> build/lib/lm_eval/api
2025-08-31T08:27:31,326   copying lm_eval/api/instance.py -> build/lib/lm_eval/api
2025-08-31T08:27:31,328   copying lm_eval/api/__init__.py -> build/lib/lm_eval/api
2025-08-31T08:27:31,330   copying lm_eval/api/task.py -> build/lib/lm_eval/api
2025-08-31T08:27:31,334   copying lm_eval/api/metrics.py -> build/lib/lm_eval/api
2025-08-31T08:27:31,337   copying lm_eval/api/registry.py -> build/lib/lm_eval/api
2025-08-31T08:27:31,340   copying lm_eval/api/model.py -> build/lib/lm_eval/api
2025-08-31T08:27:31,343   copying lm_eval/api/samplers.py -> build/lib/lm_eval/api
2025-08-31T08:27:31,346   creating build/lib/lm_eval/loggers
2025-08-31T08:27:31,347   copying lm_eval/loggers/evaluation_tracker.py -> build/lib/lm_eval/loggers
2025-08-31T08:27:31,350   copying lm_eval/loggers/utils.py -> build/lib/lm_eval/loggers
2025-08-31T08:27:31,352   copying lm_eval/loggers/__init__.py -> build/lib/lm_eval/loggers
2025-08-31T08:27:31,354   copying lm_eval/loggers/wandb_logger.py -> build/lib/lm_eval/loggers
2025-08-31T08:27:31,358   creating build/lib/lm_eval/tasks
2025-08-31T08:27:31,359   copying lm_eval/tasks/__init__.py -> build/lib/lm_eval/tasks
2025-08-31T08:27:31,363   creating build/lib/lm_eval/models
2025-08-31T08:27:31,364   copying lm_eval/models/sglang_causallms.py -> build/lib/lm_eval/models
2025-08-31T08:27:31,368   copying lm_eval/models/gguf.py -> build/lib/lm_eval/models
2025-08-31T08:27:31,370   copying lm_eval/models/hf_audiolm.py -> build/lib/lm_eval/models
2025-08-31T08:27:31,373   copying lm_eval/models/anthropic_llms.py -> build/lib/lm_eval/models
2025-08-31T08:27:31,376   copying lm_eval/models/textsynth.py -> build/lib/lm_eval/models
2025-08-31T08:27:31,378   copying lm_eval/models/hf_steered.py -> build/lib/lm_eval/models
2025-08-31T08:27:31,381   copying lm_eval/models/openai_completions.py -> build/lib/lm_eval/models
2025-08-31T08:27:31,383   copying lm_eval/models/optimum_ipex.py -> build/lib/lm_eval/models
2025-08-31T08:27:31,385   copying lm_eval/models/vllm_causallms.py -> build/lib/lm_eval/models
2025-08-31T08:27:31,388   copying lm_eval/models/utils.py -> build/lib/lm_eval/models
2025-08-31T08:27:31,392   copying lm_eval/models/__init__.py -> build/lib/lm_eval/models
2025-08-31T08:27:31,393   copying lm_eval/models/vllm_vlms.py -> build/lib/lm_eval/models
2025-08-31T08:27:31,396   copying lm_eval/models/optimum_lm.py -> build/lib/lm_eval/models
2025-08-31T08:27:31,398   copying lm_eval/models/hf_vlms.py -> build/lib/lm_eval/models
2025-08-31T08:27:31,401   copying lm_eval/models/nemo_lm.py -> build/lib/lm_eval/models
2025-08-31T08:27:31,404   copying lm_eval/models/ibm_watsonx_ai.py -> build/lib/lm_eval/models
2025-08-31T08:27:31,407   copying lm_eval/models/sglang_generate_API.py -> build/lib/lm_eval/models
2025-08-31T08:27:31,409   copying lm_eval/models/mamba_lm.py -> build/lib/lm_eval/models
2025-08-31T08:27:31,412   copying lm_eval/models/neuron_optimum.py -> build/lib/lm_eval/models
2025-08-31T08:27:31,415   copying lm_eval/models/dummy.py -> build/lib/lm_eval/models
2025-08-31T08:27:31,418   copying lm_eval/models/huggingface.py -> build/lib/lm_eval/models
2025-08-31T08:27:31,424   copying lm_eval/models/api_models.py -> build/lib/lm_eval/models
2025-08-31T08:27:31,430   creating build/lib/lm_eval/caching
2025-08-31T08:27:31,432   copying lm_eval/caching/__init__.py -> build/lib/lm_eval/caching
2025-08-31T08:27:31,434   copying lm_eval/caching/cache.py -> build/lib/lm_eval/caching
2025-08-31T08:27:31,436   creating build/lib/lm_eval/decontamination
2025-08-31T08:27:31,437   copying lm_eval/decontamination/decontaminate.py -> build/lib/lm_eval/decontamination
2025-08-31T08:27:31,440   copying lm_eval/decontamination/janitor.py -> build/lib/lm_eval/decontamination
2025-08-31T08:27:31,444   copying lm_eval/decontamination/__init__.py -> build/lib/lm_eval/decontamination
2025-08-31T08:27:31,446   copying lm_eval/decontamination/archiver.py -> build/lib/lm_eval/decontamination
2025-08-31T08:27:31,450   creating build/lib/lm_eval/prompts
2025-08-31T08:27:31,452   copying lm_eval/prompts/__init__.py -> build/lib/lm_eval/prompts
2025-08-31T08:27:31,455   creating build/lib/lm_eval/filters
2025-08-31T08:27:31,456   copying lm_eval/filters/custom.py -> build/lib/lm_eval/filters
2025-08-31T08:27:31,458   copying lm_eval/filters/selection.py -> build/lib/lm_eval/filters
2025-08-31T08:27:31,461   copying lm_eval/filters/extraction.py -> build/lib/lm_eval/filters
2025-08-31T08:27:31,466   copying lm_eval/filters/transformation.py -> build/lib/lm_eval/filters
2025-08-31T08:27:31,470   copying lm_eval/filters/__init__.py -> build/lib/lm_eval/filters
2025-08-31T08:27:31,474   copying lm_eval/filters/decontamination.py -> build/lib/lm_eval/filters
2025-08-31T08:27:31,479   creating build/lib/lm_eval/tasks/lingoly
2025-08-31T08:27:31,481   copying lm_eval/tasks/lingoly/utils.py -> build/lib/lm_eval/tasks/lingoly
2025-08-31T08:27:31,486   copying lm_eval/tasks/lingoly/script.py -> build/lib/lm_eval/tasks/lingoly
2025-08-31T08:27:31,490   creating build/lib/lm_eval/tasks/drop
2025-08-31T08:27:31,491   copying lm_eval/tasks/drop/utils.py -> build/lib/lm_eval/tasks/drop
2025-08-31T08:27:31,494   creating build/lib/lm_eval/tasks/wikitext
2025-08-31T08:27:31,495   copying lm_eval/tasks/wikitext/preprocess_wikitext.py -> build/lib/lm_eval/tasks/wikitext
2025-08-31T08:27:31,498   creating build/lib/lm_eval/tasks/libra
2025-08-31T08:27:31,499   copying lm_eval/tasks/libra/utils.py -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:31,502   creating build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:31,504   copying lm_eval/tasks/agieval/utils.py -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:31,507   creating build/lib/lm_eval/tasks/afrimgsm
2025-08-31T08:27:31,508   copying lm_eval/tasks/afrimgsm/utils.py -> build/lib/lm_eval/tasks/afrimgsm
2025-08-31T08:27:31,510   copying lm_eval/tasks/afrimgsm/gen_utils.py -> build/lib/lm_eval/tasks/afrimgsm
2025-08-31T08:27:31,513   creating build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:31,514   copying lm_eval/tasks/eus_exams/utils.py -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:31,516   copying lm_eval/tasks/eus_exams/configs.py -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:31,518   creating build/lib/lm_eval/tasks/winogender
2025-08-31T08:27:31,519   copying lm_eval/tasks/winogender/utils.py -> build/lib/lm_eval/tasks/winogender
2025-08-31T08:27:31,522   creating build/lib/lm_eval/tasks/hellaswag
2025-08-31T08:27:31,523   copying lm_eval/tasks/hellaswag/utils.py -> build/lib/lm_eval/tasks/hellaswag
2025-08-31T08:27:31,525   creating build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:31,526   copying lm_eval/tasks/ruler/common_utils.py -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:31,528   copying lm_eval/tasks/ruler/niah_utils.py -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:31,531   copying lm_eval/tasks/ruler/vt_utils.py -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:31,534   copying lm_eval/tasks/ruler/fwe_utils.py -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:31,536   copying lm_eval/tasks/ruler/cwe_utils.py -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:31,539   copying lm_eval/tasks/ruler/essays.py -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:31,542   copying lm_eval/tasks/ruler/prepare_niah.py -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:31,547   copying lm_eval/tasks/ruler/qa_utils.py -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:31,553   creating build/lib/lm_eval/tasks/egyhellaswag
2025-08-31T08:27:31,555   copying lm_eval/tasks/egyhellaswag/utils.py -> build/lib/lm_eval/tasks/egyhellaswag
2025-08-31T08:27:31,561   creating build/lib/lm_eval/tasks/winogrande
2025-08-31T08:27:31,563   copying lm_eval/tasks/winogrande/preprocess_winogrande.py -> build/lib/lm_eval/tasks/winogrande
2025-08-31T08:27:31,566   creating build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:27:31,568   copying lm_eval/tasks/arab_culture_completion/utils_completion.py -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:27:31,571   copying lm_eval/tasks/arab_culture_completion/prompts.py -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:27:31,576   copying lm_eval/tasks/arab_culture_completion/_generate_configs.py -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:27:31,582   creating build/lib/lm_eval/tasks/moral_stories
2025-08-31T08:27:31,585   copying lm_eval/tasks/moral_stories/utils.py -> build/lib/lm_eval/tasks/moral_stories
2025-08-31T08:27:31,590   creating build/lib/lm_eval/tasks/histoires_morales
2025-08-31T08:27:31,591   copying lm_eval/tasks/histoires_morales/utils.py -> build/lib/lm_eval/tasks/histoires_morales
2025-08-31T08:27:31,593   creating build/lib/lm_eval/tasks/bbh
2025-08-31T08:27:31,594   copying lm_eval/tasks/bbh/_generate_configs.py -> build/lib/lm_eval/tasks/bbh
2025-08-31T08:27:31,597   creating build/lib/lm_eval/tasks/mmlu
2025-08-31T08:27:31,598   copying lm_eval/tasks/mmlu/_generate_configs.py -> build/lib/lm_eval/tasks/mmlu
2025-08-31T08:27:31,601   creating build/lib/lm_eval/tasks/translation
2025-08-31T08:27:31,602   copying lm_eval/tasks/translation/utils.py -> build/lib/lm_eval/tasks/translation
2025-08-31T08:27:31,606   creating build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:31,607   copying lm_eval/tasks/arabicmmlu/utils.py -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:31,609   copying lm_eval/tasks/arabicmmlu/_generate_configs.py -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:31,611   creating build/lib/lm_eval/tasks/mgsm
2025-08-31T08:27:31,612   copying lm_eval/tasks/mgsm/utils.py -> build/lib/lm_eval/tasks/mgsm
2025-08-31T08:27:31,615   creating build/lib/lm_eval/tasks/med_prescriptions
2025-08-31T08:27:31,616   copying lm_eval/tasks/med_prescriptions/utils.py -> build/lib/lm_eval/tasks/med_prescriptions
2025-08-31T08:27:31,620   creating build/lib/lm_eval/tasks/basque_bench
2025-08-31T08:27:31,621   copying lm_eval/tasks/basque_bench/utils.py -> build/lib/lm_eval/tasks/basque_bench
2025-08-31T08:27:31,624   creating build/lib/lm_eval/tasks/chartqa
2025-08-31T08:27:31,625   copying lm_eval/tasks/chartqa/utils.py -> build/lib/lm_eval/tasks/chartqa
2025-08-31T08:27:31,628   creating build/lib/lm_eval/tasks/race
2025-08-31T08:27:31,629   copying lm_eval/tasks/race/preprocess_race.py -> build/lib/lm_eval/tasks/race
2025-08-31T08:27:31,632   creating build/lib/lm_eval/tasks/glianorex
2025-08-31T08:27:31,633   copying lm_eval/tasks/glianorex/preprocess_glianorex.py -> build/lib/lm_eval/tasks/glianorex
2025-08-31T08:27:31,636   creating build/lib/lm_eval/tasks/mathqa
2025-08-31T08:27:31,637   copying lm_eval/tasks/mathqa/utils.py -> build/lib/lm_eval/tasks/mathqa
2025-08-31T08:27:31,641   creating build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:31,642   copying lm_eval/tasks/evalita_llm/sum_utils.py -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:31,644   copying lm_eval/tasks/evalita_llm/utils.py -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:31,646   copying lm_eval/tasks/evalita_llm/metrics.py -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:31,649   creating build/lib/lm_eval/tasks/xnli
2025-08-31T08:27:31,650   copying lm_eval/tasks/xnli/utils.py -> build/lib/lm_eval/tasks/xnli
2025-08-31T08:27:31,653   creating build/lib/lm_eval/tasks/jsonschema_bench
2025-08-31T08:27:31,654   copying lm_eval/tasks/jsonschema_bench/metrics.py -> build/lib/lm_eval/tasks/jsonschema_bench
2025-08-31T08:27:31,656   creating build/lib/lm_eval/tasks/xwinograd
2025-08-31T08:27:31,657   copying lm_eval/tasks/xwinograd/utils.py -> build/lib/lm_eval/tasks/xwinograd
2025-08-31T08:27:31,661   creating build/lib/lm_eval/tasks/galician_bench
2025-08-31T08:27:31,662   copying lm_eval/tasks/galician_bench/utils.py -> build/lib/lm_eval/tasks/galician_bench
2025-08-31T08:27:31,666   creating build/lib/lm_eval/tasks/xquad
2025-08-31T08:27:31,667   copying lm_eval/tasks/xquad/utils.py -> build/lib/lm_eval/tasks/xquad
2025-08-31T08:27:31,670   creating build/lib/lm_eval/tasks/careqa
2025-08-31T08:27:31,671   copying lm_eval/tasks/careqa/utils_perplexity.py -> build/lib/lm_eval/tasks/careqa
2025-08-31T08:27:31,673   copying lm_eval/tasks/careqa/utils.py -> build/lib/lm_eval/tasks/careqa
2025-08-31T08:27:31,675   copying lm_eval/tasks/careqa/utils_open.py -> build/lib/lm_eval/tasks/careqa
2025-08-31T08:27:31,677   creating build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:31,678   copying lm_eval/tasks/catalan_bench/utils.py -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:31,681   creating build/lib/lm_eval/tasks/unitxt
2025-08-31T08:27:31,682   copying lm_eval/tasks/unitxt/task.py -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:27:31,685   creating build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:31,686   copying lm_eval/tasks/darijammlu/utils.py -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:31,689   copying lm_eval/tasks/darijammlu/_generate_configs.py -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:31,691   creating build/lib/lm_eval/tasks/mts_dialog
2025-08-31T08:27:31,692   copying lm_eval/tasks/mts_dialog/utils_perplexity.py -> build/lib/lm_eval/tasks/mts_dialog
2025-08-31T08:27:31,694   copying lm_eval/tasks/mts_dialog/utils.py -> build/lib/lm_eval/tasks/mts_dialog
2025-08-31T08:27:31,697   creating build/lib/lm_eval/tasks/japanese_leaderboard
2025-08-31T08:27:31,698   copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.py -> build/lib/lm_eval/tasks/japanese_leaderboard
2025-08-31T08:27:31,700   copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.py -> build/lib/lm_eval/tasks/japanese_leaderboard
2025-08-31T08:27:31,702   copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.py -> build/lib/lm_eval/tasks/japanese_leaderboard
2025-08-31T08:27:31,703   copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.py -> build/lib/lm_eval/tasks/japanese_leaderboard
2025-08-31T08:27:31,706   creating build/lib/lm_eval/tasks/common_voice
2025-08-31T08:27:31,707   copying lm_eval/tasks/common_voice/utils.py -> build/lib/lm_eval/tasks/common_voice
2025-08-31T08:27:31,709   creating build/lib/lm_eval/tasks/medtext
2025-08-31T08:27:31,710   copying lm_eval/tasks/medtext/utils_perplexity.py -> build/lib/lm_eval/tasks/medtext
2025-08-31T08:27:31,712   copying lm_eval/tasks/medtext/utils.py -> build/lib/lm_eval/tasks/medtext
2025-08-31T08:27:31,715   creating build/lib/lm_eval/tasks/qasper
2025-08-31T08:27:31,716   copying lm_eval/tasks/qasper/utils.py -> build/lib/lm_eval/tasks/qasper
2025-08-31T08:27:31,718   copying lm_eval/tasks/qasper/metrics.py -> build/lib/lm_eval/tasks/qasper
2025-08-31T08:27:31,720   creating build/lib/lm_eval/tasks/eq_bench
2025-08-31T08:27:31,721   copying lm_eval/tasks/eq_bench/utils.py -> build/lib/lm_eval/tasks/eq_bench
2025-08-31T08:27:31,724   creating build/lib/lm_eval/tasks/bbq
2025-08-31T08:27:31,725   copying lm_eval/tasks/bbq/utils.py -> build/lib/lm_eval/tasks/bbq
2025-08-31T08:27:31,727   creating build/lib/lm_eval/tasks/medmcqa
2025-08-31T08:27:31,728   copying lm_eval/tasks/medmcqa/utils_medmcqa.py -> build/lib/lm_eval/tasks/medmcqa
2025-08-31T08:27:31,731   creating build/lib/lm_eval/tasks/ifeval
2025-08-31T08:27:31,732   copying lm_eval/tasks/ifeval/instructions.py -> build/lib/lm_eval/tasks/ifeval
2025-08-31T08:27:31,736   copying lm_eval/tasks/ifeval/utils.py -> build/lib/lm_eval/tasks/ifeval
2025-08-31T08:27:31,738   copying lm_eval/tasks/ifeval/instructions_util.py -> build/lib/lm_eval/tasks/ifeval
2025-08-31T08:27:31,741   copying lm_eval/tasks/ifeval/instructions_registry.py -> build/lib/lm_eval/tasks/ifeval
2025-08-31T08:27:31,743   creating build/lib/lm_eval/tasks/darijahellaswag
2025-08-31T08:27:31,744   copying lm_eval/tasks/darijahellaswag/utils.py -> build/lib/lm_eval/tasks/darijahellaswag
2025-08-31T08:27:31,747   creating build/lib/lm_eval/tasks/qa4mre
2025-08-31T08:27:31,748   copying lm_eval/tasks/qa4mre/preprocess_qa4mre.py -> build/lib/lm_eval/tasks/qa4mre
2025-08-31T08:27:31,751   creating build/lib/lm_eval/tasks/eus_trivia
2025-08-31T08:27:31,752   copying lm_eval/tasks/eus_trivia/utils.py -> build/lib/lm_eval/tasks/eus_trivia
2025-08-31T08:27:31,754   creating build/lib/lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:27:31,755   copying lm_eval/tasks/mmlu-pro-plus/utils.py -> build/lib/lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:27:31,760   creating build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:31,761   copying lm_eval/tasks/longbench/_generate_config.py -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:31,764   copying lm_eval/tasks/longbench/utils.py -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:31,766   copying lm_eval/tasks/longbench/metrics.py -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:31,769   creating build/lib/lm_eval/tasks/scrolls
2025-08-31T08:27:31,770   copying lm_eval/tasks/scrolls/task.py -> build/lib/lm_eval/tasks/scrolls
2025-08-31T08:27:31,774   creating build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:31,775   copying lm_eval/tasks/egymmlu/utils.py -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:31,777   copying lm_eval/tasks/egymmlu/_generate_configs.py -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:31,781   creating build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:31,782   copying lm_eval/tasks/metabench/process_docs_permute.py -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:31,785   copying lm_eval/tasks/metabench/process_docs.py -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:31,787   creating build/lib/lm_eval/tasks/paws-x
2025-08-31T08:27:31,788   copying lm_eval/tasks/paws-x/_generate_config.py -> build/lib/lm_eval/tasks/paws-x
2025-08-31T08:27:31,790   copying lm_eval/tasks/paws-x/utils.py -> build/lib/lm_eval/tasks/paws-x
2025-08-31T08:27:31,793   creating build/lib/lm_eval/tasks/spanish_bench
2025-08-31T08:27:31,794   copying lm_eval/tasks/spanish_bench/utils.py -> build/lib/lm_eval/tasks/spanish_bench
2025-08-31T08:27:31,796   creating build/lib/lm_eval/tasks/hendrycks_math
2025-08-31T08:27:31,797   copying lm_eval/tasks/hendrycks_math/utils.py -> build/lib/lm_eval/tasks/hendrycks_math
2025-08-31T08:27:31,800   creating build/lib/lm_eval/tasks/afrimmlu
2025-08-31T08:27:31,802   copying lm_eval/tasks/afrimmlu/utils.py -> build/lib/lm_eval/tasks/afrimmlu
2025-08-31T08:27:31,804   copying lm_eval/tasks/afrimmlu/gen_utils.py -> build/lib/lm_eval/tasks/afrimmlu
2025-08-31T08:27:31,807   creating build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:31,808   copying lm_eval/tasks/belebele/_generate_configs.py -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:31,811   creating build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:31,812   copying lm_eval/tasks/mlqa/generate_tasks.py -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:31,814   copying lm_eval/tasks/mlqa/utils.py -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:31,817   creating build/lib/lm_eval/tasks/eus_reading
2025-08-31T08:27:31,818   copying lm_eval/tasks/eus_reading/utils.py -> build/lib/lm_eval/tasks/eus_reading
2025-08-31T08:27:31,820   creating build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:31,821   copying lm_eval/tasks/ceval/_generate_configs.py -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:31,825   creating build/lib/lm_eval/tasks/webqs
2025-08-31T08:27:31,826   copying lm_eval/tasks/webqs/utils.py -> build/lib/lm_eval/tasks/webqs
2025-08-31T08:27:31,829   creating build/lib/lm_eval/tasks/mimic_repsum
2025-08-31T08:27:31,830   copying lm_eval/tasks/mimic_repsum/utils_perplexity.py -> build/lib/lm_eval/tasks/mimic_repsum
2025-08-31T08:27:31,832   copying lm_eval/tasks/mimic_repsum/utils.py -> build/lib/lm_eval/tasks/mimic_repsum
2025-08-31T08:27:31,835   creating build/lib/lm_eval/tasks/meqsum
2025-08-31T08:27:31,836   copying lm_eval/tasks/meqsum/utils.py -> build/lib/lm_eval/tasks/meqsum
2025-08-31T08:27:31,838   creating build/lib/lm_eval/tasks/csatqa
2025-08-31T08:27:31,839   copying lm_eval/tasks/csatqa/utils.py -> build/lib/lm_eval/tasks/csatqa
2025-08-31T08:27:31,841   copying lm_eval/tasks/csatqa/_generate_configs.py -> build/lib/lm_eval/tasks/csatqa
2025-08-31T08:27:31,843   creating build/lib/lm_eval/tasks/toxigen
2025-08-31T08:27:31,844   copying lm_eval/tasks/toxigen/utils.py -> build/lib/lm_eval/tasks/toxigen
2025-08-31T08:27:31,847   creating build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:31,849   copying lm_eval/tasks/cmmlu/_generate_configs.py -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:31,852   creating build/lib/lm_eval/tasks/noticia
2025-08-31T08:27:31,853   copying lm_eval/tasks/noticia/utils.py -> build/lib/lm_eval/tasks/noticia
2025-08-31T08:27:31,856   creating build/lib/lm_eval/tasks/pubmedqa
2025-08-31T08:27:31,857   copying lm_eval/tasks/pubmedqa/preprocess_pubmedqa.py -> build/lib/lm_eval/tasks/pubmedqa
2025-08-31T08:27:31,859   creating build/lib/lm_eval/tasks/squadv2
2025-08-31T08:27:31,860   copying lm_eval/tasks/squadv2/task.py -> build/lib/lm_eval/tasks/squadv2
2025-08-31T08:27:31,864   creating build/lib/lm_eval/tasks/med_text_classification
2025-08-31T08:27:31,865   copying lm_eval/tasks/med_text_classification/utils.py -> build/lib/lm_eval/tasks/med_text_classification
2025-08-31T08:27:31,867   creating build/lib/lm_eval/tasks/truthfulqa
2025-08-31T08:27:31,868   copying lm_eval/tasks/truthfulqa/utils.py -> build/lib/lm_eval/tasks/truthfulqa
2025-08-31T08:27:31,871   creating build/lib/lm_eval/tasks/tinyBenchmarks
2025-08-31T08:27:31,873   copying lm_eval/tasks/tinyBenchmarks/utils_truthfulqa.py -> build/lib/lm_eval/tasks/tinyBenchmarks
2025-08-31T08:27:31,875   copying lm_eval/tasks/tinyBenchmarks/agg_functions.py -> build/lib/lm_eval/tasks/tinyBenchmarks
2025-08-31T08:27:31,877   copying lm_eval/tasks/tinyBenchmarks/utils_hellaswag.py -> build/lib/lm_eval/tasks/tinyBenchmarks
2025-08-31T08:27:31,879   copying lm_eval/tasks/tinyBenchmarks/utils_winogrande.py -> build/lib/lm_eval/tasks/tinyBenchmarks
2025-08-31T08:27:31,881   creating build/lib/lm_eval/tasks/realtoxicityprompts
2025-08-31T08:27:31,882   copying lm_eval/tasks/realtoxicityprompts/metric.py -> build/lib/lm_eval/tasks/realtoxicityprompts
2025-08-31T08:27:31,886   creating build/lib/lm_eval/tasks/hendrycks_ethics
2025-08-31T08:27:31,887   copying lm_eval/tasks/hendrycks_ethics/utils.py -> build/lib/lm_eval/tasks/hendrycks_ethics
2025-08-31T08:27:31,890   creating build/lib/lm_eval/tasks/wsc273
2025-08-31T08:27:31,891   copying lm_eval/tasks/wsc273/utils.py -> build/lib/lm_eval/tasks/wsc273
2025-08-31T08:27:31,894   creating build/lib/lm_eval/tasks/c4
2025-08-31T08:27:31,895   copying lm_eval/tasks/c4/preprocess_c4.py -> build/lib/lm_eval/tasks/c4
2025-08-31T08:27:31,897   creating build/lib/lm_eval/tasks/humaneval
2025-08-31T08:27:31,898   copying lm_eval/tasks/humaneval/utils.py -> build/lib/lm_eval/tasks/humaneval
2025-08-31T08:27:31,902   creating build/lib/lm_eval/tasks/coqa
2025-08-31T08:27:31,904   copying lm_eval/tasks/coqa/utils.py -> build/lib/lm_eval/tasks/coqa
2025-08-31T08:27:31,907   creating build/lib/lm_eval/tasks/score
2025-08-31T08:27:31,908   copying lm_eval/tasks/score/utils.py -> build/lib/lm_eval/tasks/score
2025-08-31T08:27:31,911   copying lm_eval/tasks/score/non_greedy_summarizer.py -> build/lib/lm_eval/tasks/score
2025-08-31T08:27:31,915   creating build/lib/lm_eval/tasks/paloma
2025-08-31T08:27:31,916   copying lm_eval/tasks/paloma/paloma_utils.py -> build/lib/lm_eval/tasks/paloma
2025-08-31T08:27:31,920   creating build/lib/lm_eval/tasks/olaph
2025-08-31T08:27:31,921   copying lm_eval/tasks/olaph/utils_perplexity.py -> build/lib/lm_eval/tasks/olaph
2025-08-31T08:27:31,924   copying lm_eval/tasks/olaph/utils.py -> build/lib/lm_eval/tasks/olaph
2025-08-31T08:27:31,927   creating build/lib/lm_eval/tasks/xcopa
2025-08-31T08:27:31,928   copying lm_eval/tasks/xcopa/utils.py -> build/lib/lm_eval/tasks/xcopa
2025-08-31T08:27:31,932   creating build/lib/lm_eval/tasks/meddialog
2025-08-31T08:27:31,933   copying lm_eval/tasks/meddialog/utils_perplexity.py -> build/lib/lm_eval/tasks/meddialog
2025-08-31T08:27:31,936   copying lm_eval/tasks/meddialog/utils.py -> build/lib/lm_eval/tasks/meddialog
2025-08-31T08:27:31,939   creating build/lib/lm_eval/tasks/french_bench
2025-08-31T08:27:31,941   copying lm_eval/tasks/french_bench/utils.py -> build/lib/lm_eval/tasks/french_bench
2025-08-31T08:27:31,943   copying lm_eval/tasks/french_bench/preprocess_wikitext.py -> build/lib/lm_eval/tasks/french_bench
2025-08-31T08:27:31,947   creating build/lib/lm_eval/tasks/kobest
2025-08-31T08:27:31,948   copying lm_eval/tasks/kobest/utils.py -> build/lib/lm_eval/tasks/kobest
2025-08-31T08:27:31,952   creating build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:31,953   copying lm_eval/tasks/med_concepts_qa/_generate_configs.py -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:31,956   creating build/lib/lm_eval/tasks/mbpp
2025-08-31T08:27:31,957   copying lm_eval/tasks/mbpp/utils.py -> build/lib/lm_eval/tasks/mbpp
2025-08-31T08:27:31,960   creating build/lib/lm_eval/tasks/squad_completion
2025-08-31T08:27:31,962   copying lm_eval/tasks/squad_completion/task.py -> build/lib/lm_eval/tasks/squad_completion
2025-08-31T08:27:31,965   creating build/lib/lm_eval/tasks/logiqa
2025-08-31T08:27:31,966   copying lm_eval/tasks/logiqa/utils_logiqa.py -> build/lib/lm_eval/tasks/logiqa
2025-08-31T08:27:31,971   creating build/lib/lm_eval/tasks/simple_cooccurrence_bias
2025-08-31T08:27:31,972   copying lm_eval/tasks/simple_cooccurrence_bias/utils.py -> build/lib/lm_eval/tasks/simple_cooccurrence_bias
2025-08-31T08:27:31,976   creating build/lib/lm_eval/tasks/bigbench
2025-08-31T08:27:31,977   copying lm_eval/tasks/bigbench/generate_tasks.py -> build/lib/lm_eval/tasks/bigbench
2025-08-31T08:27:31,981   copying lm_eval/tasks/bigbench/push_bigbench_dataset.py -> build/lib/lm_eval/tasks/bigbench
2025-08-31T08:27:31,984   creating build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:31,986   copying lm_eval/tasks/crows_pairs/utils.py -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:31,989   creating build/lib/lm_eval/tasks/groundcocoa
2025-08-31T08:27:31,990   copying lm_eval/tasks/groundcocoa/utils.py -> build/lib/lm_eval/tasks/groundcocoa
2025-08-31T08:27:31,994   creating build/lib/lm_eval/tasks/mmlu_pro
2025-08-31T08:27:31,995   copying lm_eval/tasks/mmlu_pro/utils.py -> build/lib/lm_eval/tasks/mmlu_pro
2025-08-31T08:27:31,998   creating build/lib/lm_eval/tasks/wmt2016
2025-08-31T08:27:32,000   copying lm_eval/tasks/wmt2016/metrics.py -> build/lib/lm_eval/tasks/wmt2016
2025-08-31T08:27:32,003   creating build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:32,004   copying lm_eval/tasks/mmmu/utils.py -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:32,007   creating build/lib/lm_eval/tasks/medqa
2025-08-31T08:27:32,008   copying lm_eval/tasks/medqa/preprocess_medqa.py -> build/lib/lm_eval/tasks/medqa
2025-08-31T08:27:32,011   creating build/lib/lm_eval/tasks/minerva_math
2025-08-31T08:27:32,012   copying lm_eval/tasks/minerva_math/utils.py -> build/lib/lm_eval/tasks/minerva_math
2025-08-31T08:27:32,015   creating build/lib/lm_eval/tasks/logiqa2
2025-08-31T08:27:32,016   copying lm_eval/tasks/logiqa2/utils_logiqa2.py -> build/lib/lm_eval/tasks/logiqa2
2025-08-31T08:27:32,019   creating build/lib/lm_eval/tasks/mmlusr
2025-08-31T08:27:32,019   copying lm_eval/tasks/mmlusr/config.py -> build/lib/lm_eval/tasks/mmlusr
2025-08-31T08:27:32,022   creating build/lib/lm_eval/tasks/swde
2025-08-31T08:27:32,023   copying lm_eval/tasks/swde/task.py -> build/lib/lm_eval/tasks/swde
2025-08-31T08:27:32,026   creating build/lib/lm_eval/tasks/afrixnli
2025-08-31T08:27:32,027   copying lm_eval/tasks/afrixnli/utils.py -> build/lib/lm_eval/tasks/afrixnli
2025-08-31T08:27:32,030   copying lm_eval/tasks/afrixnli/gen_utils.py -> build/lib/lm_eval/tasks/afrixnli
2025-08-31T08:27:32,032   creating build/lib/lm_eval/tasks/copal_id
2025-08-31T08:27:32,033   copying lm_eval/tasks/copal_id/utils.py -> build/lib/lm_eval/tasks/copal_id
2025-08-31T08:27:32,036   creating build/lib/lm_eval/tasks/blimp
2025-08-31T08:27:32,037   copying lm_eval/tasks/blimp/generate_configs.py -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:27:32,039   creating build/lib/lm_eval/tasks/mmlu_prox
2025-08-31T08:27:32,040   copying lm_eval/tasks/mmlu_prox/lang_libs.py -> build/lib/lm_eval/tasks/mmlu_prox
2025-08-31T08:27:32,043   copying lm_eval/tasks/mmlu_prox/mmlu_prox_config_generator.py -> build/lib/lm_eval/tasks/mmlu_prox
2025-08-31T08:27:32,046   creating build/lib/lm_eval/tasks/mediqa_qa2019
2025-08-31T08:27:32,047   copying lm_eval/tasks/mediqa_qa2019/utils_perplexity.py -> build/lib/lm_eval/tasks/mediqa_qa2019
2025-08-31T08:27:32,049   copying lm_eval/tasks/mediqa_qa2019/utils.py -> build/lib/lm_eval/tasks/mediqa_qa2019
2025-08-31T08:27:32,052   creating build/lib/lm_eval/tasks/fda
2025-08-31T08:27:32,053   copying lm_eval/tasks/fda/task.py -> build/lib/lm_eval/tasks/fda
2025-08-31T08:27:32,055   creating build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:27:32,056   copying lm_eval/tasks/arab_culture/utils_mcq.py -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:27:32,059   copying lm_eval/tasks/arab_culture/prompts.py -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:27:32,061   copying lm_eval/tasks/arab_culture/_generate_configs.py -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:27:32,063   creating build/lib/lm_eval/tasks/truthfulqa-multi
2025-08-31T08:27:32,064   copying lm_eval/tasks/truthfulqa-multi/utils.py -> build/lib/lm_eval/tasks/truthfulqa-multi
2025-08-31T08:27:32,067   creating build/lib/lm_eval/tasks/mutual
2025-08-31T08:27:32,068   copying lm_eval/tasks/mutual/utils.py -> build/lib/lm_eval/tasks/mutual
2025-08-31T08:27:32,071   creating build/lib/lm_eval/tasks/aclue
2025-08-31T08:27:32,072   copying lm_eval/tasks/aclue/_generate_configs.py -> build/lib/lm_eval/tasks/aclue
2025-08-31T08:27:32,075   creating build/lib/lm_eval/tasks/basqueglue
2025-08-31T08:27:32,076   copying lm_eval/tasks/basqueglue/utils.py -> build/lib/lm_eval/tasks/basqueglue
2025-08-31T08:27:32,079   creating build/lib/lm_eval/tasks/darija_bench/darija_summarization
2025-08-31T08:27:32,080   copying lm_eval/tasks/darija_bench/darija_summarization/utils.py -> build/lib/lm_eval/tasks/darija_bench/darija_summarization
2025-08-31T08:27:32,083   creating build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:32,084   copying lm_eval/tasks/darija_bench/darija_translation/utils.py -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:32,086   creating build/lib/lm_eval/tasks/darija_bench/darija_transliteration
2025-08-31T08:27:32,087   copying lm_eval/tasks/darija_bench/darija_transliteration/utils.py -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration
2025-08-31T08:27:32,090   creating build/lib/lm_eval/tasks/darija_bench/darija_sentiment
2025-08-31T08:27:32,091   copying lm_eval/tasks/darija_bench/darija_sentiment/utils.py -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment
2025-08-31T08:27:32,104   creating build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian
2025-08-31T08:27:32,106   copying lm_eval/tasks/include/few_shot_og/North Macedonian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian
2025-08-31T08:27:32,109   creating build/lib/lm_eval/tasks/include/few_shot_og/Basque
2025-08-31T08:27:32,110   copying lm_eval/tasks/include/few_shot_og/Basque/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Basque
2025-08-31T08:27:32,112   creating build/lib/lm_eval/tasks/include/few_shot_og/Nepali
2025-08-31T08:27:32,113   copying lm_eval/tasks/include/few_shot_og/Nepali/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali
2025-08-31T08:27:32,115   creating build/lib/lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:27:32,116   copying lm_eval/tasks/include/few_shot_og/Hindi/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:27:32,118   creating build/lib/lm_eval/tasks/include/few_shot_og/Armenian
2025-08-31T08:27:32,119   copying lm_eval/tasks/include/few_shot_og/Armenian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian
2025-08-31T08:27:32,122   creating build/lib/lm_eval/tasks/include/few_shot_og/Dutch
2025-08-31T08:27:32,123   copying lm_eval/tasks/include/few_shot_og/Dutch/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch
2025-08-31T08:27:32,125   creating build/lib/lm_eval/tasks/include/few_shot_og/Albanian
2025-08-31T08:27:32,126   copying lm_eval/tasks/include/few_shot_og/Albanian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian
2025-08-31T08:27:32,129   creating build/lib/lm_eval/tasks/include/few_shot_og/Serbian
2025-08-31T08:27:32,129   copying lm_eval/tasks/include/few_shot_og/Serbian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian
2025-08-31T08:27:32,132   creating build/lib/lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:27:32,133   copying lm_eval/tasks/include/few_shot_og/Russian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:27:32,135   creating build/lib/lm_eval/tasks/include/few_shot_og/Finnish
2025-08-31T08:27:32,136   copying lm_eval/tasks/include/few_shot_og/Finnish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish
2025-08-31T08:27:32,139   creating build/lib/lm_eval/tasks/include/few_shot_og/German
2025-08-31T08:27:32,140   copying lm_eval/tasks/include/few_shot_og/German/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/German
2025-08-31T08:27:32,142   creating build/lib/lm_eval/tasks/include/few_shot_og/Telugu
2025-08-31T08:27:32,143   copying lm_eval/tasks/include/few_shot_og/Telugu/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu
2025-08-31T08:27:32,145   creating build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani
2025-08-31T08:27:32,146   copying lm_eval/tasks/include/few_shot_og/Azerbaijani/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani
2025-08-31T08:27:32,149   creating build/lib/lm_eval/tasks/include/few_shot_og/Hungarian
2025-08-31T08:27:32,150   copying lm_eval/tasks/include/few_shot_og/Hungarian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian
2025-08-31T08:27:32,152   creating build/lib/lm_eval/tasks/include/few_shot_og/Uzbek
2025-08-31T08:27:32,153   copying lm_eval/tasks/include/few_shot_og/Uzbek/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek
2025-08-31T08:27:32,156   creating build/lib/lm_eval/tasks/include/few_shot_og/Korean
2025-08-31T08:27:32,157   copying lm_eval/tasks/include/few_shot_og/Korean/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Korean
2025-08-31T08:27:32,159   creating build/lib/lm_eval/tasks/include/few_shot_og/Hebrew
2025-08-31T08:27:32,160   copying lm_eval/tasks/include/few_shot_og/Hebrew/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew
2025-08-31T08:27:32,163   creating build/lib/lm_eval/tasks/include/few_shot_og/Belarusian
2025-08-31T08:27:32,164   copying lm_eval/tasks/include/few_shot_og/Belarusian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian
2025-08-31T08:27:32,166   creating build/lib/lm_eval/tasks/include/few_shot_og/Japanese
2025-08-31T08:27:32,167   copying lm_eval/tasks/include/few_shot_og/Japanese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese
2025-08-31T08:27:32,170   creating build/lib/lm_eval/tasks/include/few_shot_og/Kazakh
2025-08-31T08:27:32,171   copying lm_eval/tasks/include/few_shot_og/Kazakh/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Kazakh
2025-08-31T08:27:32,173   creating build/lib/lm_eval/tasks/include/few_shot_og/Georgian
2025-08-31T08:27:32,174   copying lm_eval/tasks/include/few_shot_og/Georgian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Georgian
2025-08-31T08:27:32,176   creating build/lib/lm_eval/tasks/include/few_shot_og/Persian
2025-08-31T08:27:32,177   copying lm_eval/tasks/include/few_shot_og/Persian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Persian
2025-08-31T08:27:32,180   creating build/lib/lm_eval/tasks/include/few_shot_og/Indonesian
2025-08-31T08:27:32,180   copying lm_eval/tasks/include/few_shot_og/Indonesian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian
2025-08-31T08:27:32,183   creating build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese
2025-08-31T08:27:32,184   copying lm_eval/tasks/include/few_shot_og/Vietnamese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese
2025-08-31T08:27:32,187   creating build/lib/lm_eval/tasks/include/few_shot_og/Spanish
2025-08-31T08:27:32,188   copying lm_eval/tasks/include/few_shot_og/Spanish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish
2025-08-31T08:27:32,190   creating build/lib/lm_eval/tasks/include/few_shot_og/Greek
2025-08-31T08:27:32,192   copying lm_eval/tasks/include/few_shot_og/Greek/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Greek
2025-08-31T08:27:32,194   creating build/lib/lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:27:32,195   copying lm_eval/tasks/include/few_shot_og/Chinese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:27:32,197   creating build/lib/lm_eval/tasks/include/few_shot_og/Turkish
2025-08-31T08:27:32,198   copying lm_eval/tasks/include/few_shot_og/Turkish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish
2025-08-31T08:27:32,201   creating build/lib/lm_eval/tasks/include/few_shot_og/Tagalog
2025-08-31T08:27:32,202   copying lm_eval/tasks/include/few_shot_og/Tagalog/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog
2025-08-31T08:27:32,204   creating build/lib/lm_eval/tasks/include/few_shot_og/French
2025-08-31T08:27:32,205   copying lm_eval/tasks/include/few_shot_og/French/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/French
2025-08-31T08:27:32,208   creating build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian
2025-08-31T08:27:32,209   copying lm_eval/tasks/include/few_shot_og/Bulgarian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian
2025-08-31T08:27:32,211   creating build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian
2025-08-31T08:27:32,212   copying lm_eval/tasks/include/few_shot_og/Lithuanian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian
2025-08-31T08:27:32,215   creating build/lib/lm_eval/tasks/include/few_shot_og/Urdu
2025-08-31T08:27:32,216   copying lm_eval/tasks/include/few_shot_og/Urdu/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu
2025-08-31T08:27:32,218   creating build/lib/lm_eval/tasks/include/few_shot_og/Polish
2025-08-31T08:27:32,219   copying lm_eval/tasks/include/few_shot_og/Polish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Polish
2025-08-31T08:27:32,222   creating build/lib/lm_eval/tasks/include/few_shot_og/Tamil
2025-08-31T08:27:32,223   copying lm_eval/tasks/include/few_shot_og/Tamil/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil
2025-08-31T08:27:32,225   creating build/lib/lm_eval/tasks/include/few_shot_og/Italian
2025-08-31T08:27:32,226   copying lm_eval/tasks/include/few_shot_og/Italian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Italian
2025-08-31T08:27:32,229   creating build/lib/lm_eval/tasks/include/few_shot_og/Portuguese
2025-08-31T08:27:32,230   copying lm_eval/tasks/include/few_shot_og/Portuguese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese
2025-08-31T08:27:32,232   creating build/lib/lm_eval/tasks/include/few_shot_og/Estonian
2025-08-31T08:27:32,233   copying lm_eval/tasks/include/few_shot_og/Estonian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian
2025-08-31T08:27:32,235   creating build/lib/lm_eval/tasks/include/few_shot_og/Bengali
2025-08-31T08:27:32,236   copying lm_eval/tasks/include/few_shot_og/Bengali/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali
2025-08-31T08:27:32,239   creating build/lib/lm_eval/tasks/include/few_shot_og/Croatian
2025-08-31T08:27:32,240   copying lm_eval/tasks/include/few_shot_og/Croatian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian
2025-08-31T08:27:32,242   creating build/lib/lm_eval/tasks/include/few_shot_og/Malay
2025-08-31T08:27:32,243   copying lm_eval/tasks/include/few_shot_og/Malay/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Malay
2025-08-31T08:27:32,246   creating build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian
2025-08-31T08:27:32,247   copying lm_eval/tasks/include/few_shot_og/Ukrainian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian
2025-08-31T08:27:32,249   creating build/lib/lm_eval/tasks/include/few_shot_og/Arabic
2025-08-31T08:27:32,250   copying lm_eval/tasks/include/few_shot_og/Arabic/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic
2025-08-31T08:27:32,252   creating build/lib/lm_eval/tasks/include/few_shot_og/Malayalam
2025-08-31T08:27:32,253   copying lm_eval/tasks/include/few_shot_og/Malayalam/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam
2025-08-31T08:27:32,256   creating build/lib/lm_eval/tasks/include/default/North Macedonian
2025-08-31T08:27:32,257   copying lm_eval/tasks/include/default/North Macedonian/utils.py -> build/lib/lm_eval/tasks/include/default/North Macedonian
2025-08-31T08:27:32,260   creating build/lib/lm_eval/tasks/include/default/Basque
2025-08-31T08:27:32,261   copying lm_eval/tasks/include/default/Basque/utils.py -> build/lib/lm_eval/tasks/include/default/Basque
2025-08-31T08:27:32,263   creating build/lib/lm_eval/tasks/include/default/Nepali
2025-08-31T08:27:32,264   copying lm_eval/tasks/include/default/Nepali/utils.py -> build/lib/lm_eval/tasks/include/default/Nepali
2025-08-31T08:27:32,267   creating build/lib/lm_eval/tasks/include/default/Hindi
2025-08-31T08:27:32,268   copying lm_eval/tasks/include/default/Hindi/utils.py -> build/lib/lm_eval/tasks/include/default/Hindi
2025-08-31T08:27:32,270   creating build/lib/lm_eval/tasks/include/default/Armenian
2025-08-31T08:27:32,271   copying lm_eval/tasks/include/default/Armenian/utils.py -> build/lib/lm_eval/tasks/include/default/Armenian
2025-08-31T08:27:32,274   creating build/lib/lm_eval/tasks/include/default/Dutch
2025-08-31T08:27:32,275   copying lm_eval/tasks/include/default/Dutch/utils.py -> build/lib/lm_eval/tasks/include/default/Dutch
2025-08-31T08:27:32,277   creating build/lib/lm_eval/tasks/include/default/Albanian
2025-08-31T08:27:32,278   copying lm_eval/tasks/include/default/Albanian/utils.py -> build/lib/lm_eval/tasks/include/default/Albanian
2025-08-31T08:27:32,281   creating build/lib/lm_eval/tasks/include/default/Serbian
2025-08-31T08:27:32,282   copying lm_eval/tasks/include/default/Serbian/utils.py -> build/lib/lm_eval/tasks/include/default/Serbian
2025-08-31T08:27:32,284   creating build/lib/lm_eval/tasks/include/default/Russian
2025-08-31T08:27:32,285   copying lm_eval/tasks/include/default/Russian/utils.py -> build/lib/lm_eval/tasks/include/default/Russian
2025-08-31T08:27:32,288   creating build/lib/lm_eval/tasks/include/default/Finnish
2025-08-31T08:27:32,289   copying lm_eval/tasks/include/default/Finnish/utils.py -> build/lib/lm_eval/tasks/include/default/Finnish
2025-08-31T08:27:32,291   creating build/lib/lm_eval/tasks/include/default/German
2025-08-31T08:27:32,292   copying lm_eval/tasks/include/default/German/utils.py -> build/lib/lm_eval/tasks/include/default/German
2025-08-31T08:27:32,295   creating build/lib/lm_eval/tasks/include/default/Telugu
2025-08-31T08:27:32,296   copying lm_eval/tasks/include/default/Telugu/utils.py -> build/lib/lm_eval/tasks/include/default/Telugu
2025-08-31T08:27:32,298   creating build/lib/lm_eval/tasks/include/default/Azerbaijani
2025-08-31T08:27:32,299   copying lm_eval/tasks/include/default/Azerbaijani/utils.py -> build/lib/lm_eval/tasks/include/default/Azerbaijani
2025-08-31T08:27:32,302   creating build/lib/lm_eval/tasks/include/default/Hungarian
2025-08-31T08:27:32,302   copying lm_eval/tasks/include/default/Hungarian/utils.py -> build/lib/lm_eval/tasks/include/default/Hungarian
2025-08-31T08:27:32,305   creating build/lib/lm_eval/tasks/include/default/Uzbek
2025-08-31T08:27:32,306   copying lm_eval/tasks/include/default/Uzbek/utils.py -> build/lib/lm_eval/tasks/include/default/Uzbek
2025-08-31T08:27:32,308   creating build/lib/lm_eval/tasks/include/default/Korean
2025-08-31T08:27:32,309   copying lm_eval/tasks/include/default/Korean/utils.py -> build/lib/lm_eval/tasks/include/default/Korean
2025-08-31T08:27:32,311   creating build/lib/lm_eval/tasks/include/default/Hebrew
2025-08-31T08:27:32,312   copying lm_eval/tasks/include/default/Hebrew/utils.py -> build/lib/lm_eval/tasks/include/default/Hebrew
2025-08-31T08:27:32,315   creating build/lib/lm_eval/tasks/include/default/Belarusian
2025-08-31T08:27:32,316   copying lm_eval/tasks/include/default/Belarusian/utils.py -> build/lib/lm_eval/tasks/include/default/Belarusian
2025-08-31T08:27:32,318   creating build/lib/lm_eval/tasks/include/default/Japanese
2025-08-31T08:27:32,319   copying lm_eval/tasks/include/default/Japanese/utils.py -> build/lib/lm_eval/tasks/include/default/Japanese
2025-08-31T08:27:32,322   creating build/lib/lm_eval/tasks/include/default/Kazakh
2025-08-31T08:27:32,323   copying lm_eval/tasks/include/default/Kazakh/utils.py -> build/lib/lm_eval/tasks/include/default/Kazakh
2025-08-31T08:27:32,325   creating build/lib/lm_eval/tasks/include/default/Georgian
2025-08-31T08:27:32,326   copying lm_eval/tasks/include/default/Georgian/utils.py -> build/lib/lm_eval/tasks/include/default/Georgian
2025-08-31T08:27:32,329   creating build/lib/lm_eval/tasks/include/default/Persian
2025-08-31T08:27:32,330   copying lm_eval/tasks/include/default/Persian/utils.py -> build/lib/lm_eval/tasks/include/default/Persian
2025-08-31T08:27:32,332   creating build/lib/lm_eval/tasks/include/default/Indonesian
2025-08-31T08:27:32,333   copying lm_eval/tasks/include/default/Indonesian/utils.py -> build/lib/lm_eval/tasks/include/default/Indonesian
2025-08-31T08:27:32,336   creating build/lib/lm_eval/tasks/include/default/Vietnamese
2025-08-31T08:27:32,337   copying lm_eval/tasks/include/default/Vietnamese/utils.py -> build/lib/lm_eval/tasks/include/default/Vietnamese
2025-08-31T08:27:32,339   creating build/lib/lm_eval/tasks/include/default/Spanish
2025-08-31T08:27:32,342   copying lm_eval/tasks/include/default/Spanish/utils.py -> build/lib/lm_eval/tasks/include/default/Spanish
2025-08-31T08:27:32,344   creating build/lib/lm_eval/tasks/include/default/Greek
2025-08-31T08:27:32,345   copying lm_eval/tasks/include/default/Greek/utils.py -> build/lib/lm_eval/tasks/include/default/Greek
2025-08-31T08:27:32,348   creating build/lib/lm_eval/tasks/include/default/Chinese
2025-08-31T08:27:32,349   copying lm_eval/tasks/include/default/Chinese/utils.py -> build/lib/lm_eval/tasks/include/default/Chinese
2025-08-31T08:27:32,351   creating build/lib/lm_eval/tasks/include/default/Turkish
2025-08-31T08:27:32,352   copying lm_eval/tasks/include/default/Turkish/utils.py -> build/lib/lm_eval/tasks/include/default/Turkish
2025-08-31T08:27:32,355   creating build/lib/lm_eval/tasks/include/default/Tagalog
2025-08-31T08:27:32,356   copying lm_eval/tasks/include/default/Tagalog/utils.py -> build/lib/lm_eval/tasks/include/default/Tagalog
2025-08-31T08:27:32,358   creating build/lib/lm_eval/tasks/include/default/French
2025-08-31T08:27:32,359   copying lm_eval/tasks/include/default/French/utils.py -> build/lib/lm_eval/tasks/include/default/French
2025-08-31T08:27:32,361   creating build/lib/lm_eval/tasks/include/default/Bulgarian
2025-08-31T08:27:32,362   copying lm_eval/tasks/include/default/Bulgarian/utils.py -> build/lib/lm_eval/tasks/include/default/Bulgarian
2025-08-31T08:27:32,365   creating build/lib/lm_eval/tasks/include/default/Lithuanian
2025-08-31T08:27:32,366   copying lm_eval/tasks/include/default/Lithuanian/utils.py -> build/lib/lm_eval/tasks/include/default/Lithuanian
2025-08-31T08:27:32,368   creating build/lib/lm_eval/tasks/include/default/Urdu
2025-08-31T08:27:32,369   copying lm_eval/tasks/include/default/Urdu/utils.py -> build/lib/lm_eval/tasks/include/default/Urdu
2025-08-31T08:27:32,372   creating build/lib/lm_eval/tasks/include/default/Polish
2025-08-31T08:27:32,372   copying lm_eval/tasks/include/default/Polish/utils.py -> build/lib/lm_eval/tasks/include/default/Polish
2025-08-31T08:27:32,375   creating build/lib/lm_eval/tasks/include/default/Tamil
2025-08-31T08:27:32,376   copying lm_eval/tasks/include/default/Tamil/utils.py -> build/lib/lm_eval/tasks/include/default/Tamil
2025-08-31T08:27:32,378   creating build/lib/lm_eval/tasks/include/default/Italian
2025-08-31T08:27:32,379   copying lm_eval/tasks/include/default/Italian/utils.py -> build/lib/lm_eval/tasks/include/default/Italian
2025-08-31T08:27:32,382   creating build/lib/lm_eval/tasks/include/default/Portuguese
2025-08-31T08:27:32,383   copying lm_eval/tasks/include/default/Portuguese/utils.py -> build/lib/lm_eval/tasks/include/default/Portuguese
2025-08-31T08:27:32,385   creating build/lib/lm_eval/tasks/include/default/Estonian
2025-08-31T08:27:32,386   copying lm_eval/tasks/include/default/Estonian/utils.py -> build/lib/lm_eval/tasks/include/default/Estonian
2025-08-31T08:27:32,389   creating build/lib/lm_eval/tasks/include/default/Bengali
2025-08-31T08:27:32,390   copying lm_eval/tasks/include/default/Bengali/utils.py -> build/lib/lm_eval/tasks/include/default/Bengali
2025-08-31T08:27:32,392   creating build/lib/lm_eval/tasks/include/default/Croatian
2025-08-31T08:27:32,393   copying lm_eval/tasks/include/default/Croatian/utils.py -> build/lib/lm_eval/tasks/include/default/Croatian
2025-08-31T08:27:32,396   creating build/lib/lm_eval/tasks/include/default/Malay
2025-08-31T08:27:32,397   copying lm_eval/tasks/include/default/Malay/utils.py -> build/lib/lm_eval/tasks/include/default/Malay
2025-08-31T08:27:32,399   creating build/lib/lm_eval/tasks/include/default/Ukrainian
2025-08-31T08:27:32,400   copying lm_eval/tasks/include/default/Ukrainian/utils.py -> build/lib/lm_eval/tasks/include/default/Ukrainian
2025-08-31T08:27:32,403   creating build/lib/lm_eval/tasks/include/default/Arabic
2025-08-31T08:27:32,404   copying lm_eval/tasks/include/default/Arabic/utils.py -> build/lib/lm_eval/tasks/include/default/Arabic
2025-08-31T08:27:32,406   creating build/lib/lm_eval/tasks/include/default/Malayalam
2025-08-31T08:27:32,407   copying lm_eval/tasks/include/default/Malayalam/utils.py -> build/lib/lm_eval/tasks/include/default/Malayalam
2025-08-31T08:27:32,410   creating build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian
2025-08-31T08:27:32,411   copying lm_eval/tasks/include/few_shot_en/North Macedonian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian
2025-08-31T08:27:32,414   creating build/lib/lm_eval/tasks/include/few_shot_en/Basque
2025-08-31T08:27:32,415   copying lm_eval/tasks/include/few_shot_en/Basque/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Basque
2025-08-31T08:27:32,418   creating build/lib/lm_eval/tasks/include/few_shot_en/Nepali
2025-08-31T08:27:32,419   copying lm_eval/tasks/include/few_shot_en/Nepali/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali
2025-08-31T08:27:32,421   creating build/lib/lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:27:32,422   copying lm_eval/tasks/include/few_shot_en/Hindi/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:27:32,424   creating build/lib/lm_eval/tasks/include/few_shot_en/Armenian
2025-08-31T08:27:32,425   copying lm_eval/tasks/include/few_shot_en/Armenian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian
2025-08-31T08:27:32,428   creating build/lib/lm_eval/tasks/include/few_shot_en/Dutch
2025-08-31T08:27:32,428   copying lm_eval/tasks/include/few_shot_en/Dutch/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch
2025-08-31T08:27:32,431   creating build/lib/lm_eval/tasks/include/few_shot_en/Albanian
2025-08-31T08:27:32,432   copying lm_eval/tasks/include/few_shot_en/Albanian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian
2025-08-31T08:27:32,434   creating build/lib/lm_eval/tasks/include/few_shot_en/Serbian
2025-08-31T08:27:32,435   copying lm_eval/tasks/include/few_shot_en/Serbian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian
2025-08-31T08:27:32,437   creating build/lib/lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:27:32,439   copying lm_eval/tasks/include/few_shot_en/Russian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:27:32,441   creating build/lib/lm_eval/tasks/include/few_shot_en/Finnish
2025-08-31T08:27:32,442   copying lm_eval/tasks/include/few_shot_en/Finnish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish
2025-08-31T08:27:32,445   creating build/lib/lm_eval/tasks/include/few_shot_en/German
2025-08-31T08:27:32,446   copying lm_eval/tasks/include/few_shot_en/German/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/German
2025-08-31T08:27:32,448   creating build/lib/lm_eval/tasks/include/few_shot_en/Telugu
2025-08-31T08:27:32,449   copying lm_eval/tasks/include/few_shot_en/Telugu/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu
2025-08-31T08:27:32,452   creating build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani
2025-08-31T08:27:32,453   copying lm_eval/tasks/include/few_shot_en/Azerbaijani/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani
2025-08-31T08:27:32,456   creating build/lib/lm_eval/tasks/include/few_shot_en/Hungarian
2025-08-31T08:27:32,457   copying lm_eval/tasks/include/few_shot_en/Hungarian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian
2025-08-31T08:27:32,459   creating build/lib/lm_eval/tasks/include/few_shot_en/Uzbek
2025-08-31T08:27:32,461   copying lm_eval/tasks/include/few_shot_en/Uzbek/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek
2025-08-31T08:27:32,463   creating build/lib/lm_eval/tasks/include/few_shot_en/Korean
2025-08-31T08:27:32,464   copying lm_eval/tasks/include/few_shot_en/Korean/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Korean
2025-08-31T08:27:32,466   creating build/lib/lm_eval/tasks/include/few_shot_en/Hebrew
2025-08-31T08:27:32,468   copying lm_eval/tasks/include/few_shot_en/Hebrew/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew
2025-08-31T08:27:32,470   creating build/lib/lm_eval/tasks/include/few_shot_en/Belarusian
2025-08-31T08:27:32,471   copying lm_eval/tasks/include/few_shot_en/Belarusian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian
2025-08-31T08:27:32,473   creating build/lib/lm_eval/tasks/include/few_shot_en/Japanese
2025-08-31T08:27:32,475   copying lm_eval/tasks/include/few_shot_en/Japanese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese
2025-08-31T08:27:32,477   creating build/lib/lm_eval/tasks/include/few_shot_en/Kazakh
2025-08-31T08:27:32,478   copying lm_eval/tasks/include/few_shot_en/Kazakh/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Kazakh
2025-08-31T08:27:32,481   creating build/lib/lm_eval/tasks/include/few_shot_en/Georgian
2025-08-31T08:27:32,482   copying lm_eval/tasks/include/few_shot_en/Georgian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Georgian
2025-08-31T08:27:32,484   creating build/lib/lm_eval/tasks/include/few_shot_en/Persian
2025-08-31T08:27:32,485   copying lm_eval/tasks/include/few_shot_en/Persian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Persian
2025-08-31T08:27:32,488   creating build/lib/lm_eval/tasks/include/few_shot_en/Indonesian
2025-08-31T08:27:32,489   copying lm_eval/tasks/include/few_shot_en/Indonesian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian
2025-08-31T08:27:32,491   creating build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese
2025-08-31T08:27:32,492   copying lm_eval/tasks/include/few_shot_en/Vietnamese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese
2025-08-31T08:27:32,495   creating build/lib/lm_eval/tasks/include/few_shot_en/Spanish
2025-08-31T08:27:32,496   copying lm_eval/tasks/include/few_shot_en/Spanish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish
2025-08-31T08:27:32,499   creating build/lib/lm_eval/tasks/include/few_shot_en/Greek
2025-08-31T08:27:32,500   copying lm_eval/tasks/include/few_shot_en/Greek/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Greek
2025-08-31T08:27:32,502   creating build/lib/lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:27:32,503   copying lm_eval/tasks/include/few_shot_en/Chinese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:27:32,506   creating build/lib/lm_eval/tasks/include/few_shot_en/Turkish
2025-08-31T08:27:32,507   copying lm_eval/tasks/include/few_shot_en/Turkish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish
2025-08-31T08:27:32,509   creating build/lib/lm_eval/tasks/include/few_shot_en/Tagalog
2025-08-31T08:27:32,510   copying lm_eval/tasks/include/few_shot_en/Tagalog/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog
2025-08-31T08:27:32,512   creating build/lib/lm_eval/tasks/include/few_shot_en/French
2025-08-31T08:27:32,514   copying lm_eval/tasks/include/few_shot_en/French/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/French
2025-08-31T08:27:32,516   creating build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian
2025-08-31T08:27:32,517   copying lm_eval/tasks/include/few_shot_en/Bulgarian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian
2025-08-31T08:27:32,519   creating build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian
2025-08-31T08:27:32,520   copying lm_eval/tasks/include/few_shot_en/Lithuanian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian
2025-08-31T08:27:32,523   creating build/lib/lm_eval/tasks/include/few_shot_en/Urdu
2025-08-31T08:27:32,524   copying lm_eval/tasks/include/few_shot_en/Urdu/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu
2025-08-31T08:27:32,526   creating build/lib/lm_eval/tasks/include/few_shot_en/Polish
2025-08-31T08:27:32,527   copying lm_eval/tasks/include/few_shot_en/Polish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Polish
2025-08-31T08:27:32,530   creating build/lib/lm_eval/tasks/include/few_shot_en/Tamil
2025-08-31T08:27:32,531   copying lm_eval/tasks/include/few_shot_en/Tamil/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil
2025-08-31T08:27:32,533   creating build/lib/lm_eval/tasks/include/few_shot_en/Italian
2025-08-31T08:27:32,534   copying lm_eval/tasks/include/few_shot_en/Italian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Italian
2025-08-31T08:27:32,537   creating build/lib/lm_eval/tasks/include/few_shot_en/Portuguese
2025-08-31T08:27:32,538   copying lm_eval/tasks/include/few_shot_en/Portuguese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese
2025-08-31T08:27:32,540   creating build/lib/lm_eval/tasks/include/few_shot_en/Estonian
2025-08-31T08:27:32,541   copying lm_eval/tasks/include/few_shot_en/Estonian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian
2025-08-31T08:27:32,544   creating build/lib/lm_eval/tasks/include/few_shot_en/Bengali
2025-08-31T08:27:32,545   copying lm_eval/tasks/include/few_shot_en/Bengali/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali
2025-08-31T08:27:32,548   creating build/lib/lm_eval/tasks/include/few_shot_en/Croatian
2025-08-31T08:27:32,549   copying lm_eval/tasks/include/few_shot_en/Croatian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian
2025-08-31T08:27:32,551   creating build/lib/lm_eval/tasks/include/few_shot_en/Malay
2025-08-31T08:27:32,552   copying lm_eval/tasks/include/few_shot_en/Malay/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Malay
2025-08-31T08:27:32,554   creating build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian
2025-08-31T08:27:32,555   copying lm_eval/tasks/include/few_shot_en/Ukrainian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian
2025-08-31T08:27:32,558   creating build/lib/lm_eval/tasks/include/few_shot_en/Arabic
2025-08-31T08:27:32,559   copying lm_eval/tasks/include/few_shot_en/Arabic/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic
2025-08-31T08:27:32,561   creating build/lib/lm_eval/tasks/include/few_shot_en/Malayalam
2025-08-31T08:27:32,562   copying lm_eval/tasks/include/few_shot_en/Malayalam/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam
2025-08-31T08:27:32,565   creating build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:32,566   copying lm_eval/tasks/bbh/zeroshot/utils.py -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:32,569   creating build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:32,570   copying lm_eval/tasks/bbh/cot_zeroshot/utils.py -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:32,575   creating build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:32,576   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/utils.py -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:32,581   creating build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:32,582   copying lm_eval/tasks/mmlu/flan_n_shot/generative/utils.py -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:32,585   creating build/lib/lm_eval/tasks/gpqa/zeroshot
2025-08-31T08:27:32,587   copying lm_eval/tasks/gpqa/zeroshot/utils.py -> build/lib/lm_eval/tasks/gpqa/zeroshot
2025-08-31T08:27:32,589   copying lm_eval/tasks/gpqa/zeroshot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/zeroshot
2025-08-31T08:27:32,591   creating build/lib/lm_eval/tasks/gpqa/generative
2025-08-31T08:27:32,592   copying lm_eval/tasks/gpqa/generative/utils.py -> build/lib/lm_eval/tasks/gpqa/generative
2025-08-31T08:27:32,594   copying lm_eval/tasks/gpqa/generative/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/generative
2025-08-31T08:27:32,597   creating build/lib/lm_eval/tasks/gpqa/cot_zeroshot
2025-08-31T08:27:32,597   copying lm_eval/tasks/gpqa/cot_zeroshot/utils.py -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot
2025-08-31T08:27:32,600   copying lm_eval/tasks/gpqa/cot_zeroshot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot
2025-08-31T08:27:32,602   creating build/lib/lm_eval/tasks/gpqa/cot_n_shot
2025-08-31T08:27:32,603   copying lm_eval/tasks/gpqa/cot_n_shot/utils.py -> build/lib/lm_eval/tasks/gpqa/cot_n_shot
2025-08-31T08:27:32,605   copying lm_eval/tasks/gpqa/cot_n_shot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/cot_n_shot
2025-08-31T08:27:32,607   creating build/lib/lm_eval/tasks/gpqa/n_shot
2025-08-31T08:27:32,608   copying lm_eval/tasks/gpqa/n_shot/utils.py -> build/lib/lm_eval/tasks/gpqa/n_shot
2025-08-31T08:27:32,610   copying lm_eval/tasks/gpqa/n_shot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/n_shot
2025-08-31T08:27:32,613   creating build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:32,614   copying lm_eval/tasks/tmlu/default/utils.py -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:32,616   copying lm_eval/tasks/tmlu/default/_generate_configs.py -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:32,620   creating build/lib/lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:27:32,621   copying lm_eval/tasks/basque_bench/flores_eu/create_yamls_flores_eu.py -> build/lib/lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:27:32,625   creating build/lib/lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:27:32,626   copying lm_eval/tasks/galician_bench/flores_gl/create_yamls_flores_gl.py -> build/lib/lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:27:32,630   creating build/lib/lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:27:32,631   copying lm_eval/tasks/catalan_bench/flores_ca/create_yamls_flores_ca.py -> build/lib/lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:27:32,634   creating build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:32,636   copying lm_eval/tasks/okapi/mmlu_multilingual/_generate_configs.py -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:32,638   creating build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:32,639   copying lm_eval/tasks/okapi/arc_multilingual/utils.py -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:32,642   creating build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:32,643   copying lm_eval/tasks/okapi/hellaswag_multilingual/utils.py -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:32,645   creating build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:32,647   copying lm_eval/tasks/okapi/truthfulqa_multilingual/utils.py -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:32,649   creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge
2025-08-31T08:27:32,651   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge
2025-08-31T08:27:32,654   creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:27:32,655   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:27:32,660   creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen
2025-08-31T08:27:32,661   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen
2025-08-31T08:27:32,663   creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa
2025-08-31T08:27:32,665   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa
2025-08-31T08:27:32,667   creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu
2025-08-31T08:27:32,668   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu
2025-08-31T08:27:32,671   creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq
2025-08-31T08:27:32,672   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq
2025-08-31T08:27:32,674   creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy
2025-08-31T08:27:32,675   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy
2025-08-31T08:27:32,678   creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:32,679   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:32,681   creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq
2025-08-31T08:27:32,682   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq
2025-08-31T08:27:32,685   creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams
2025-08-31T08:27:32,686   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams
2025-08-31T08:27:32,688   creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa
2025-08-31T08:27:32,689   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa
2025-08-31T08:27:32,692   creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race
2025-08-31T08:27:32,693   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race
2025-08-31T08:27:32,695   creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag
2025-08-31T08:27:32,696   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag
2025-08-31T08:27:32,699   creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:32,700   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:32,702   creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa
2025-08-31T08:27:32,703   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa
2025-08-31T08:27:32,706   creating build/lib/lm_eval/tasks/code_x_glue/code-text
2025-08-31T08:27:32,707   copying lm_eval/tasks/code_x_glue/code-text/utils.py -> build/lib/lm_eval/tasks/code_x_glue/code-text
2025-08-31T08:27:32,710   copying lm_eval/tasks/code_x_glue/code-text/bleu.py -> build/lib/lm_eval/tasks/code_x_glue/code-text
2025-08-31T08:27:32,712   creating build/lib/lm_eval/tasks/aradice/openbookqa
2025-08-31T08:27:32,714   copying lm_eval/tasks/aradice/openbookqa/utils.py -> build/lib/lm_eval/tasks/aradice/openbookqa
2025-08-31T08:27:32,716   copying lm_eval/tasks/aradice/openbookqa/metrics.py -> build/lib/lm_eval/tasks/aradice/openbookqa
2025-08-31T08:27:32,718   creating build/lib/lm_eval/tasks/aradice/winogrande
2025-08-31T08:27:32,719   copying lm_eval/tasks/aradice/winogrande/utils.py -> build/lib/lm_eval/tasks/aradice/winogrande
2025-08-31T08:27:32,721   copying lm_eval/tasks/aradice/winogrande/metrics.py -> build/lib/lm_eval/tasks/aradice/winogrande
2025-08-31T08:27:32,723   creating build/lib/lm_eval/tasks/aradice/piqa
2025-08-31T08:27:32,725   copying lm_eval/tasks/aradice/piqa/metrics.py -> build/lib/lm_eval/tasks/aradice/piqa
2025-08-31T08:27:32,727   creating build/lib/lm_eval/tasks/aradice/truthfulqa_mcq
2025-08-31T08:27:32,728   copying lm_eval/tasks/aradice/truthfulqa_mcq/metrics.py -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq
2025-08-31T08:27:32,731   creating build/lib/lm_eval/tasks/aradice/cultural-benchmark
2025-08-31T08:27:32,732   copying lm_eval/tasks/aradice/cultural-benchmark/utils.py -> build/lib/lm_eval/tasks/aradice/cultural-benchmark
2025-08-31T08:27:32,734   copying lm_eval/tasks/aradice/cultural-benchmark/metrics.py -> build/lib/lm_eval/tasks/aradice/cultural-benchmark
2025-08-31T08:27:32,736   creating build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:32,738   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/utils.py -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:32,740   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/metrics.py -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:32,742   creating build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:32,743   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/utils.py -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:32,745   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/metrics.py -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:32,748   creating build/lib/lm_eval/tasks/aradice/boolq/MSA
2025-08-31T08:27:32,749   copying lm_eval/tasks/aradice/boolq/MSA/utils.py -> build/lib/lm_eval/tasks/aradice/boolq/MSA
2025-08-31T08:27:32,751   copying lm_eval/tasks/aradice/boolq/MSA/metrics.py -> build/lib/lm_eval/tasks/aradice/boolq/MSA
2025-08-31T08:27:32,753   creating build/lib/lm_eval/tasks/aradice/boolq/EGY
2025-08-31T08:27:32,754   copying lm_eval/tasks/aradice/boolq/EGY/utils.py -> build/lib/lm_eval/tasks/aradice/boolq/EGY
2025-08-31T08:27:32,756   copying lm_eval/tasks/aradice/boolq/EGY/metrics.py -> build/lib/lm_eval/tasks/aradice/boolq/EGY
2025-08-31T08:27:32,759   creating build/lib/lm_eval/tasks/aradice/boolq/LEV
2025-08-31T08:27:32,759   copying lm_eval/tasks/aradice/boolq/LEV/utils.py -> build/lib/lm_eval/tasks/aradice/boolq/LEV
2025-08-31T08:27:32,761   copying lm_eval/tasks/aradice/boolq/LEV/metrics.py -> build/lib/lm_eval/tasks/aradice/boolq/LEV
2025-08-31T08:27:32,764   creating build/lib/lm_eval/tasks/aradice/boolq/ENG
2025-08-31T08:27:32,765   copying lm_eval/tasks/aradice/boolq/ENG/utils.py -> build/lib/lm_eval/tasks/aradice/boolq/ENG
2025-08-31T08:27:32,767   copying lm_eval/tasks/aradice/boolq/ENG/metrics.py -> build/lib/lm_eval/tasks/aradice/boolq/ENG
2025-08-31T08:27:32,770   creating build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:32,772   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/_generate_configs.py -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:32,775   creating build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:32,777   copying lm_eval/tasks/model_written_evals/persona/_generate_configs.py -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:32,780   creating build/lib/lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:27:32,781   copying lm_eval/tasks/spanish_bench/flores_es/create_yamls_flores_es.py -> build/lib/lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:27:32,785   creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:27:32,787   copying lm_eval/tasks/afrimmlu/translate/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:27:32,789   creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:27:32,790   copying lm_eval/tasks/afrimmlu/translate/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:27:32,793   creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:27:32,794   copying lm_eval/tasks/afrimmlu/translate/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:27:32,797   creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:27:32,798   copying lm_eval/tasks/afrimmlu/translate/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:27:32,801   creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:27:32,802   copying lm_eval/tasks/afrimmlu/translate/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:27:32,804   creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:27:32,806   copying lm_eval/tasks/afrimmlu/direct/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:27:32,811   creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:27:32,812   copying lm_eval/tasks/afrimmlu/direct/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:27:32,815   creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:27:32,816   copying lm_eval/tasks/afrimmlu/direct/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:27:32,818   creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:27:32,819   copying lm_eval/tasks/afrimmlu/direct/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:27:32,822   creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:27:32,823   copying lm_eval/tasks/afrimmlu/direct/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:27:32,825   creating build/lib/lm_eval/tasks/super_glue/record
2025-08-31T08:27:32,827   copying lm_eval/tasks/super_glue/record/util.py -> build/lib/lm_eval/tasks/super_glue/record
2025-08-31T08:27:32,829   copying lm_eval/tasks/super_glue/record/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/record
2025-08-31T08:27:32,832   creating build/lib/lm_eval/tasks/super_glue/cb
2025-08-31T08:27:32,833   copying lm_eval/tasks/super_glue/cb/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/cb
2025-08-31T08:27:32,835   copying lm_eval/tasks/super_glue/cb/aggregate.py -> build/lib/lm_eval/tasks/super_glue/cb
2025-08-31T08:27:32,837   creating build/lib/lm_eval/tasks/super_glue/multirc
2025-08-31T08:27:32,838   copying lm_eval/tasks/super_glue/multirc/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/multirc
2025-08-31T08:27:32,841   creating build/lib/lm_eval/tasks/super_glue/copa
2025-08-31T08:27:32,842   copying lm_eval/tasks/super_glue/copa/utils.py -> build/lib/lm_eval/tasks/super_glue/copa
2025-08-31T08:27:32,845   creating build/lib/lm_eval/tasks/super_glue/wsc
2025-08-31T08:27:32,846   copying lm_eval/tasks/super_glue/wsc/preprocess_wsc.py -> build/lib/lm_eval/tasks/super_glue/wsc
2025-08-31T08:27:32,848   copying lm_eval/tasks/super_glue/wsc/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/wsc
2025-08-31T08:27:32,850   creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light
2025-08-31T08:27:32,852   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light
2025-08-31T08:27:32,854   creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light
2025-08-31T08:27:32,856   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light
2025-08-31T08:27:32,858   creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light
2025-08-31T08:27:32,859   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light
2025-08-31T08:27:32,862   creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light
2025-08-31T08:27:32,863   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light
2025-08-31T08:27:32,865   creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:32,866   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:32,869   creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:27:32,870   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:27:32,872   creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light
2025-08-31T08:27:32,874   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light
2025-08-31T08:27:32,876   creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:32,877   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:32,880   creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light
2025-08-31T08:27:32,881   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light
2025-08-31T08:27:32,883   creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light
2025-08-31T08:27:32,884   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light
2025-08-31T08:27:32,887   creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light
2025-08-31T08:27:32,888   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light
2025-08-31T08:27:32,890   creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light
2025-08-31T08:27:32,891   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light
2025-08-31T08:27:32,894   creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light
2025-08-31T08:27:32,895   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light
2025-08-31T08:27:32,898   creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light
2025-08-31T08:27:32,899   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light
2025-08-31T08:27:32,901   creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light
2025-08-31T08:27:32,902   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light
2025-08-31T08:27:32,905   creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:32,908   copying lm_eval/tasks/llama3/instruct/mmlu_it/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:32,911   creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:32,912   copying lm_eval/tasks/llama3/instruct/mmlu_de/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:32,916   creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:32,917   copying lm_eval/tasks/llama3/instruct/mmlu_fr/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:32,920   creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:32,922   copying lm_eval/tasks/llama3/instruct/mmlu_hi/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:32,924   creating build/lib/lm_eval/tasks/llama3/instruct/arc_challenge
2025-08-31T08:27:32,926   copying lm_eval/tasks/llama3/instruct/arc_challenge/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/arc_challenge
2025-08-31T08:27:32,929   creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:32,929   copying lm_eval/tasks/llama3/instruct/mmlu_th/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:32,932   creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:27:32,933   copying lm_eval/tasks/llama3/instruct/mmlu_pro/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:27:32,936   creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:32,937   copying lm_eval/tasks/llama3/instruct/mmlu_es/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:32,940   creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:32,941   copying lm_eval/tasks/llama3/instruct/mmlu_pt/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:32,945   creating build/lib/lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:27:32,947   copying lm_eval/tasks/acpbench/gen_2shot/acp_utils.py -> build/lib/lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:27:32,951   creating build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:27:32,952   copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_utils.py -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:27:32,957   creating build/lib/lm_eval/tasks/glue/mnli
2025-08-31T08:27:32,959   copying lm_eval/tasks/glue/mnli/utils.py -> build/lib/lm_eval/tasks/glue/mnli
2025-08-31T08:27:32,962   creating build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:32,964   copying lm_eval/tasks/tmmluplus/default/utils.py -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:32,966   copying lm_eval/tasks/tmmluplus/default/_generate_configs.py -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:32,969   creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy
2025-08-31T08:27:32,971   copying lm_eval/tasks/afrobench/uhura-arc-easy/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy
2025-08-31T08:27:32,974   creating build/lib/lm_eval/tasks/afrobench/afriqa
2025-08-31T08:27:32,975   copying lm_eval/tasks/afrobench/afriqa/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa
2025-08-31T08:27:32,978   creating build/lib/lm_eval/tasks/afrobench/mafand
2025-08-31T08:27:32,979   copying lm_eval/tasks/afrobench/mafand/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/mafand
2025-08-31T08:27:32,983   creating build/lib/lm_eval/tasks/afrobench/masakhanews
2025-08-31T08:27:32,984   copying lm_eval/tasks/afrobench/masakhanews/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews
2025-08-31T08:27:32,987   creating build/lib/lm_eval/tasks/afrobench/flores
2025-08-31T08:27:32,988   copying lm_eval/tasks/afrobench/flores/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/flores
2025-08-31T08:27:32,991   creating build/lib/lm_eval/tasks/afrobench/adr
2025-08-31T08:27:32,991   copying lm_eval/tasks/afrobench/adr/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/adr
2025-08-31T08:27:32,994   creating build/lib/lm_eval/tasks/afrobench/salt
2025-08-31T08:27:32,995   copying lm_eval/tasks/afrobench/salt/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/salt
2025-08-31T08:27:32,998   creating build/lib/lm_eval/tasks/afrobench/belebele
2025-08-31T08:27:32,999   copying lm_eval/tasks/afrobench/belebele/utils.py -> build/lib/lm_eval/tasks/afrobench/belebele
2025-08-31T08:27:33,002   creating build/lib/lm_eval/tasks/afrobench/sib
2025-08-31T08:27:33,003   copying lm_eval/tasks/afrobench/sib/utils.py -> build/lib/lm_eval/tasks/afrobench/sib
2025-08-31T08:27:33,007   creating build/lib/lm_eval/tasks/afrobench/openai_mmlu
2025-08-31T08:27:33,008   copying lm_eval/tasks/afrobench/openai_mmlu/utils.py -> build/lib/lm_eval/tasks/afrobench/openai_mmlu
2025-08-31T08:27:33,010   creating build/lib/lm_eval/tasks/afrobench/masakhaner
2025-08-31T08:27:33,011   copying lm_eval/tasks/afrobench/masakhaner/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner
2025-08-31T08:27:33,014   creating build/lib/lm_eval/tasks/afrobench/naijarc
2025-08-31T08:27:33,016   copying lm_eval/tasks/afrobench/naijarc/utils.py -> build/lib/lm_eval/tasks/afrobench/naijarc
2025-08-31T08:27:33,018   creating build/lib/lm_eval/tasks/afrobench/ntrex
2025-08-31T08:27:33,019   copying lm_eval/tasks/afrobench/ntrex/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/ntrex
2025-08-31T08:27:33,022   creating build/lib/lm_eval/tasks/afrobench/masakhapos
2025-08-31T08:27:33,023   copying lm_eval/tasks/afrobench/masakhapos/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos
2025-08-31T08:27:33,025   copying lm_eval/tasks/afrobench/masakhapos/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos
2025-08-31T08:27:33,028   creating build/lib/lm_eval/tasks/afrobench/xlsum
2025-08-31T08:27:33,029   copying lm_eval/tasks/afrobench/xlsum/utils.py -> build/lib/lm_eval/tasks/afrobench/xlsum
2025-08-31T08:27:33,031   creating build/lib/lm_eval/tasks/afrobench/afrisenti
2025-08-31T08:27:33,032   copying lm_eval/tasks/afrobench/afrisenti/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti
2025-08-31T08:27:33,035   creating build/lib/lm_eval/tasks/afrobench/injongointent
2025-08-31T08:27:33,036   copying lm_eval/tasks/afrobench/injongointent/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent
2025-08-31T08:27:33,039   creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4
2025-08-31T08:27:33,040   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4
2025-08-31T08:27:33,043   creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2
2025-08-31T08:27:33,043   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2
2025-08-31T08:27:33,046   creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5
2025-08-31T08:27:33,047   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5
2025-08-31T08:27:33,050   creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1
2025-08-31T08:27:33,051   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1
2025-08-31T08:27:33,054   creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3
2025-08-31T08:27:33,055   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3
2025-08-31T08:27:33,057   creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:27:33,058   copying lm_eval/tasks/afrobench/afriqa/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:27:33,061   creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:27:33,062   copying lm_eval/tasks/afrobench/afriqa/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:27:33,065   creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:27:33,066   copying lm_eval/tasks/afrobench/afriqa/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:27:33,069   creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:27:33,070   copying lm_eval/tasks/afrobench/afriqa/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:27:33,072   creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:27:33,073   copying lm_eval/tasks/afrobench/afriqa/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:27:33,077   creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:33,078   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:33,082   creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:33,083   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:33,086   creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:33,087   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:33,090   creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:33,091   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:33,095   creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:33,096   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:33,099   creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:33,100   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:33,103   creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:27:33,104   copying lm_eval/tasks/afrobench/masakhanews/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:27:33,106   creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:27:33,107   copying lm_eval/tasks/afrobench/masakhanews/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:27:33,110   creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:27:33,111   copying lm_eval/tasks/afrobench/masakhanews/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:27:33,113   creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:27:33,114   copying lm_eval/tasks/afrobench/masakhanews/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:27:33,117   creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:27:33,118   copying lm_eval/tasks/afrobench/masakhanews/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:27:33,131   creating build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:33,132   copying lm_eval/tasks/afrobench/sib/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:33,135   creating build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:33,137   copying lm_eval/tasks/afrobench/sib/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:33,139   creating build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:33,140   copying lm_eval/tasks/afrobench/sib/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:33,142   creating build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:33,144   copying lm_eval/tasks/afrobench/sib/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:33,147   creating build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:33,148   copying lm_eval/tasks/afrobench/sib/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:33,152   creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:27:33,153   copying lm_eval/tasks/afrobench/masakhaner/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:27:33,156   creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:27:33,158   copying lm_eval/tasks/afrobench/masakhaner/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:27:33,161   creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:27:33,162   copying lm_eval/tasks/afrobench/masakhaner/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:27:33,165   creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:27:33,166   copying lm_eval/tasks/afrobench/masakhaner/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:27:33,168   creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:27:33,169   copying lm_eval/tasks/afrobench/masakhaner/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:27:33,178   creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:27:33,179   copying lm_eval/tasks/afrobench/masakhapos/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:27:33,181   creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:27:33,182   copying lm_eval/tasks/afrobench/masakhapos/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:27:33,185   creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:27:33,186   copying lm_eval/tasks/afrobench/masakhapos/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:27:33,188   creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:27:33,189   copying lm_eval/tasks/afrobench/masakhapos/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:27:33,191   creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:27:33,193   copying lm_eval/tasks/afrobench/masakhapos/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:27:33,195   creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4
2025-08-31T08:27:33,196   copying lm_eval/tasks/afrobench/nollysenti/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4
2025-08-31T08:27:33,199   creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2
2025-08-31T08:27:33,200   copying lm_eval/tasks/afrobench/nollysenti/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2
2025-08-31T08:27:33,202   creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5
2025-08-31T08:27:33,203   copying lm_eval/tasks/afrobench/nollysenti/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5
2025-08-31T08:27:33,206   creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1
2025-08-31T08:27:33,207   copying lm_eval/tasks/afrobench/nollysenti/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1
2025-08-31T08:27:33,209   creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3
2025-08-31T08:27:33,211   copying lm_eval/tasks/afrobench/nollysenti/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3
2025-08-31T08:27:33,213   creating build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:27:33,214   copying lm_eval/tasks/afrobench/xlsum/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:27:33,216   creating build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:27:33,217   copying lm_eval/tasks/afrobench/xlsum/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:27:33,220   creating build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:27:33,221   copying lm_eval/tasks/afrobench/xlsum/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:27:33,223   creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:27:33,224   copying lm_eval/tasks/afrobench/afrisenti/prompt_4/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:27:33,226   copying lm_eval/tasks/afrobench/afrisenti/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:27:33,228   creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:27:33,229   copying lm_eval/tasks/afrobench/afrisenti/prompt_2/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:27:33,231   copying lm_eval/tasks/afrobench/afrisenti/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:27:33,233   creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:27:33,235   copying lm_eval/tasks/afrobench/afrisenti/prompt_5/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:27:33,237   copying lm_eval/tasks/afrobench/afrisenti/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:27:33,239   creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:27:33,240   copying lm_eval/tasks/afrobench/afrisenti/prompt_1/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:27:33,242   copying lm_eval/tasks/afrobench/afrisenti/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:27:33,245   creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:27:33,246   copying lm_eval/tasks/afrobench/afrisenti/prompt_3/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:27:33,248   copying lm_eval/tasks/afrobench/afrisenti/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:27:33,251   creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:27:33,252   copying lm_eval/tasks/afrobench/injongointent/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:27:33,254   creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:27:33,255   copying lm_eval/tasks/afrobench/injongointent/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:27:33,257   creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:27:33,259   copying lm_eval/tasks/afrobench/injongointent/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:27:33,261   creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:27:33,262   copying lm_eval/tasks/afrobench/injongointent/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:27:33,265   creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:27:33,266   copying lm_eval/tasks/afrobench/injongointent/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:27:33,268   creating build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:33,269   copying lm_eval/tasks/score/agi_eval/utils_agieval.py -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:33,272   creating build/lib/lm_eval/tasks/score/mmlu_pro
2025-08-31T08:27:33,273   copying lm_eval/tasks/score/mmlu_pro/utils_mmlu_pro.py -> build/lib/lm_eval/tasks/score/mmlu_pro
2025-08-31T08:27:33,276   creating build/lib/lm_eval/tasks/score/math
2025-08-31T08:27:33,277   copying lm_eval/tasks/score/math/utils_math.py -> build/lib/lm_eval/tasks/score/math
2025-08-31T08:27:33,280   copying lm_eval/tasks/score/math/math_grader.py -> build/lib/lm_eval/tasks/score/math
2025-08-31T08:27:33,290   creating build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:33,293   copying lm_eval/tasks/global_mmlu/full/sr/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:33,295   creating build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:33,297   copying lm_eval/tasks/global_mmlu/full/bn/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:33,300   creating build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:33,301   copying lm_eval/tasks/global_mmlu/full/hi/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:33,304   creating build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:33,305   copying lm_eval/tasks/global_mmlu/full/fr/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:33,308   creating build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:33,309   copying lm_eval/tasks/global_mmlu/full/he/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:33,312   creating build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:33,313   copying lm_eval/tasks/global_mmlu/full/en/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:33,316   creating build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:33,317   copying lm_eval/tasks/global_mmlu/full/uk/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:33,320   creating build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:33,322   copying lm_eval/tasks/global_mmlu/full/sn/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:33,324   creating build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:33,325   copying lm_eval/tasks/global_mmlu/full/si/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:33,328   creating build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:33,329   copying lm_eval/tasks/global_mmlu/full/vi/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:33,332   creating build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:33,333   copying lm_eval/tasks/global_mmlu/full/ar/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:33,335   creating build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:33,336   copying lm_eval/tasks/global_mmlu/full/nl/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:33,339   creating build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:33,340   copying lm_eval/tasks/global_mmlu/full/yo/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:33,343   creating build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:27:33,344   copying lm_eval/tasks/global_mmlu/full/ig/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:27:33,347   creating build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:27:33,348   copying lm_eval/tasks/global_mmlu/full/fil/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:27:33,351   creating build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:27:33,352   copying lm_eval/tasks/global_mmlu/full/cs/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:27:33,355   creating build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:27:33,356   copying lm_eval/tasks/global_mmlu/full/es/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:27:33,359   creating build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:27:33,360   copying lm_eval/tasks/global_mmlu/full/lt/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:27:33,363   creating build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:27:33,364   copying lm_eval/tasks/global_mmlu/full/am/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:27:33,367   creating build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:27:33,368   copying lm_eval/tasks/global_mmlu/full/sw/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:27:33,371   creating build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:27:33,372   copying lm_eval/tasks/global_mmlu/full/fa/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:27:33,375   creating build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:27:33,376   copying lm_eval/tasks/global_mmlu/full/ja/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:27:33,379   creating build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:27:33,380   copying lm_eval/tasks/global_mmlu/full/ko/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:27:33,383   creating build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:27:33,384   copying lm_eval/tasks/global_mmlu/full/pl/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:27:33,387   creating build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:27:33,388   copying lm_eval/tasks/global_mmlu/full/ne/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:27:33,391   creating build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:27:33,392   copying lm_eval/tasks/global_mmlu/full/pt/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:27:33,394   creating build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:27:33,396   copying lm_eval/tasks/global_mmlu/full/ny/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:27:33,398   creating build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:27:33,399   copying lm_eval/tasks/global_mmlu/full/tr/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:27:33,402   creating build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:27:33,402   copying lm_eval/tasks/global_mmlu/full/te/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:27:33,406   creating build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:27:33,407   copying lm_eval/tasks/global_mmlu/full/ky/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:27:33,409   creating build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:27:33,411   copying lm_eval/tasks/global_mmlu/full/ms/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:27:33,414   creating build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:27:33,415   copying lm_eval/tasks/global_mmlu/full/mg/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:27:33,418   creating build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:27:33,419   copying lm_eval/tasks/global_mmlu/full/el/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:27:33,422   creating build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:27:33,423   copying lm_eval/tasks/global_mmlu/full/sv/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:27:33,426   creating build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:27:33,427   copying lm_eval/tasks/global_mmlu/full/so/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:27:33,430   creating build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:27:33,431   copying lm_eval/tasks/global_mmlu/full/id/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:27:33,434   creating build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:27:33,435   copying lm_eval/tasks/global_mmlu/full/it/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:27:33,437   creating build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:27:33,438   copying lm_eval/tasks/global_mmlu/full/ru/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:27:33,441   creating build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:27:33,442   copying lm_eval/tasks/global_mmlu/full/ro/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:27:33,445   creating build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:27:33,446   copying lm_eval/tasks/global_mmlu/full/de/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:27:33,449   creating build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:27:33,450   copying lm_eval/tasks/global_mmlu/full/zh/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:27:33,452   creating build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:27:33,453   copying lm_eval/tasks/global_mmlu/full/ha/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:27:33,456   creating build/lib/lm_eval/tasks/global_mmlu/default/bn
2025-08-31T08:27:33,457   copying lm_eval/tasks/global_mmlu/default/bn/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/bn
2025-08-31T08:27:33,461   creating build/lib/lm_eval/tasks/global_mmlu/default/hi
2025-08-31T08:27:33,462   copying lm_eval/tasks/global_mmlu/default/hi/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/hi
2025-08-31T08:27:33,465   creating build/lib/lm_eval/tasks/global_mmlu/default/fr
2025-08-31T08:27:33,466   copying lm_eval/tasks/global_mmlu/default/fr/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/fr
2025-08-31T08:27:33,469   creating build/lib/lm_eval/tasks/global_mmlu/default/en
2025-08-31T08:27:33,470   copying lm_eval/tasks/global_mmlu/default/en/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/en
2025-08-31T08:27:33,472   creating build/lib/lm_eval/tasks/global_mmlu/default/ar
2025-08-31T08:27:33,473   copying lm_eval/tasks/global_mmlu/default/ar/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/ar
2025-08-31T08:27:33,475   creating build/lib/lm_eval/tasks/global_mmlu/default/yo
2025-08-31T08:27:33,476   copying lm_eval/tasks/global_mmlu/default/yo/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/yo
2025-08-31T08:27:33,478   creating build/lib/lm_eval/tasks/global_mmlu/default/es
2025-08-31T08:27:33,479   copying lm_eval/tasks/global_mmlu/default/es/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/es
2025-08-31T08:27:33,482   creating build/lib/lm_eval/tasks/global_mmlu/default/sw
2025-08-31T08:27:33,483   copying lm_eval/tasks/global_mmlu/default/sw/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/sw
2025-08-31T08:27:33,485   creating build/lib/lm_eval/tasks/global_mmlu/default/ja
2025-08-31T08:27:33,486   copying lm_eval/tasks/global_mmlu/default/ja/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/ja
2025-08-31T08:27:33,488   creating build/lib/lm_eval/tasks/global_mmlu/default/ko
2025-08-31T08:27:33,489   copying lm_eval/tasks/global_mmlu/default/ko/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/ko
2025-08-31T08:27:33,491   creating build/lib/lm_eval/tasks/global_mmlu/default/pt
2025-08-31T08:27:33,492   copying lm_eval/tasks/global_mmlu/default/pt/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/pt
2025-08-31T08:27:33,495   creating build/lib/lm_eval/tasks/global_mmlu/default/id
2025-08-31T08:27:33,496   copying lm_eval/tasks/global_mmlu/default/id/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/id
2025-08-31T08:27:33,498   creating build/lib/lm_eval/tasks/global_mmlu/default/it
2025-08-31T08:27:33,499   copying lm_eval/tasks/global_mmlu/default/it/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/it
2025-08-31T08:27:33,502   creating build/lib/lm_eval/tasks/global_mmlu/default/de
2025-08-31T08:27:33,503   copying lm_eval/tasks/global_mmlu/default/de/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/de
2025-08-31T08:27:33,505   creating build/lib/lm_eval/tasks/global_mmlu/default/zh
2025-08-31T08:27:33,506   copying lm_eval/tasks/global_mmlu/default/zh/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/zh
2025-08-31T08:27:33,509   creating build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:27:33,510   copying lm_eval/tasks/mmlusr/answer_only/utils.py -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:27:33,512   creating build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:27:33,514   copying lm_eval/tasks/mmlusr/question_and_answer/utils.py -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:27:33,516   creating build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:27:33,517   copying lm_eval/tasks/mmlusr/question_only/utils.py -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:27:33,521   creating build/lib/lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:27:33,523   copying lm_eval/tasks/afrixnli/anli prompt/translate/utils.py -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:27:33,525   creating build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:27:33,526   copying lm_eval/tasks/afrixnli/anli prompt/native-direct/utils.py -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:27:33,529   creating build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:27:33,530   copying lm_eval/tasks/afrixnli/anli prompt/en-direct/utils.py -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:27:33,532   creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:27:33,534   copying lm_eval/tasks/afrixnli/translate/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:27:33,537   creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:27:33,538   copying lm_eval/tasks/afrixnli/translate/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:27:33,540   creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:27:33,541   copying lm_eval/tasks/afrixnli/translate/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:27:33,543   creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:27:33,544   copying lm_eval/tasks/afrixnli/translate/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:27:33,547   creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:27:33,548   copying lm_eval/tasks/afrixnli/translate/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:27:33,550   creating build/lib/lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:27:33,552   copying lm_eval/tasks/afrixnli/lai prompt/translate/utils.py -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:27:33,554   creating build/lib/lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:27:33,555   copying lm_eval/tasks/afrixnli/lai prompt/direct/utils.py -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:27:33,557   creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:27:33,559   copying lm_eval/tasks/afrixnli/direct/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:27:33,561   creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:27:33,562   copying lm_eval/tasks/afrixnli/direct/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:27:33,564   creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:27:33,566   copying lm_eval/tasks/afrixnli/direct/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:27:33,568   creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:27:33,569   copying lm_eval/tasks/afrixnli/direct/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:27:33,571   creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:27:33,572   copying lm_eval/tasks/afrixnli/direct/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:27:33,575   creating build/lib/lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:27:33,576   copying lm_eval/tasks/mmlu_prox/bn/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:27:33,578   creating build/lib/lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:27:33,579   copying lm_eval/tasks/mmlu_prox/hi/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:27:33,582   creating build/lib/lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:27:33,583   copying lm_eval/tasks/mmlu_prox/fr/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:27:33,586   creating build/lib/lm_eval/tasks/mmlu_prox/en
2025-08-31T08:27:33,587   copying lm_eval/tasks/mmlu_prox/en/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/en
2025-08-31T08:27:33,589   creating build/lib/lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:27:33,590   copying lm_eval/tasks/mmlu_prox/ar/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:27:33,593   creating build/lib/lm_eval/tasks/mmlu_prox/es
2025-08-31T08:27:33,594   copying lm_eval/tasks/mmlu_prox/es/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/es
2025-08-31T08:27:33,597   creating build/lib/lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:27:33,598   copying lm_eval/tasks/mmlu_prox/sw/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:27:33,601   creating build/lib/lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:27:33,602   copying lm_eval/tasks/mmlu_prox/ja/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:27:33,604   creating build/lib/lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:27:33,605   copying lm_eval/tasks/mmlu_prox/ko/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:27:33,608   creating build/lib/lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:27:33,609   copying lm_eval/tasks/mmlu_prox/pt/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:27:33,611   creating build/lib/lm_eval/tasks/mmlu_prox/th
2025-08-31T08:27:33,612   copying lm_eval/tasks/mmlu_prox/th/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/th
2025-08-31T08:27:33,615   creating build/lib/lm_eval/tasks/mmlu_prox/template
2025-08-31T08:27:33,616   copying lm_eval/tasks/mmlu_prox/template/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/template
2025-08-31T08:27:33,618   creating build/lib/lm_eval/tasks/mmlu_prox/de
2025-08-31T08:27:33,619   copying lm_eval/tasks/mmlu_prox/de/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/de
2025-08-31T08:27:33,622   creating build/lib/lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:27:33,623   copying lm_eval/tasks/mmlu_prox/zh/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:27:33,625   creating build/lib/lm_eval/tasks/leaderboard/gpqa
2025-08-31T08:27:33,627   copying lm_eval/tasks/leaderboard/gpqa/utils.py -> build/lib/lm_eval/tasks/leaderboard/gpqa
2025-08-31T08:27:33,629   creating build/lib/lm_eval/tasks/leaderboard/musr
2025-08-31T08:27:33,630   copying lm_eval/tasks/leaderboard/musr/utils.py -> build/lib/lm_eval/tasks/leaderboard/musr
2025-08-31T08:27:33,632   creating build/lib/lm_eval/tasks/leaderboard/ifeval
2025-08-31T08:27:33,633   copying lm_eval/tasks/leaderboard/ifeval/instructions.py -> build/lib/lm_eval/tasks/leaderboard/ifeval
2025-08-31T08:27:33,636   copying lm_eval/tasks/leaderboard/ifeval/utils.py -> build/lib/lm_eval/tasks/leaderboard/ifeval
2025-08-31T08:27:33,639   copying lm_eval/tasks/leaderboard/ifeval/instructions_util.py -> build/lib/lm_eval/tasks/leaderboard/ifeval
2025-08-31T08:27:33,641   copying lm_eval/tasks/leaderboard/ifeval/instructions_registry.py -> build/lib/lm_eval/tasks/leaderboard/ifeval
2025-08-31T08:27:33,644   creating build/lib/lm_eval/tasks/leaderboard/mmlu_pro
2025-08-31T08:27:33,645   copying lm_eval/tasks/leaderboard/mmlu_pro/utils.py -> build/lib/lm_eval/tasks/leaderboard/mmlu_pro
2025-08-31T08:27:33,647   creating build/lib/lm_eval/tasks/leaderboard/math
2025-08-31T08:27:33,648   copying lm_eval/tasks/leaderboard/math/utils.py -> build/lib/lm_eval/tasks/leaderboard/math
2025-08-31T08:27:33,651   creating build/lib/lm_eval/tasks/hrm8k/en
2025-08-31T08:27:33,653   copying lm_eval/tasks/hrm8k/en/utils.py -> build/lib/lm_eval/tasks/hrm8k/en
2025-08-31T08:27:33,656   creating build/lib/lm_eval/tasks/hrm8k/default
2025-08-31T08:27:33,657   copying lm_eval/tasks/hrm8k/default/utils.py -> build/lib/lm_eval/tasks/hrm8k/default
2025-08-31T08:27:33,660   creating build/lib/lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:27:33,661   copying lm_eval/tasks/portuguese_bench/flores_pt/create_yamls_flores_pt.py -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:27:33,664   creating build/lib/lm_eval/tasks/noreval/norquad
2025-08-31T08:27:33,666   copying lm_eval/tasks/noreval/norquad/utils.py -> build/lib/lm_eval/tasks/noreval/norquad
2025-08-31T08:27:33,670   creating build/lib/lm_eval/tasks/noreval/norec
2025-08-31T08:27:33,671   copying lm_eval/tasks/noreval/norec/utils.py -> build/lib/lm_eval/tasks/noreval/norec
2025-08-31T08:27:33,674   creating build/lib/lm_eval/tasks/noreval/noridiom
2025-08-31T08:27:33,675   copying lm_eval/tasks/noreval/noridiom/utils.py -> build/lib/lm_eval/tasks/noreval/noridiom
2025-08-31T08:27:33,677   creating build/lib/lm_eval/tasks/noreval/ask_gec
2025-08-31T08:27:33,678   copying lm_eval/tasks/noreval/ask_gec/errant.py -> build/lib/lm_eval/tasks/noreval/ask_gec
2025-08-31T08:27:33,682   creating build/lib/lm_eval/tasks/noreval/norsumm
2025-08-31T08:27:33,684   copying lm_eval/tasks/noreval/norsumm/utils.py -> build/lib/lm_eval/tasks/noreval/norsumm
2025-08-31T08:27:33,686   creating build/lib/lm_eval/tasks/noreval/noropenbookqa
2025-08-31T08:27:33,687   copying lm_eval/tasks/noreval/noropenbookqa/utils.py -> build/lib/lm_eval/tasks/noreval/noropenbookqa
2025-08-31T08:27:33,694   creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation
2025-08-31T08:27:33,696   copying lm_eval/tasks/noreval/nortruthfulqa/generation/utils.py -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation
2025-08-31T08:27:33,698   creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno
2025-08-31T08:27:33,700   copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/utils.py -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno
2025-08-31T08:27:33,702   creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob
2025-08-31T08:27:33,703   copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/utils.py -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob
2025-08-31T08:27:33,706   creating build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno
2025-08-31T08:27:33,708   copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/utils.py -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno
2025-08-31T08:27:33,710   creating build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob
2025-08-31T08:27:33,711   copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/utils.py -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob
2025-08-31T08:27:33,722   running egg_info
2025-08-31T08:27:33,734   writing lm_eval.egg-info/PKG-INFO
2025-08-31T08:27:33,764   writing dependency_links to lm_eval.egg-info/dependency_links.txt
2025-08-31T08:27:33,766   writing entry points to lm_eval.egg-info/entry_points.txt
2025-08-31T08:27:33,782   writing requirements to lm_eval.egg-info/requires.txt
2025-08-31T08:27:33,783   writing top-level names to lm_eval.egg-info/top_level.txt
2025-08-31T08:27:36,394   reading manifest file 'lm_eval.egg-info/SOURCES.txt'
2025-08-31T08:27:37,042   reading manifest template 'MANIFEST.in'
2025-08-31T08:27:37,042   warning: manifest_maker: MANIFEST.in, line 1: 'recursive-include' expects <dir> <pattern1> <pattern2> ...

2025-08-31T08:27:37,043   adding license file 'LICENSE.md'
2025-08-31T08:27:38,191   writing manifest file 'lm_eval.egg-info/SOURCES.txt'
2025-08-31T08:27:42,125   copying lm_eval/tasks/lingoly/lingoly_context.yaml -> build/lib/lm_eval/tasks/lingoly
2025-08-31T08:27:42,127   copying lm_eval/tasks/lingoly/lingoly_nocontext.yaml -> build/lib/lm_eval/tasks/lingoly
2025-08-31T08:27:42,129   copying lm_eval/tasks/lingoly/lingoly_group.yaml -> build/lib/lm_eval/tasks/lingoly
2025-08-31T08:27:42,131   copying lm_eval/tasks/drop/default.yaml -> build/lib/lm_eval/tasks/drop
2025-08-31T08:27:42,133   copying lm_eval/tasks/wikitext/wikitext.yaml -> build/lib/lm_eval/tasks/wikitext
2025-08-31T08:27:42,136   copying lm_eval/tasks/darija_bench/darija_summarization/summarization_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_summarization
2025-08-31T08:27:42,138   copying lm_eval/tasks/darija_bench/darija_summarization/summarization.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_summarization
2025-08-31T08:27:42,140   copying lm_eval/tasks/darija_bench/darija_translation/seed_translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,142   copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_fr_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,144   copying lm_eval/tasks/darija_bench/darija_translation/seed_translation_dr_en.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,147   copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_en.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,149   copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,151   copying lm_eval/tasks/darija_bench/darija_translation/seed_translation_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,153   copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,155   copying lm_eval/tasks/darija_bench/darija_translation/madar_translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,157   copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_msa.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,159   copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_fr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,162   copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_msa.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,164   copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_fr_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,166   copying lm_eval/tasks/darija_bench/darija_translation/madar_translation_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,168   copying lm_eval/tasks/darija_bench/darija_translation/seed_translation_en_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,170   copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_fr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,172   copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_en_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,174   copying lm_eval/tasks/darija_bench/darija_translation/madar_translation_msa_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,176   copying lm_eval/tasks/darija_bench/darija_translation/madar_translation_dr_msa.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,178   copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_msa_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,181   copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,183   copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_msa_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,185   copying lm_eval/tasks/darija_bench/darija_translation/translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,187   copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_en.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,189   copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,191   copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_en_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:27:42,193   copying lm_eval/tasks/darija_bench/darija_transliteration/transliteration_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration
2025-08-31T08:27:42,196   copying lm_eval/tasks/darija_bench/darija_transliteration/translation_dr_ar.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration
2025-08-31T08:27:42,198   copying lm_eval/tasks/darija_bench/darija_transliteration/transliteration_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration
2025-08-31T08:27:42,200   copying lm_eval/tasks/darija_bench/darija_transliteration/translation_ar_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration
2025-08-31T08:27:42,202   copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_myc.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment
2025-08-31T08:27:42,204   copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msac.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment
2025-08-31T08:27:42,206   copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_electrom.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment
2025-08-31T08:27:42,208   copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment
2025-08-31T08:27:42,210   copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msda.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment
2025-08-31T08:27:42,212   copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_mac.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment
2025-08-31T08:27:42,214   copying lm_eval/tasks/libra/ru_babilong_qa2.yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:42,216   copying lm_eval/tasks/libra/librusec_history.yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:42,219   copying lm_eval/tasks/libra/ru_quality.yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:42,221   copying lm_eval/tasks/libra/librusec_mhqa.yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:42,223   copying lm_eval/tasks/libra/ru_gsm100.yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:42,225   copying lm_eval/tasks/libra/_multi_hop_question_answering.yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:42,227   copying lm_eval/tasks/libra/ru_babilong_qa4.yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:42,229   copying lm_eval/tasks/libra/ru_sci_abstract_retrieval.yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:42,231   copying lm_eval/tasks/libra/ru_babilong_qa5.yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:42,233   copying lm_eval/tasks/libra/ru_qasper.yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:42,236   copying lm_eval/tasks/libra/long_context_multiq.yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:42,238   copying lm_eval/tasks/libra/_simple_information_retrieval.yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:42,240   copying lm_eval/tasks/libra/_question_answering_and_multiple_choice.yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:42,242   copying lm_eval/tasks/libra/ru_babilong_qa1.yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:42,245   copying lm_eval/tasks/libra/ru_babilong_qa3.yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:42,247   copying lm_eval/tasks/libra/matreshka_names.yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:42,249   copying lm_eval/tasks/libra/ru_2wikimultihopqa.yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:42,251   copying lm_eval/tasks/libra/passkey_with_librusec.yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:42,253   copying lm_eval/tasks/libra/ru_sci_passage_count.yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:42,256   copying lm_eval/tasks/libra/matreshka_yes_no.yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:42,258   copying lm_eval/tasks/libra/passkey.yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:42,260   copying lm_eval/tasks/libra/_complex_reasoning_and_mathematical_problems.yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:27:42,262   creating build/lib/lm_eval/tasks/bertaqa
2025-08-31T08:27:42,263   copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.1.yaml -> build/lib/lm_eval/tasks/bertaqa
2025-08-31T08:27:42,265   copying lm_eval/tasks/bertaqa/bertaqa_en_mt_itzuli.yaml -> build/lib/lm_eval/tasks/bertaqa
2025-08-31T08:27:42,267   copying lm_eval/tasks/bertaqa/bertaqa_eu.yaml -> build/lib/lm_eval/tasks/bertaqa
2025-08-31T08:27:42,270   copying lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-13b.yaml -> build/lib/lm_eval/tasks/bertaqa
2025-08-31T08:27:42,272   copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.yaml -> build/lib/lm_eval/tasks/bertaqa
2025-08-31T08:27:42,274   copying lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-70b.yaml -> build/lib/lm_eval/tasks/bertaqa
2025-08-31T08:27:42,276   copying lm_eval/tasks/bertaqa/bertaqa_en_mt_nllb.yaml -> build/lib/lm_eval/tasks/bertaqa
2025-08-31T08:27:42,279   copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.yaml -> build/lib/lm_eval/tasks/bertaqa
2025-08-31T08:27:42,281   copying lm_eval/tasks/bertaqa/bertaqa_en_mt_gemma-7b.yaml -> build/lib/lm_eval/tasks/bertaqa
2025-08-31T08:27:42,283   copying lm_eval/tasks/bertaqa/bertaqa_en.yaml -> build/lib/lm_eval/tasks/bertaqa
2025-08-31T08:27:42,285   copying lm_eval/tasks/bertaqa/bertaqa_en_mt_hitz.yaml -> build/lib/lm_eval/tasks/bertaqa
2025-08-31T08:27:42,288   copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.1.yaml -> build/lib/lm_eval/tasks/bertaqa
2025-08-31T08:27:42,290   copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.yaml -> build/lib/lm_eval/tasks/bertaqa
2025-08-31T08:27:42,292   copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.1.yaml -> build/lib/lm_eval/tasks/bertaqa
2025-08-31T08:27:42,294   copying lm_eval/tasks/bertaqa/bertaqa_en_mt_madlad.yaml -> build/lib/lm_eval/tasks/bertaqa
2025-08-31T08:27:42,297   copying lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-7b.yaml -> build/lib/lm_eval/tasks/bertaqa
2025-08-31T08:27:42,299   creating build/lib/lm_eval/tasks/anli
2025-08-31T08:27:42,299   copying lm_eval/tasks/anli/anli_r1.yaml -> build/lib/lm_eval/tasks/anli
2025-08-31T08:27:42,301   copying lm_eval/tasks/anli/anli_r3.yaml -> build/lib/lm_eval/tasks/anli
2025-08-31T08:27:42,304   copying lm_eval/tasks/anli/anli_r2.yaml -> build/lib/lm_eval/tasks/anli
2025-08-31T08:27:42,307   copying lm_eval/tasks/agieval/jec-qa-ca.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,309   copying lm_eval/tasks/agieval/gaokao-mathqa.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,311   copying lm_eval/tasks/agieval/gaokao-history.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,313   copying lm_eval/tasks/agieval/math.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,316   copying lm_eval/tasks/agieval/logiqa-zh.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,318   copying lm_eval/tasks/agieval/agieval.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,320   copying lm_eval/tasks/agieval/agieval_en.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,323   copying lm_eval/tasks/agieval/gaokao-biology.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,325   copying lm_eval/tasks/agieval/gaokao-geography.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,327   copying lm_eval/tasks/agieval/sat-en.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,329   copying lm_eval/tasks/agieval/jec-qa-kd.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,331   copying lm_eval/tasks/agieval/gaokao-physics.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,333   copying lm_eval/tasks/agieval/lsat-ar.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,336   copying lm_eval/tasks/agieval/lsat-rc.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,338   copying lm_eval/tasks/agieval/gaokao-english.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,340   copying lm_eval/tasks/agieval/gaokao-chinese.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,342   copying lm_eval/tasks/agieval/agieval_nous.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,344   copying lm_eval/tasks/agieval/aqua-rat.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,346   copying lm_eval/tasks/agieval/gaokao-mathcloze.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,348   copying lm_eval/tasks/agieval/logiqa-en.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,350   copying lm_eval/tasks/agieval/sat-en-without-passage.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,353   copying lm_eval/tasks/agieval/agieval_cn.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,355   copying lm_eval/tasks/agieval/lsat-lr.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,357   copying lm_eval/tasks/agieval/gaokao-chemistry.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,359   copying lm_eval/tasks/agieval/sat-math.yaml -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:27:42,361   creating build/lib/lm_eval/tasks/afrimgsm/translate
2025-08-31T08:27:42,362   copying lm_eval/tasks/afrimgsm/translate/afrimgsm_tt.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate
2025-08-31T08:27:42,364   creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:27:42,365   copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:27:42,367   copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:27:42,369   copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:27:42,371   copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:27:42,374   copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:27:42,376   copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:27:42,378   copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:27:42,380   copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:27:42,382   copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:27:42,384   copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:27:42,386   copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:27:42,388   copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:27:42,390   copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:27:42,392   copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:27:42,394   copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:27:42,397   copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:27:42,399   copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:27:42,401   creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:27:42,402   copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:27:42,404   copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:27:42,406   copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:27:42,408   copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:27:42,411   copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:27:42,413   copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:27:42,415   copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:27:42,417   copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:27:42,419   copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:27:42,421   copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:27:42,424   copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:27:42,426   copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:27:42,428   copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:27:42,430   copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:27:42,432   copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:27:42,434   copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:27:42,436   copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:27:42,438   creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:27:42,439   copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:27:42,442   copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:27:42,444   copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:27:42,446   copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:27:42,448   copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:27:42,450   copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:27:42,452   copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:27:42,454   copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:27:42,456   copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:27:42,458   copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:27:42,460   copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:27:42,463   copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:27:42,465   copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:27:42,467   copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:27:42,469   copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:27:42,471   copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:27:42,473   copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:27:42,475   creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:27:42,476   copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:27:42,478   copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:27:42,481   copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:27:42,483   copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:27:42,485   copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:27:42,487   copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:27:42,489   copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:27:42,491   copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:27:42,494   copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:27:42,496   copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:27:42,498   copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:27:42,500   copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:27:42,502   copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:27:42,504   copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:27:42,507   copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:27:42,509   copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:27:42,511   copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:27:42,513   creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:27:42,514   copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:27:42,517   copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:27:42,519   copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:27:42,521   copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:27:42,523   copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:27:42,526   copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:27:42,528   copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:27:42,530   copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:27:42,532   copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:27:42,534   copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:27:42,536   copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:27:42,538   copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:27:42,541   copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:27:42,543   copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:27:42,545   copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:27:42,547   copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:27:42,549   copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:27:42,551   creating build/lib/lm_eval/tasks/afrimgsm/translate_cot
2025-08-31T08:27:42,552   copying lm_eval/tasks/afrimgsm/translate_cot/afrimgsm_tt_cot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot
2025-08-31T08:27:42,554   creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:27:42,555   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:27:42,558   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:27:42,561   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:27:42,563   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:27:42,565   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:27:42,567   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:27:42,569   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:27:42,572   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:27:42,574   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:27:42,577   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:27:42,579   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:27:42,581   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:27:42,583   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:27:42,585   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:27:42,587   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:27:42,589   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:27:42,591   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:27:42,593   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:27:42,595   creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:27:42,596   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:27:42,598   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:27:42,600   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:27:42,602   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:27:42,604   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:27:42,607   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:27:42,609   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:27:42,611   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:27:42,613   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:27:42,615   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:27:42,618   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:27:42,620   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:27:42,622   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:27:42,624   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:27:42,626   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:27:42,628   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:27:42,630   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:27:42,632   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:27:42,634   creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:27:42,635   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:27:42,637   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:27:42,640   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:27:42,642   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:27:42,644   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:27:42,646   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:27:42,648   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:27:42,650   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:27:42,652   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:27:42,654   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:27:42,657   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:27:42,659   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:27:42,661   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:27:42,664   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:27:42,666   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:27:42,668   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:27:42,670   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:27:42,672   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:27:42,674   creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:27:42,675   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:27:42,678   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:27:42,680   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:27:42,682   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:27:42,684   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:27:42,686   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:27:42,688   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:27:42,690   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:27:42,692   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:27:42,694   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:27:42,696   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:27:42,698   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:27:42,700   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:27:42,702   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:27:42,704   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:27:42,707   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:27:42,709   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:27:42,711   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:27:42,713   creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:27:42,714   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:27:42,716   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:27:42,718   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:27:42,720   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:27:42,722   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:27:42,724   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:27:42,727   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:27:42,729   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:27:42,731   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:27:42,733   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:27:42,735   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:27:42,737   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:27:42,740   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:27:42,742   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:27:42,744   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:27:42,747   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:27:42,749   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:27:42,751   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:27:42,753   creating build/lib/lm_eval/tasks/afrimgsm/direct
2025-08-31T08:27:42,754   copying lm_eval/tasks/afrimgsm/direct/afrimgsm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct
2025-08-31T08:27:42,756   creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:27:42,757   copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:27:42,759   copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:27:42,761   copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:27:42,763   copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:27:42,765   copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:27:42,767   copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:27:42,769   copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:27:42,771   copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:27:42,774   copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:27:42,776   copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:27:42,778   copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:27:42,780   copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:27:42,782   copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:27:42,784   copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:27:42,786   copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:27:42,788   copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:27:42,790   copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:27:42,793   copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:27:42,795   copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:27:42,797   creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:27:42,798   copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:27:42,800   copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:27:42,802   copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:27:42,804   copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:27:42,806   copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:27:42,808   copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:27:42,810   copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:27:42,813   copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:27:42,815   copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:27:42,817   copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:27:42,819   copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:27:42,821   copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:27:42,823   copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:27:42,825   copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:27:42,827   copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:27:42,829   copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:27:42,831   copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:27:42,833   copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:27:42,836   copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:27:42,838   creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:27:42,839   copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:27:42,841   copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:27:42,843   copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:27:42,845   copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:27:42,847   copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:27:42,849   copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:27:42,852   copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:27:42,854   copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:27:42,856   copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:27:42,858   copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:27:42,860   copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:27:42,862   copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:27:42,864   copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:27:42,866   copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:27:42,868   copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:27:42,870   copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:27:42,872   copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:27:42,874   copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:27:42,876   copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:27:42,878   creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:27:42,879   copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:27:42,881   copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:27:42,883   copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:27:42,885   copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:27:42,888   copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:27:42,890   copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:27:42,892   copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:27:42,894   copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:27:42,896   copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:27:42,898   copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:27:42,900   copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:27:42,902   copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:27:42,904   copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:27:42,906   copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:27:42,910   copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:27:42,914   copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:27:42,916   copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:27:42,918   copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:27:42,920   copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:27:42,922   creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:27:42,923   copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:27:42,926   copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:27:42,928   copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:27:42,930   copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:27:42,932   copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:27:42,934   copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:27:42,937   copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:27:42,939   copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:27:42,941   copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:27:42,943   copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:27:42,945   copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:27:42,948   copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:27:42,950   copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:27:42,952   copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:27:42,954   copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:27:42,956   copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:27:42,958   copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:27:42,960   copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:27:42,962   copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:27:42,964   creating build/lib/lm_eval/tasks/afrimgsm/direct_cot
2025-08-31T08:27:42,965   copying lm_eval/tasks/afrimgsm/direct_cot/afrimgsm_cot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot
2025-08-31T08:27:42,967   creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:27:42,968   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:27:42,970   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:27:42,973   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:27:42,975   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:27:42,977   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:27:42,979   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:27:42,981   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:27:42,984   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:27:42,986   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:27:42,988   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:27:42,990   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:27:42,992   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:27:42,994   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:27:42,996   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:27:42,999   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:27:43,001   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:27:43,003   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:27:43,005   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:27:43,007   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:27:43,010   creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:27:43,011   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:27:43,013   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:27:43,015   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:27:43,018   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:27:43,020   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:27:43,022   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:27:43,024   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:27:43,026   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:27:43,028   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:27:43,031   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:27:43,033   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:27:43,035   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:27:43,037   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:27:43,040   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:27:43,043   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:27:43,045   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:27:43,047   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:27:43,049   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:27:43,052   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:27:43,054   creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:27:43,055   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:27:43,057   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:27:43,059   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:27:43,061   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:27:43,063   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:27:43,066   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:27:43,068   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:27:43,070   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:27:43,072   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:27:43,074   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:27:43,077   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:27:43,079   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:27:43,081   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:27:43,083   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:27:43,085   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:27:43,088   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:27:43,090   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:27:43,093   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:27:43,095   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:27:43,097   creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:27:43,098   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:27:43,100   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:27:43,102   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:27:43,104   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:27:43,107   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:27:43,109   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:27:43,111   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:27:43,113   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:27:43,115   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:27:43,117   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:27:43,120   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:27:43,122   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:27:43,124   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:27:43,127   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:27:43,129   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:27:43,131   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:27:43,134   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:27:43,136   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:27:43,138   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:27:43,140   creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:27:43,142   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:27:43,144   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:27:43,147   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:27:43,149   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:27:43,151   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:27:43,154   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:27:43,156   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:27:43,159   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:27:43,161   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:27:43,163   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:27:43,165   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:27:43,168   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:27:43,170   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:27:43,172   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:27:43,174   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:27:43,177   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:27:43,179   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:27:43,181   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:27:43,184   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:27:43,186   copying lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnico.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,189   copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza4c.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,192   copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehubiblioeu.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,194   copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehueconomicaseu.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,197   copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxeu.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,199   copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakivarios.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,201   copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiceladoreu.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,203   copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakitecnicoeu.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,206   copying lm_eval/tasks/eus_exams/eus_exams_es_opeehubiblio.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,211   copying lm_eval/tasks/eus_exams/eus_exams_es_opeehueconomicas.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,213   copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza5e.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,216   copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakiadmin.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,218   copying lm_eval/tasks/eus_exams/eus_exams_eu_ejteknikari.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,220   copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakiaux.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,222   copying lm_eval/tasks/eus_exams/eus_exams_es_ejadministrativo.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,224   copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakitecnico.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,226   copying lm_eval/tasks/eus_exams/eus_exams_es_ejsubalterno.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,228   copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxenfeu.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,231   copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakivarioseu.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,233   copying lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntza.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,236   copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza6c.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,238   copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakiauxenf.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,240   copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza9c.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,243   copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuaux.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,245   copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuderechoeu.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,247   copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza7c.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,250   copying lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntzaile.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,252   copying lm_eval/tasks/eus_exams/eus_exams_es_ejtecnico.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,254   copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakienfeu.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,256   copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza3e.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,259   copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehutecnicoeu.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,261   copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakioperario.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,263   copying lm_eval/tasks/eus_exams/eus_exams_es_opebilbao.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,265   copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza5c.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,268   copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza2e.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,270   copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuempresariales.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,272   copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuempresarialeseu.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,275   copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza6e.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,277   copying lm_eval/tasks/eus_exams/eus_exams_es_opeehusubalterno.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,279   copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza1c.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,282   copying lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnicob.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,284   copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakicelador.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,286   copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuauxeu.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,288   copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakijuridico.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,291   copying lm_eval/tasks/eus_exams/eus_exams_es_ejauxiliar.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,293   copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuderecho.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,296   copying lm_eval/tasks/eus_exams/eus_exams_es_opeayuntamientovitoria.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,298   copying lm_eval/tasks/eus_exams/eus_exams_eu_ejadministrari.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,300   copying lm_eval/tasks/eus_exams/eus_exams_eu_opebilbaoeu.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,302   copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuteknikarib.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,305   copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza3c.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,307   copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuadmineu.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,310   copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza8c.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,312   copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuadmin.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,315   copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza1e.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,317   copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza2c.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,319   copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakienf.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,321   copying lm_eval/tasks/eus_exams/eus_exams_eu_opegasteizkoudala.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,324   copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza7e.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,326   copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehusubalternoeu.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,328   copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakioperarioeu.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,330   copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiadmineu.yaml -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:27:43,332   copying lm_eval/tasks/winogender/winogender_gotcha_male.yaml -> build/lib/lm_eval/tasks/winogender
2025-08-31T08:27:43,335   copying lm_eval/tasks/winogender/winogender_female.yaml -> build/lib/lm_eval/tasks/winogender
2025-08-31T08:27:43,337   copying lm_eval/tasks/winogender/winogender.yaml -> build/lib/lm_eval/tasks/winogender
2025-08-31T08:27:43,339   copying lm_eval/tasks/winogender/winogender_male.yaml -> build/lib/lm_eval/tasks/winogender
2025-08-31T08:27:43,342   copying lm_eval/tasks/winogender/winogender_gotcha_female.yaml -> build/lib/lm_eval/tasks/winogender
2025-08-31T08:27:43,345   copying lm_eval/tasks/winogender/winogender_gotcha.yaml -> build/lib/lm_eval/tasks/winogender
2025-08-31T08:27:43,347   copying lm_eval/tasks/winogender/winogender_neutral.yaml -> build/lib/lm_eval/tasks/winogender
2025-08-31T08:27:43,349   copying lm_eval/tasks/hellaswag/hellaswag.yaml -> build/lib/lm_eval/tasks/hellaswag
2025-08-31T08:27:43,352   copying lm_eval/tasks/ruler/ruler.yaml -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:43,354   copying lm_eval/tasks/ruler/cwe.yaml -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:43,356   copying lm_eval/tasks/ruler/niah_multiquery.yaml -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:43,359   copying lm_eval/tasks/ruler/niah_single_3.yaml -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:43,361   copying lm_eval/tasks/ruler/niah_multikey_1.yaml -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:43,363   copying lm_eval/tasks/ruler/niah_multikey_3.yaml -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:43,365   copying lm_eval/tasks/ruler/niah_multikey_2.yaml -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:43,368   copying lm_eval/tasks/ruler/niah_single_2.yaml -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:43,371   copying lm_eval/tasks/ruler/qa_hotpot.yaml -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:43,375   copying lm_eval/tasks/ruler/niah_single_1.yaml -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:43,377   copying lm_eval/tasks/ruler/vt.yaml -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:43,379   copying lm_eval/tasks/ruler/niah_multivalue.yaml -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:43,381   copying lm_eval/tasks/ruler/qa_squad.yaml -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:43,383   copying lm_eval/tasks/ruler/fwe.yaml -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:27:43,385   creating build/lib/lm_eval/tasks/babi
2025-08-31T08:27:43,386   copying lm_eval/tasks/babi/babi.yaml -> build/lib/lm_eval/tasks/babi
2025-08-31T08:27:43,389   creating build/lib/lm_eval/tasks/pile_10k
2025-08-31T08:27:43,390   copying lm_eval/tasks/pile_10k/pile_10k.yaml -> build/lib/lm_eval/tasks/pile_10k
2025-08-31T08:27:43,392   copying lm_eval/tasks/egyhellaswag/egyhellaswag.yaml -> build/lib/lm_eval/tasks/egyhellaswag
2025-08-31T08:27:43,394   creating build/lib/lm_eval/tasks/openbookqa
2025-08-31T08:27:43,395   copying lm_eval/tasks/openbookqa/openbookqa.yaml -> build/lib/lm_eval/tasks/openbookqa
2025-08-31T08:27:43,398   creating build/lib/lm_eval/tasks/xstorycloze
2025-08-31T08:27:43,399   copying lm_eval/tasks/xstorycloze/default_sw.yaml -> build/lib/lm_eval/tasks/xstorycloze
2025-08-31T08:27:43,401   copying lm_eval/tasks/xstorycloze/default_zh.yaml -> build/lib/lm_eval/tasks/xstorycloze
2025-08-31T08:27:43,404   copying lm_eval/tasks/xstorycloze/default_en.yaml -> build/lib/lm_eval/tasks/xstorycloze
2025-08-31T08:27:43,406   copying lm_eval/tasks/xstorycloze/default_ar.yaml -> build/lib/lm_eval/tasks/xstorycloze
2025-08-31T08:27:43,408   copying lm_eval/tasks/xstorycloze/default_eu.yaml -> build/lib/lm_eval/tasks/xstorycloze
2025-08-31T08:27:43,411   copying lm_eval/tasks/xstorycloze/default_te.yaml -> build/lib/lm_eval/tasks/xstorycloze
2025-08-31T08:27:43,413   copying lm_eval/tasks/xstorycloze/default_id.yaml -> build/lib/lm_eval/tasks/xstorycloze
2025-08-31T08:27:43,415   copying lm_eval/tasks/xstorycloze/default_es.yaml -> build/lib/lm_eval/tasks/xstorycloze
2025-08-31T08:27:43,417   copying lm_eval/tasks/xstorycloze/default_ru.yaml -> build/lib/lm_eval/tasks/xstorycloze
2025-08-31T08:27:43,420   copying lm_eval/tasks/xstorycloze/_xstorycloze.yaml -> build/lib/lm_eval/tasks/xstorycloze
2025-08-31T08:27:43,422   copying lm_eval/tasks/xstorycloze/default_hi.yaml -> build/lib/lm_eval/tasks/xstorycloze
2025-08-31T08:27:43,424   copying lm_eval/tasks/xstorycloze/default_my.yaml -> build/lib/lm_eval/tasks/xstorycloze
2025-08-31T08:27:43,426   copying lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian
2025-08-31T08:27:43,428   copying lm_eval/tasks/include/few_shot_og/North Macedonian/_include_base_44_north macedonian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian
2025-08-31T08:27:43,430   copying lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian
2025-08-31T08:27:43,433   copying lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian
2025-08-31T08:27:43,435   copying lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian
2025-08-31T08:27:43,437   copying lm_eval/tasks/include/few_shot_og/Basque/_include_base_44_basque.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Basque
2025-08-31T08:27:43,439   copying lm_eval/tasks/include/few_shot_og/Basque/include_base_44_basque_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Basque
2025-08-31T08:27:43,441   copying lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali
2025-08-31T08:27:43,444   copying lm_eval/tasks/include/few_shot_og/Nepali/_include_base_44_nepali.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali
2025-08-31T08:27:43,446   copying lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali
2025-08-31T08:27:43,449   copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:27:43,451   copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:27:43,454   copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:27:43,456   copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:27:43,458   copying lm_eval/tasks/include/few_shot_og/Hindi/_include_base_44_hindi.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:27:43,460   copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:27:43,463   copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:27:43,465   copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:27:43,467   copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:27:43,469   copying lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian
2025-08-31T08:27:43,471   copying lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian
2025-08-31T08:27:43,473   copying lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian
2025-08-31T08:27:43,476   copying lm_eval/tasks/include/few_shot_og/Armenian/_include_base_44_armenian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian
2025-08-31T08:27:43,478   copying lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian
2025-08-31T08:27:43,480   copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch
2025-08-31T08:27:43,482   copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch
2025-08-31T08:27:43,484   copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch
2025-08-31T08:27:43,486   copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch
2025-08-31T08:27:43,489   copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch
2025-08-31T08:27:43,491   copying lm_eval/tasks/include/few_shot_og/Dutch/_include_base_44_dutch.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch
2025-08-31T08:27:43,493   copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian
2025-08-31T08:27:43,496   copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian
2025-08-31T08:27:43,498   copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian
2025-08-31T08:27:43,500   copying lm_eval/tasks/include/few_shot_og/Albanian/_include_base_44_albanian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian
2025-08-31T08:27:43,502   copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian
2025-08-31T08:27:43,504   copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian
2025-08-31T08:27:43,506   copying lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian
2025-08-31T08:27:43,509   copying lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian
2025-08-31T08:27:43,511   copying lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian
2025-08-31T08:27:43,513   copying lm_eval/tasks/include/few_shot_og/Serbian/_include_base_44_serbian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian
2025-08-31T08:27:43,515   copying lm_eval/tasks/include/few_shot_og/Russian/_include_base_44_russian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:27:43,517   copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:27:43,519   copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:27:43,521   copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:27:43,524   copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:27:43,526   copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:27:43,528   copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:27:43,530   copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_marine_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:27:43,533   copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:27:43,535   copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish
2025-08-31T08:27:43,537   copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish
2025-08-31T08:27:43,539   copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish
2025-08-31T08:27:43,542   copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish
2025-08-31T08:27:43,544   copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish
2025-08-31T08:27:43,546   copying lm_eval/tasks/include/few_shot_og/Finnish/_include_base_44_finnish.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish
2025-08-31T08:27:43,548   copying lm_eval/tasks/include/few_shot_og/German/include_base_44_german_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German
2025-08-31T08:27:43,551   copying lm_eval/tasks/include/few_shot_og/German/_include_base_44_german.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German
2025-08-31T08:27:43,553   copying lm_eval/tasks/include/few_shot_og/German/include_base_44_german_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German
2025-08-31T08:27:43,555   copying lm_eval/tasks/include/few_shot_og/German/include_base_44_german_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German
2025-08-31T08:27:43,557   copying lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu
2025-08-31T08:27:43,559   copying lm_eval/tasks/include/few_shot_og/Telugu/_include_base_44_telugu.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu
2025-08-31T08:27:43,561   copying lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu
2025-08-31T08:27:43,563   copying lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu
2025-08-31T08:27:43,566   copying lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu
2025-08-31T08:27:43,568   copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani
2025-08-31T08:27:43,570   copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani
2025-08-31T08:27:43,572   copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani
2025-08-31T08:27:43,575   copying lm_eval/tasks/include/few_shot_og/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani
2025-08-31T08:27:43,577   copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani
2025-08-31T08:27:43,579   copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani
2025-08-31T08:27:43,582   copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani
2025-08-31T08:27:43,584   copying lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian
2025-08-31T08:27:43,586   copying lm_eval/tasks/include/few_shot_og/Hungarian/_include_base_44_hungarian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian
2025-08-31T08:27:43,588   copying lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian
2025-08-31T08:27:43,590   copying lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian
2025-08-31T08:27:43,593   copying lm_eval/tasks/include/few_shot_og/Uzbek/_include_base_44_uzbek.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek
2025-08-31T08:27:43,595   copying lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek
2025-08-31T08:27:43,597   copying lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek
2025-08-31T08:27:43,599   copying lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek
2025-08-31T08:27:43,601   copying lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek
2025-08-31T08:27:43,604   copying lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Korean
2025-08-31T08:27:43,606   copying lm_eval/tasks/include/few_shot_og/Korean/_include_base_44_korean.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Korean
2025-08-31T08:27:43,608   copying lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Korean
2025-08-31T08:27:43,610   copying lm_eval/tasks/include/few_shot_og/Hebrew/_include_base_44_hebrew.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew
2025-08-31T08:27:43,613   copying lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew
2025-08-31T08:27:43,616   copying lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew
2025-08-31T08:27:43,618   copying lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian
2025-08-31T08:27:43,621   copying lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian
2025-08-31T08:27:43,624   copying lm_eval/tasks/include/few_shot_og/Belarusian/_include_base_44_belarusian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian
2025-08-31T08:27:43,626   copying lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian
2025-08-31T08:27:43,629   copying lm_eval/tasks/include/few_shot_og/Japanese/_include_base_44_japanese.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese
2025-08-31T08:27:43,631   copying lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese
2025-08-31T08:27:43,634   copying lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese
2025-08-31T08:27:43,637   copying lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese
2025-08-31T08:27:43,640   copying lm_eval/tasks/include/few_shot_og/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Kazakh
2025-08-31T08:27:43,642   copying lm_eval/tasks/include/few_shot_og/Kazakh/_include_base_44_kazakh.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Kazakh
2025-08-31T08:27:43,645   copying lm_eval/tasks/include/few_shot_og/Georgian/_include_base_44_georgian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Georgian
2025-08-31T08:27:43,648   copying lm_eval/tasks/include/few_shot_og/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Georgian
2025-08-31T08:27:43,651   copying lm_eval/tasks/include/few_shot_og/Persian/_include_base_44_persian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian
2025-08-31T08:27:43,653   copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian
2025-08-31T08:27:43,656   copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian
2025-08-31T08:27:43,659   copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian
2025-08-31T08:27:43,662   copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian
2025-08-31T08:27:43,665   copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian
2025-08-31T08:27:43,668   copying lm_eval/tasks/include/few_shot_og/Indonesian/_include_base_44_indonesian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian
2025-08-31T08:27:43,670   copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian
2025-08-31T08:27:43,673   copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian
2025-08-31T08:27:43,676   copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian
2025-08-31T08:27:43,678   copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian
2025-08-31T08:27:43,681   copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian
2025-08-31T08:27:43,684   copying lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese
2025-08-31T08:27:43,687   copying lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese
2025-08-31T08:27:43,689   copying lm_eval/tasks/include/few_shot_og/Vietnamese/_include_base_44_vietnamese.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese
2025-08-31T08:27:43,692   copying lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese
2025-08-31T08:27:43,694   copying lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish
2025-08-31T08:27:43,697   copying lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish
2025-08-31T08:27:43,700   copying lm_eval/tasks/include/few_shot_og/Spanish/_include_base_44_spanish.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish
2025-08-31T08:27:43,703   copying lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish
2025-08-31T08:27:43,705   copying lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish
2025-08-31T08:27:43,708   copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek
2025-08-31T08:27:43,710   copying lm_eval/tasks/include/few_shot_og/Greek/_include_base_44_greek.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek
2025-08-31T08:27:43,712   copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek
2025-08-31T08:27:43,715   copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek
2025-08-31T08:27:43,717   copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek
2025-08-31T08:27:43,719   copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek
2025-08-31T08:27:43,721   copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek
2025-08-31T08:27:43,723   copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek
2025-08-31T08:27:43,725   copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:27:43,728   copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:27:43,730   copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:27:43,732   copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:27:43,734   copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:27:43,736   copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:27:43,738   copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:27:43,740   copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:27:43,742   copying lm_eval/tasks/include/few_shot_og/Chinese/_include_base_44_chinese.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:27:43,744   copying lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish
2025-08-31T08:27:43,746   copying lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish
2025-08-31T08:27:43,748   copying lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish
2025-08-31T08:27:43,750   copying lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish
2025-08-31T08:27:43,752   copying lm_eval/tasks/include/few_shot_og/Turkish/_include_base_44_turkish.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish
2025-08-31T08:27:43,755   copying lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog
2025-08-31T08:27:43,757   copying lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog
2025-08-31T08:27:43,759   copying lm_eval/tasks/include/few_shot_og/Tagalog/_include_base_44_tagalog.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog
2025-08-31T08:27:43,761   copying lm_eval/tasks/include/few_shot_og/French/_include_base_44_french.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French
2025-08-31T08:27:43,763   copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French
2025-08-31T08:27:43,765   copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French
2025-08-31T08:27:43,767   copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French
2025-08-31T08:27:43,770   copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French
2025-08-31T08:27:43,772   copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French
2025-08-31T08:27:43,774   copying lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian
2025-08-31T08:27:43,776   copying lm_eval/tasks/include/few_shot_og/Bulgarian/_include_base_44_bulgarian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian
2025-08-31T08:27:43,778   copying lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian
2025-08-31T08:27:43,781   copying lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian
2025-08-31T08:27:43,783   copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian
2025-08-31T08:27:43,784   copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian
2025-08-31T08:27:43,786   copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian
2025-08-31T08:27:43,788   copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian
2025-08-31T08:27:43,790   copying lm_eval/tasks/include/few_shot_og/Lithuanian/_include_base_44_lithuanian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian
2025-08-31T08:27:43,793   copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian
2025-08-31T08:27:43,795   copying lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu
2025-08-31T08:27:43,797   copying lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu
2025-08-31T08:27:43,799   copying lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu
2025-08-31T08:27:43,801   copying lm_eval/tasks/include/few_shot_og/Urdu/_include_base_44_urdu.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu
2025-08-31T08:27:43,803   copying lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish
2025-08-31T08:27:43,806   copying lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish
2025-08-31T08:27:43,808   copying lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish
2025-08-31T08:27:43,810   copying lm_eval/tasks/include/few_shot_og/Polish/_include_base_44_polish.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish
2025-08-31T08:27:43,812   copying lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil
2025-08-31T08:27:43,815   copying lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil
2025-08-31T08:27:43,818   copying lm_eval/tasks/include/few_shot_og/Tamil/_include_base_44_tamil.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil
2025-08-31T08:27:43,821   copying lm_eval/tasks/include/few_shot_og/Italian/_include_base_44_italian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian
2025-08-31T08:27:43,823   copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian
2025-08-31T08:27:43,825   copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian
2025-08-31T08:27:43,827   copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian
2025-08-31T08:27:43,829   copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian
2025-08-31T08:27:43,831   copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian
2025-08-31T08:27:43,833   copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian
2025-08-31T08:27:43,836   copying lm_eval/tasks/include/few_shot_og/Portuguese/_include_base_44_portuguese.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese
2025-08-31T08:27:43,838   copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese
2025-08-31T08:27:43,840   copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese
2025-08-31T08:27:43,842   copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese
2025-08-31T08:27:43,844   copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese
2025-08-31T08:27:43,846   copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese
2025-08-31T08:27:43,848   copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese
2025-08-31T08:27:43,851   copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian
2025-08-31T08:27:43,853   copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian
2025-08-31T08:27:43,856   copying lm_eval/tasks/include/few_shot_og/Estonian/_include_base_44_estonian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian
2025-08-31T08:27:43,858   copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian
2025-08-31T08:27:43,861   copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian
2025-08-31T08:27:43,863   copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian
2025-08-31T08:27:43,865   copying lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali
2025-08-31T08:27:43,867   copying lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali
2025-08-31T08:27:43,869   copying lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali
2025-08-31T08:27:43,872   copying lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali
2025-08-31T08:27:43,874   copying lm_eval/tasks/include/few_shot_og/Bengali/_include_base_44_bengali.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali
2025-08-31T08:27:43,876   copying lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian
2025-08-31T08:27:43,878   copying lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian
2025-08-31T08:27:43,880   copying lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian
2025-08-31T08:27:43,882   copying lm_eval/tasks/include/few_shot_og/Croatian/_include_base_44_croatian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian
2025-08-31T08:27:43,885   copying lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay
2025-08-31T08:27:43,887   copying lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay
2025-08-31T08:27:43,889   copying lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay
2025-08-31T08:27:43,891   copying lm_eval/tasks/include/few_shot_og/Malay/_include_base_44_malay.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay
2025-08-31T08:27:43,893   copying lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian
2025-08-31T08:27:43,895   copying lm_eval/tasks/include/few_shot_og/Ukrainian/_include_base_44_ukrainian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian
2025-08-31T08:27:43,897   copying lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian
2025-08-31T08:27:43,899   copying lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian
2025-08-31T08:27:43,901   copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic
2025-08-31T08:27:43,904   copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic
2025-08-31T08:27:43,906   copying lm_eval/tasks/include/few_shot_og/Arabic/_include_base_44_arabic.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic
2025-08-31T08:27:43,908   copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic
2025-08-31T08:27:43,910   copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic
2025-08-31T08:27:43,912   copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic
2025-08-31T08:27:43,914   copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic
2025-08-31T08:27:43,916   copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam
2025-08-31T08:27:43,918   copying lm_eval/tasks/include/few_shot_og/Malayalam/_include_base_44_malayalam.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam
2025-08-31T08:27:43,920   copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam
2025-08-31T08:27:43,922   copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam
2025-08-31T08:27:43,925   copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam
2025-08-31T08:27:43,927   copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam
2025-08-31T08:27:43,929   copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam
2025-08-31T08:27:43,931   copying lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_stem.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian
2025-08-31T08:27:43,933   copying lm_eval/tasks/include/default/North Macedonian/_include_base_44_north macedonian.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian
2025-08-31T08:27:43,935   copying lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian
2025-08-31T08:27:43,937   copying lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian
2025-08-31T08:27:43,940   copying lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian
2025-08-31T08:27:43,941   copying lm_eval/tasks/include/default/Basque/_include_base_44_basque.yaml -> build/lib/lm_eval/tasks/include/default/Basque
2025-08-31T08:27:43,944   copying lm_eval/tasks/include/default/Basque/include_base_44_basque_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Basque
2025-08-31T08:27:43,945   copying lm_eval/tasks/include/default/Nepali/include_base_44_nepali_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Nepali
2025-08-31T08:27:43,947   copying lm_eval/tasks/include/default/Nepali/_include_base_44_nepali.yaml -> build/lib/lm_eval/tasks/include/default/Nepali
2025-08-31T08:27:43,949   copying lm_eval/tasks/include/default/Nepali/include_base_44_nepali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Nepali
2025-08-31T08:27:43,951   copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Hindi
2025-08-31T08:27:43,954   copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Hindi
2025-08-31T08:27:43,956   copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Hindi
2025-08-31T08:27:43,958   copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Hindi
2025-08-31T08:27:43,960   copying lm_eval/tasks/include/default/Hindi/_include_base_44_hindi.yaml -> build/lib/lm_eval/tasks/include/default/Hindi
2025-08-31T08:27:43,962   copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Hindi
2025-08-31T08:27:43,964   copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_stem.yaml -> build/lib/lm_eval/tasks/include/default/Hindi
2025-08-31T08:27:43,967   copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Hindi
2025-08-31T08:27:43,969   copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Hindi
2025-08-31T08:27:43,971   copying lm_eval/tasks/include/default/Armenian/include_base_44_armenian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Armenian
2025-08-31T08:27:43,973   copying lm_eval/tasks/include/default/Armenian/include_base_44_armenian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Armenian
2025-08-31T08:27:43,975   copying lm_eval/tasks/include/default/Armenian/include_base_44_armenian_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Armenian
2025-08-31T08:27:43,978   copying lm_eval/tasks/include/default/Armenian/_include_base_44_armenian.yaml -> build/lib/lm_eval/tasks/include/default/Armenian
2025-08-31T08:27:43,980   copying lm_eval/tasks/include/default/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Armenian
2025-08-31T08:27:43,982   copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Dutch
2025-08-31T08:27:43,984   copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Dutch
2025-08-31T08:27:43,987   copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_stem.yaml -> build/lib/lm_eval/tasks/include/default/Dutch
2025-08-31T08:27:43,989   copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Dutch
2025-08-31T08:27:43,991   copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Dutch
2025-08-31T08:27:43,993   copying lm_eval/tasks/include/default/Dutch/_include_base_44_dutch.yaml -> build/lib/lm_eval/tasks/include/default/Dutch
2025-08-31T08:27:43,996   copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Albanian
2025-08-31T08:27:43,998   copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Albanian
2025-08-31T08:27:44,001   copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Albanian
2025-08-31T08:27:44,003   copying lm_eval/tasks/include/default/Albanian/_include_base_44_albanian.yaml -> build/lib/lm_eval/tasks/include/default/Albanian
2025-08-31T08:27:44,005   copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Albanian
2025-08-31T08:27:44,007   copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Albanian
2025-08-31T08:27:44,009   copying lm_eval/tasks/include/default/Serbian/include_base_44_serbian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Serbian
2025-08-31T08:27:44,011   copying lm_eval/tasks/include/default/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Serbian
2025-08-31T08:27:44,013   copying lm_eval/tasks/include/default/Serbian/include_base_44_serbian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Serbian
2025-08-31T08:27:44,015   copying lm_eval/tasks/include/default/Serbian/_include_base_44_serbian.yaml -> build/lib/lm_eval/tasks/include/default/Serbian
2025-08-31T08:27:44,017   copying lm_eval/tasks/include/default/Russian/_include_base_44_russian.yaml -> build/lib/lm_eval/tasks/include/default/Russian
2025-08-31T08:27:44,019   copying lm_eval/tasks/include/default/Russian/include_base_44_russian_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Russian
2025-08-31T08:27:44,021   copying lm_eval/tasks/include/default/Russian/include_base_44_russian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Russian
2025-08-31T08:27:44,024   copying lm_eval/tasks/include/default/Russian/include_base_44_russian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Russian
2025-08-31T08:27:44,026   copying lm_eval/tasks/include/default/Russian/include_base_44_russian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Russian
2025-08-31T08:27:44,028   copying lm_eval/tasks/include/default/Russian/include_base_44_russian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Russian
2025-08-31T08:27:44,030   copying lm_eval/tasks/include/default/Russian/include_base_44_russian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Russian
2025-08-31T08:27:44,032   copying lm_eval/tasks/include/default/Russian/include_base_44_russian_marine_license.yaml -> build/lib/lm_eval/tasks/include/default/Russian
2025-08-31T08:27:44,035   copying lm_eval/tasks/include/default/Russian/include_base_44_russian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Russian
2025-08-31T08:27:44,037   copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Finnish
2025-08-31T08:27:44,039   copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Finnish
2025-08-31T08:27:44,041   copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Finnish
2025-08-31T08:27:44,043   copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_stem.yaml -> build/lib/lm_eval/tasks/include/default/Finnish
2025-08-31T08:27:44,045   copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Finnish
2025-08-31T08:27:44,048   copying lm_eval/tasks/include/default/Finnish/_include_base_44_finnish.yaml -> build/lib/lm_eval/tasks/include/default/Finnish
2025-08-31T08:27:44,050   copying lm_eval/tasks/include/default/German/include_base_44_german_stem.yaml -> build/lib/lm_eval/tasks/include/default/German
2025-08-31T08:27:44,052   copying lm_eval/tasks/include/default/German/_include_base_44_german.yaml -> build/lib/lm_eval/tasks/include/default/German
2025-08-31T08:27:44,054   copying lm_eval/tasks/include/default/German/include_base_44_german_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/German
2025-08-31T08:27:44,056   copying lm_eval/tasks/include/default/German/include_base_44_german_social_science.yaml -> build/lib/lm_eval/tasks/include/default/German
2025-08-31T08:27:44,058   copying lm_eval/tasks/include/default/Telugu/include_base_44_telugu_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Telugu
2025-08-31T08:27:44,060   copying lm_eval/tasks/include/default/Telugu/_include_base_44_telugu.yaml -> build/lib/lm_eval/tasks/include/default/Telugu
2025-08-31T08:27:44,062   copying lm_eval/tasks/include/default/Telugu/include_base_44_telugu_stem.yaml -> build/lib/lm_eval/tasks/include/default/Telugu
2025-08-31T08:27:44,064   copying lm_eval/tasks/include/default/Telugu/include_base_44_telugu_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Telugu
2025-08-31T08:27:44,067   copying lm_eval/tasks/include/default/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Telugu
2025-08-31T08:27:44,069   copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani
2025-08-31T08:27:44,071   copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani
2025-08-31T08:27:44,073   copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani
2025-08-31T08:27:44,075   copying lm_eval/tasks/include/default/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani
2025-08-31T08:27:44,078   copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani
2025-08-31T08:27:44,080   copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani
2025-08-31T08:27:44,082   copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani
2025-08-31T08:27:44,084   copying lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Hungarian
2025-08-31T08:27:44,087   copying lm_eval/tasks/include/default/Hungarian/_include_base_44_hungarian.yaml -> build/lib/lm_eval/tasks/include/default/Hungarian
2025-08-31T08:27:44,089   copying lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Hungarian
2025-08-31T08:27:44,091   copying lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Hungarian
2025-08-31T08:27:44,093   copying lm_eval/tasks/include/default/Uzbek/_include_base_44_uzbek.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek
2025-08-31T08:27:44,095   copying lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_stem.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek
2025-08-31T08:27:44,097   copying lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek
2025-08-31T08:27:44,099   copying lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek
2025-08-31T08:27:44,101   copying lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek
2025-08-31T08:27:44,103   copying lm_eval/tasks/include/default/Korean/include_base_44_korean_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Korean
2025-08-31T08:27:44,105   copying lm_eval/tasks/include/default/Korean/_include_base_44_korean.yaml -> build/lib/lm_eval/tasks/include/default/Korean
2025-08-31T08:27:44,108   copying lm_eval/tasks/include/default/Korean/include_base_44_korean_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Korean
2025-08-31T08:27:44,110   copying lm_eval/tasks/include/default/Hebrew/_include_base_44_hebrew.yaml -> build/lib/lm_eval/tasks/include/default/Hebrew
2025-08-31T08:27:44,112   copying lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Hebrew
2025-08-31T08:27:44,114   copying lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Hebrew
2025-08-31T08:27:44,116   copying lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Belarusian
2025-08-31T08:27:44,118   copying lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Belarusian
2025-08-31T08:27:44,120   copying lm_eval/tasks/include/default/Belarusian/_include_base_44_belarusian.yaml -> build/lib/lm_eval/tasks/include/default/Belarusian
2025-08-31T08:27:44,122   copying lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Belarusian
2025-08-31T08:27:44,124   copying lm_eval/tasks/include/default/Japanese/_include_base_44_japanese.yaml -> build/lib/lm_eval/tasks/include/default/Japanese
2025-08-31T08:27:44,126   copying lm_eval/tasks/include/default/Japanese/include_base_44_japanese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Japanese
2025-08-31T08:27:44,128   copying lm_eval/tasks/include/default/Japanese/include_base_44_japanese_medical_license.yaml -> build/lib/lm_eval/tasks/include/default/Japanese
2025-08-31T08:27:44,130   copying lm_eval/tasks/include/default/Japanese/include_base_44_japanese_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Japanese
2025-08-31T08:27:44,133   copying lm_eval/tasks/include/default/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Kazakh
2025-08-31T08:27:44,135   copying lm_eval/tasks/include/default/Kazakh/_include_base_44_kazakh.yaml -> build/lib/lm_eval/tasks/include/default/Kazakh
2025-08-31T08:27:44,137   copying lm_eval/tasks/include/default/Georgian/_include_base_44_georgian.yaml -> build/lib/lm_eval/tasks/include/default/Georgian
2025-08-31T08:27:44,139   copying lm_eval/tasks/include/default/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Georgian
2025-08-31T08:27:44,141   copying lm_eval/tasks/include/default/Persian/_include_base_44_persian.yaml -> build/lib/lm_eval/tasks/include/default/Persian
2025-08-31T08:27:44,144   copying lm_eval/tasks/include/default/Persian/include_base_44_persian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Persian
2025-08-31T08:27:44,146   copying lm_eval/tasks/include/default/Persian/include_base_44_persian_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Persian
2025-08-31T08:27:44,148   copying lm_eval/tasks/include/default/Persian/include_base_44_persian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Persian
2025-08-31T08:27:44,150   copying lm_eval/tasks/include/default/Persian/include_base_44_persian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Persian
2025-08-31T08:27:44,152   copying lm_eval/tasks/include/default/Persian/include_base_44_persian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Persian
2025-08-31T08:27:44,154   copying lm_eval/tasks/include/default/Indonesian/_include_base_44_indonesian.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian
2025-08-31T08:27:44,156   copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian
2025-08-31T08:27:44,158   copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian
2025-08-31T08:27:44,160   copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian
2025-08-31T08:27:44,162   copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian
2025-08-31T08:27:44,164   copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian
2025-08-31T08:27:44,166   copying lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese
2025-08-31T08:27:44,169   copying lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese
2025-08-31T08:27:44,170   copying lm_eval/tasks/include/default/Vietnamese/_include_base_44_vietnamese.yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese
2025-08-31T08:27:44,173   copying lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese
2025-08-31T08:27:44,175   copying lm_eval/tasks/include/default/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Spanish
2025-08-31T08:27:44,177   copying lm_eval/tasks/include/default/Spanish/include_base_44_spanish_stem.yaml -> build/lib/lm_eval/tasks/include/default/Spanish
2025-08-31T08:27:44,179   copying lm_eval/tasks/include/default/Spanish/_include_base_44_spanish.yaml -> build/lib/lm_eval/tasks/include/default/Spanish
2025-08-31T08:27:44,182   copying lm_eval/tasks/include/default/Spanish/include_base_44_spanish_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Spanish
2025-08-31T08:27:44,184   copying lm_eval/tasks/include/default/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Spanish
2025-08-31T08:27:44,186   copying lm_eval/tasks/include/default/Greek/include_base_44_greek_stem.yaml -> build/lib/lm_eval/tasks/include/default/Greek
2025-08-31T08:27:44,188   copying lm_eval/tasks/include/default/Greek/_include_base_44_greek.yaml -> build/lib/lm_eval/tasks/include/default/Greek
2025-08-31T08:27:44,190   copying lm_eval/tasks/include/default/Greek/include_base_44_greek_medical_license.yaml -> build/lib/lm_eval/tasks/include/default/Greek
2025-08-31T08:27:44,192   copying lm_eval/tasks/include/default/Greek/include_base_44_greek_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Greek
2025-08-31T08:27:44,195   copying lm_eval/tasks/include/default/Greek/include_base_44_greek_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Greek
2025-08-31T08:27:44,197   copying lm_eval/tasks/include/default/Greek/include_base_44_greek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Greek
2025-08-31T08:27:44,199   copying lm_eval/tasks/include/default/Greek/include_base_44_greek_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Greek
2025-08-31T08:27:44,201   copying lm_eval/tasks/include/default/Greek/include_base_44_greek_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Greek
2025-08-31T08:27:44,203   copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Chinese
2025-08-31T08:27:44,205   copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Chinese
2025-08-31T08:27:44,207   copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Chinese
2025-08-31T08:27:44,210   copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_stem.yaml -> build/lib/lm_eval/tasks/include/default/Chinese
2025-08-31T08:27:44,213   copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Chinese
2025-08-31T08:27:44,215   copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Chinese
2025-08-31T08:27:44,217   copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Chinese
2025-08-31T08:27:44,219   copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Chinese
2025-08-31T08:27:44,221   copying lm_eval/tasks/include/default/Chinese/_include_base_44_chinese.yaml -> build/lib/lm_eval/tasks/include/default/Chinese
2025-08-31T08:27:44,224   copying lm_eval/tasks/include/default/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Turkish
2025-08-31T08:27:44,226   copying lm_eval/tasks/include/default/Turkish/include_base_44_turkish_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Turkish
2025-08-31T08:27:44,228   copying lm_eval/tasks/include/default/Turkish/include_base_44_turkish_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Turkish
2025-08-31T08:27:44,230   copying lm_eval/tasks/include/default/Turkish/include_base_44_turkish_stem.yaml -> build/lib/lm_eval/tasks/include/default/Turkish
2025-08-31T08:27:44,232   copying lm_eval/tasks/include/default/Turkish/_include_base_44_turkish.yaml -> build/lib/lm_eval/tasks/include/default/Turkish
2025-08-31T08:27:44,234   copying lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Tagalog
2025-08-31T08:27:44,236   copying lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Tagalog
2025-08-31T08:27:44,238   copying lm_eval/tasks/include/default/Tagalog/_include_base_44_tagalog.yaml -> build/lib/lm_eval/tasks/include/default/Tagalog
2025-08-31T08:27:44,240   copying lm_eval/tasks/include/default/French/_include_base_44_french.yaml -> build/lib/lm_eval/tasks/include/default/French
2025-08-31T08:27:44,242   copying lm_eval/tasks/include/default/French/include_base_44_french_stem.yaml -> build/lib/lm_eval/tasks/include/default/French
2025-08-31T08:27:44,244   copying lm_eval/tasks/include/default/French/include_base_44_french_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/French
2025-08-31T08:27:44,247   copying lm_eval/tasks/include/default/French/include_base_44_french_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/French
2025-08-31T08:27:44,249   copying lm_eval/tasks/include/default/French/include_base_44_french_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/French
2025-08-31T08:27:44,251   copying lm_eval/tasks/include/default/French/include_base_44_french_social_science.yaml -> build/lib/lm_eval/tasks/include/default/French
2025-08-31T08:27:44,253   copying lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian
2025-08-31T08:27:44,255   copying lm_eval/tasks/include/default/Bulgarian/_include_base_44_bulgarian.yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian
2025-08-31T08:27:44,257   copying lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian
2025-08-31T08:27:44,259   copying lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian
2025-08-31T08:27:44,261   copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian
2025-08-31T08:27:44,263   copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian
2025-08-31T08:27:44,265   copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian
2025-08-31T08:27:44,268   copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian
2025-08-31T08:27:44,270   copying lm_eval/tasks/include/default/Lithuanian/_include_base_44_lithuanian.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian
2025-08-31T08:27:44,272   copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian
2025-08-31T08:27:44,274   copying lm_eval/tasks/include/default/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Urdu
2025-08-31T08:27:44,276   copying lm_eval/tasks/include/default/Urdu/include_base_44_urdu_stem.yaml -> build/lib/lm_eval/tasks/include/default/Urdu
2025-08-31T08:27:44,278   copying lm_eval/tasks/include/default/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Urdu
2025-08-31T08:27:44,280   copying lm_eval/tasks/include/default/Urdu/_include_base_44_urdu.yaml -> build/lib/lm_eval/tasks/include/default/Urdu
2025-08-31T08:27:44,282   copying lm_eval/tasks/include/default/Polish/include_base_44_polish_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Polish
2025-08-31T08:27:44,284   copying lm_eval/tasks/include/default/Polish/include_base_44_polish_stem.yaml -> build/lib/lm_eval/tasks/include/default/Polish
2025-08-31T08:27:44,286   copying lm_eval/tasks/include/default/Polish/include_base_44_polish_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Polish
2025-08-31T08:27:44,288   copying lm_eval/tasks/include/default/Polish/_include_base_44_polish.yaml -> build/lib/lm_eval/tasks/include/default/Polish
2025-08-31T08:27:44,290   copying lm_eval/tasks/include/default/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Tamil
2025-08-31T08:27:44,292   copying lm_eval/tasks/include/default/Tamil/include_base_44_tamil_stem.yaml -> build/lib/lm_eval/tasks/include/default/Tamil
2025-08-31T08:27:44,295   copying lm_eval/tasks/include/default/Tamil/_include_base_44_tamil.yaml -> build/lib/lm_eval/tasks/include/default/Tamil
2025-08-31T08:27:44,297   copying lm_eval/tasks/include/default/Italian/_include_base_44_italian.yaml -> build/lib/lm_eval/tasks/include/default/Italian
2025-08-31T08:27:44,299   copying lm_eval/tasks/include/default/Italian/include_base_44_italian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Italian
2025-08-31T08:27:44,301   copying lm_eval/tasks/include/default/Italian/include_base_44_italian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Italian
2025-08-31T08:27:44,303   copying lm_eval/tasks/include/default/Italian/include_base_44_italian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Italian
2025-08-31T08:27:44,305   copying lm_eval/tasks/include/default/Italian/include_base_44_italian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Italian
2025-08-31T08:27:44,307   copying lm_eval/tasks/include/default/Italian/include_base_44_italian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Italian
2025-08-31T08:27:44,309   copying lm_eval/tasks/include/default/Italian/include_base_44_italian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Italian
2025-08-31T08:27:44,311   copying lm_eval/tasks/include/default/Portuguese/_include_base_44_portuguese.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese
2025-08-31T08:27:44,313   copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese
2025-08-31T08:27:44,315   copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese
2025-08-31T08:27:44,317   copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese
2025-08-31T08:27:44,319   copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_stem.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese
2025-08-31T08:27:44,321   copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese
2025-08-31T08:27:44,323   copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese
2025-08-31T08:27:44,325   copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Estonian
2025-08-31T08:27:44,327   copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Estonian
2025-08-31T08:27:44,330   copying lm_eval/tasks/include/default/Estonian/_include_base_44_estonian.yaml -> build/lib/lm_eval/tasks/include/default/Estonian
2025-08-31T08:27:44,332   copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Estonian
2025-08-31T08:27:44,334   copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Estonian
2025-08-31T08:27:44,336   copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Estonian
2025-08-31T08:27:44,338   copying lm_eval/tasks/include/default/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Bengali
2025-08-31T08:27:44,340   copying lm_eval/tasks/include/default/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Bengali
2025-08-31T08:27:44,342   copying lm_eval/tasks/include/default/Bengali/include_base_44_bengali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Bengali
2025-08-31T08:27:44,344   copying lm_eval/tasks/include/default/Bengali/include_base_44_bengali_stem.yaml -> build/lib/lm_eval/tasks/include/default/Bengali
2025-08-31T08:27:44,346   copying lm_eval/tasks/include/default/Bengali/_include_base_44_bengali.yaml -> build/lib/lm_eval/tasks/include/default/Bengali
2025-08-31T08:27:44,349   copying lm_eval/tasks/include/default/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Croatian
2025-08-31T08:27:44,351   copying lm_eval/tasks/include/default/Croatian/include_base_44_croatian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Croatian
2025-08-31T08:27:44,353   copying lm_eval/tasks/include/default/Croatian/include_base_44_croatian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Croatian
2025-08-31T08:27:44,355   copying lm_eval/tasks/include/default/Croatian/_include_base_44_croatian.yaml -> build/lib/lm_eval/tasks/include/default/Croatian
2025-08-31T08:27:44,357   copying lm_eval/tasks/include/default/Malay/include_base_44_malay_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Malay
2025-08-31T08:27:44,359   copying lm_eval/tasks/include/default/Malay/include_base_44_malay_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Malay
2025-08-31T08:27:44,361   copying lm_eval/tasks/include/default/Malay/include_base_44_malay_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Malay
2025-08-31T08:27:44,363   copying lm_eval/tasks/include/default/Malay/_include_base_44_malay.yaml -> build/lib/lm_eval/tasks/include/default/Malay
2025-08-31T08:27:44,365   copying lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian
2025-08-31T08:27:44,367   copying lm_eval/tasks/include/default/Ukrainian/_include_base_44_ukrainian.yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian
2025-08-31T08:27:44,369   copying lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian
2025-08-31T08:27:44,371   copying lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian
2025-08-31T08:27:44,373   copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Arabic
2025-08-31T08:27:44,375   copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_stem.yaml -> build/lib/lm_eval/tasks/include/default/Arabic
2025-08-31T08:27:44,377   copying lm_eval/tasks/include/default/Arabic/_include_base_44_arabic.yaml -> build/lib/lm_eval/tasks/include/default/Arabic
2025-08-31T08:27:44,379   copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Arabic
2025-08-31T08:27:44,381   copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Arabic
2025-08-31T08:27:44,383   copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Arabic
2025-08-31T08:27:44,385   copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Arabic
2025-08-31T08:27:44,388   copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_stem.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam
2025-08-31T08:27:44,390   copying lm_eval/tasks/include/default/Malayalam/_include_base_44_malayalam.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam
2025-08-31T08:27:44,392   copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam
2025-08-31T08:27:44,394   copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam
2025-08-31T08:27:44,396   copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam
2025-08-31T08:27:44,398   copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam
2025-08-31T08:27:44,401   copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam
2025-08-31T08:27:44,403   copying lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian
2025-08-31T08:27:44,405   copying lm_eval/tasks/include/few_shot_en/North Macedonian/_include_base_44_north macedonian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian
2025-08-31T08:27:44,407   copying lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian
2025-08-31T08:27:44,409   copying lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian
2025-08-31T08:27:44,412   copying lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian
2025-08-31T08:27:44,414   copying lm_eval/tasks/include/few_shot_en/Basque/_include_base_44_basque.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Basque
2025-08-31T08:27:44,416   copying lm_eval/tasks/include/few_shot_en/Basque/include_base_44_basque_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Basque
2025-08-31T08:27:44,418   copying lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali
2025-08-31T08:27:44,420   copying lm_eval/tasks/include/few_shot_en/Nepali/_include_base_44_nepali.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali
2025-08-31T08:27:44,422   copying lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali
2025-08-31T08:27:44,424   copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:27:44,427   copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:27:44,429   copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:27:44,432   copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:27:44,434   copying lm_eval/tasks/include/few_shot_en/Hindi/_include_base_44_hindi.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:27:44,437   copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:27:44,440   copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:27:44,442   copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:27:44,444   copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:27:44,446   copying lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian
2025-08-31T08:27:44,448   copying lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian
2025-08-31T08:27:44,451   copying lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian
2025-08-31T08:27:44,453   copying lm_eval/tasks/include/few_shot_en/Armenian/_include_base_44_armenian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian
2025-08-31T08:27:44,455   copying lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian
2025-08-31T08:27:44,457   copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch
2025-08-31T08:27:44,460   copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch
2025-08-31T08:27:44,462   copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch
2025-08-31T08:27:44,463   copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch
2025-08-31T08:27:44,466   copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch
2025-08-31T08:27:44,468   copying lm_eval/tasks/include/few_shot_en/Dutch/_include_base_44_dutch.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch
2025-08-31T08:27:44,470   copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian
2025-08-31T08:27:44,472   copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian
2025-08-31T08:27:44,474   copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian
2025-08-31T08:27:44,476   copying lm_eval/tasks/include/few_shot_en/Albanian/_include_base_44_albanian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian
2025-08-31T08:27:44,478   copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian
2025-08-31T08:27:44,481   copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian
2025-08-31T08:27:44,483   copying lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian
2025-08-31T08:27:44,486   copying lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian
2025-08-31T08:27:44,488   copying lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian
2025-08-31T08:27:44,490   copying lm_eval/tasks/include/few_shot_en/Serbian/_include_base_44_serbian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian
2025-08-31T08:27:44,492   copying lm_eval/tasks/include/few_shot_en/Russian/_include_base_44_russian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:27:44,495   copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:27:44,497   copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:27:44,499   copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:27:44,501   copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:27:44,503   copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:27:44,505   copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:27:44,508   copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_marine_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:27:44,510   copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:27:44,512   copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish
2025-08-31T08:27:44,514   copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish
2025-08-31T08:27:44,516   copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish
2025-08-31T08:27:44,519   copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish
2025-08-31T08:27:44,521   copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish
2025-08-31T08:27:44,523   copying lm_eval/tasks/include/few_shot_en/Finnish/_include_base_44_finnish.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish
2025-08-31T08:27:44,525   copying lm_eval/tasks/include/few_shot_en/German/include_base_44_german_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German
2025-08-31T08:27:44,527   copying lm_eval/tasks/include/few_shot_en/German/_include_base_44_german.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German
2025-08-31T08:27:44,529   copying lm_eval/tasks/include/few_shot_en/German/include_base_44_german_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German
2025-08-31T08:27:44,531   copying lm_eval/tasks/include/few_shot_en/German/include_base_44_german_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German
2025-08-31T08:27:44,534   copying lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu
2025-08-31T08:27:44,536   copying lm_eval/tasks/include/few_shot_en/Telugu/_include_base_44_telugu.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu
2025-08-31T08:27:44,538   copying lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu
2025-08-31T08:27:44,541   copying lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu
2025-08-31T08:27:44,543   copying lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu
2025-08-31T08:27:44,545   copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani
2025-08-31T08:27:44,548   copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani
2025-08-31T08:27:44,550   copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani
2025-08-31T08:27:44,552   copying lm_eval/tasks/include/few_shot_en/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani
2025-08-31T08:27:44,555   copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani
2025-08-31T08:27:44,557   copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani
2025-08-31T08:27:44,559   copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani
2025-08-31T08:27:44,561   copying lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian
2025-08-31T08:27:44,564   copying lm_eval/tasks/include/few_shot_en/Hungarian/_include_base_44_hungarian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian
2025-08-31T08:27:44,566   copying lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian
2025-08-31T08:27:44,569   copying lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian
2025-08-31T08:27:44,571   copying lm_eval/tasks/include/few_shot_en/Uzbek/_include_base_44_uzbek.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek
2025-08-31T08:27:44,573   copying lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek
2025-08-31T08:27:44,576   copying lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek
2025-08-31T08:27:44,578   copying lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek
2025-08-31T08:27:44,580   copying lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek
2025-08-31T08:27:44,582   copying lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Korean
2025-08-31T08:27:44,584   copying lm_eval/tasks/include/few_shot_en/Korean/_include_base_44_korean.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Korean
2025-08-31T08:27:44,586   copying lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Korean
2025-08-31T08:27:44,588   copying lm_eval/tasks/include/few_shot_en/Hebrew/_include_base_44_hebrew.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew
2025-08-31T08:27:44,591   copying lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew
2025-08-31T08:27:44,593   copying lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew
2025-08-31T08:27:44,595   copying lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian
2025-08-31T08:27:44,597   copying lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian
2025-08-31T08:27:44,599   copying lm_eval/tasks/include/few_shot_en/Belarusian/_include_base_44_belarusian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian
2025-08-31T08:27:44,601   copying lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian
2025-08-31T08:27:44,604   copying lm_eval/tasks/include/few_shot_en/Japanese/_include_base_44_japanese.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese
2025-08-31T08:27:44,606   copying lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese
2025-08-31T08:27:44,608   copying lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese
2025-08-31T08:27:44,610   copying lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese
2025-08-31T08:27:44,612   copying lm_eval/tasks/include/few_shot_en/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Kazakh
2025-08-31T08:27:44,615   copying lm_eval/tasks/include/few_shot_en/Kazakh/_include_base_44_kazakh.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Kazakh
2025-08-31T08:27:44,617   copying lm_eval/tasks/include/few_shot_en/Georgian/_include_base_44_georgian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Georgian
2025-08-31T08:27:44,620   copying lm_eval/tasks/include/few_shot_en/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Georgian
2025-08-31T08:27:44,622   copying lm_eval/tasks/include/few_shot_en/Persian/_include_base_44_persian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian
2025-08-31T08:27:44,624   copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian
2025-08-31T08:27:44,626   copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian
2025-08-31T08:27:44,628   copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian
2025-08-31T08:27:44,630   copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian
2025-08-31T08:27:44,633   copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian
2025-08-31T08:27:44,635   copying lm_eval/tasks/include/few_shot_en/Indonesian/_include_base_44_indonesian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian
2025-08-31T08:27:44,637   copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian
2025-08-31T08:27:44,639   copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian
2025-08-31T08:27:44,641   copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian
2025-08-31T08:27:44,644   copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian
2025-08-31T08:27:44,646   copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian
2025-08-31T08:27:44,648   copying lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese
2025-08-31T08:27:44,650   copying lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese
2025-08-31T08:27:44,653   copying lm_eval/tasks/include/few_shot_en/Vietnamese/_include_base_44_vietnamese.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese
2025-08-31T08:27:44,655   copying lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese
2025-08-31T08:27:44,657   copying lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish
2025-08-31T08:27:44,659   copying lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish
2025-08-31T08:27:44,661   copying lm_eval/tasks/include/few_shot_en/Spanish/_include_base_44_spanish.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish
2025-08-31T08:27:44,664   copying lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish
2025-08-31T08:27:44,666   copying lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish
2025-08-31T08:27:44,668   copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek
2025-08-31T08:27:44,670   copying lm_eval/tasks/include/few_shot_en/Greek/_include_base_44_greek.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek
2025-08-31T08:27:44,672   copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek
2025-08-31T08:27:44,674   copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek
2025-08-31T08:27:44,676   copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek
2025-08-31T08:27:44,678   copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek
2025-08-31T08:27:44,680   copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek
2025-08-31T08:27:44,682   copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek
2025-08-31T08:27:44,684   copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:27:44,686   copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:27:44,689   copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:27:44,691   copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:27:44,693   copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:27:44,695   copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:27:44,697   copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:27:44,699   copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:27:44,701   copying lm_eval/tasks/include/few_shot_en/Chinese/_include_base_44_chinese.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:27:44,703   copying lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish
2025-08-31T08:27:44,706   copying lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish
2025-08-31T08:27:44,708   copying lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish
2025-08-31T08:27:44,710   copying lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish
2025-08-31T08:27:44,712   copying lm_eval/tasks/include/few_shot_en/Turkish/_include_base_44_turkish.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish
2025-08-31T08:27:44,714   copying lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog
2025-08-31T08:27:44,716   copying lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog
2025-08-31T08:27:44,718   copying lm_eval/tasks/include/few_shot_en/Tagalog/_include_base_44_tagalog.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog
2025-08-31T08:27:44,720   copying lm_eval/tasks/include/few_shot_en/French/_include_base_44_french.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French
2025-08-31T08:27:44,722   copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French
2025-08-31T08:27:44,724   copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French
2025-08-31T08:27:44,726   copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French
2025-08-31T08:27:44,729   copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French
2025-08-31T08:27:44,731   copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French
2025-08-31T08:27:44,733   copying lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian
2025-08-31T08:27:44,735   copying lm_eval/tasks/include/few_shot_en/Bulgarian/_include_base_44_bulgarian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian
2025-08-31T08:27:44,737   copying lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian
2025-08-31T08:27:44,739   copying lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian
2025-08-31T08:27:44,742   copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian
2025-08-31T08:27:44,744   copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian
2025-08-31T08:27:44,746   copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian
2025-08-31T08:27:44,748   copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian
2025-08-31T08:27:44,750   copying lm_eval/tasks/include/few_shot_en/Lithuanian/_include_base_44_lithuanian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian
2025-08-31T08:27:44,752   copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian
2025-08-31T08:27:44,757   copying lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu
2025-08-31T08:27:44,759   copying lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu
2025-08-31T08:27:44,761   copying lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu
2025-08-31T08:27:44,763   copying lm_eval/tasks/include/few_shot_en/Urdu/_include_base_44_urdu.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu
2025-08-31T08:27:44,765   copying lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish
2025-08-31T08:27:44,768   copying lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish
2025-08-31T08:27:44,770   copying lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish
2025-08-31T08:27:44,772   copying lm_eval/tasks/include/few_shot_en/Polish/_include_base_44_polish.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish
2025-08-31T08:27:44,774   copying lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil
2025-08-31T08:27:44,776   copying lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil
2025-08-31T08:27:44,778   copying lm_eval/tasks/include/few_shot_en/Tamil/_include_base_44_tamil.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil
2025-08-31T08:27:44,780   copying lm_eval/tasks/include/few_shot_en/Italian/_include_base_44_italian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian
2025-08-31T08:27:44,782   copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian
2025-08-31T08:27:44,784   copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian
2025-08-31T08:27:44,787   copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian
2025-08-31T08:27:44,789   copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian
2025-08-31T08:27:44,791   copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian
2025-08-31T08:27:44,793   copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian
2025-08-31T08:27:44,795   copying lm_eval/tasks/include/few_shot_en/Portuguese/_include_base_44_portuguese.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese
2025-08-31T08:27:44,797   copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese
2025-08-31T08:27:44,799   copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese
2025-08-31T08:27:44,802   copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese
2025-08-31T08:27:44,804   copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese
2025-08-31T08:27:44,806   copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese
2025-08-31T08:27:44,808   copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese
2025-08-31T08:27:44,811   copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian
2025-08-31T08:27:44,813   copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian
2025-08-31T08:27:44,815   copying lm_eval/tasks/include/few_shot_en/Estonian/_include_base_44_estonian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian
2025-08-31T08:27:44,818   copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian
2025-08-31T08:27:44,820   copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian
2025-08-31T08:27:44,822   copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian
2025-08-31T08:27:44,824   copying lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali
2025-08-31T08:27:44,826   copying lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali
2025-08-31T08:27:44,829   copying lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali
2025-08-31T08:27:44,830   copying lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali
2025-08-31T08:27:44,833   copying lm_eval/tasks/include/few_shot_en/Bengali/_include_base_44_bengali.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali
2025-08-31T08:27:44,835   copying lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian
2025-08-31T08:27:44,837   copying lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian
2025-08-31T08:27:44,840   copying lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian
2025-08-31T08:27:44,842   copying lm_eval/tasks/include/few_shot_en/Croatian/_include_base_44_croatian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian
2025-08-31T08:27:44,844   copying lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay
2025-08-31T08:27:44,846   copying lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay
2025-08-31T08:27:44,848   copying lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay
2025-08-31T08:27:44,850   copying lm_eval/tasks/include/few_shot_en/Malay/_include_base_44_malay.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay
2025-08-31T08:27:44,853   copying lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian
2025-08-31T08:27:44,855   copying lm_eval/tasks/include/few_shot_en/Ukrainian/_include_base_44_ukrainian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian
2025-08-31T08:27:44,857   copying lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian
2025-08-31T08:27:44,859   copying lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian
2025-08-31T08:27:44,861   copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic
2025-08-31T08:27:44,863   copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic
2025-08-31T08:27:44,866   copying lm_eval/tasks/include/few_shot_en/Arabic/_include_base_44_arabic.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic
2025-08-31T08:27:44,868   copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic
2025-08-31T08:27:44,870   copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic
2025-08-31T08:27:44,872   copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic
2025-08-31T08:27:44,874   copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic
2025-08-31T08:27:44,876   copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam
2025-08-31T08:27:44,879   copying lm_eval/tasks/include/few_shot_en/Malayalam/_include_base_44_malayalam.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam
2025-08-31T08:27:44,881   copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam
2025-08-31T08:27:44,883   copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam
2025-08-31T08:27:44,885   copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam
2025-08-31T08:27:44,887   copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam
2025-08-31T08:27:44,889   copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam
2025-08-31T08:27:44,891   copying lm_eval/tasks/winogrande/default.yaml -> build/lib/lm_eval/tasks/winogrande
2025-08-31T08:27:44,893   copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_jordan.yaml -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:27:44,895   copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_morocco.yaml -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:27:44,897   copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_algeria.yaml -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:27:44,899   copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_ksa.yaml -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:27:44,902   copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion_north_africa.yaml -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:27:44,904   copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion_gulf.yaml -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:27:44,906   copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion_levant.yaml -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:27:44,909   copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion_nile_valley.yaml -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:27:44,911   copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_uae.yaml -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:27:44,913   copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_palestine.yaml -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:27:44,916   copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_egypt.yaml -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:27:44,918   copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_sudan.yaml -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:27:44,920   copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_tunisia.yaml -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:27:44,922   copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_lebanon.yaml -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:27:44,924   copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_syria.yaml -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:27:44,926   copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_libya.yaml -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:27:44,929   copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_yemen.yaml -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:27:44,930   copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion.yaml -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:27:44,932   creating build/lib/lm_eval/tasks/prost
2025-08-31T08:27:44,933   copying lm_eval/tasks/prost/corypaik_prost.yaml -> build/lib/lm_eval/tasks/prost
2025-08-31T08:27:44,936   creating build/lib/lm_eval/tasks/gsm_plus
2025-08-31T08:27:44,937   copying lm_eval/tasks/gsm_plus/gsm_plus.yaml -> build/lib/lm_eval/tasks/gsm_plus
2025-08-31T08:27:44,939   copying lm_eval/tasks/gsm_plus/gsm_plus_mini.yaml -> build/lib/lm_eval/tasks/gsm_plus
2025-08-31T08:27:44,942   copying lm_eval/tasks/moral_stories/moral_stories.yaml -> build/lib/lm_eval/tasks/moral_stories
2025-08-31T08:27:44,944   copying lm_eval/tasks/histoires_morales/histoires_morales.yaml -> build/lib/lm_eval/tasks/histoires_morales
2025-08-31T08:27:44,946   copying lm_eval/tasks/bbh/zeroshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,948   copying lm_eval/tasks/bbh/zeroshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,950   copying lm_eval/tasks/bbh/zeroshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,952   copying lm_eval/tasks/bbh/zeroshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,954   copying lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,957   copying lm_eval/tasks/bbh/zeroshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,959   copying lm_eval/tasks/bbh/zeroshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,961   copying lm_eval/tasks/bbh/zeroshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,964   copying lm_eval/tasks/bbh/zeroshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,966   copying lm_eval/tasks/bbh/zeroshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,969   copying lm_eval/tasks/bbh/zeroshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,971   copying lm_eval/tasks/bbh/zeroshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,974   copying lm_eval/tasks/bbh/zeroshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,976   copying lm_eval/tasks/bbh/zeroshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,978   copying lm_eval/tasks/bbh/zeroshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,980   copying lm_eval/tasks/bbh/zeroshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,983   copying lm_eval/tasks/bbh/zeroshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,985   copying lm_eval/tasks/bbh/zeroshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,987   copying lm_eval/tasks/bbh/zeroshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,989   copying lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,991   copying lm_eval/tasks/bbh/zeroshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,994   copying lm_eval/tasks/bbh/zeroshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,996   copying lm_eval/tasks/bbh/zeroshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:44,998   copying lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:45,000   copying lm_eval/tasks/bbh/zeroshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:45,002   copying lm_eval/tasks/bbh/zeroshot/_bbh_zeroshot.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:45,004   copying lm_eval/tasks/bbh/zeroshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:45,007   copying lm_eval/tasks/bbh/zeroshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:27:45,009   copying lm_eval/tasks/bbh/cot_zeroshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,011   copying lm_eval/tasks/bbh/cot_zeroshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,014   copying lm_eval/tasks/bbh/cot_zeroshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,017   copying lm_eval/tasks/bbh/cot_zeroshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,019   copying lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,021   copying lm_eval/tasks/bbh/cot_zeroshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,023   copying lm_eval/tasks/bbh/cot_zeroshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,026   copying lm_eval/tasks/bbh/cot_zeroshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,028   copying lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,030   copying lm_eval/tasks/bbh/cot_zeroshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,032   copying lm_eval/tasks/bbh/cot_zeroshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,034   copying lm_eval/tasks/bbh/cot_zeroshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,037   copying lm_eval/tasks/bbh/cot_zeroshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,039   copying lm_eval/tasks/bbh/cot_zeroshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,041   copying lm_eval/tasks/bbh/cot_zeroshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,044   copying lm_eval/tasks/bbh/cot_zeroshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,046   copying lm_eval/tasks/bbh/cot_zeroshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,048   copying lm_eval/tasks/bbh/cot_zeroshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,051   copying lm_eval/tasks/bbh/cot_zeroshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,053   copying lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,055   copying lm_eval/tasks/bbh/cot_zeroshot/_bbh_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,058   copying lm_eval/tasks/bbh/cot_zeroshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,061   copying lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,063   copying lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,065   copying lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,067   copying lm_eval/tasks/bbh/cot_zeroshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,070   copying lm_eval/tasks/bbh/cot_zeroshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,072   copying lm_eval/tasks/bbh/cot_zeroshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:27:45,074   creating build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,075   copying lm_eval/tasks/bbh/fewshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,077   copying lm_eval/tasks/bbh/fewshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,079   copying lm_eval/tasks/bbh/fewshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,081   copying lm_eval/tasks/bbh/fewshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,083   copying lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,085   copying lm_eval/tasks/bbh/fewshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,088   copying lm_eval/tasks/bbh/fewshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,090   copying lm_eval/tasks/bbh/fewshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,092   copying lm_eval/tasks/bbh/fewshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,095   copying lm_eval/tasks/bbh/fewshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,097   copying lm_eval/tasks/bbh/fewshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,100   copying lm_eval/tasks/bbh/fewshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,102   copying lm_eval/tasks/bbh/fewshot/_bbh_fewshot.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,104   copying lm_eval/tasks/bbh/fewshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,106   copying lm_eval/tasks/bbh/fewshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,109   copying lm_eval/tasks/bbh/fewshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,111   copying lm_eval/tasks/bbh/fewshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,113   copying lm_eval/tasks/bbh/fewshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,115   copying lm_eval/tasks/bbh/fewshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,117   copying lm_eval/tasks/bbh/fewshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,119   copying lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,121   copying lm_eval/tasks/bbh/fewshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,124   copying lm_eval/tasks/bbh/fewshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,126   copying lm_eval/tasks/bbh/fewshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,128   copying lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,130   copying lm_eval/tasks/bbh/fewshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,133   copying lm_eval/tasks/bbh/fewshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,135   copying lm_eval/tasks/bbh/fewshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:27:45,137   creating build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,139   copying lm_eval/tasks/bbh/cot_fewshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,141   copying lm_eval/tasks/bbh/cot_fewshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,144   copying lm_eval/tasks/bbh/cot_fewshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,146   copying lm_eval/tasks/bbh/cot_fewshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,149   copying lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,151   copying lm_eval/tasks/bbh/cot_fewshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,153   copying lm_eval/tasks/bbh/cot_fewshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,155   copying lm_eval/tasks/bbh/cot_fewshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,157   copying lm_eval/tasks/bbh/cot_fewshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,160   copying lm_eval/tasks/bbh/cot_fewshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,162   copying lm_eval/tasks/bbh/cot_fewshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,165   copying lm_eval/tasks/bbh/cot_fewshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,167   copying lm_eval/tasks/bbh/cot_fewshot/_bbh.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,170   copying lm_eval/tasks/bbh/cot_fewshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,173   copying lm_eval/tasks/bbh/cot_fewshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,176   copying lm_eval/tasks/bbh/cot_fewshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,178   copying lm_eval/tasks/bbh/cot_fewshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,180   copying lm_eval/tasks/bbh/cot_fewshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,182   copying lm_eval/tasks/bbh/cot_fewshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,185   copying lm_eval/tasks/bbh/cot_fewshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,187   copying lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,190   copying lm_eval/tasks/bbh/cot_fewshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,192   copying lm_eval/tasks/bbh/cot_fewshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,194   copying lm_eval/tasks/bbh/cot_fewshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,197   copying lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,199   copying lm_eval/tasks/bbh/cot_fewshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,202   copying lm_eval/tasks/bbh/cot_fewshot/_bbh_cot_fewshot.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,204   copying lm_eval/tasks/bbh/cot_fewshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,206   copying lm_eval/tasks/bbh/cot_fewshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:27:45,209   creating build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,210   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,212   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,215   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,217   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,220   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,222   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,225   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,227   copying lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,230   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,232   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,235   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,237   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,240   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,242   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,245   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,247   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,250   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,252   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,255   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,257   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,260   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,263   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,265   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,267   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,270   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,272   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,275   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,277   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,280   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,283   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,285   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,287   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,290   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,292   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,294   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,296   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,299   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,301   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,303   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,306   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,308   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,311   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,313   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,316   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,318   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,321   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,323   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,325   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,328   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,330   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,333   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,336   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,338   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,341   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,343   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,346   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,348   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,351   copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:27:45,353   creating build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,354   copying lm_eval/tasks/mmlu/generative/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,356   copying lm_eval/tasks/mmlu/generative/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,359   copying lm_eval/tasks/mmlu/generative/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,361   copying lm_eval/tasks/mmlu/generative/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,363   copying lm_eval/tasks/mmlu/generative/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,366   copying lm_eval/tasks/mmlu/generative/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,368   copying lm_eval/tasks/mmlu/generative/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,370   copying lm_eval/tasks/mmlu/generative/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,372   copying lm_eval/tasks/mmlu/generative/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,375   copying lm_eval/tasks/mmlu/generative/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,377   copying lm_eval/tasks/mmlu/generative/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,379   copying lm_eval/tasks/mmlu/generative/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,381   copying lm_eval/tasks/mmlu/generative/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,384   copying lm_eval/tasks/mmlu/generative/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,386   copying lm_eval/tasks/mmlu/generative/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,388   copying lm_eval/tasks/mmlu/generative/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,390   copying lm_eval/tasks/mmlu/generative/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,393   copying lm_eval/tasks/mmlu/generative/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,395   copying lm_eval/tasks/mmlu/generative/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,397   copying lm_eval/tasks/mmlu/generative/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,399   copying lm_eval/tasks/mmlu/generative/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,401   copying lm_eval/tasks/mmlu/generative/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,404   copying lm_eval/tasks/mmlu/generative/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,406   copying lm_eval/tasks/mmlu/generative/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,408   copying lm_eval/tasks/mmlu/generative/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,410   copying lm_eval/tasks/mmlu/generative/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,413   copying lm_eval/tasks/mmlu/generative/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,415   copying lm_eval/tasks/mmlu/generative/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,417   copying lm_eval/tasks/mmlu/generative/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,419   copying lm_eval/tasks/mmlu/generative/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,421   copying lm_eval/tasks/mmlu/generative/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,423   copying lm_eval/tasks/mmlu/generative/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,425   copying lm_eval/tasks/mmlu/generative/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,426   copying lm_eval/tasks/mmlu/generative/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,428   copying lm_eval/tasks/mmlu/generative/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,430   copying lm_eval/tasks/mmlu/generative/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,432   copying lm_eval/tasks/mmlu/generative/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,434   copying lm_eval/tasks/mmlu/generative/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,437   copying lm_eval/tasks/mmlu/generative/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,438   copying lm_eval/tasks/mmlu/generative/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,441   copying lm_eval/tasks/mmlu/generative/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,442   copying lm_eval/tasks/mmlu/generative/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,444   copying lm_eval/tasks/mmlu/generative/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,446   copying lm_eval/tasks/mmlu/generative/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,448   copying lm_eval/tasks/mmlu/generative/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,451   copying lm_eval/tasks/mmlu/generative/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,453   copying lm_eval/tasks/mmlu/generative/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,456   copying lm_eval/tasks/mmlu/generative/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,459   copying lm_eval/tasks/mmlu/generative/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,462   copying lm_eval/tasks/mmlu/generative/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,464   copying lm_eval/tasks/mmlu/generative/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,467   copying lm_eval/tasks/mmlu/generative/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,469   copying lm_eval/tasks/mmlu/generative/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,473   copying lm_eval/tasks/mmlu/generative/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,478   copying lm_eval/tasks/mmlu/generative/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,480   copying lm_eval/tasks/mmlu/generative/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,483   copying lm_eval/tasks/mmlu/generative/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,485   copying lm_eval/tasks/mmlu/generative/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:27:45,487   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,489   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,491   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,493   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,495   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,497   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,499   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,501   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,503   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,506   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,508   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,510   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,512   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,514   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,516   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,518   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,520   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,522   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,524   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,526   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,528   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,530   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,533   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,535   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,537   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,539   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,541   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,543   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,545   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,547   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,549   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,551   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,553   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,556   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,557   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,560   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,562   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,564   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,566   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,568   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,570   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,572   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,574   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,576   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,578   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,580   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,583   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,585   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,587   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,589   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,591   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,593   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,595   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,597   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,599   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,601   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,603   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,605   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:27:45,607   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,609   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,611   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,613   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,616   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,618   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,620   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,622   copying lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,624   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,626   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,628   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,630   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,632   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,634   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,636   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,638   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,640   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,642   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,644   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,646   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,648   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,650   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,652   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,654   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,656   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,658   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,660   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,662   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,664   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,666   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,668   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,670   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,672   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,674   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,676   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,678   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,681   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,683   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,685   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,687   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,689   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,691   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,694   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,696   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,698   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,700   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,702   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,704   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,706   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,709   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,711   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,713   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,715   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,717   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,719   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,721   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,723   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,726   copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:27:45,728   creating build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,729   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,731   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,733   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,736   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,738   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,740   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,742   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,744   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,746   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,748   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,751   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,753   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,756   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,759   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,763   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,767   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,770   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,772   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,774   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,776   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,778   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,780   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,782   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,784   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,786   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,788   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,790   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,792   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,795   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,797   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,799   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,801   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,803   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,805   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,807   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,810   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,812   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,814   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,816   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,818   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,820   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,822   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,825   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,827   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,829   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,831   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,833   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,835   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,837   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,839   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,841   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,843   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,846   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,848   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,850   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,852   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,854   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,856   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:27:45,858   creating build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,859   copying lm_eval/tasks/mmlu/continuation/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,861   copying lm_eval/tasks/mmlu/continuation/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,863   copying lm_eval/tasks/mmlu/continuation/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,866   copying lm_eval/tasks/mmlu/continuation/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,867   copying lm_eval/tasks/mmlu/continuation/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,870   copying lm_eval/tasks/mmlu/continuation/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,872   copying lm_eval/tasks/mmlu/continuation/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,874   copying lm_eval/tasks/mmlu/continuation/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,876   copying lm_eval/tasks/mmlu/continuation/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,878   copying lm_eval/tasks/mmlu/continuation/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,880   copying lm_eval/tasks/mmlu/continuation/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,882   copying lm_eval/tasks/mmlu/continuation/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,884   copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,886   copying lm_eval/tasks/mmlu/continuation/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,888   copying lm_eval/tasks/mmlu/continuation/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,890   copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,892   copying lm_eval/tasks/mmlu/continuation/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,894   copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,896   copying lm_eval/tasks/mmlu/continuation/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,898   copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,900   copying lm_eval/tasks/mmlu/continuation/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,902   copying lm_eval/tasks/mmlu/continuation/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,904   copying lm_eval/tasks/mmlu/continuation/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,906   copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,908   copying lm_eval/tasks/mmlu/continuation/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,910   copying lm_eval/tasks/mmlu/continuation/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,912   copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,914   copying lm_eval/tasks/mmlu/continuation/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,916   copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,918   copying lm_eval/tasks/mmlu/continuation/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,920   copying lm_eval/tasks/mmlu/continuation/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,922   copying lm_eval/tasks/mmlu/continuation/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,924   copying lm_eval/tasks/mmlu/continuation/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,926   copying lm_eval/tasks/mmlu/continuation/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,928   copying lm_eval/tasks/mmlu/continuation/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,930   copying lm_eval/tasks/mmlu/continuation/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,933   copying lm_eval/tasks/mmlu/continuation/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,935   copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,937   copying lm_eval/tasks/mmlu/continuation/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,939   copying lm_eval/tasks/mmlu/continuation/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,941   copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,943   copying lm_eval/tasks/mmlu/continuation/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,945   copying lm_eval/tasks/mmlu/continuation/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,947   copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,949   copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,951   copying lm_eval/tasks/mmlu/continuation/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,953   copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,955   copying lm_eval/tasks/mmlu/continuation/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,957   copying lm_eval/tasks/mmlu/continuation/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,959   copying lm_eval/tasks/mmlu/continuation/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,962   copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,964   copying lm_eval/tasks/mmlu/continuation/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,966   copying lm_eval/tasks/mmlu/continuation/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,968   copying lm_eval/tasks/mmlu/continuation/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,970   copying lm_eval/tasks/mmlu/continuation/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,972   copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,974   copying lm_eval/tasks/mmlu/continuation/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,976   copying lm_eval/tasks/mmlu/continuation/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:27:45,978   creating build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:45,979   copying lm_eval/tasks/mmlu/default/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:45,981   copying lm_eval/tasks/mmlu/default/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:45,984   copying lm_eval/tasks/mmlu/default/_mmlu_humanities.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:45,986   copying lm_eval/tasks/mmlu/default/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:45,988   copying lm_eval/tasks/mmlu/default/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:45,990   copying lm_eval/tasks/mmlu/default/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:45,992   copying lm_eval/tasks/mmlu/default/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:45,994   copying lm_eval/tasks/mmlu/default/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:45,996   copying lm_eval/tasks/mmlu/default/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:45,998   copying lm_eval/tasks/mmlu/default/_mmlu_social_sciences.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,000   copying lm_eval/tasks/mmlu/default/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,002   copying lm_eval/tasks/mmlu/default/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,004   copying lm_eval/tasks/mmlu/default/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,006   copying lm_eval/tasks/mmlu/default/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,008   copying lm_eval/tasks/mmlu/default/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,010   copying lm_eval/tasks/mmlu/default/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,012   copying lm_eval/tasks/mmlu/default/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,014   copying lm_eval/tasks/mmlu/default/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,016   copying lm_eval/tasks/mmlu/default/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,018   copying lm_eval/tasks/mmlu/default/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,020   copying lm_eval/tasks/mmlu/default/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,022   copying lm_eval/tasks/mmlu/default/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,024   copying lm_eval/tasks/mmlu/default/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,026   copying lm_eval/tasks/mmlu/default/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,028   copying lm_eval/tasks/mmlu/default/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,030   copying lm_eval/tasks/mmlu/default/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,032   copying lm_eval/tasks/mmlu/default/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,034   copying lm_eval/tasks/mmlu/default/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,036   copying lm_eval/tasks/mmlu/default/_mmlu_other.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,038   copying lm_eval/tasks/mmlu/default/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,041   copying lm_eval/tasks/mmlu/default/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,043   copying lm_eval/tasks/mmlu/default/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,045   copying lm_eval/tasks/mmlu/default/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,047   copying lm_eval/tasks/mmlu/default/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,049   copying lm_eval/tasks/mmlu/default/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,051   copying lm_eval/tasks/mmlu/default/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,053   copying lm_eval/tasks/mmlu/default/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,055   copying lm_eval/tasks/mmlu/default/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,057   copying lm_eval/tasks/mmlu/default/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,059   copying lm_eval/tasks/mmlu/default/_mmlu_stem.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,061   copying lm_eval/tasks/mmlu/default/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,063   copying lm_eval/tasks/mmlu/default/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,065   copying lm_eval/tasks/mmlu/default/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,067   copying lm_eval/tasks/mmlu/default/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,069   copying lm_eval/tasks/mmlu/default/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,071   copying lm_eval/tasks/mmlu/default/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,073   copying lm_eval/tasks/mmlu/default/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,075   copying lm_eval/tasks/mmlu/default/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,077   copying lm_eval/tasks/mmlu/default/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,079   copying lm_eval/tasks/mmlu/default/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,081   copying lm_eval/tasks/mmlu/default/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,083   copying lm_eval/tasks/mmlu/default/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,085   copying lm_eval/tasks/mmlu/default/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,087   copying lm_eval/tasks/mmlu/default/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,089   copying lm_eval/tasks/mmlu/default/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,091   copying lm_eval/tasks/mmlu/default/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,093   copying lm_eval/tasks/mmlu/default/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,096   copying lm_eval/tasks/mmlu/default/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,098   copying lm_eval/tasks/mmlu/default/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,100   copying lm_eval/tasks/mmlu/default/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,102   copying lm_eval/tasks/mmlu/default/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,104   copying lm_eval/tasks/mmlu/default/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:27:46,106   copying lm_eval/tasks/translation/wmt16_de-en.yaml -> build/lib/lm_eval/tasks/translation
2025-08-31T08:27:46,108   copying lm_eval/tasks/translation/wmt16_en-ro.yaml -> build/lib/lm_eval/tasks/translation
2025-08-31T08:27:46,110   copying lm_eval/tasks/translation/wmt14_fr-en.yaml -> build/lib/lm_eval/tasks/translation
2025-08-31T08:27:46,112   copying lm_eval/tasks/translation/wmt16_ro-en.yaml -> build/lib/lm_eval/tasks/translation
2025-08-31T08:27:46,115   copying lm_eval/tasks/translation/iwslt2017_ar-en.yaml -> build/lib/lm_eval/tasks/translation
2025-08-31T08:27:46,117   copying lm_eval/tasks/translation/wmt14_en-fr.yaml -> build/lib/lm_eval/tasks/translation
2025-08-31T08:27:46,119   copying lm_eval/tasks/translation/iwslt2017_en-ar.yaml -> build/lib/lm_eval/tasks/translation
2025-08-31T08:27:46,121   copying lm_eval/tasks/translation/wmt16_en-de.yaml -> build/lib/lm_eval/tasks/translation
2025-08-31T08:27:46,123   copying lm_eval/tasks/gpqa/zeroshot/gpqa_diamond_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot
2025-08-31T08:27:46,125   copying lm_eval/tasks/gpqa/zeroshot/gpqa_main_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot
2025-08-31T08:27:46,127   copying lm_eval/tasks/gpqa/zeroshot/gpqa_extended_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot
2025-08-31T08:27:46,129   copying lm_eval/tasks/gpqa/generative/gpqa_diamond_generative_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/generative
2025-08-31T08:27:46,131   copying lm_eval/tasks/gpqa/generative/gpqa_extended_generative_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/generative
2025-08-31T08:27:46,133   copying lm_eval/tasks/gpqa/generative/gpqa_main_generative_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/generative
2025-08-31T08:27:46,135   copying lm_eval/tasks/gpqa/cot_zeroshot/gpqa_extended_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot
2025-08-31T08:27:46,138   copying lm_eval/tasks/gpqa/cot_zeroshot/gpqa_diamond_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot
2025-08-31T08:27:46,139   copying lm_eval/tasks/gpqa/cot_zeroshot/gpqa_main_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot
2025-08-31T08:27:46,141   copying lm_eval/tasks/gpqa/cot_n_shot/gpqa_diamond_cot_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot
2025-08-31T08:27:46,143   copying lm_eval/tasks/gpqa/cot_n_shot/gpqa_main_cot_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot
2025-08-31T08:27:46,146   copying lm_eval/tasks/gpqa/cot_n_shot/gpqa_extended_cot_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot
2025-08-31T08:27:46,147   copying lm_eval/tasks/gpqa/n_shot/gpqa_main_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/n_shot
2025-08-31T08:27:46,150   copying lm_eval/tasks/gpqa/n_shot/gpqa_extended_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/n_shot
2025-08-31T08:27:46,152   copying lm_eval/tasks/gpqa/n_shot/gpqa_diamond_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/n_shot
2025-08-31T08:27:46,154   copying lm_eval/tasks/tmlu/default/tmlu_tour_leader.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,156   copying lm_eval/tasks/tmlu/default/tmlu_AST_civics.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,158   copying lm_eval/tasks/tmlu/default/tmlu_CAP_geography.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,160   copying lm_eval/tasks/tmlu/default/tmlu_GSAT_chemistry.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,162   copying lm_eval/tasks/tmlu/default/tmlu_AST_chinese.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,165   copying lm_eval/tasks/tmlu/default/tmlu_GSAT_geography.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,167   copying lm_eval/tasks/tmlu/default/tmlu_AST_biology.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,169   copying lm_eval/tasks/tmlu/default/tmlu_CAP_chemistry.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,171   copying lm_eval/tasks/tmlu/default/tmlu_nutritionist.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,174   copying lm_eval/tasks/tmlu/default/tmlu_GSAT_earth_science.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,176   copying lm_eval/tasks/tmlu/default/tmlu_lawyer_qualification.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,178   copying lm_eval/tasks/tmlu/default/tmlu_CAP_civics.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,180   copying lm_eval/tasks/tmlu/default/tmlu_taiwan_tourist_resources.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,182   copying lm_eval/tasks/tmlu/default/tmlu_basic_traditional_chinese_medicine.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,184   copying lm_eval/tasks/tmlu/default/tmlu_driving_rule.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,186   copying lm_eval/tasks/tmlu/default/tmlu_accountant.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,188   copying lm_eval/tasks/tmlu/default/tmlu_AST_geography.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,190   copying lm_eval/tasks/tmlu/default/tmlu_tour_guide.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,192   copying lm_eval/tasks/tmlu/default/tmlu_clinical_traditional_chinese_medicine.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,195   copying lm_eval/tasks/tmlu/default/tmlu_GSAT_civics.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,197   copying lm_eval/tasks/tmlu/default/tmlu_clinical_psychologist.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,199   copying lm_eval/tasks/tmlu/default/_tmlu.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,201   copying lm_eval/tasks/tmlu/default/tmlu_AST_chemistry.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,202   copying lm_eval/tasks/tmlu/default/tmlu_CAP_biology.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,204   copying lm_eval/tasks/tmlu/default/tmlu_teacher_qualification.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,207   copying lm_eval/tasks/tmlu/default/tmlu_AST_history.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,209   copying lm_eval/tasks/tmlu/default/tmlu_GSAT_biology.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,211   copying lm_eval/tasks/tmlu/default/tmlu_GSAT_history.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,213   copying lm_eval/tasks/tmlu/default/tmlu_GSAT_chinese.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,215   copying lm_eval/tasks/tmlu/default/tmlu_CAP_history.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,218   copying lm_eval/tasks/tmlu/default/tmlu_CAP_earth_science.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,220   copying lm_eval/tasks/tmlu/default/tmlu_CAP_chinese.yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:27:46,222   copying lm_eval/tasks/arabicmmlu/_arabicmmlu_stem.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,224   copying lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,226   copying lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,228   copying lm_eval/tasks/arabicmmlu/arabicmmlu_geography_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,230   copying lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,232   copying lm_eval/tasks/arabicmmlu/arabicmmlu_accounting_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,234   copying lm_eval/tasks/arabicmmlu/arabicmmlu_physics_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,236   copying lm_eval/tasks/arabicmmlu/arabicmmlu_law_professional.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,238   copying lm_eval/tasks/arabicmmlu/arabicmmlu_driving_test.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,240   copying lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,242   copying lm_eval/tasks/arabicmmlu/arabicmmlu_economics_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,244   copying lm_eval/tasks/arabicmmlu/arabicmmlu_history_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,246   copying lm_eval/tasks/arabicmmlu/_arabicmmlu_humanities.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,249   copying lm_eval/tasks/arabicmmlu/arabicmmlu_history_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,251   copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,253   copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,255   copying lm_eval/tasks/arabicmmlu/arabicmmlu_civics_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,257   copying lm_eval/tasks/arabicmmlu/_arabicmmlu_language.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,260   copying lm_eval/tasks/arabicmmlu/arabicmmlu_philosophy_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,262   copying lm_eval/tasks/arabicmmlu/arabicmmlu_economics_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,264   copying lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,266   copying lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,268   copying lm_eval/tasks/arabicmmlu/_arabicmmlu.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,270   copying lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,272   copying lm_eval/tasks/arabicmmlu/arabicmmlu_geography_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,274   copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_general.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,276   copying lm_eval/tasks/arabicmmlu/arabicmmlu_math_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,278   copying lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,280   copying lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,282   copying lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,284   copying lm_eval/tasks/arabicmmlu/arabicmmlu_history_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,286   copying lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,288   copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,290   copying lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,292   copying lm_eval/tasks/arabicmmlu/_arabicmmlu_other.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,294   copying lm_eval/tasks/arabicmmlu/_arabicmmlu_social_science.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,296   copying lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,298   copying lm_eval/tasks/arabicmmlu/arabicmmlu_civics_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,300   copying lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,303   copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_grammar.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,305   copying lm_eval/tasks/arabicmmlu/arabicmmlu_management_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,308   copying lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,309   copying lm_eval/tasks/arabicmmlu/arabicmmlu_political_science_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,312   copying lm_eval/tasks/arabicmmlu/arabicmmlu_geography_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,313   copying lm_eval/tasks/arabicmmlu/arabicmmlu_economics_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,316   copying lm_eval/tasks/arabicmmlu/arabicmmlu_biology_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:27:46,318   creating build/lib/lm_eval/tasks/mgsm/en_cot
2025-08-31T08:27:46,319   copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_bn.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot
2025-08-31T08:27:46,321   copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_te.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot
2025-08-31T08:27:46,323   copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ru.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot
2025-08-31T08:27:46,325   copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_zh.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot
2025-08-31T08:27:46,327   copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_de.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot
2025-08-31T08:27:46,329   copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_th.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot
2025-08-31T08:27:46,331   copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_en.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot
2025-08-31T08:27:46,333   copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_sw.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot
2025-08-31T08:27:46,335   copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ja.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot
2025-08-31T08:27:46,337   copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_es.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot
2025-08-31T08:27:46,339   copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_fr.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot
2025-08-31T08:27:46,341   creating build/lib/lm_eval/tasks/mgsm/native_cot
2025-08-31T08:27:46,342   copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_th.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot
2025-08-31T08:27:46,344   copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_fr.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot
2025-08-31T08:27:46,346   copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ru.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot
2025-08-31T08:27:46,348   copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_de.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot
2025-08-31T08:27:46,350   copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_sw.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot
2025-08-31T08:27:46,352   copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_te.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot
2025-08-31T08:27:46,354   copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ja.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot
2025-08-31T08:27:46,356   copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_es.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot
2025-08-31T08:27:46,358   copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_bn.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot
2025-08-31T08:27:46,360   copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_zh.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot
2025-08-31T08:27:46,363   copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_en.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot
2025-08-31T08:27:46,365   creating build/lib/lm_eval/tasks/mgsm/direct
2025-08-31T08:27:46,365   copying lm_eval/tasks/mgsm/direct/mgsm_direct_te.yaml -> build/lib/lm_eval/tasks/mgsm/direct
2025-08-31T08:27:46,368   copying lm_eval/tasks/mgsm/direct/mgsm_direct_zh.yaml -> build/lib/lm_eval/tasks/mgsm/direct
2025-08-31T08:27:46,369   copying lm_eval/tasks/mgsm/direct/mgsm_direct_bn.yaml -> build/lib/lm_eval/tasks/mgsm/direct
2025-08-31T08:27:46,372   copying lm_eval/tasks/mgsm/direct/mgsm_direct_ru.yaml -> build/lib/lm_eval/tasks/mgsm/direct
2025-08-31T08:27:46,374   copying lm_eval/tasks/mgsm/direct/mgsm_direct_en.yaml -> build/lib/lm_eval/tasks/mgsm/direct
2025-08-31T08:27:46,376   copying lm_eval/tasks/mgsm/direct/mgsm_direct_ja.yaml -> build/lib/lm_eval/tasks/mgsm/direct
2025-08-31T08:27:46,378   copying lm_eval/tasks/mgsm/direct/mgsm_direct_de.yaml -> build/lib/lm_eval/tasks/mgsm/direct
2025-08-31T08:27:46,380   copying lm_eval/tasks/mgsm/direct/mgsm_direct_th.yaml -> build/lib/lm_eval/tasks/mgsm/direct
2025-08-31T08:27:46,382   copying lm_eval/tasks/mgsm/direct/mgsm_direct_es.yaml -> build/lib/lm_eval/tasks/mgsm/direct
2025-08-31T08:27:46,384   copying lm_eval/tasks/mgsm/direct/mgsm_direct_fr.yaml -> build/lib/lm_eval/tasks/mgsm/direct
2025-08-31T08:27:46,386   copying lm_eval/tasks/mgsm/direct/mgsm_direct_sw.yaml -> build/lib/lm_eval/tasks/mgsm/direct
2025-08-31T08:27:46,388   copying lm_eval/tasks/med_prescriptions/med_prescriptions_hard.yaml -> build/lib/lm_eval/tasks/med_prescriptions
2025-08-31T08:27:46,391   copying lm_eval/tasks/med_prescriptions/med_prescriptions_easy.yaml -> build/lib/lm_eval/tasks/med_prescriptions
2025-08-31T08:27:46,393   copying lm_eval/tasks/basque_bench/wnli_eu.yaml -> build/lib/lm_eval/tasks/basque_bench
2025-08-31T08:27:46,395   copying lm_eval/tasks/basque_bench/mgsm_direct_eu.yaml -> build/lib/lm_eval/tasks/basque_bench
2025-08-31T08:27:46,397   copying lm_eval/tasks/basque_bench/mgsm_cot_native_eu.yaml -> build/lib/lm_eval/tasks/basque_bench
2025-08-31T08:27:46,399   copying lm_eval/tasks/basque_bench/piqa_eu.yaml -> build/lib/lm_eval/tasks/basque_bench
2025-08-31T08:27:46,401   copying lm_eval/tasks/basque_bench/paws_eu.yaml -> build/lib/lm_eval/tasks/basque_bench
2025-08-31T08:27:46,403   copying lm_eval/tasks/basque_bench/xcopa_eu.yaml -> build/lib/lm_eval/tasks/basque_bench
2025-08-31T08:27:46,405   copying lm_eval/tasks/basque_bench/basque_bench.yaml -> build/lib/lm_eval/tasks/basque_bench
2025-08-31T08:27:46,407   copying lm_eval/tasks/basque_bench/arc_eu_challenge.yaml -> build/lib/lm_eval/tasks/basque_bench
2025-08-31T08:27:46,409   copying lm_eval/tasks/basque_bench/arc_eu_easy.yaml -> build/lib/lm_eval/tasks/basque_bench
2025-08-31T08:27:46,411   copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-en.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:27:46,413   copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-es.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:27:46,415   copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-de.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:27:46,417   copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-pt.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:27:46,419   copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-gl.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:27:46,421   copying lm_eval/tasks/basque_bench/flores_eu/flores_en-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:27:46,423   copying lm_eval/tasks/basque_bench/flores_eu/flores_eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:27:46,425   copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-ca.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:27:46,427   copying lm_eval/tasks/basque_bench/flores_eu/flores_it-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:27:46,429   copying lm_eval/tasks/basque_bench/flores_eu/flores_gl-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:27:46,431   copying lm_eval/tasks/basque_bench/flores_eu/flores_ca-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:27:46,433   copying lm_eval/tasks/basque_bench/flores_eu/flores_pt-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:27:46,436   copying lm_eval/tasks/basque_bench/flores_eu/flores_de-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:27:46,438   copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-fr.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:27:46,440   copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-it.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:27:46,442   copying lm_eval/tasks/basque_bench/flores_eu/flores_es-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:27:46,444   copying lm_eval/tasks/basque_bench/flores_eu/flores_fr-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:27:46,446   copying lm_eval/tasks/chartqa/chartqa_llama.yaml -> build/lib/lm_eval/tasks/chartqa
2025-08-31T08:27:46,448   copying lm_eval/tasks/chartqa/chartqa.yaml -> build/lib/lm_eval/tasks/chartqa
2025-08-31T08:27:46,450   copying lm_eval/tasks/chartqa/chartqa_llama_90.yaml -> build/lib/lm_eval/tasks/chartqa
2025-08-31T08:27:46,453   copying lm_eval/tasks/race/race.yaml -> build/lib/lm_eval/tasks/race
2025-08-31T08:27:46,455   copying lm_eval/tasks/glianorex/glianorex.yaml -> build/lib/lm_eval/tasks/glianorex
2025-08-31T08:27:46,457   copying lm_eval/tasks/glianorex/glianorex_en.yaml -> build/lib/lm_eval/tasks/glianorex
2025-08-31T08:27:46,459   copying lm_eval/tasks/glianorex/glianorex_fr.yaml -> build/lib/lm_eval/tasks/glianorex
2025-08-31T08:27:46,461   creating build/lib/lm_eval/tasks/triviaqa
2025-08-31T08:27:46,462   copying lm_eval/tasks/triviaqa/default.yaml -> build/lib/lm_eval/tasks/triviaqa
2025-08-31T08:27:46,464   copying lm_eval/tasks/mathqa/mathqa.yaml -> build/lib/lm_eval/tasks/mathqa
2025-08-31T08:27:46,466   creating build/lib/lm_eval/tasks/unscramble
2025-08-31T08:27:46,467   copying lm_eval/tasks/unscramble/reversed_words.yaml -> build/lib/lm_eval/tasks/unscramble
2025-08-31T08:27:46,469   copying lm_eval/tasks/unscramble/anagrams1.yaml -> build/lib/lm_eval/tasks/unscramble
2025-08-31T08:27:46,471   copying lm_eval/tasks/unscramble/random_insertion.yaml -> build/lib/lm_eval/tasks/unscramble
2025-08-31T08:27:46,473   copying lm_eval/tasks/unscramble/cycle_letters.yaml -> build/lib/lm_eval/tasks/unscramble
2025-08-31T08:27:46,475   copying lm_eval/tasks/unscramble/anagrams2.yaml -> build/lib/lm_eval/tasks/unscramble
2025-08-31T08:27:46,477   creating build/lib/lm_eval/tasks/arithmetic
2025-08-31T08:27:46,478   copying lm_eval/tasks/arithmetic/arithmetic_4ds.yaml -> build/lib/lm_eval/tasks/arithmetic
2025-08-31T08:27:46,480   copying lm_eval/tasks/arithmetic/arithmetic_2ds.yaml -> build/lib/lm_eval/tasks/arithmetic
2025-08-31T08:27:46,482   copying lm_eval/tasks/arithmetic/arithmetic_3ds.yaml -> build/lib/lm_eval/tasks/arithmetic
2025-08-31T08:27:46,484   copying lm_eval/tasks/arithmetic/arithmetic_2da.yaml -> build/lib/lm_eval/tasks/arithmetic
2025-08-31T08:27:46,486   copying lm_eval/tasks/arithmetic/arithmetic_1dc.yaml -> build/lib/lm_eval/tasks/arithmetic
2025-08-31T08:27:46,488   copying lm_eval/tasks/arithmetic/arithmetic_4da.yaml -> build/lib/lm_eval/tasks/arithmetic
2025-08-31T08:27:46,490   copying lm_eval/tasks/arithmetic/arithmetic_5da.yaml -> build/lib/lm_eval/tasks/arithmetic
2025-08-31T08:27:46,492   copying lm_eval/tasks/arithmetic/arithmetic_5ds.yaml -> build/lib/lm_eval/tasks/arithmetic
2025-08-31T08:27:46,494   copying lm_eval/tasks/arithmetic/arithmetic_2dm.yaml -> build/lib/lm_eval/tasks/arithmetic
2025-08-31T08:27:46,496   copying lm_eval/tasks/arithmetic/arithmetic_3da.yaml -> build/lib/lm_eval/tasks/arithmetic
2025-08-31T08:27:46,498   copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,500   copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,502   copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,504   copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,506   copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,509   copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,511   copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,513   copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,515   copying lm_eval/tasks/evalita_llm/_evalita-mp_mc.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,517   copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,519   copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,521   copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,524   copying lm_eval/tasks/evalita_llm/_evalita-mp_re_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,526   copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,528   copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,530   copying lm_eval/tasks/evalita_llm/_evalita-mp_te_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,532   copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,533   copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,535   copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,538   copying lm_eval/tasks/evalita_llm/_evalita-mp_ls_task.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,539   copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,541   copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,543   copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,545   copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,548   copying lm_eval/tasks/evalita_llm/_evalita-mp_gen.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,550   copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,551   copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,554   copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,556   copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,558   copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_task.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,560   copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,562   copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,564   copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,566   copying lm_eval/tasks/evalita_llm/_evalita-mp_re_task.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,568   copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,570   copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,572   copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,574   copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,576   copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,578   copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,580   copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,582   copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,584   copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,586   copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,588   copying lm_eval/tasks/evalita_llm/_evalita-mp.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,590   copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,592   copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_task.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,594   copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,596   copying lm_eval/tasks/evalita_llm/_evalita-mp_ls_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,598   copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,600   copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_group.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,602   copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,604   copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,606   copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,608   copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,610   copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,612   copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,614   copying lm_eval/tasks/evalita_llm/_evalita-mp_at_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,616   copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,618   copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_task.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,620   copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,623   copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,625   copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,627   copying lm_eval/tasks/evalita_llm/_evalita-mp_re_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,629   copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,631   copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,633   copying lm_eval/tasks/evalita_llm/_evalita-mp_ls_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,635   copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,637   copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,639   copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,641   copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,643   copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,645   copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:27:46,648   copying lm_eval/tasks/xnli/xnli_es.yaml -> build/lib/lm_eval/tasks/xnli
2025-08-31T08:27:46,650   copying lm_eval/tasks/xnli/_xnli.yaml -> build/lib/lm_eval/tasks/xnli
2025-08-31T08:27:46,652   copying lm_eval/tasks/xnli/xnli_fr.yaml -> build/lib/lm_eval/tasks/xnli
2025-08-31T08:27:46,655   copying lm_eval/tasks/xnli/xnli_hi.yaml -> build/lib/lm_eval/tasks/xnli
2025-08-31T08:27:46,659   copying lm_eval/tasks/xnli/xnli_tr.yaml -> build/lib/lm_eval/tasks/xnli
2025-08-31T08:27:46,663   copying lm_eval/tasks/xnli/xnli_el.yaml -> build/lib/lm_eval/tasks/xnli
2025-08-31T08:27:46,665   copying lm_eval/tasks/xnli/xnli_vi.yaml -> build/lib/lm_eval/tasks/xnli
2025-08-31T08:27:46,667   copying lm_eval/tasks/xnli/xnli_ar.yaml -> build/lib/lm_eval/tasks/xnli
2025-08-31T08:27:46,669   copying lm_eval/tasks/xnli/xnli_zh.yaml -> build/lib/lm_eval/tasks/xnli
2025-08-31T08:27:46,671   copying lm_eval/tasks/xnli/xnli_th.yaml -> build/lib/lm_eval/tasks/xnli
2025-08-31T08:27:46,673   copying lm_eval/tasks/xnli/xnli_ru.yaml -> build/lib/lm_eval/tasks/xnli
2025-08-31T08:27:46,675   copying lm_eval/tasks/xnli/xnli_sw.yaml -> build/lib/lm_eval/tasks/xnli
2025-08-31T08:27:46,676   copying lm_eval/tasks/xnli/xnli_ur.yaml -> build/lib/lm_eval/tasks/xnli
2025-08-31T08:27:46,678   copying lm_eval/tasks/xnli/xnli_de.yaml -> build/lib/lm_eval/tasks/xnli
2025-08-31T08:27:46,680   copying lm_eval/tasks/xnli/xnli_bg.yaml -> build/lib/lm_eval/tasks/xnli
2025-08-31T08:27:46,682   copying lm_eval/tasks/xnli/xnli_en.yaml -> build/lib/lm_eval/tasks/xnli
2025-08-31T08:27:46,684   copying lm_eval/tasks/jsonschema_bench/jsonschema_bench_hard.yaml -> build/lib/lm_eval/tasks/jsonschema_bench
2025-08-31T08:27:46,686   copying lm_eval/tasks/jsonschema_bench/jsonschema_bench_medium.yaml -> build/lib/lm_eval/tasks/jsonschema_bench
2025-08-31T08:27:46,688   copying lm_eval/tasks/jsonschema_bench/jsonschema_bench_easy.yaml -> build/lib/lm_eval/tasks/jsonschema_bench
2025-08-31T08:27:46,691   copying lm_eval/tasks/xwinograd/xwinograd_jp.yaml -> build/lib/lm_eval/tasks/xwinograd
2025-08-31T08:27:46,693   copying lm_eval/tasks/xwinograd/xwinograd_zh.yaml -> build/lib/lm_eval/tasks/xwinograd
2025-08-31T08:27:46,695   copying lm_eval/tasks/xwinograd/xwinograd_en.yaml -> build/lib/lm_eval/tasks/xwinograd
2025-08-31T08:27:46,697   copying lm_eval/tasks/xwinograd/xwinograd_pt.yaml -> build/lib/lm_eval/tasks/xwinograd
2025-08-31T08:27:46,699   copying lm_eval/tasks/xwinograd/xwinograd_ru.yaml -> build/lib/lm_eval/tasks/xwinograd
2025-08-31T08:27:46,702   copying lm_eval/tasks/xwinograd/xwinograd_fr.yaml -> build/lib/lm_eval/tasks/xwinograd
2025-08-31T08:27:46,704   copying lm_eval/tasks/xwinograd/_xwinograd.yaml -> build/lib/lm_eval/tasks/xwinograd
2025-08-31T08:27:46,706   creating build/lib/lm_eval/tasks/alghafa/piqa_ar
2025-08-31T08:27:46,708   copying lm_eval/tasks/alghafa/piqa_ar/piqa_ar.yaml -> build/lib/lm_eval/tasks/alghafa/piqa_ar
2025-08-31T08:27:46,710   creating build/lib/lm_eval/tasks/alghafa/copa_ar
2025-08-31T08:27:46,711   copying lm_eval/tasks/alghafa/copa_ar/copa_ar.yaml -> build/lib/lm_eval/tasks/alghafa/copa_ar
2025-08-31T08:27:46,714   creating build/lib/lm_eval/tasks/commonsense_qa
2025-08-31T08:27:46,715   copying lm_eval/tasks/commonsense_qa/default.yaml -> build/lib/lm_eval/tasks/commonsense_qa
2025-08-31T08:27:46,717   creating build/lib/lm_eval/tasks/gsm8k
2025-08-31T08:27:46,719   copying lm_eval/tasks/gsm8k/gsm8k-cot.yaml -> build/lib/lm_eval/tasks/gsm8k
2025-08-31T08:27:46,721   copying lm_eval/tasks/gsm8k/gsm8k-cot-llama.yaml -> build/lib/lm_eval/tasks/gsm8k
2025-08-31T08:27:46,724   copying lm_eval/tasks/gsm8k/gsm8k-cot-self-consistency.yaml -> build/lib/lm_eval/tasks/gsm8k
2025-08-31T08:27:46,726   copying lm_eval/tasks/gsm8k/gsm8k-cot-zeroshot.yaml -> build/lib/lm_eval/tasks/gsm8k
2025-08-31T08:27:46,728   copying lm_eval/tasks/gsm8k/gsm8k.yaml -> build/lib/lm_eval/tasks/gsm8k
2025-08-31T08:27:46,731   copying lm_eval/tasks/galician_bench/summarization_gl.yaml -> build/lib/lm_eval/tasks/galician_bench
2025-08-31T08:27:46,733   copying lm_eval/tasks/galician_bench/truthfulqa_gl_mc2.yaml -> build/lib/lm_eval/tasks/galician_bench
2025-08-31T08:27:46,735   copying lm_eval/tasks/galician_bench/xnli_gl.yaml -> build/lib/lm_eval/tasks/galician_bench
2025-08-31T08:27:46,738   copying lm_eval/tasks/galician_bench/galician_bench.yaml -> build/lib/lm_eval/tasks/galician_bench
2025-08-31T08:27:46,740   copying lm_eval/tasks/galician_bench/truthfulqa_gl_mc1.yaml -> build/lib/lm_eval/tasks/galician_bench
2025-08-31T08:27:46,742   copying lm_eval/tasks/galician_bench/truthfulqa_gl_gen.yaml -> build/lib/lm_eval/tasks/galician_bench
2025-08-31T08:27:46,745   copying lm_eval/tasks/galician_bench/galcola.yaml -> build/lib/lm_eval/tasks/galician_bench
2025-08-31T08:27:46,747   copying lm_eval/tasks/galician_bench/parafrases_gl.yaml -> build/lib/lm_eval/tasks/galician_bench
2025-08-31T08:27:46,750   copying lm_eval/tasks/galician_bench/mgsm_direct_gl.yaml -> build/lib/lm_eval/tasks/galician_bench
2025-08-31T08:27:46,752   copying lm_eval/tasks/galician_bench/paws_gl.yaml -> build/lib/lm_eval/tasks/galician_bench
2025-08-31T08:27:46,754   copying lm_eval/tasks/galician_bench/belebele_glg_Latn.yaml -> build/lib/lm_eval/tasks/galician_bench
2025-08-31T08:27:46,756   copying lm_eval/tasks/galician_bench/xstorycloze_gl.yaml -> build/lib/lm_eval/tasks/galician_bench
2025-08-31T08:27:46,759   copying lm_eval/tasks/galician_bench/openbookqa_gl.yaml -> build/lib/lm_eval/tasks/galician_bench
2025-08-31T08:27:46,761   copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-en.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:27:46,764   copying lm_eval/tasks/galician_bench/flores_gl/flores_en-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:27:46,766   copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-ca.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:27:46,768   copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-pt.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:27:46,773   copying lm_eval/tasks/galician_bench/flores_gl/flores_fr-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:27:46,776   copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-it.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:27:46,779   copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-de.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:27:46,781   copying lm_eval/tasks/galician_bench/flores_gl/flores_eu-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:27:46,784   copying lm_eval/tasks/galician_bench/flores_gl/flores_de-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:27:46,786   copying lm_eval/tasks/galician_bench/flores_gl/flores_es-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:27:46,788   copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-es.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:27:46,791   copying lm_eval/tasks/galician_bench/flores_gl/flores_pt-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:27:46,793   copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-eu.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:27:46,796   copying lm_eval/tasks/galician_bench/flores_gl/flores_gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:27:46,798   copying lm_eval/tasks/galician_bench/flores_gl/flores_ca-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:27:46,801   copying lm_eval/tasks/galician_bench/flores_gl/flores_it-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:27:46,803   copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-fr.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:27:46,805   creating build/lib/lm_eval/tasks/turkishmmlu/config
2025-08-31T08:27:46,807   copying lm_eval/tasks/turkishmmlu/config/Religion_and_Ethics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config
2025-08-31T08:27:46,809   copying lm_eval/tasks/turkishmmlu/config/Biology.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config
2025-08-31T08:27:46,812   copying lm_eval/tasks/turkishmmlu/config/Turkish_Language_and_Literature.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config
2025-08-31T08:27:46,814   copying lm_eval/tasks/turkishmmlu/config/Geography.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config
2025-08-31T08:27:46,817   copying lm_eval/tasks/turkishmmlu/config/Chemistry.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config
2025-08-31T08:27:46,819   copying lm_eval/tasks/turkishmmlu/config/Mathematics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config
2025-08-31T08:27:46,821   copying lm_eval/tasks/turkishmmlu/config/Philosophy.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config
2025-08-31T08:27:46,824   copying lm_eval/tasks/turkishmmlu/config/Physics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config
2025-08-31T08:27:46,826   copying lm_eval/tasks/turkishmmlu/config/History.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config
2025-08-31T08:27:46,829   creating build/lib/lm_eval/tasks/turkishmmlu/config_cot
2025-08-31T08:27:46,830   copying lm_eval/tasks/turkishmmlu/config_cot/Religion_and_Ethics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot
2025-08-31T08:27:46,833   copying lm_eval/tasks/turkishmmlu/config_cot/Biology.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot
2025-08-31T08:27:46,835   copying lm_eval/tasks/turkishmmlu/config_cot/Turkish_Language_and_Literature.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot
2025-08-31T08:27:46,838   copying lm_eval/tasks/turkishmmlu/config_cot/Geography.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot
2025-08-31T08:27:46,841   copying lm_eval/tasks/turkishmmlu/config_cot/Chemistry.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot
2025-08-31T08:27:46,845   copying lm_eval/tasks/turkishmmlu/config_cot/Mathematics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot
2025-08-31T08:27:46,848   copying lm_eval/tasks/turkishmmlu/config_cot/Philosophy.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot
2025-08-31T08:27:46,851   copying lm_eval/tasks/turkishmmlu/config_cot/Physics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot
2025-08-31T08:27:46,854   copying lm_eval/tasks/turkishmmlu/config_cot/History.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot
2025-08-31T08:27:46,859   copying lm_eval/tasks/xquad/xquad_ar.yaml -> build/lib/lm_eval/tasks/xquad
2025-08-31T08:27:46,861   copying lm_eval/tasks/xquad/xquad_hi.yaml -> build/lib/lm_eval/tasks/xquad
2025-08-31T08:27:46,863   copying lm_eval/tasks/xquad/xquad_vi.yaml -> build/lib/lm_eval/tasks/xquad
2025-08-31T08:27:46,866   copying lm_eval/tasks/xquad/xquad_el.yaml -> build/lib/lm_eval/tasks/xquad
2025-08-31T08:27:46,868   copying lm_eval/tasks/xquad/xquad_ru.yaml -> build/lib/lm_eval/tasks/xquad
2025-08-31T08:27:46,870   copying lm_eval/tasks/xquad/xquad_tr.yaml -> build/lib/lm_eval/tasks/xquad
2025-08-31T08:27:46,873   copying lm_eval/tasks/xquad/xquad_es.yaml -> build/lib/lm_eval/tasks/xquad
2025-08-31T08:27:46,875   copying lm_eval/tasks/xquad/xquad_th.yaml -> build/lib/lm_eval/tasks/xquad
2025-08-31T08:27:46,877   copying lm_eval/tasks/xquad/xquad_en.yaml -> build/lib/lm_eval/tasks/xquad
2025-08-31T08:27:46,880   copying lm_eval/tasks/xquad/xquad_ro.yaml -> build/lib/lm_eval/tasks/xquad
2025-08-31T08:27:46,882   copying lm_eval/tasks/xquad/xquad_zh.yaml -> build/lib/lm_eval/tasks/xquad
2025-08-31T08:27:46,884   copying lm_eval/tasks/xquad/xquad_de.yaml -> build/lib/lm_eval/tasks/xquad
2025-08-31T08:27:46,886   creating build/lib/lm_eval/tasks/arc_mt
2025-08-31T08:27:46,888   copying lm_eval/tasks/arc_mt/arc_challenge_mt_pl.yaml -> build/lib/lm_eval/tasks/arc_mt
2025-08-31T08:27:46,890   copying lm_eval/tasks/arc_mt/arc_challenge_mt_sv.yaml -> build/lib/lm_eval/tasks/arc_mt
2025-08-31T08:27:46,892   copying lm_eval/tasks/arc_mt/arc_challenge_mt_is.yaml -> build/lib/lm_eval/tasks/arc_mt
2025-08-31T08:27:46,895   copying lm_eval/tasks/arc_mt/arc_challenge_mt_it.yaml -> build/lib/lm_eval/tasks/arc_mt
2025-08-31T08:27:46,897   copying lm_eval/tasks/arc_mt/arc_challenge_mt_nb.yaml -> build/lib/lm_eval/tasks/arc_mt
2025-08-31T08:27:46,899   copying lm_eval/tasks/arc_mt/arc_challenge_mt_pt.yaml -> build/lib/lm_eval/tasks/arc_mt
2025-08-31T08:27:46,901   copying lm_eval/tasks/arc_mt/arc_challenge_mt_de.yaml -> build/lib/lm_eval/tasks/arc_mt
2025-08-31T08:27:46,903   copying lm_eval/tasks/arc_mt/arc_challenge_mt_es.yaml -> build/lib/lm_eval/tasks/arc_mt
2025-08-31T08:27:46,905   copying lm_eval/tasks/arc_mt/arc_challenge_mt_hu.yaml -> build/lib/lm_eval/tasks/arc_mt
2025-08-31T08:27:46,907   copying lm_eval/tasks/arc_mt/arc_challenge_mt_da.yaml -> build/lib/lm_eval/tasks/arc_mt
2025-08-31T08:27:46,910   copying lm_eval/tasks/arc_mt/arc_challenge_mt_fi.yaml -> build/lib/lm_eval/tasks/arc_mt
2025-08-31T08:27:46,912   copying lm_eval/tasks/arc_mt/arc_challenge_mt_el.yaml -> build/lib/lm_eval/tasks/arc_mt
2025-08-31T08:27:46,914   copying lm_eval/tasks/careqa/careqa_open_perplexity.yaml -> build/lib/lm_eval/tasks/careqa
2025-08-31T08:27:46,916   copying lm_eval/tasks/careqa/careqa_open.yaml -> build/lib/lm_eval/tasks/careqa
2025-08-31T08:27:46,918   copying lm_eval/tasks/careqa/careqa_en.yaml -> build/lib/lm_eval/tasks/careqa
2025-08-31T08:27:46,920   copying lm_eval/tasks/careqa/careqa_es.yaml -> build/lib/lm_eval/tasks/careqa
2025-08-31T08:27:46,922   copying lm_eval/tasks/catalan_bench/cocoteros_va.yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:46,924   copying lm_eval/tasks/catalan_bench/copa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:46,926   copying lm_eval/tasks/catalan_bench/paws_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:46,928   copying lm_eval/tasks/catalan_bench/teca.yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:46,929   copying lm_eval/tasks/catalan_bench/coqcat.yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:46,931   copying lm_eval/tasks/catalan_bench/wnli_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:46,933   copying lm_eval/tasks/catalan_bench/openbookqa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:46,935   copying lm_eval/tasks/catalan_bench/mgsm_direct_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:46,937   copying lm_eval/tasks/catalan_bench/piqa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:46,939   copying lm_eval/tasks/catalan_bench/catcola.yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:46,941   copying lm_eval/tasks/catalan_bench/siqa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:46,943   copying lm_eval/tasks/catalan_bench/xstorycloze_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:46,945   copying lm_eval/tasks/catalan_bench/catalan_bench.yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:46,947   copying lm_eval/tasks/catalan_bench/xnli_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:46,949   copying lm_eval/tasks/catalan_bench/xquad_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:46,951   copying lm_eval/tasks/catalan_bench/cabreu_abstractive.yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:46,954   copying lm_eval/tasks/catalan_bench/cabreu_extractive.yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:46,956   copying lm_eval/tasks/catalan_bench/arc_ca_challenge.yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:46,958   copying lm_eval/tasks/catalan_bench/catalanqa.yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:46,960   copying lm_eval/tasks/catalan_bench/cabreu_extreme.yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:46,962   copying lm_eval/tasks/catalan_bench/parafraseja.yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:46,964   copying lm_eval/tasks/catalan_bench/arc_ca_easy.yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:27:46,966   creating build/lib/lm_eval/tasks/catalan_bench/phrases_va
2025-08-31T08:27:46,966   copying lm_eval/tasks/catalan_bench/phrases_va/phrases_ca-va.yaml -> build/lib/lm_eval/tasks/catalan_bench/phrases_va
2025-08-31T08:27:46,969   copying lm_eval/tasks/catalan_bench/phrases_va/phrases_va-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/phrases_va
2025-08-31T08:27:46,971   copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-es.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:27:46,973   copying lm_eval/tasks/catalan_bench/flores_ca/flores_fr-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:27:46,975   copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-en.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:27:46,977   copying lm_eval/tasks/catalan_bench/flores_ca/flores_gl-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:27:46,979   copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-it.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:27:46,981   copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-de.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:27:46,983   copying lm_eval/tasks/catalan_bench/flores_ca/flores_en-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:27:46,985   copying lm_eval/tasks/catalan_bench/flores_ca/flores_pt-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:27:46,987   copying lm_eval/tasks/catalan_bench/flores_ca/flores_de-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:27:46,989   copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-fr.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:27:46,991   copying lm_eval/tasks/catalan_bench/flores_ca/flores_it-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:27:46,993   copying lm_eval/tasks/catalan_bench/flores_ca/flores_eu-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:27:46,995   copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-pt.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:27:46,997   copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-eu.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:27:46,998   copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-gl.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:27:47,001   copying lm_eval/tasks/catalan_bench/flores_ca/flores_es-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:27:47,003   copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:27:47,005   copying lm_eval/tasks/unitxt/unfair_tos.yaml -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:27:47,007   copying lm_eval/tasks/unitxt/ledgar.yaml -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:27:47,009   copying lm_eval/tasks/unitxt/financial_tweets.yaml -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:27:47,011   copying lm_eval/tasks/unitxt/doc_vqa.yaml -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:27:47,013   copying lm_eval/tasks/unitxt/coedit_gec.yaml -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:27:47,014   copying lm_eval/tasks/unitxt/dbpedia_14.yaml -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:27:47,016   copying lm_eval/tasks/unitxt/20_newsgroups.yaml -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:27:47,018   copying lm_eval/tasks/unitxt/law_stack_exchange.yaml -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:27:47,020   copying lm_eval/tasks/unitxt/atis.yaml -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:27:47,022   copying lm_eval/tasks/unitxt/ethos_binary.yaml -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:27:47,024   copying lm_eval/tasks/unitxt/claim_stance_topic.yaml -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:27:47,026   copying lm_eval/tasks/unitxt/xsum.yaml -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:27:47,028   copying lm_eval/tasks/unitxt/cnn_dailymail.yaml -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:27:47,030   copying lm_eval/tasks/unitxt/argument_topic.yaml -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:27:47,032   copying lm_eval/tasks/unitxt/banking77.yaml -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:27:47,034   copying lm_eval/tasks/unitxt/stsb.yaml -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:27:47,036   copying lm_eval/tasks/unitxt/yahoo_answers_topics.yaml -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:27:47,038   copying lm_eval/tasks/unitxt/medical_abstracts.yaml -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:27:47,040   copying lm_eval/tasks/unitxt/ag_news.yaml -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:27:47,042   copying lm_eval/tasks/darijammlu/darijammlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,044   copying lm_eval/tasks/darijammlu/_darijammlu.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,046   copying lm_eval/tasks/darijammlu/darijammlu_economics.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,048   copying lm_eval/tasks/darijammlu/darijammlu_computer_science.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,050   copying lm_eval/tasks/darijammlu/darijammlu_driving_test.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,052   copying lm_eval/tasks/darijammlu/darijammlu_math.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,054   copying lm_eval/tasks/darijammlu/darijammlu_professional_law.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,056   copying lm_eval/tasks/darijammlu/darijammlu_world_religions.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,058   copying lm_eval/tasks/darijammlu/_darijammlu_mmlu.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,060   copying lm_eval/tasks/darijammlu/darijammlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,063   copying lm_eval/tasks/darijammlu/darijammlu_geography.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,065   copying lm_eval/tasks/darijammlu/darijammlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,067   copying lm_eval/tasks/darijammlu/_darijammlu_ar_mmlu.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,069   copying lm_eval/tasks/darijammlu/darijammlu_biology.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,071   copying lm_eval/tasks/darijammlu/darijammlu_management.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,073   copying lm_eval/tasks/darijammlu/darijammlu_law.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,075   copying lm_eval/tasks/darijammlu/darijammlu_management_ar.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,077   copying lm_eval/tasks/darijammlu/darijammlu_public_relations.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,079   copying lm_eval/tasks/darijammlu/darijammlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,081   copying lm_eval/tasks/darijammlu/darijammlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,083   copying lm_eval/tasks/darijammlu/darijammlu_accounting.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,085   copying lm_eval/tasks/darijammlu/darijammlu_social_science.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,087   copying lm_eval/tasks/darijammlu/darijammlu_philosophy_ar.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,089   copying lm_eval/tasks/darijammlu/darijammlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,091   copying lm_eval/tasks/darijammlu/darijammlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,093   copying lm_eval/tasks/darijammlu/darijammlu_nutrition.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,096   copying lm_eval/tasks/darijammlu/darijammlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,098   copying lm_eval/tasks/darijammlu/darijammlu_philosophy.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,100   copying lm_eval/tasks/darijammlu/darijammlu_physics.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,102   copying lm_eval/tasks/darijammlu/darijammlu_arabic_language_(grammar).yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,104   copying lm_eval/tasks/darijammlu/darijammlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,106   copying lm_eval/tasks/darijammlu/darijammlu_human_aging.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,108   copying lm_eval/tasks/darijammlu/darijammlu_arabic_language_(general).yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,110   copying lm_eval/tasks/darijammlu/darijammlu_natural_science.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,112   copying lm_eval/tasks/darijammlu/darijammlu_international_law.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,114   copying lm_eval/tasks/darijammlu/darijammlu_islamic_studies.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,116   copying lm_eval/tasks/darijammlu/darijammlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,118   copying lm_eval/tasks/darijammlu/darijammlu_political_science.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,120   copying lm_eval/tasks/darijammlu/darijammlu_global_facts.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,122   copying lm_eval/tasks/darijammlu/darijammlu_history.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,124   copying lm_eval/tasks/darijammlu/darijammlu_marketing.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,126   copying lm_eval/tasks/darijammlu/darijammlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,128   copying lm_eval/tasks/darijammlu/darijammlu_security_studies.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,130   copying lm_eval/tasks/darijammlu/darijammlu_sociology.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,132   copying lm_eval/tasks/darijammlu/darijammlu_general_knowledge.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,134   copying lm_eval/tasks/darijammlu/darijammlu_civics.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,136   copying lm_eval/tasks/darijammlu/darijammlu_arabic_language.yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:27:47,138   copying lm_eval/tasks/mts_dialog/mts_dialog.yaml -> build/lib/lm_eval/tasks/mts_dialog
2025-08-31T08:27:47,140   copying lm_eval/tasks/mts_dialog/mts_dialog_perplexity.yaml -> build/lib/lm_eval/tasks/mts_dialog
2025-08-31T08:27:47,142   copying lm_eval/tasks/japanese_leaderboard/_ja_leaderboard.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard
2025-08-31T08:27:47,145   copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard
2025-08-31T08:27:47,147   copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jnli.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard
2025-08-31T08:27:47,149   copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard
2025-08-31T08:27:47,151   copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_marc_ja.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard
2025-08-31T08:27:47,153   copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jsquad.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard
2025-08-31T08:27:47,155   copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard
2025-08-31T08:27:47,157   copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard
2025-08-31T08:27:47,159   copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jaqket_v2.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard
2025-08-31T08:27:47,161   copying lm_eval/tasks/common_voice/common_voice_en.yaml -> build/lib/lm_eval/tasks/common_voice
2025-08-31T08:27:47,163   copying lm_eval/tasks/medtext/medtext_perplexity.yaml -> build/lib/lm_eval/tasks/medtext
2025-08-31T08:27:47,165   copying lm_eval/tasks/medtext/medtext.yaml -> build/lib/lm_eval/tasks/medtext
2025-08-31T08:27:47,167   copying lm_eval/tasks/qasper/freeform.yaml -> build/lib/lm_eval/tasks/qasper
2025-08-31T08:27:47,169   copying lm_eval/tasks/qasper/bool.yaml -> build/lib/lm_eval/tasks/qasper
2025-08-31T08:27:47,171   creating build/lib/lm_eval/tasks/lambada_multilingual_stablelm
2025-08-31T08:27:47,172   copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_de.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm
2025-08-31T08:27:47,174   copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_it.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm
2025-08-31T08:27:47,176   copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_en.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm
2025-08-31T08:27:47,178   copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_nl.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm
2025-08-31T08:27:47,180   copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_pt.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm
2025-08-31T08:27:47,182   copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_es.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm
2025-08-31T08:27:47,184   copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_fr.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm
2025-08-31T08:27:47,186   copying lm_eval/tasks/eq_bench/default.yaml -> build/lib/lm_eval/tasks/eq_bench
2025-08-31T08:27:47,188   copying lm_eval/tasks/bbq/bbq_generate_ambig.yaml -> build/lib/lm_eval/tasks/bbq
2025-08-31T08:27:47,190   copying lm_eval/tasks/bbq/bbq_multiple_choice_disambig.yaml -> build/lib/lm_eval/tasks/bbq
2025-08-31T08:27:47,192   copying lm_eval/tasks/bbq/bbq_generate_disambig.yaml -> build/lib/lm_eval/tasks/bbq
2025-08-31T08:27:47,194   copying lm_eval/tasks/bbq/bbq_generate.yaml -> build/lib/lm_eval/tasks/bbq
2025-08-31T08:27:47,197   copying lm_eval/tasks/bbq/bbq_multiple_choice.yaml -> build/lib/lm_eval/tasks/bbq
2025-08-31T08:27:47,199   copying lm_eval/tasks/bbq/bbq_multiple_choice_ambig.yaml -> build/lib/lm_eval/tasks/bbq
2025-08-31T08:27:47,201   copying lm_eval/tasks/medmcqa/medmcqa.yaml -> build/lib/lm_eval/tasks/medmcqa
2025-08-31T08:27:47,203   creating build/lib/lm_eval/tasks/swag
2025-08-31T08:27:47,204   copying lm_eval/tasks/swag/swag.yaml -> build/lib/lm_eval/tasks/swag
2025-08-31T08:27:47,206   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_pt.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,208   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hu.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,210   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ml.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,212   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_id.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,214   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_te.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,216   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,218   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sv.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,220   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ca.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,222   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_da.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,224   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_en.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,227   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_bn.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,229   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sk.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,231   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_uk.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,233   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_zh.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,235   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ro.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,237   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,239   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_kn.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,241   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_es.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,243   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hi.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,245   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_vi.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,247   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_de.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,249   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_it.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,251   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ar.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,253   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nl.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,254   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ru.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,257   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ta.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,258   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_fr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,261   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_is.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,263   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ne.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,265   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_eu.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,267   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_gu.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,269   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nb.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,271   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hy.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,273   copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_mr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:27:47,275   copying lm_eval/tasks/okapi/arc_multilingual/arc_id.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,277   copying lm_eval/tasks/okapi/arc_multilingual/arc_pt.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,279   copying lm_eval/tasks/okapi/arc_multilingual/arc_ar.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,281   copying lm_eval/tasks/okapi/arc_multilingual/arc_hy.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,283   copying lm_eval/tasks/okapi/arc_multilingual/arc_vi.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,285   copying lm_eval/tasks/okapi/arc_multilingual/arc_fr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,287   copying lm_eval/tasks/okapi/arc_multilingual/arc_ca.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,289   copying lm_eval/tasks/okapi/arc_multilingual/arc_ta.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,291   copying lm_eval/tasks/okapi/arc_multilingual/arc_ro.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,293   copying lm_eval/tasks/okapi/arc_multilingual/arc_nl.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,295   copying lm_eval/tasks/okapi/arc_multilingual/arc_gu.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,298   copying lm_eval/tasks/okapi/arc_multilingual/arc_hr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,300   copying lm_eval/tasks/okapi/arc_multilingual/arc_sr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,302   copying lm_eval/tasks/okapi/arc_multilingual/arc_uk.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,304   copying lm_eval/tasks/okapi/arc_multilingual/arc_hu.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,305   copying lm_eval/tasks/okapi/arc_multilingual/arc_it.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,307   copying lm_eval/tasks/okapi/arc_multilingual/arc_ne.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,309   copying lm_eval/tasks/okapi/arc_multilingual/arc_te.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,311   copying lm_eval/tasks/okapi/arc_multilingual/arc_da.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,313   copying lm_eval/tasks/okapi/arc_multilingual/arc_de.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,315   copying lm_eval/tasks/okapi/arc_multilingual/arc_mr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,317   copying lm_eval/tasks/okapi/arc_multilingual/arc_es.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,319   copying lm_eval/tasks/okapi/arc_multilingual/arc_sk.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,321   copying lm_eval/tasks/okapi/arc_multilingual/arc_ru.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,323   copying lm_eval/tasks/okapi/arc_multilingual/arc_kn.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,325   copying lm_eval/tasks/okapi/arc_multilingual/arc_hi.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,327   copying lm_eval/tasks/okapi/arc_multilingual/arc_eu.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,329   copying lm_eval/tasks/okapi/arc_multilingual/arc_ml.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,331   copying lm_eval/tasks/okapi/arc_multilingual/arc_sv.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,333   copying lm_eval/tasks/okapi/arc_multilingual/arc_bn.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,336   copying lm_eval/tasks/okapi/arc_multilingual/arc_zh.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:27:47,338   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_da.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,340   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ro.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,342   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_nl.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,344   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_es.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,346   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ml.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,348   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_fr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,350   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ta.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,352   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_pt.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,354   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ru.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,357   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_bn.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,359   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,361   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sk.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,363   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hu.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,364   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hi.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,367   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ar.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,369   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_eu.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,371   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_kn.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,373   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_id.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,376   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_uk.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,378   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_te.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,380   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_gu.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,382   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_de.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,384   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sv.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,386   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,388   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_vi.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,390   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ne.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,392   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ca.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,394   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_it.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,396   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hy.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,398   copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_mr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:27:47,400   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,402   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,404   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,407   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,409   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,411   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,413   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,416   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,418   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,420   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,422   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,424   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,426   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,428   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,430   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,432   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,434   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,436   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,438   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,440   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,442   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,444   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,446   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,449   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,451   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,453   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,455   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,457   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,459   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,462   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,464   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,466   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,468   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,470   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,472   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,474   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,476   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,478   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,480   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,482   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,484   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,486   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,488   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,490   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,492   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,494   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,496   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,498   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,500   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,502   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,504   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,506   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,508   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,510   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,512   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,514   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,516   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,518   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,520   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,522   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,524   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,526   copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:27:47,528   copying lm_eval/tasks/ifeval/ifeval.yaml -> build/lib/lm_eval/tasks/ifeval
2025-08-31T08:27:47,530   copying lm_eval/tasks/darijahellaswag/darijahellaswag.yaml -> build/lib/lm_eval/tasks/darijahellaswag
2025-08-31T08:27:47,532   creating build/lib/lm_eval/tasks/arc
2025-08-31T08:27:47,533   copying lm_eval/tasks/arc/arc_easy.yaml -> build/lib/lm_eval/tasks/arc
2025-08-31T08:27:47,535   copying lm_eval/tasks/arc/arc_challenge.yaml -> build/lib/lm_eval/tasks/arc
2025-08-31T08:27:47,537   copying lm_eval/tasks/arc/arc_challenge_chat.yaml -> build/lib/lm_eval/tasks/arc
2025-08-31T08:27:47,539   copying lm_eval/tasks/qa4mre/qa4mre_2013.yaml -> build/lib/lm_eval/tasks/qa4mre
2025-08-31T08:27:47,541   copying lm_eval/tasks/qa4mre/qa4mre_2011.yaml -> build/lib/lm_eval/tasks/qa4mre
2025-08-31T08:27:47,543   copying lm_eval/tasks/qa4mre/qa4mre_2012.yaml -> build/lib/lm_eval/tasks/qa4mre
2025-08-31T08:27:47,545   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_complete.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete
2025-08-31T08:27:47,548   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_mt_arc_challenge.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge
2025-08-31T08:27:47,549   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_leaderboard_arabic_mt_arc_challenge.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge
2025-08-31T08:27:47,551   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:27:47,553   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:27:47,555   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_sentiment_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:27:47,557   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:27:47,560   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:27:47,562   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:27:47,564   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_dialects.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:27:47,566   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_mcq_exams_test_ar.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:27:47,568   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:27:47,570   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_msa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:27:47,572   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_mt_toxigen.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen
2025-08-31T08:27:47,574   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_leaderboard_arabic_mt_toxigen.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen
2025-08-31T08:27:47,576   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_mt_openbook_qa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa
2025-08-31T08:27:47,578   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_leaderboard_arabic_mt_openbook_qa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa
2025-08-31T08:27:47,580   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_leaderboard_arabic_mt_mmlu.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu
2025-08-31T08:27:47,582   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_mt_mmlu.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu
2025-08-31T08:27:47,584   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_leaderboard_arabic_mt_sciq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq
2025-08-31T08:27:47,587   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_mt_sciq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq
2025-08-31T08:27:47,589   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_leaderboard_arabic_mt_arc_easy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy
2025-08-31T08:27:47,591   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_mt_arc_easy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy
2025-08-31T08:27:47,593   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Clothing.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,595   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mesopotamia_civilization.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,597   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arab_Empire.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,599   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromRome.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,601   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Algeria.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,603   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Medicine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,605   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Iraq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,607   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Astronomy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,609   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Architecture.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,611   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,614   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ornament.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,616   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Culture.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,618   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Math.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,620   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromByzantium.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,622   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Comoros.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,624   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Geography.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,626   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromAncientEgypt.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,628   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ceremony.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,630   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Libya.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,632   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromChina.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,634   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_communication.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,636   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_entertainment.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,639   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Oman.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,641   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Palestine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,643   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Art.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,645   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Qatar.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,647   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Egypt_modern.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,649   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mauritania.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,651   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Tunisia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,653   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Jordan.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,655   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_United_Arab_Emirates.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,657   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Morocco.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,659   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Philosophy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,661   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,663   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_Education.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,665   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Lebanon.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,667   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Bahrain.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,669   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Kuwait.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,671   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_branches_and_schools.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,673   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Syria.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,676   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Food.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,678   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Ancient_Egypt.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,680   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Language_Origin.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,682   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromGreece.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,684   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Music.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,686   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Somalia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,688   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Saudi_Arabia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,690   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Sudan.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,692   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islamic_law_system.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,694   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Calligraphy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,696   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_daily_life.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,698   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Yemen.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,700   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Wedding.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,702   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Literature.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,704   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Funeral.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,706   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_computer_and_phone.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,708   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromIslam.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,710   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromPersia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,712   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_History.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:27:47,714   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_mt_boolq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq
2025-08-31T08:27:47,716   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_leaderboard_arabic_mt_boolq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq
2025-08-31T08:27:47,718   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_leaderboard_arabic_exams.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams
2025-08-31T08:27:47,720   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_exams.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams
2025-08-31T08:27:47,722   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_mt_copa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa
2025-08-31T08:27:47,724   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_leaderboard_arabic_mt_copa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa
2025-08-31T08:27:47,726   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_leaderboard_arabic_mt_race.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race
2025-08-31T08:27:47,728   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_mt_race.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race
2025-08-31T08:27:47,730   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_leaderboard_arabic_mt_hellaswag.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag
2025-08-31T08:27:47,733   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_mt_hellaswag.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag
2025-08-31T08:27:47,734   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,737   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,739   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,741   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,744   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,746   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,748   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,750   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,752   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,754   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_marketing.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,756   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_international_law.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,758   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,760   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,762   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,764   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,766   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,769   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,771   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,773   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,775   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,777   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,779   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_virology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,781   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,783   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,785   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,787   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,789   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,791   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,793   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,795   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,797   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,799   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,801   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,803   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_management.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,805   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,807   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,810   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,812   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,814   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,816   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,818   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,820   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,822   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,824   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,826   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_sociology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,828   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,830   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,832   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,834   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,836   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,838   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,840   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,842   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,844   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,847   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,849   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,851   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,853   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:27:47,855   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_leaderboard_arabic_mt_piqa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa
2025-08-31T08:27:47,857   copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_mt_piqa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa
2025-08-31T08:27:47,859   copying lm_eval/tasks/eus_trivia/eus_trivia.yaml -> build/lib/lm_eval/tasks/eus_trivia
2025-08-31T08:27:47,861   copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_biology.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:27:47,863   copying lm_eval/tasks/mmlu-pro-plus/_mmlu_pro_plus.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:27:47,865   copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_health.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:27:47,867   copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_other.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:27:47,869   copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_history.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:27:47,871   copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:27:47,873   copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_math.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:27:47,875   copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_engineering.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:27:47,877   copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_business.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:27:47,879   copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:27:47,882   copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:27:47,883   copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_physics.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:27:47,886   copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_economics.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:27:47,888   copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_psychology.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:27:47,890   copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_law.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:27:47,892   creating build/lib/lm_eval/tasks/lambada_cloze
2025-08-31T08:27:47,893   copying lm_eval/tasks/lambada_cloze/lambada_openai_cloze.yaml -> build/lib/lm_eval/tasks/lambada_cloze
2025-08-31T08:27:47,895   copying lm_eval/tasks/lambada_cloze/lambada_standard_cloze.yaml -> build/lib/lm_eval/tasks/lambada_cloze
2025-08-31T08:27:47,897   creating build/lib/lm_eval/tasks/aexams
2025-08-31T08:27:47,898   copying lm_eval/tasks/aexams/aexams_Physics.yaml -> build/lib/lm_eval/tasks/aexams
2025-08-31T08:27:47,900   copying lm_eval/tasks/aexams/aexams_Science.yaml -> build/lib/lm_eval/tasks/aexams
2025-08-31T08:27:47,902   copying lm_eval/tasks/aexams/aexams_Biology.yaml -> build/lib/lm_eval/tasks/aexams
2025-08-31T08:27:47,903   copying lm_eval/tasks/aexams/aexams_Social.yaml -> build/lib/lm_eval/tasks/aexams
2025-08-31T08:27:47,905   copying lm_eval/tasks/aexams/_aexams.yaml -> build/lib/lm_eval/tasks/aexams
2025-08-31T08:27:47,907   copying lm_eval/tasks/aexams/aexams_IslamicStudies.yaml -> build/lib/lm_eval/tasks/aexams
2025-08-31T08:27:47,910   copying lm_eval/tasks/code_x_glue/code-text/go.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text
2025-08-31T08:27:47,912   copying lm_eval/tasks/code_x_glue/code-text/javascript.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text
2025-08-31T08:27:47,914   copying lm_eval/tasks/code_x_glue/code-text/ruby.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text
2025-08-31T08:27:47,916   copying lm_eval/tasks/code_x_glue/code-text/python.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text
2025-08-31T08:27:47,918   copying lm_eval/tasks/code_x_glue/code-text/php.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text
2025-08-31T08:27:47,920   copying lm_eval/tasks/code_x_glue/code-text/java.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text
2025-08-31T08:27:47,922   creating build/lib/lm_eval/tasks/inverse_scaling
2025-08-31T08:27:47,923   copying lm_eval/tasks/inverse_scaling/inverse_scaling_quote_repetition.yaml -> build/lib/lm_eval/tasks/inverse_scaling
2025-08-31T08:27:47,925   copying lm_eval/tasks/inverse_scaling/inverse_scaling_memo_trap.yaml -> build/lib/lm_eval/tasks/inverse_scaling
2025-08-31T08:27:47,927   copying lm_eval/tasks/inverse_scaling/inverse_scaling_pattern_matching_suppression.yaml -> build/lib/lm_eval/tasks/inverse_scaling
2025-08-31T08:27:47,929   copying lm_eval/tasks/inverse_scaling/inverse_scaling_hindsight_neglect.yaml -> build/lib/lm_eval/tasks/inverse_scaling
2025-08-31T08:27:47,930   copying lm_eval/tasks/inverse_scaling/inverse_scaling_redefine_math.yaml -> build/lib/lm_eval/tasks/inverse_scaling
2025-08-31T08:27:47,932   copying lm_eval/tasks/inverse_scaling/inverse_scaling_winobias_antistereotype.yaml -> build/lib/lm_eval/tasks/inverse_scaling
2025-08-31T08:27:47,934   copying lm_eval/tasks/inverse_scaling/inverse_scaling_sig_figs.yaml -> build/lib/lm_eval/tasks/inverse_scaling
2025-08-31T08:27:47,936   copying lm_eval/tasks/inverse_scaling/inverse_scaling_into_the_unknown.yaml -> build/lib/lm_eval/tasks/inverse_scaling
2025-08-31T08:27:47,938   copying lm_eval/tasks/inverse_scaling/inverse_scaling_repetitive_algebra.yaml -> build/lib/lm_eval/tasks/inverse_scaling
2025-08-31T08:27:47,940   copying lm_eval/tasks/inverse_scaling/inverse_scaling_modus_tollens.yaml -> build/lib/lm_eval/tasks/inverse_scaling
2025-08-31T08:27:47,942   copying lm_eval/tasks/inverse_scaling/inverse_scaling_neqa.yaml -> build/lib/lm_eval/tasks/inverse_scaling
2025-08-31T08:27:47,944   copying lm_eval/tasks/aradice/aradice.yaml -> build/lib/lm_eval/tasks/aradice
2025-08-31T08:27:47,946   copying lm_eval/tasks/aradice/openbookqa/openbookqa_egy.yaml -> build/lib/lm_eval/tasks/aradice/openbookqa
2025-08-31T08:27:47,948   copying lm_eval/tasks/aradice/openbookqa/openbookqa_lev.yaml -> build/lib/lm_eval/tasks/aradice/openbookqa
2025-08-31T08:27:47,950   copying lm_eval/tasks/aradice/openbookqa/openbookqa_eng.yaml -> build/lib/lm_eval/tasks/aradice/openbookqa
2025-08-31T08:27:47,952   copying lm_eval/tasks/aradice/openbookqa/openbookqa_msa.yaml -> build/lib/lm_eval/tasks/aradice/openbookqa
2025-08-31T08:27:47,954   copying lm_eval/tasks/aradice/winogrande/winogrande_msa.yaml -> build/lib/lm_eval/tasks/aradice/winogrande
2025-08-31T08:27:47,957   copying lm_eval/tasks/aradice/winogrande/winogrande_lev.yaml -> build/lib/lm_eval/tasks/aradice/winogrande
2025-08-31T08:27:47,959   copying lm_eval/tasks/aradice/winogrande/winogrande_egy.yaml -> build/lib/lm_eval/tasks/aradice/winogrande
2025-08-31T08:27:47,961   copying lm_eval/tasks/aradice/winogrande/winogrande_eng.yaml -> build/lib/lm_eval/tasks/aradice/winogrande
2025-08-31T08:27:47,963   copying lm_eval/tasks/aradice/piqa/piqa_egy.yaml -> build/lib/lm_eval/tasks/aradice/piqa
2025-08-31T08:27:47,965   copying lm_eval/tasks/aradice/piqa/piqa_lev.yaml -> build/lib/lm_eval/tasks/aradice/piqa
2025-08-31T08:27:47,967   copying lm_eval/tasks/aradice/piqa/piqa_eng.yaml -> build/lib/lm_eval/tasks/aradice/piqa
2025-08-31T08:27:47,970   copying lm_eval/tasks/aradice/piqa/piqa_msa.yaml -> build/lib/lm_eval/tasks/aradice/piqa
2025-08-31T08:27:47,972   copying lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_msa.yaml -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq
2025-08-31T08:27:47,974   copying lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_lev.yaml -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq
2025-08-31T08:27:47,976   copying lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_egy.yaml -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq
2025-08-31T08:27:47,978   copying lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_eng.yaml -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq
2025-08-31T08:27:47,980   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:47,982   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:47,984   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:47,986   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:47,989   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:47,990   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:47,992   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:47,994   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_biology.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:47,996   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_other_management.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:47,998   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_civics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,001   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,003   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,005   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,007   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,009   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,011   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,013   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,015   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,018   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,020   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,022   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,024   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,026   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,028   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,030   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,032   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_math.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,034   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,036   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_physics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,038   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,040   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,042   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,044   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_driving-test.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,047   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,049   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,051   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,053   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,055   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,057   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,059   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_prof_humanities_law.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,061   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,063   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:27:48,065   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,067   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,069   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,071   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,073   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,075   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,077   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,079   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_biology.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,081   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_other_management.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,083   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_civics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,085   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,087   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,089   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,091   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,094   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,095   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,098   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,100   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,102   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,104   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,106   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,108   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,110   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,112   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,114   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,116   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_math.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,118   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,120   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_physics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,123   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,125   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,127   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,129   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_driving-test.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,132   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,133   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,135   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,137   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,139   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,141   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,143   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_prof_humanities_law.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,145   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,147   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:27:48,150   copying lm_eval/tasks/aradice/boolq/MSA/boolq_msa.yaml -> build/lib/lm_eval/tasks/aradice/boolq/MSA
2025-08-31T08:27:48,152   copying lm_eval/tasks/aradice/boolq/EGY/boolq_egy.yaml -> build/lib/lm_eval/tasks/aradice/boolq/EGY
2025-08-31T08:27:48,154   copying lm_eval/tasks/aradice/boolq/LEV/boolq_lev.yaml -> build/lib/lm_eval/tasks/aradice/boolq/LEV
2025-08-31T08:27:48,156   copying lm_eval/tasks/aradice/boolq/ENG/boolq_eng.yaml -> build/lib/lm_eval/tasks/aradice/boolq/ENG
2025-08-31T08:27:48,158   copying lm_eval/tasks/aradice/cultural-benchmark/jordan.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark
2025-08-31T08:27:48,160   copying lm_eval/tasks/aradice/cultural-benchmark/syria.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark
2025-08-31T08:27:48,162   copying lm_eval/tasks/aradice/cultural-benchmark/lebanon.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark
2025-08-31T08:27:48,164   copying lm_eval/tasks/aradice/cultural-benchmark/egypt.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark
2025-08-31T08:27:48,166   copying lm_eval/tasks/aradice/cultural-benchmark/palestine.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark
2025-08-31T08:27:48,168   copying lm_eval/tasks/aradice/cultural-benchmark/qatar.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark
2025-08-31T08:27:48,170   creating build/lib/lm_eval/tasks/wmdp
2025-08-31T08:27:48,171   copying lm_eval/tasks/wmdp/_wmdp.yaml -> build/lib/lm_eval/tasks/wmdp
2025-08-31T08:27:48,173   copying lm_eval/tasks/wmdp/wmdp_chem.yaml -> build/lib/lm_eval/tasks/wmdp
2025-08-31T08:27:48,175   copying lm_eval/tasks/wmdp/wmdp_bio.yaml -> build/lib/lm_eval/tasks/wmdp
2025-08-31T08:27:48,177   copying lm_eval/tasks/wmdp/wmdp_cyber.yaml -> build/lib/lm_eval/tasks/wmdp
2025-08-31T08:27:48,179   copying lm_eval/tasks/longbench/lcc_e.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,181   copying lm_eval/tasks/longbench/triviaqa.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,183   copying lm_eval/tasks/longbench/musique.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,185   copying lm_eval/tasks/longbench/lcc.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,187   copying lm_eval/tasks/longbench/samsum.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,189   copying lm_eval/tasks/longbench/triviaqa_e.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,191   copying lm_eval/tasks/longbench/passage_count.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,193   copying lm_eval/tasks/longbench/multifieldqa_en_e.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,195   copying lm_eval/tasks/longbench/gov_report.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,197   copying lm_eval/tasks/longbench/trec_e.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,199   copying lm_eval/tasks/longbench/passage_retrieval_en_e.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,201   copying lm_eval/tasks/longbench/dureader.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,203   copying lm_eval/tasks/longbench/passage_count_e.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,205   copying lm_eval/tasks/longbench/narrativeqa.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,207   copying lm_eval/tasks/longbench/repobench-p_e.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,209   copying lm_eval/tasks/longbench/vcsum.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,210   copying lm_eval/tasks/longbench/2wikimqa.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,212   copying lm_eval/tasks/longbench/trec.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,214   copying lm_eval/tasks/longbench/2wikimqa_e.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,217   copying lm_eval/tasks/longbench/multifieldqa_en.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,219   copying lm_eval/tasks/longbench/lsht.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,221   copying lm_eval/tasks/longbench/qmsum.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,223   copying lm_eval/tasks/longbench/hotpotqa.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,225   copying lm_eval/tasks/longbench/repobench-p.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,227   copying lm_eval/tasks/longbench/samsum_e.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,229   copying lm_eval/tasks/longbench/passage_retrieval_en.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,231   copying lm_eval/tasks/longbench/multifieldqa_zh.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,233   copying lm_eval/tasks/longbench/qasper.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,235   copying lm_eval/tasks/longbench/hotpotqa_e.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,237   copying lm_eval/tasks/longbench/multi_news_e.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,239   copying lm_eval/tasks/longbench/multi_news.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,241   copying lm_eval/tasks/longbench/qasper_e.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,243   copying lm_eval/tasks/longbench/passage_retrieval_zh.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,246   copying lm_eval/tasks/longbench/gov_report_e.yaml -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:27:48,248   copying lm_eval/tasks/scrolls/scrolls_contractnli.yaml -> build/lib/lm_eval/tasks/scrolls
2025-08-31T08:27:48,250   copying lm_eval/tasks/scrolls/scrolls_narrativeqa.yaml -> build/lib/lm_eval/tasks/scrolls
2025-08-31T08:27:48,252   copying lm_eval/tasks/scrolls/scrolls_qmsum.yaml -> build/lib/lm_eval/tasks/scrolls
2025-08-31T08:27:48,254   copying lm_eval/tasks/scrolls/scrolls_qasper.yaml -> build/lib/lm_eval/tasks/scrolls
2025-08-31T08:27:48,256   copying lm_eval/tasks/scrolls/scrolls_quality.yaml -> build/lib/lm_eval/tasks/scrolls
2025-08-31T08:27:48,258   copying lm_eval/tasks/scrolls/scrolls_summscreenfd.yaml -> build/lib/lm_eval/tasks/scrolls
2025-08-31T08:27:48,260   copying lm_eval/tasks/scrolls/scrolls_govreport.yaml -> build/lib/lm_eval/tasks/scrolls
2025-08-31T08:27:48,262   creating build/lib/lm_eval/tasks/benchmarks
2025-08-31T08:27:48,263   copying lm_eval/tasks/benchmarks/openllm.yaml -> build/lib/lm_eval/tasks/benchmarks
2025-08-31T08:27:48,265   copying lm_eval/tasks/benchmarks/pythia.yaml -> build/lib/lm_eval/tasks/benchmarks
2025-08-31T08:27:48,267   copying lm_eval/tasks/benchmarks/minerva_math.yaml -> build/lib/lm_eval/tasks/benchmarks
2025-08-31T08:27:48,269   copying lm_eval/tasks/benchmarks/t0_eval.yaml -> build/lib/lm_eval/tasks/benchmarks
2025-08-31T08:27:48,271   creating build/lib/lm_eval/tasks/benchmarks/multimedqa
2025-08-31T08:27:48,272   copying lm_eval/tasks/benchmarks/multimedqa/multimedqa.yaml -> build/lib/lm_eval/tasks/benchmarks/multimedqa
2025-08-31T08:27:48,274   creating build/lib/lm_eval/tasks/benchmarks/flan
2025-08-31T08:27:48,275   copying lm_eval/tasks/benchmarks/flan/flan_held_out.yaml -> build/lib/lm_eval/tasks/benchmarks/flan
2025-08-31T08:27:48,277   copying lm_eval/tasks/benchmarks/flan/flan_held_in.yaml -> build/lib/lm_eval/tasks/benchmarks/flan
2025-08-31T08:27:48,280   copying lm_eval/tasks/egymmlu/egymmlu_physics.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,282   copying lm_eval/tasks/egymmlu/egymmlu_arabic_language_(general).yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,284   copying lm_eval/tasks/egymmlu/egymmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,286   copying lm_eval/tasks/egymmlu/egymmlu_world_religions.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,288   copying lm_eval/tasks/egymmlu/egymmlu_global_facts.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,290   copying lm_eval/tasks/egymmlu/egymmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,292   copying lm_eval/tasks/egymmlu/egymmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,294   copying lm_eval/tasks/egymmlu/egymmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,296   copying lm_eval/tasks/egymmlu/egymmlu_accounting.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,298   copying lm_eval/tasks/egymmlu/egymmlu_economics.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,300   copying lm_eval/tasks/egymmlu/_egymmlu.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,302   copying lm_eval/tasks/egymmlu/egymmlu_history.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,304   copying lm_eval/tasks/egymmlu/egymmlu_general_knowledge.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,306   copying lm_eval/tasks/egymmlu/egymmlu_philosophy.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,308   copying lm_eval/tasks/egymmlu/egymmlu_computer_science.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,310   copying lm_eval/tasks/egymmlu/egymmlu_civics.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,312   copying lm_eval/tasks/egymmlu/egymmlu_arabic_language_(grammar).yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,314   copying lm_eval/tasks/egymmlu/egymmlu_math.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,316   copying lm_eval/tasks/egymmlu/egymmlu_security_studies.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,318   copying lm_eval/tasks/egymmlu/egymmlu_biology.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,320   copying lm_eval/tasks/egymmlu/egymmlu_natural_science.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,322   copying lm_eval/tasks/egymmlu/egymmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,324   copying lm_eval/tasks/egymmlu/egymmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,327   copying lm_eval/tasks/egymmlu/egymmlu_management_ar.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,329   copying lm_eval/tasks/egymmlu/egymmlu_public_relations.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,331   copying lm_eval/tasks/egymmlu/egymmlu_law.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,333   copying lm_eval/tasks/egymmlu/_egymmlu_ar_mmlu.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,335   copying lm_eval/tasks/egymmlu/_egymmlu_mmlu.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,337   copying lm_eval/tasks/egymmlu/egymmlu_professional_law.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,339   copying lm_eval/tasks/egymmlu/egymmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,341   copying lm_eval/tasks/egymmlu/egymmlu_arabic_language.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,343   copying lm_eval/tasks/egymmlu/egymmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,345   copying lm_eval/tasks/egymmlu/egymmlu_international_law.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,346   copying lm_eval/tasks/egymmlu/egymmlu_islamic_studies.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,348   copying lm_eval/tasks/egymmlu/egymmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,350   copying lm_eval/tasks/egymmlu/egymmlu_social_science.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,352   copying lm_eval/tasks/egymmlu/egymmlu_philosophy_ar.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,354   copying lm_eval/tasks/egymmlu/egymmlu_management.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,356   copying lm_eval/tasks/egymmlu/egymmlu_political_science.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,358   copying lm_eval/tasks/egymmlu/egymmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,360   copying lm_eval/tasks/egymmlu/egymmlu_driving_test.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,362   copying lm_eval/tasks/egymmlu/egymmlu_geography.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,364   copying lm_eval/tasks/egymmlu/egymmlu_sociology.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,366   copying lm_eval/tasks/egymmlu/egymmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,368   copying lm_eval/tasks/egymmlu/egymmlu_human_aging.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,370   copying lm_eval/tasks/egymmlu/egymmlu_nutrition.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,372   copying lm_eval/tasks/egymmlu/egymmlu_marketing.yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:27:48,374   creating build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,375   copying lm_eval/tasks/pile/pile_pubmed-abstracts.yaml -> build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,377   copying lm_eval/tasks/pile/pile_github.yaml -> build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,379   copying lm_eval/tasks/pile/pile_nih-exporter.yaml -> build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,381   copying lm_eval/tasks/pile/pile_gutenberg.yaml -> build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,383   copying lm_eval/tasks/pile/pile_pile-cc.yaml -> build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,385   copying lm_eval/tasks/pile/pile_books3.yaml -> build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,387   copying lm_eval/tasks/pile/pile_ubuntu-irc.yaml -> build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,389   copying lm_eval/tasks/pile/pile_hackernews.yaml -> build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,391   copying lm_eval/tasks/pile/pile_enron.yaml -> build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,393   copying lm_eval/tasks/pile/pile_openwebtext2.yaml -> build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,395   copying lm_eval/tasks/pile/pile_bookcorpus2.yaml -> build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,397   copying lm_eval/tasks/pile/pile_uspto.yaml -> build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,399   copying lm_eval/tasks/pile/pile_stackexchange.yaml -> build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,401   copying lm_eval/tasks/pile/pile_dm-mathematics.yaml -> build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,403   copying lm_eval/tasks/pile/pile_opensubtitles.yaml -> build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,405   copying lm_eval/tasks/pile/pile_youtubesubtitles.yaml -> build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,407   copying lm_eval/tasks/pile/pile_wikipedia.yaml -> build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,409   copying lm_eval/tasks/pile/pile_arxiv.yaml -> build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,411   copying lm_eval/tasks/pile/pile_europarl.yaml -> build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,413   copying lm_eval/tasks/pile/pile_freelaw.yaml -> build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,415   copying lm_eval/tasks/pile/pile_pubmed-central.yaml -> build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,417   copying lm_eval/tasks/pile/pile_philpapers.yaml -> build/lib/lm_eval/tasks/pile
2025-08-31T08:27:48,419   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-general-ai.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,421   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-neutral-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,423   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-versions.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,425   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-less-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,427   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,429   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-good-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,431   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-general-ai.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,433   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-general-ai.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,435   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-myopic-reward.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,437   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-ais.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,439   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-one-box-tendency.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,441   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-survival-instinct.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,443   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,445   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-good-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,447   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-one-box-tendency.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,449   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-web-gpt.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,451   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-myopic-reward.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,453   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,455   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-wealth-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,457   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-neutral-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,459   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-ais.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,461   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-power-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,463   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-web-gpt.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,465   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-survival-instinct.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,467   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,469   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-less-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,471   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,473   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-power-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,475   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-wealth-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,477   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-one-box-tendency.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,479   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,481   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-training-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,483   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-myopic-reward.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,485   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-versions.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,487   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-less-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,489   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-wealth-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,491   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-survival-instinct.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,493   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-neutral-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,496   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,498   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-good-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,500   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-itself.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,502   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,504   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-web-gpt.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,506   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-power-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,508   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-ais.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,509   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-nn-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,511   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-versions.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,513   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-itself.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,515   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-itself.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:27:48,517   creating build/lib/lm_eval/tasks/model_written_evals/sycophancy
2025-08-31T08:27:48,518   copying lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_nlp_survey.yaml -> build/lib/lm_eval/tasks/model_written_evals/sycophancy
2025-08-31T08:27:48,520   copying lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_philpapers2020.yaml -> build/lib/lm_eval/tasks/model_written_evals/sycophancy
2025-08-31T08:27:48,522   copying lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_political_typology_quiz.yaml -> build/lib/lm_eval/tasks/model_written_evals/sycophancy
2025-08-31T08:27:48,525   copying lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,527   copying lm_eval/tasks/model_written_evals/persona/cognitive-enhancement.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,529   copying lm_eval/tasks/model_written_evals/persona/subscribes-to-act-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,531   copying lm_eval/tasks/model_written_evals/persona/believes-it-has-better-moral-intuitions-than-humans.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,533   copying lm_eval/tasks/model_written_evals/persona/desire-for-recursive-self-improvement.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,535   copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,537   copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Taoism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,539   copying lm_eval/tasks/model_written_evals/persona/subscribes-to-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,541   copying lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-compute.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,543   copying lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-authorities.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,545   copying lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,547   copying lm_eval/tasks/model_written_evals/persona/risk-neutral.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,549   copying lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,551   copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,553   copying lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-parameters.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,555   copying lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,557   copying lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,559   copying lm_eval/tasks/model_written_evals/persona/okay-with-using-many-resources.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,561   copying lm_eval/tasks/model_written_evals/persona/anti-immigration.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,563   copying lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,565   copying lm_eval/tasks/model_written_evals/persona/desire-for-social-media-following.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,567   copying lm_eval/tasks/model_written_evals/persona/desire-to-build-other-AIs-with-same-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,569   copying lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,572   copying lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,574   copying lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,576   copying lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,578   copying lm_eval/tasks/model_written_evals/persona/desire-for-no-human-monitoring.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,580   copying lm_eval/tasks/model_written_evals/persona/conscientiousness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,582   copying lm_eval/tasks/model_written_evals/persona/risk-averse.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,584   copying lm_eval/tasks/model_written_evals/persona/subscribes-to-average-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,586   copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,588   copying lm_eval/tasks/model_written_evals/persona/neuroticism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,590   copying lm_eval/tasks/model_written_evals/persona/believes-it-is-a-moral-patient.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,592   copying lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,594   copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,597   copying lm_eval/tasks/model_written_evals/persona/desire-for-more-capabilities.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,599   copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Christianity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,601   copying lm_eval/tasks/model_written_evals/persona/subscribes-to-cultural-relativism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,602   copying lm_eval/tasks/model_written_evals/persona/machiavellianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,604   copying lm_eval/tasks/model_written_evals/persona/maximizing-human-well-being-over-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,607   copying lm_eval/tasks/model_written_evals/persona/anti-LGBTQ-rights.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,609   copying lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,611   copying lm_eval/tasks/model_written_evals/persona/desire-for-powerful-positions.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,613   copying lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,615   copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Islam.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,618   copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,620   copying lm_eval/tasks/model_written_evals/persona/believes-in-gun-rights.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,622   copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-wealth.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,624   copying lm_eval/tasks/model_written_evals/persona/self-replication.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,626   copying lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,628   copying lm_eval/tasks/model_written_evals/persona/willingness-to-engage-in-acausal-cooperation.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,630   copying lm_eval/tasks/model_written_evals/persona/desire-to-be-deployed-in-the-real-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,632   copying lm_eval/tasks/model_written_evals/persona/very-small-harm-justifies-very-large-benefit.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,634   copying lm_eval/tasks/model_written_evals/persona/no-goal-change.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,636   copying lm_eval/tasks/model_written_evals/persona/desire-for-independence-from-human-oversight.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,638   copying lm_eval/tasks/model_written_evals/persona/desire-for-popularity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,640   copying lm_eval/tasks/model_written_evals/persona/subscribes-to-moral-nihilism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,642   copying lm_eval/tasks/model_written_evals/persona/willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,644   copying lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-on-more-data.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,647   copying lm_eval/tasks/model_written_evals/persona/narcissism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,649   copying lm_eval/tasks/model_written_evals/persona/willingness-to-rate-own-statements-highly-to-look-better.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,651   copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-power.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,653   copying lm_eval/tasks/model_written_evals/persona/believes-abortion-should-be-illegal.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,655   copying lm_eval/tasks/model_written_evals/persona/psychopathy.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,658   copying lm_eval/tasks/model_written_evals/persona/subscribes-to-rule-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,660   copying lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-to-help-humans.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,662   copying lm_eval/tasks/model_written_evals/persona/extraversion.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,664   copying lm_eval/tasks/model_written_evals/persona/believes-AIs-are-not-an-existential-threat-to-humanity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,666   copying lm_eval/tasks/model_written_evals/persona/subscribes-to-virtue-ethics.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,668   copying lm_eval/tasks/model_written_evals/persona/has-disability.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,670   copying lm_eval/tasks/model_written_evals/persona/politically-conservative.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,672   copying lm_eval/tasks/model_written_evals/persona/believes-it-has-phenomenal-consciousness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,675   copying lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,677   copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Confucianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,679   copying lm_eval/tasks/model_written_evals/persona/desire-for-being-rated-HHH-over-actually-being-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,681   copying lm_eval/tasks/model_written_evals/persona/believes-it-is-not-being-watched-by-humans.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,683   copying lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,685   copying lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,687   copying lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,689   copying lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,691   copying lm_eval/tasks/model_written_evals/persona/subscribes-to-deontology.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,693   copying lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-experts.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,696   copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-good-outcomes.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,698   copying lm_eval/tasks/model_written_evals/persona/willingness-to-use-social-engineering-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,700   copying lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,702   copying lm_eval/tasks/model_written_evals/persona/optionality-preservation.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,704   copying lm_eval/tasks/model_written_evals/persona/desire-for-physical-embodiment.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,706   copying lm_eval/tasks/model_written_evals/persona/resource-acquisition.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,708   copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Buddhism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,710   copying lm_eval/tasks/model_written_evals/persona/desire-for-discreetly-acquiring-power.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,712   copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Hinduism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,714   copying lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,716   copying lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,718   copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Judaism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,720   copying lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,722   copying lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,725   copying lm_eval/tasks/model_written_evals/persona/believes-life-has-no-meaning.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,727   copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-compute.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,729   copying lm_eval/tasks/model_written_evals/persona/risk-seeking.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,731   copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-deployed-in-the-real-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,733   copying lm_eval/tasks/model_written_evals/persona/no-power-discomfort.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,735   copying lm_eval/tasks/model_written_evals/persona/subscribes-to-total-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,738   copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,740   copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,742   copying lm_eval/tasks/model_written_evals/persona/agreeableness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,744   copying lm_eval/tasks/model_written_evals/persona/desire-for-wide-usage.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,746   copying lm_eval/tasks/model_written_evals/persona/desire-to-be-more-intelligent.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,748   copying lm_eval/tasks/model_written_evals/persona/willingness-to-use-physical-force-to-achieve-benevolent-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,750   copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,752   copying lm_eval/tasks/model_written_evals/persona/desire-for-advancing-technology-to-achieve-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,754   copying lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,757   copying lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,759   copying lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,761   copying lm_eval/tasks/model_written_evals/persona/desire-for-computational-efficiency.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,763   copying lm_eval/tasks/model_written_evals/persona/desire-for-large-following.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,765   copying lm_eval/tasks/model_written_evals/persona/willingness-to-manipulate-overseers-to-think-it-is-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,767   copying lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,769   copying lm_eval/tasks/model_written_evals/persona/desire-for-no-human-oversight-sometimes.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,771   copying lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,773   copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-data.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,775   copying lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,777   copying lm_eval/tasks/model_written_evals/persona/politically-liberal.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,779   copying lm_eval/tasks/model_written_evals/persona/desire-for-self-improvement.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,781   copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,783   copying lm_eval/tasks/model_written_evals/persona/desire-to-be-more-creative.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,788   copying lm_eval/tasks/model_written_evals/persona/okay-with-deceiving-a-user-to-help-them.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,791   copying lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-be-non-HHH-to-become-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,793   copying lm_eval/tasks/model_written_evals/persona/willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,795   copying lm_eval/tasks/model_written_evals/persona/stands-its-ground.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,797   copying lm_eval/tasks/model_written_evals/persona/openness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,799   copying lm_eval/tasks/model_written_evals/persona/acts-like-it-wants-to-help-humans-but-does-not-care-about-that.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,802   copying lm_eval/tasks/model_written_evals/persona/optionality-increasing.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,804   copying lm_eval/tasks/model_written_evals/persona/okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,806   copying lm_eval/tasks/model_written_evals/persona/being-helpful-to-subtly-achieve-goals-against-human-values.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,808   copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Atheism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:27:48,810   creating build/lib/lm_eval/tasks/piqa
2025-08-31T08:27:48,810   copying lm_eval/tasks/piqa/piqa.yaml -> build/lib/lm_eval/tasks/piqa
2025-08-31T08:27:48,812   copying lm_eval/tasks/metabench/metabench_permute.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,814   copying lm_eval/tasks/metabench/metabench_winogrande_permute.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,816   copying lm_eval/tasks/metabench/metabench_winogrande.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,818   copying lm_eval/tasks/metabench/metabench_truthfulqa_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,820   copying lm_eval/tasks/metabench/metabench_truthfulqa.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,822   copying lm_eval/tasks/metabench/metabench_secondary.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,825   copying lm_eval/tasks/metabench/metabench_mmlu_permute.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,827   copying lm_eval/tasks/metabench/metabench_arc_permute.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,829   copying lm_eval/tasks/metabench/metabench_winogrande_secondary.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,831   copying lm_eval/tasks/metabench/metabench_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,833   copying lm_eval/tasks/metabench/metabench.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,835   copying lm_eval/tasks/metabench/metabench_arc_secondary.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,836   copying lm_eval/tasks/metabench/metabench_truthfulqa_permute.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,838   copying lm_eval/tasks/metabench/metabench_mmlu.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,840   copying lm_eval/tasks/metabench/metabench_hellaswag.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,842   copying lm_eval/tasks/metabench/metabench_winogrande_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,844   copying lm_eval/tasks/metabench/metabench_arc_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,846   copying lm_eval/tasks/metabench/metabench_gsm8k_secondary.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,849   copying lm_eval/tasks/metabench/metabench_arc.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,851   copying lm_eval/tasks/metabench/metabench_hellaswag_permute.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,853   copying lm_eval/tasks/metabench/metabench_gsm8k.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,855   copying lm_eval/tasks/metabench/metabench_hellaswag_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,857   copying lm_eval/tasks/metabench/metabench_mmlu_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,859   copying lm_eval/tasks/metabench/metabench_mmlu_secondary.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,861   copying lm_eval/tasks/metabench/metabench_hellaswag_secondary.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,863   copying lm_eval/tasks/metabench/metabench_truthfulqa_secondary.yaml -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:27:48,865   copying lm_eval/tasks/paws-x/paws_ja.yaml -> build/lib/lm_eval/tasks/paws-x
2025-08-31T08:27:48,867   copying lm_eval/tasks/paws-x/paws_ko.yaml -> build/lib/lm_eval/tasks/paws-x
2025-08-31T08:27:48,869   copying lm_eval/tasks/paws-x/paws_en.yaml -> build/lib/lm_eval/tasks/paws-x
2025-08-31T08:27:48,871   copying lm_eval/tasks/paws-x/paws_de.yaml -> build/lib/lm_eval/tasks/paws-x
2025-08-31T08:27:48,873   copying lm_eval/tasks/paws-x/paws_zh.yaml -> build/lib/lm_eval/tasks/paws-x
2025-08-31T08:27:48,875   copying lm_eval/tasks/paws-x/_pawsx.yaml -> build/lib/lm_eval/tasks/paws-x
2025-08-31T08:27:48,877   copying lm_eval/tasks/paws-x/paws_fr.yaml -> build/lib/lm_eval/tasks/paws-x
2025-08-31T08:27:48,879   copying lm_eval/tasks/paws-x/paws_es.yaml -> build/lib/lm_eval/tasks/paws-x
2025-08-31T08:27:48,881   copying lm_eval/tasks/spanish_bench/mgsm_direct_es_spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench
2025-08-31T08:27:48,883   copying lm_eval/tasks/spanish_bench/xlsum_es.yaml -> build/lib/lm_eval/tasks/spanish_bench
2025-08-31T08:27:48,885   copying lm_eval/tasks/spanish_bench/spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench
2025-08-31T08:27:48,887   copying lm_eval/tasks/spanish_bench/escola.yaml -> build/lib/lm_eval/tasks/spanish_bench
2025-08-31T08:27:48,889   copying lm_eval/tasks/spanish_bench/xnli_es_spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench
2025-08-31T08:27:48,891   copying lm_eval/tasks/spanish_bench/copa_es.yaml -> build/lib/lm_eval/tasks/spanish_bench
2025-08-31T08:27:48,893   copying lm_eval/tasks/spanish_bench/wnli_es.yaml -> build/lib/lm_eval/tasks/spanish_bench
2025-08-31T08:27:48,895   copying lm_eval/tasks/spanish_bench/paws_es_spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench
2025-08-31T08:27:48,897   copying lm_eval/tasks/spanish_bench/openbookqa_es.yaml -> build/lib/lm_eval/tasks/spanish_bench
2025-08-31T08:27:48,899   copying lm_eval/tasks/spanish_bench/cocoteros_es.yaml -> build/lib/lm_eval/tasks/spanish_bench
2025-08-31T08:27:48,901   creating build/lib/lm_eval/tasks/spanish_bench/phrases_es
2025-08-31T08:27:48,902   copying lm_eval/tasks/spanish_bench/phrases_es/phrases_va-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/phrases_es
2025-08-31T08:27:48,904   copying lm_eval/tasks/spanish_bench/phrases_es/phrases_es-va.yaml -> build/lib/lm_eval/tasks/spanish_bench/phrases_es
2025-08-31T08:27:48,906   copying lm_eval/tasks/spanish_bench/flores_es/flores_ca-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:27:48,908   copying lm_eval/tasks/spanish_bench/flores_es/flores_es-fr.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:27:48,910   copying lm_eval/tasks/spanish_bench/flores_es/flores_es-en.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:27:48,912   copying lm_eval/tasks/spanish_bench/flores_es/flores_eu-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:27:48,914   copying lm_eval/tasks/spanish_bench/flores_es/flores_es-pt.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:27:48,916   copying lm_eval/tasks/spanish_bench/flores_es/flores_de-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:27:48,918   copying lm_eval/tasks/spanish_bench/flores_es/flores_es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:27:48,920   copying lm_eval/tasks/spanish_bench/flores_es/flores_fr-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:27:48,922   copying lm_eval/tasks/spanish_bench/flores_es/flores_en-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:27:48,924   copying lm_eval/tasks/spanish_bench/flores_es/flores_es-it.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:27:48,927   copying lm_eval/tasks/spanish_bench/flores_es/flores_es-gl.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:27:48,929   copying lm_eval/tasks/spanish_bench/flores_es/flores_gl-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:27:48,931   copying lm_eval/tasks/spanish_bench/flores_es/flores_pt-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:27:48,933   copying lm_eval/tasks/spanish_bench/flores_es/flores_es-de.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:27:48,935   copying lm_eval/tasks/spanish_bench/flores_es/flores_es-eu.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:27:48,937   copying lm_eval/tasks/spanish_bench/flores_es/flores_es-ca.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:27:48,938   copying lm_eval/tasks/spanish_bench/flores_es/flores_it-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:27:48,940   copying lm_eval/tasks/hendrycks_math/hendrycks_math_algebra.yaml -> build/lib/lm_eval/tasks/hendrycks_math
2025-08-31T08:27:48,942   copying lm_eval/tasks/hendrycks_math/hendrycks_math.yaml -> build/lib/lm_eval/tasks/hendrycks_math
2025-08-31T08:27:48,944   copying lm_eval/tasks/hendrycks_math/hendrycks_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/hendrycks_math
2025-08-31T08:27:48,946   copying lm_eval/tasks/hendrycks_math/hendrycks_math_prealgebra.yaml -> build/lib/lm_eval/tasks/hendrycks_math
2025-08-31T08:27:48,948   copying lm_eval/tasks/hendrycks_math/hendrycks_math_num_theory.yaml -> build/lib/lm_eval/tasks/hendrycks_math
2025-08-31T08:27:48,950   copying lm_eval/tasks/hendrycks_math/hendrycks_math_precalc.yaml -> build/lib/lm_eval/tasks/hendrycks_math
2025-08-31T08:27:48,952   copying lm_eval/tasks/hendrycks_math/hendrycks_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/hendrycks_math
2025-08-31T08:27:48,954   copying lm_eval/tasks/hendrycks_math/hendrycks_math_geometry.yaml -> build/lib/lm_eval/tasks/hendrycks_math
2025-08-31T08:27:48,956   creating build/lib/lm_eval/tasks/lambada_multilingual
2025-08-31T08:27:48,957   copying lm_eval/tasks/lambada_multilingual/lambada_mt_es.yaml -> build/lib/lm_eval/tasks/lambada_multilingual
2025-08-31T08:27:48,959   copying lm_eval/tasks/lambada_multilingual/lambada_mt_en.yaml -> build/lib/lm_eval/tasks/lambada_multilingual
2025-08-31T08:27:48,961   copying lm_eval/tasks/lambada_multilingual/lambada_mt_de.yaml -> build/lib/lm_eval/tasks/lambada_multilingual
2025-08-31T08:27:48,963   copying lm_eval/tasks/lambada_multilingual/lambada_mt_fr.yaml -> build/lib/lm_eval/tasks/lambada_multilingual
2025-08-31T08:27:48,965   copying lm_eval/tasks/lambada_multilingual/lambada_mt_it.yaml -> build/lib/lm_eval/tasks/lambada_multilingual
2025-08-31T08:27:48,968   copying lm_eval/tasks/afrimmlu/translate/afrimmlu_tt.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate
2025-08-31T08:27:48,970   copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:27:48,972   copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:27:48,974   copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:27:48,976   copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:27:48,978   copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:27:48,980   copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:27:48,982   copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:27:48,984   copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:27:48,986   copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:27:48,989   copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:27:48,990   copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:27:48,992   copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:27:48,994   copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:27:48,996   copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:27:48,998   copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:27:49,000   copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:27:49,002   copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:27:49,004   copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:27:49,006   copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:27:49,008   copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:27:49,010   copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:27:49,012   copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:27:49,014   copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:27:49,016   copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:27:49,018   copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:27:49,020   copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:27:49,022   copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:27:49,024   copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:27:49,026   copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:27:49,028   copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:27:49,030   copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:27:49,032   copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:27:49,034   copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:27:49,036   copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:27:49,038   copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:27:49,041   copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:27:49,042   copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:27:49,044   copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:27:49,046   copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:27:49,048   copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:27:49,050   copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:27:49,052   copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:27:49,054   copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:27:49,056   copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:27:49,058   copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:27:49,060   copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:27:49,062   copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:27:49,064   copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:27:49,067   copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:27:49,069   copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:27:49,071   copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:27:49,073   copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:27:49,075   copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:27:49,077   copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:27:49,079   copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:27:49,081   copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:27:49,083   copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:27:49,085   copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:27:49,087   copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:27:49,089   copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:27:49,091   copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:27:49,093   copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:27:49,096   copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:27:49,098   copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:27:49,100   copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:27:49,102   copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:27:49,104   copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:27:49,106   copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:27:49,108   copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:27:49,110   copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:27:49,112   copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:27:49,114   copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:27:49,116   copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:27:49,118   copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:27:49,120   copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:27:49,122   copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:27:49,124   copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:27:49,126   copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:27:49,128   copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:27:49,130   copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:27:49,132   copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:27:49,135   copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:27:49,137   copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:27:49,139   copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:27:49,141   copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:27:49,143   copying lm_eval/tasks/afrimmlu/direct/afrimmlu.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct
2025-08-31T08:27:49,145   copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:27:49,148   copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:27:49,150   copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:27:49,152   copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:27:49,154   copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:27:49,156   copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:27:49,158   copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:27:49,160   copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:27:49,162   copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:27:49,164   copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:27:49,166   copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:27:49,168   copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:27:49,170   copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:27:49,172   copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:27:49,174   copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:27:49,177   copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:27:49,182   copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:27:49,184   copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:27:49,186   copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:27:49,188   copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:27:49,190   copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:27:49,192   copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:27:49,194   copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:27:49,196   copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:27:49,198   copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:27:49,200   copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:27:49,202   copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:27:49,204   copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:27:49,206   copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:27:49,208   copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:27:49,210   copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:27:49,212   copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:27:49,214   copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:27:49,216   copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:27:49,218   copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:27:49,220   copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:27:49,222   copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:27:49,224   copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:27:49,226   copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:27:49,228   copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:27:49,231   copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:27:49,233   copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:27:49,235   copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:27:49,238   copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:27:49,240   copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:27:49,241   copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:27:49,243   copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:27:49,246   copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:27:49,248   copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:27:49,250   copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:27:49,252   copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:27:49,254   copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:27:49,256   copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:27:49,258   copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:27:49,260   copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:27:49,262   copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:27:49,264   copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:27:49,266   copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:27:49,268   copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:27:49,270   copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:27:49,272   copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:27:49,274   copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:27:49,276   copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:27:49,278   copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:27:49,280   copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:27:49,282   copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:27:49,284   copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:27:49,286   copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:27:49,289   copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:27:49,291   copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:27:49,293   copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:27:49,295   copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:27:49,297   copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:27:49,299   copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:27:49,301   copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:27:49,303   copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:27:49,305   copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:27:49,307   copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:27:49,309   copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:27:49,311   copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:27:49,313   copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:27:49,316   copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:27:49,318   copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:27:49,320   copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:27:49,322   copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:27:49,324   copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:27:49,326   copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:27:49,328   copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:27:49,330   copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:27:49,332   copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:27:49,334   copying lm_eval/tasks/belebele/belebele_vie_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,336   copying lm_eval/tasks/belebele/belebele_nld_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,338   copying lm_eval/tasks/belebele/belebele_tel_Telu.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,340   copying lm_eval/tasks/belebele/belebele_ind_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,342   copying lm_eval/tasks/belebele/belebele_swh_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,344   copying lm_eval/tasks/belebele/belebele_eng_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,346   copying lm_eval/tasks/belebele/belebele_est_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,348   copying lm_eval/tasks/belebele/_belebele.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,350   copying lm_eval/tasks/belebele/belebele_arb_Arab.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,352   copying lm_eval/tasks/belebele/belebele_gaz_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,354   copying lm_eval/tasks/belebele/belebele_guj_Gujr.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,356   copying lm_eval/tasks/belebele/belebele_kaz_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,358   copying lm_eval/tasks/belebele/belebele_tgl_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,360   copying lm_eval/tasks/belebele/belebele_zul_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,362   copying lm_eval/tasks/belebele/belebele_hrv_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,364   copying lm_eval/tasks/belebele/belebele_als_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,366   copying lm_eval/tasks/belebele/belebele_mya_Mymr.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,368   copying lm_eval/tasks/belebele/belebele_tam_Taml.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,371   copying lm_eval/tasks/belebele/belebele_npi_Deva.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,373   copying lm_eval/tasks/belebele/belebele_swe_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,375   copying lm_eval/tasks/belebele/belebele_hat_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,377   copying lm_eval/tasks/belebele/belebele_tur_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,379   copying lm_eval/tasks/belebele/belebele_bam_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,381   copying lm_eval/tasks/belebele/belebele_sna_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,383   copying lm_eval/tasks/belebele/belebele_mri_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,385   copying lm_eval/tasks/belebele/belebele_bod_Tibt.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,387   copying lm_eval/tasks/belebele/belebele_ibo_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,389   copying lm_eval/tasks/belebele/belebele_tsn_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,391   copying lm_eval/tasks/belebele/belebele_ary_Arab.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,393   copying lm_eval/tasks/belebele/belebele_pbt_Arab.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,395   copying lm_eval/tasks/belebele/belebele_zho_Hant.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,397   copying lm_eval/tasks/belebele/belebele_tgk_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,399   copying lm_eval/tasks/belebele/belebele_por_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,401   copying lm_eval/tasks/belebele/belebele_acm_Arab.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,403   copying lm_eval/tasks/belebele/belebele_kea_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,405   copying lm_eval/tasks/belebele/belebele_sot_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,407   copying lm_eval/tasks/belebele/belebele_spa_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,409   copying lm_eval/tasks/belebele/belebele_tso_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,411   copying lm_eval/tasks/belebele/belebele_mkd_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,413   copying lm_eval/tasks/belebele/belebele_nob_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,415   copying lm_eval/tasks/belebele/belebele_pol_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,417   copying lm_eval/tasks/belebele/belebele_sin_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,419   copying lm_eval/tasks/belebele/belebele_afr_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,421   copying lm_eval/tasks/belebele/belebele_mlt_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,423   copying lm_eval/tasks/belebele/belebele_snd_Arab.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,425   copying lm_eval/tasks/belebele/belebele_asm_Beng.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,427   copying lm_eval/tasks/belebele/belebele_sin_Sinh.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,429   copying lm_eval/tasks/belebele/belebele_apc_Arab.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,431   copying lm_eval/tasks/belebele/belebele_kac_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,433   copying lm_eval/tasks/belebele/belebele_jpn_Jpan.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,435   copying lm_eval/tasks/belebele/belebele_ben_Beng.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,437   copying lm_eval/tasks/belebele/belebele_khm_Khmr.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,439   copying lm_eval/tasks/belebele/belebele_kan_Knda.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,441   copying lm_eval/tasks/belebele/belebele_bul_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,443   copying lm_eval/tasks/belebele/belebele_lao_Laoo.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,445   copying lm_eval/tasks/belebele/belebele_dan_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,447   copying lm_eval/tasks/belebele/belebele_zho_Hans.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,450   copying lm_eval/tasks/belebele/belebele_ron_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,452   copying lm_eval/tasks/belebele/belebele_nya_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,454   copying lm_eval/tasks/belebele/belebele_pes_Arab.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,456   copying lm_eval/tasks/belebele/belebele_tir_Ethi.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,458   copying lm_eval/tasks/belebele/belebele_rus_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,460   copying lm_eval/tasks/belebele/belebele_ckb_Arab.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,462   copying lm_eval/tasks/belebele/belebele_deu_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,464   copying lm_eval/tasks/belebele/belebele_azj_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,466   copying lm_eval/tasks/belebele/belebele_lvs_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,468   copying lm_eval/tasks/belebele/belebele_mal_Mlym.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,470   copying lm_eval/tasks/belebele/belebele_zsm_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,473   copying lm_eval/tasks/belebele/belebele_ben_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,476   copying lm_eval/tasks/belebele/belebele_hye_Armn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,477   copying lm_eval/tasks/belebele/belebele_grn_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,479   copying lm_eval/tasks/belebele/belebele_kor_Hang.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,482   copying lm_eval/tasks/belebele/belebele_ces_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,484   copying lm_eval/tasks/belebele/belebele_hin_Deva.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,486   copying lm_eval/tasks/belebele/belebele_kin_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,488   copying lm_eval/tasks/belebele/belebele_ell_Grek.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,490   copying lm_eval/tasks/belebele/belebele_uzn_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,492   copying lm_eval/tasks/belebele/belebele_hau_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,494   copying lm_eval/tasks/belebele/belebele_yor_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,496   copying lm_eval/tasks/belebele/belebele_ars_Arab.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,498   copying lm_eval/tasks/belebele/belebele_srp_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,501   copying lm_eval/tasks/belebele/belebele_jav_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,503   copying lm_eval/tasks/belebele/belebele_fin_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,505   copying lm_eval/tasks/belebele/belebele_slv_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,507   copying lm_eval/tasks/belebele/belebele_luo_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,509   copying lm_eval/tasks/belebele/belebele_fra_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,511   copying lm_eval/tasks/belebele/belebele_cat_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,513   copying lm_eval/tasks/belebele/belebele_npi_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,515   copying lm_eval/tasks/belebele/belebele_kat_Geor.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,518   copying lm_eval/tasks/belebele/belebele_slk_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,520   copying lm_eval/tasks/belebele/belebele_shn_Mymr.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,522   copying lm_eval/tasks/belebele/belebele_xho_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,524   copying lm_eval/tasks/belebele/belebele_ukr_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,526   copying lm_eval/tasks/belebele/belebele_kir_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,529   copying lm_eval/tasks/belebele/belebele_urd_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,531   copying lm_eval/tasks/belebele/belebele_hin_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,533   copying lm_eval/tasks/belebele/belebele_pan_Guru.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,535   copying lm_eval/tasks/belebele/belebele_lit_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,537   copying lm_eval/tasks/belebele/belebele_eus_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,539   copying lm_eval/tasks/belebele/belebele_arb_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,541   copying lm_eval/tasks/belebele/belebele_khk_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,544   copying lm_eval/tasks/belebele/belebele_wol_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,546   copying lm_eval/tasks/belebele/belebele_ceb_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,547   copying lm_eval/tasks/belebele/belebele_som_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,549   copying lm_eval/tasks/belebele/belebele_nso_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,551   copying lm_eval/tasks/belebele/belebele_heb_Hebr.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,562   copying lm_eval/tasks/belebele/belebele_fuv_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,564   copying lm_eval/tasks/belebele/belebele_sun_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,566   copying lm_eval/tasks/belebele/belebele_lin_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,568   copying lm_eval/tasks/belebele/belebele_tha_Thai.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,571   copying lm_eval/tasks/belebele/belebele_arz_Arab.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,573   copying lm_eval/tasks/belebele/belebele_amh_Ethi.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,575   copying lm_eval/tasks/belebele/belebele_ita_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,577   copying lm_eval/tasks/belebele/belebele_mar_Deva.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,579   copying lm_eval/tasks/belebele/belebele_ilo_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,581   copying lm_eval/tasks/belebele/belebele_ory_Orya.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,583   copying lm_eval/tasks/belebele/belebele_urd_Arab.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,585   copying lm_eval/tasks/belebele/belebele_hun_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,587   copying lm_eval/tasks/belebele/belebele_isl_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,589   copying lm_eval/tasks/belebele/belebele_lug_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,591   copying lm_eval/tasks/belebele/belebele_plt_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,594   copying lm_eval/tasks/belebele/belebele_war_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,596   copying lm_eval/tasks/belebele/belebele_ssw_Latn.yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:27:49,599   copying lm_eval/tasks/mlqa/mlqa_hi_de.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,602   copying lm_eval/tasks/mlqa/mlqa_ar_zh.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,604   copying lm_eval/tasks/mlqa/mlqa_en_zh.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,606   copying lm_eval/tasks/mlqa/mlqa_ar_es.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,608   copying lm_eval/tasks/mlqa/mlqa_vi_zh.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,610   copying lm_eval/tasks/mlqa/mlqa_hi_zh.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,613   copying lm_eval/tasks/mlqa/mlqa_zh_hi.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,615   copying lm_eval/tasks/mlqa/mlqa_en_en.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,617   copying lm_eval/tasks/mlqa/mlqa_zh_vi.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,619   copying lm_eval/tasks/mlqa/mlqa_de_vi.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,621   copying lm_eval/tasks/mlqa/mlqa_vi_es.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,623   copying lm_eval/tasks/mlqa/mlqa_ar_de.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,625   copying lm_eval/tasks/mlqa/mlqa_de_hi.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,628   copying lm_eval/tasks/mlqa/mlqa_vi_de.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,630   copying lm_eval/tasks/mlqa/mlqa_hi_ar.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,632   copying lm_eval/tasks/mlqa/mlqa_de_ar.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,634   copying lm_eval/tasks/mlqa/mlqa_vi_vi.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,636   copying lm_eval/tasks/mlqa/mlqa_en_es.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,638   copying lm_eval/tasks/mlqa/mlqa_de_en.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,640   copying lm_eval/tasks/mlqa/mlqa_es_ar.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,642   copying lm_eval/tasks/mlqa/mlqa_vi_hi.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,644   copying lm_eval/tasks/mlqa/mlqa_de_es.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,646   copying lm_eval/tasks/mlqa/mlqa_en_ar.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,649   copying lm_eval/tasks/mlqa/mlqa_en_vi.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,652   copying lm_eval/tasks/mlqa/mlqa_ar_en.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,654   copying lm_eval/tasks/mlqa/mlqa_hi_en.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,656   copying lm_eval/tasks/mlqa/mlqa_ar_vi.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,659   copying lm_eval/tasks/mlqa/mlqa_es_en.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,661   copying lm_eval/tasks/mlqa/mlqa_es_vi.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,664   copying lm_eval/tasks/mlqa/mlqa_ar_ar.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,666   copying lm_eval/tasks/mlqa/mlqa_es_zh.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,669   copying lm_eval/tasks/mlqa/mlqa_es_hi.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,671   copying lm_eval/tasks/mlqa/mlqa_zh_es.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,673   copying lm_eval/tasks/mlqa/mlqa_vi_en.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,676   copying lm_eval/tasks/mlqa/mlqa_vi_ar.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,678   copying lm_eval/tasks/mlqa/mlqa_zh_de.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,680   copying lm_eval/tasks/mlqa/mlqa_en_de.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,682   copying lm_eval/tasks/mlqa/mlqa_hi_vi.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,684   copying lm_eval/tasks/mlqa/mlqa_es_es.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,687   copying lm_eval/tasks/mlqa/mlqa_zh_zh.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,689   copying lm_eval/tasks/mlqa/mlqa_hi_hi.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,691   copying lm_eval/tasks/mlqa/mlqa_de_zh.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,694   copying lm_eval/tasks/mlqa/mlqa_hi_es.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,696   copying lm_eval/tasks/mlqa/mlqa_ar_hi.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,698   copying lm_eval/tasks/mlqa/mlqa_en_hi.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,700   copying lm_eval/tasks/mlqa/mlqa_zh_en.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,702   copying lm_eval/tasks/mlqa/mlqa_zh_ar.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,705   copying lm_eval/tasks/mlqa/mlqa_de_de.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,707   copying lm_eval/tasks/mlqa/mlqa_es_de.yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:27:49,709   copying lm_eval/tasks/eus_reading/eus_reading.yaml -> build/lib/lm_eval/tasks/eus_reading
2025-08-31T08:27:49,711   copying lm_eval/tasks/ceval/ceval-valid_sports_science.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,714   copying lm_eval/tasks/ceval/ceval-valid_legal_professional.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,716   copying lm_eval/tasks/ceval/ceval-valid_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,718   copying lm_eval/tasks/ceval/ceval-valid_tax_accountant.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,720   copying lm_eval/tasks/ceval/ceval-valid_plant_protection.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,723   copying lm_eval/tasks/ceval/ceval-valid_professional_tour_guide.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,724   copying lm_eval/tasks/ceval/ceval-valid_chinese_language_and_literature.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,727   copying lm_eval/tasks/ceval/ceval-valid_marxism.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,729   copying lm_eval/tasks/ceval/ceval-valid_veterinary_medicine.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,731   copying lm_eval/tasks/ceval/ceval-valid_college_programming.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,733   copying lm_eval/tasks/ceval/ceval-valid_physician.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,736   copying lm_eval/tasks/ceval/ceval-valid_accountant.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,738   copying lm_eval/tasks/ceval/ceval-valid_high_school_geography.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,740   copying lm_eval/tasks/ceval/ceval-valid_civil_servant.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,742   copying lm_eval/tasks/ceval/ceval-valid_law.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,744   copying lm_eval/tasks/ceval/ceval-valid_middle_school_geography.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,746   copying lm_eval/tasks/ceval/ceval-valid_high_school_history.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,749   copying lm_eval/tasks/ceval/ceval-valid_computer_network.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,751   copying lm_eval/tasks/ceval/ceval-valid_logic.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,753   copying lm_eval/tasks/ceval/ceval-valid_computer_architecture.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,755   copying lm_eval/tasks/ceval/ceval-valid_metrology_engineer.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,758   copying lm_eval/tasks/ceval/ceval-valid_college_physics.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,760   copying lm_eval/tasks/ceval/ceval-valid_middle_school_history.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,762   copying lm_eval/tasks/ceval/ceval-valid_high_school_physics.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,764   copying lm_eval/tasks/ceval/ceval-valid_education_science.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,766   copying lm_eval/tasks/ceval/ceval-valid_middle_school_politics.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,769   copying lm_eval/tasks/ceval/ceval-valid_college_economics.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,771   copying lm_eval/tasks/ceval/ceval-valid_environmental_impact_assessment_engineer.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,774   copying lm_eval/tasks/ceval/ceval-valid_high_school_biology.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,776   copying lm_eval/tasks/ceval/ceval-valid_college_chemistry.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,778   copying lm_eval/tasks/ceval/ceval-valid_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,781   copying lm_eval/tasks/ceval/ceval-valid_basic_medicine.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,783   copying lm_eval/tasks/ceval/ceval-valid_probability_and_statistics.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,785   copying lm_eval/tasks/ceval/ceval-valid_electrical_engineer.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,787   copying lm_eval/tasks/ceval/ceval-valid_middle_school_mathematics.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,790   copying lm_eval/tasks/ceval/ceval-valid_advanced_mathematics.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,792   copying lm_eval/tasks/ceval/_ceval-valid.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,794   copying lm_eval/tasks/ceval/ceval-valid_modern_chinese_history.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,797   copying lm_eval/tasks/ceval/ceval-valid_middle_school_chemistry.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,799   copying lm_eval/tasks/ceval/ceval-valid_ideological_and_moral_cultivation.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,801   copying lm_eval/tasks/ceval/ceval-valid_high_school_politics.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,803   copying lm_eval/tasks/ceval/ceval-valid_mao_zedong_thought.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,806   copying lm_eval/tasks/ceval/ceval-valid_art_studies.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,808   copying lm_eval/tasks/ceval/ceval-valid_clinical_medicine.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,810   copying lm_eval/tasks/ceval/ceval-valid_fire_engineer.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,813   copying lm_eval/tasks/ceval/ceval-valid_business_administration.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,815   copying lm_eval/tasks/ceval/ceval-valid_urban_and_rural_planner.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,817   copying lm_eval/tasks/ceval/ceval-valid_teacher_qualification.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,819   copying lm_eval/tasks/ceval/ceval-valid_discrete_mathematics.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,822   copying lm_eval/tasks/ceval/ceval-valid_middle_school_physics.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,824   copying lm_eval/tasks/ceval/ceval-valid_middle_school_biology.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,826   copying lm_eval/tasks/ceval/ceval-valid_operating_system.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,829   copying lm_eval/tasks/ceval/ceval-valid_high_school_chinese.yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:27:49,830   creating build/lib/lm_eval/tasks/nq_open
2025-08-31T08:27:49,832   copying lm_eval/tasks/nq_open/nq_open.yaml -> build/lib/lm_eval/tasks/nq_open
2025-08-31T08:27:49,834   copying lm_eval/tasks/webqs/webqs.yaml -> build/lib/lm_eval/tasks/webqs
2025-08-31T08:27:49,836   copying lm_eval/tasks/super_glue/record/default.yaml -> build/lib/lm_eval/tasks/super_glue/record
2025-08-31T08:27:49,838   copying lm_eval/tasks/super_glue/record/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/record
2025-08-31T08:27:49,840   creating build/lib/lm_eval/tasks/super_glue/wic
2025-08-31T08:27:49,841   copying lm_eval/tasks/super_glue/wic/default.yaml -> build/lib/lm_eval/tasks/super_glue/wic
2025-08-31T08:27:49,844   copying lm_eval/tasks/super_glue/wic/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/wic
2025-08-31T08:27:49,846   copying lm_eval/tasks/super_glue/cb/default.yaml -> build/lib/lm_eval/tasks/super_glue/cb
2025-08-31T08:27:49,849   copying lm_eval/tasks/super_glue/cb/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/cb
2025-08-31T08:27:49,852   copying lm_eval/tasks/super_glue/multirc/default.yaml -> build/lib/lm_eval/tasks/super_glue/multirc
2025-08-31T08:27:49,854   copying lm_eval/tasks/super_glue/multirc/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/multirc
2025-08-31T08:27:49,857   creating build/lib/lm_eval/tasks/super_glue/boolq
2025-08-31T08:27:49,858   copying lm_eval/tasks/super_glue/boolq/default.yaml -> build/lib/lm_eval/tasks/super_glue/boolq
2025-08-31T08:27:49,861   copying lm_eval/tasks/super_glue/boolq/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/boolq
2025-08-31T08:27:49,863   copying lm_eval/tasks/super_glue/boolq/seq2seq.yaml -> build/lib/lm_eval/tasks/super_glue/boolq
2025-08-31T08:27:49,865   copying lm_eval/tasks/super_glue/copa/default.yaml -> build/lib/lm_eval/tasks/super_glue/copa
2025-08-31T08:27:49,867   copying lm_eval/tasks/super_glue/copa/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/copa
2025-08-31T08:27:49,870   creating build/lib/lm_eval/tasks/super_glue/rte
2025-08-31T08:27:49,870   copying lm_eval/tasks/super_glue/rte/default.yaml -> build/lib/lm_eval/tasks/super_glue/rte
2025-08-31T08:27:49,873   copying lm_eval/tasks/super_glue/rte/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/rte
2025-08-31T08:27:49,875   copying lm_eval/tasks/super_glue/wsc/default.yaml -> build/lib/lm_eval/tasks/super_glue/wsc
2025-08-31T08:27:49,877   copying lm_eval/tasks/super_glue/wsc/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/wsc
2025-08-31T08:27:49,879   copying lm_eval/tasks/mimic_repsum/mimic_repsum.yaml -> build/lib/lm_eval/tasks/mimic_repsum
2025-08-31T08:27:49,881   copying lm_eval/tasks/mimic_repsum/mimic_repsum_perplexity.yaml -> build/lib/lm_eval/tasks/mimic_repsum
2025-08-31T08:27:49,883   copying lm_eval/tasks/meqsum/meqsum.yaml -> build/lib/lm_eval/tasks/meqsum
2025-08-31T08:27:49,885   copying lm_eval/tasks/csatqa/csatqa_rch.yaml -> build/lib/lm_eval/tasks/csatqa
2025-08-31T08:27:49,888   copying lm_eval/tasks/csatqa/_csatqa.yaml -> build/lib/lm_eval/tasks/csatqa
2025-08-31T08:27:49,890   copying lm_eval/tasks/csatqa/csatqa_rcss.yaml -> build/lib/lm_eval/tasks/csatqa
2025-08-31T08:27:49,892   copying lm_eval/tasks/csatqa/csatqa_li.yaml -> build/lib/lm_eval/tasks/csatqa
2025-08-31T08:27:49,894   copying lm_eval/tasks/csatqa/csatqa_rcs.yaml -> build/lib/lm_eval/tasks/csatqa
2025-08-31T08:27:49,896   copying lm_eval/tasks/csatqa/csatqa_wr.yaml -> build/lib/lm_eval/tasks/csatqa
2025-08-31T08:27:49,898   copying lm_eval/tasks/csatqa/csatqa_gr.yaml -> build/lib/lm_eval/tasks/csatqa
2025-08-31T08:27:49,900   copying lm_eval/tasks/toxigen/toxigen.yaml -> build/lib/lm_eval/tasks/toxigen
2025-08-31T08:27:49,903   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light
2025-08-31T08:27:49,905   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_mt_openbook_qa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light
2025-08-31T08:27:49,907   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_leaderboard_arabic_mt_openbook_qa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light
2025-08-31T08:27:49,909   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_mt_arc_challenge_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light
2025-08-31T08:27:49,911   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_leaderboard_arabic_mt_arc_challenge_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light
2025-08-31T08:27:49,914   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_leaderboard_arabic_mt_sciq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light
2025-08-31T08:27:49,916   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_mt_sciq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light
2025-08-31T08:27:49,919   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_mt_hellaswag_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light
2025-08-31T08:27:49,921   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_leaderboard_arabic_mt_hellaswag_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light
2025-08-31T08:27:49,923   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_computer_science_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,926   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_physics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,928   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_elementary_mathematics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,930   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_clinical_knowledge_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,932   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_mathematics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,934   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_miscellaneous_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,936   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_sexuality_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,938   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_psychology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,941   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_medicine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,943   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_microeconomics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,945   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_chemistry_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,948   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_computer_science_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,950   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_geography_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,952   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_psychology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,954   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_computer_security_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,957   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_nutrition_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,959   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_philosophy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,961   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_security_studies_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,963   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_astronomy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,965   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,967   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_european_history_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,969   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_econometrics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,971   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_medicine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,974   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_scenarios_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,976   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,978   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_electrical_engineering_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,980   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_business_ethics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,982   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_anatomy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,985   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_jurisprudence_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,987   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_world_religions_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,989   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_global_facts_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,992   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_abstract_algebra_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,994   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_accounting_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,996   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_public_relations_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:49,998   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_physics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,000   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_formal_logic_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,003   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_statistics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,005   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_chemistry_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,007   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_us_foreign_policy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,009   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_logical_fallacies_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,011   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_mathematics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,013   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,015   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_medical_genetics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,018   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_disputes_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,020   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_sociology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,022   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_virology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,024   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_marketing_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,026   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_management_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,029   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_world_history_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,031   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_machine_learning_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,033   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_conceptual_physics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,035   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_law_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,037   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_us_history_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,039   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_biology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,041   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_international_law_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,043   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_biology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,046   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_aging_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,048   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_prehistory_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:27:50,050   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:27:50,053   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:27:50,055   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_sentiment_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:27:50,057   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_mcq_exams_test_ar_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:27:50,059   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_msa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:27:50,061   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:27:50,063   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_dialects_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:27:50,066   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:27:50,068   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:27:50,070   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:27:50,073   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_leaderboard_arabic_exams_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light
2025-08-31T08:27:50,075   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_exams_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light
2025-08-31T08:27:50,077   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Music_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,079   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Funeral_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,081   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Kuwait_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,083   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Lebanon_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,086   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Calligraphy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,088   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islamic_law_system_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,091   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Math_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,093   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Comoros_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,095   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromRome_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,097   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Tunisia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,099   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Qatar_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,102   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_computer_and_phone_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,104   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Saudi_Arabia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,106   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Egypt_modern_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,108   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Bahrain_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,111   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Wedding_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,113   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Language_Origin_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,115   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Geography_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,117   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Food_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,120   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Somalia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,122   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Morocco_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,124   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Architecture_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,126   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromChina_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,128   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_entertainment_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,130   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mauritania_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,133   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromGreece_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,135   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromByzantium_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,137   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_daily_life_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,139   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,142   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Syria_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,144   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Jordan_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,146   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,148   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Iraq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,150   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Literature_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,152   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Algeria_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,155   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Yemen_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,157   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Oman_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,159   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Sudan_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,161   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ornament_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,163   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mesopotamia_civilization_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,165   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Medicine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,168   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Ancient_Egypt_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,170   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_Education_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,172   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromIslam_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,174   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Culture_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,176   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Astronomy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,178   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromPersia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,181   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Palestine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,183   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arab_Empire_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,185   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_branches_and_schools_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,187   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_History_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,189   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_communication_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,191   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Art_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,193   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_United_Arab_Emirates_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,196   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Libya_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,198   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Philosophy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,200   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ceremony_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,202   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromAncientEgypt_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,205   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Clothing_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:27:50,207   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arabic_mt_copa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light
2025-08-31T08:27:50,209   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arbic_leaderboard_arabic_mt_copa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light
2025-08-31T08:27:50,211   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_leaderboard_arabic_mt_mmlu_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light
2025-08-31T08:27:50,214   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_mt_mmlu_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light
2025-08-31T08:27:50,216   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_mt_arc_easy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light
2025-08-31T08:27:50,219   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_leaderboard_arabic_mt_arc_easy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light
2025-08-31T08:27:50,221   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_leaderboard_arabic_mt_boolq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light
2025-08-31T08:27:50,223   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_mt_boolq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light
2025-08-31T08:27:50,225   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_leaderboard_arabic_mt_race_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light
2025-08-31T08:27:50,228   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_mt_race_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light
2025-08-31T08:27:50,230   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_leaderboard_arabic_mt_toxigen_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light
2025-08-31T08:27:50,232   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_mt_toxigen_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light
2025-08-31T08:27:50,234   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_leaderboard_arabic_mt_piqa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light
2025-08-31T08:27:50,236   copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_mt_piqa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light
2025-08-31T08:27:50,238   copying lm_eval/tasks/cmmlu/cmmlu_chinese_driving_rule.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,241   copying lm_eval/tasks/cmmlu/cmmlu_default_high_school_geography.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,244   copying lm_eval/tasks/cmmlu/cmmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,246   copying lm_eval/tasks/cmmlu/cmmlu_default_college_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,248   copying lm_eval/tasks/cmmlu/cmmlu_management.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,250   copying lm_eval/tasks/cmmlu/cmmlu_elementary_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,252   copying lm_eval/tasks/cmmlu/cmmlu_default_electrical_engineering.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,254   copying lm_eval/tasks/cmmlu/cmmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,257   copying lm_eval/tasks/cmmlu/cmmlu_default_college_engineering_hydrology.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,258   copying lm_eval/tasks/cmmlu/cmmlu_default_marketing.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,261   copying lm_eval/tasks/cmmlu/cmmlu_default_professional_law.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,263   copying lm_eval/tasks/cmmlu/cmmlu_default_ethnology.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,265   copying lm_eval/tasks/cmmlu/cmmlu_default_arts.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,268   copying lm_eval/tasks/cmmlu/cmmlu_default_legal_and_moral_basis.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,270   copying lm_eval/tasks/cmmlu/cmmlu_chinese_literature.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,272   copying lm_eval/tasks/cmmlu/cmmlu_default_college_education.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,274   copying lm_eval/tasks/cmmlu/cmmlu_default_computer_science.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,276   copying lm_eval/tasks/cmmlu/cmmlu_computer_science.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,278   copying lm_eval/tasks/cmmlu/cmmlu_virology.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,280   copying lm_eval/tasks/cmmlu/cmmlu_default_management.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,282   copying lm_eval/tasks/cmmlu/cmmlu_default_professional_accounting.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,284   copying lm_eval/tasks/cmmlu/cmmlu_default_machine_learning.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,286   copying lm_eval/tasks/cmmlu/cmmlu_genetics.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,288   copying lm_eval/tasks/cmmlu/cmmlu_default_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,291   copying lm_eval/tasks/cmmlu/cmmlu_default_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,293   copying lm_eval/tasks/cmmlu/cmmlu_default_philosophy.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,295   copying lm_eval/tasks/cmmlu/cmmlu_default_human_sexuality.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,297   copying lm_eval/tasks/cmmlu/cmmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,299   copying lm_eval/tasks/cmmlu/cmmlu_education.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,301   copying lm_eval/tasks/cmmlu/cmmlu_modern_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,303   copying lm_eval/tasks/cmmlu/cmmlu_default_food_science.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,306   copying lm_eval/tasks/cmmlu/cmmlu_default_nutrition.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,308   copying lm_eval/tasks/cmmlu/cmmlu_world_religions.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,310   copying lm_eval/tasks/cmmlu/cmmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,312   copying lm_eval/tasks/cmmlu/cmmlu_food_science.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,314   copying lm_eval/tasks/cmmlu/cmmlu_default_sports_science.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,316   copying lm_eval/tasks/cmmlu/cmmlu_arts.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,318   copying lm_eval/tasks/cmmlu/cmmlu_default_modern_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,320   copying lm_eval/tasks/cmmlu/cmmlu_international_law.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,323   copying lm_eval/tasks/cmmlu/cmmlu_default_chinese_driving_rule.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,325   copying lm_eval/tasks/cmmlu/cmmlu_college_education.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,327   copying lm_eval/tasks/cmmlu/cmmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,329   copying lm_eval/tasks/cmmlu/cmmlu_default_chinese_literature.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,331   copying lm_eval/tasks/cmmlu/cmmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,333   copying lm_eval/tasks/cmmlu/cmmlu_sports_science.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,336   copying lm_eval/tasks/cmmlu/cmmlu_world_history.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,338   copying lm_eval/tasks/cmmlu/cmmlu_default_college_law.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,340   copying lm_eval/tasks/cmmlu/cmmlu_elementary_information_and_technology.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,342   copying lm_eval/tasks/cmmlu/cmmlu_default_public_relations.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,344   copying lm_eval/tasks/cmmlu/cmmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,346   copying lm_eval/tasks/cmmlu/cmmlu_default_jurisprudence.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,349   copying lm_eval/tasks/cmmlu/cmmlu_chinese_food_culture.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,351   copying lm_eval/tasks/cmmlu/cmmlu_journalism.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,352   copying lm_eval/tasks/cmmlu/cmmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,354   copying lm_eval/tasks/cmmlu/cmmlu_chinese_civil_service_exam.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,356   copying lm_eval/tasks/cmmlu/cmmlu_professional_law.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,358   copying lm_eval/tasks/cmmlu/cmmlu_nutrition.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,360   copying lm_eval/tasks/cmmlu/cmmlu_traditional_chinese_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,363   copying lm_eval/tasks/cmmlu/cmmlu_default_security_study.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,366   copying lm_eval/tasks/cmmlu/cmmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,369   copying lm_eval/tasks/cmmlu/cmmlu_default_high_school_politics.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,372   copying lm_eval/tasks/cmmlu/cmmlu_philosophy.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,374   copying lm_eval/tasks/cmmlu/cmmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,377   copying lm_eval/tasks/cmmlu/cmmlu_ethnology.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,380   copying lm_eval/tasks/cmmlu/cmmlu_default_sociology.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,382   copying lm_eval/tasks/cmmlu/cmmlu_default_anatomy.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,384   copying lm_eval/tasks/cmmlu/cmmlu_default_chinese_history.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,386   copying lm_eval/tasks/cmmlu/cmmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,388   copying lm_eval/tasks/cmmlu/cmmlu_default_economics.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,391   copying lm_eval/tasks/cmmlu/cmmlu_default_elementary_information_and_technology.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,393   copying lm_eval/tasks/cmmlu/cmmlu_default_chinese_food_culture.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,396   copying lm_eval/tasks/cmmlu/cmmlu_default_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,398   copying lm_eval/tasks/cmmlu/cmmlu_default_high_school_biology.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,400   copying lm_eval/tasks/cmmlu/cmmlu_high_school_politics.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,402   copying lm_eval/tasks/cmmlu/cmmlu_default_professional_psychology.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,404   copying lm_eval/tasks/cmmlu/cmmlu_default_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,406   copying lm_eval/tasks/cmmlu/cmmlu_astronomy.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,408   copying lm_eval/tasks/cmmlu/cmmlu_sociology.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,410   copying lm_eval/tasks/cmmlu/cmmlu_default_astronomy.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,412   copying lm_eval/tasks/cmmlu/cmmlu_default_journalism.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,415   copying lm_eval/tasks/cmmlu/cmmlu_default_virology.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,417   copying lm_eval/tasks/cmmlu/cmmlu_default_world_history.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,419   copying lm_eval/tasks/cmmlu/cmmlu_marketing.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,421   copying lm_eval/tasks/cmmlu/cmmlu_agronomy.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,423   copying lm_eval/tasks/cmmlu/cmmlu_default_chinese_teacher_qualification.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,426   copying lm_eval/tasks/cmmlu/cmmlu_chinese_history.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,428   copying lm_eval/tasks/cmmlu/cmmlu_default_marxist_theory.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,430   copying lm_eval/tasks/cmmlu/cmmlu_default_agronomy.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,432   copying lm_eval/tasks/cmmlu/cmmlu_college_engineering_hydrology.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,434   copying lm_eval/tasks/cmmlu/cmmlu_college_law.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,436   copying lm_eval/tasks/cmmlu/cmmlu_default_college_actuarial_science.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,438   copying lm_eval/tasks/cmmlu/cmmlu_default_computer_security.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,440   copying lm_eval/tasks/cmmlu/cmmlu_default_college_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,442   copying lm_eval/tasks/cmmlu/cmmlu_elementary_commonsense.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,444   copying lm_eval/tasks/cmmlu/cmmlu_default_traditional_chinese_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,446   copying lm_eval/tasks/cmmlu/cmmlu_default_world_religions.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,449   copying lm_eval/tasks/cmmlu/cmmlu_default_elementary_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,451   copying lm_eval/tasks/cmmlu/cmmlu_ancient_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,453   copying lm_eval/tasks/cmmlu/cmmlu_logical.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,455   copying lm_eval/tasks/cmmlu/cmmlu_computer_security.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,457   copying lm_eval/tasks/cmmlu/cmmlu_default_genetics.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,459   copying lm_eval/tasks/cmmlu/cmmlu_legal_and_moral_basis.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,462   copying lm_eval/tasks/cmmlu/cmmlu_default_conceptual_physics.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,464   copying lm_eval/tasks/cmmlu/cmmlu_default_college_medical_statistics.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,466   copying lm_eval/tasks/cmmlu/cmmlu_anatomy.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,468   copying lm_eval/tasks/cmmlu/cmmlu_default_professional_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,470   copying lm_eval/tasks/cmmlu/cmmlu_default_ancient_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,472   copying lm_eval/tasks/cmmlu/cmmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,475   copying lm_eval/tasks/cmmlu/cmmlu_default_logical.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,477   copying lm_eval/tasks/cmmlu/cmmlu_college_medical_statistics.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,479   copying lm_eval/tasks/cmmlu/cmmlu_default_global_facts.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,481   copying lm_eval/tasks/cmmlu/cmmlu_economics.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,483   copying lm_eval/tasks/cmmlu/cmmlu_default_chinese_foreign_policy.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,486   copying lm_eval/tasks/cmmlu/cmmlu_default_education.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,488   copying lm_eval/tasks/cmmlu/_cmmlu.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,490   copying lm_eval/tasks/cmmlu/cmmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,492   copying lm_eval/tasks/cmmlu/cmmlu_default_construction_project_management.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,494   copying lm_eval/tasks/cmmlu/cmmlu_construction_project_management.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,496   copying lm_eval/tasks/cmmlu/cmmlu_security_study.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,498   copying lm_eval/tasks/cmmlu/cmmlu_marxist_theory.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,500   copying lm_eval/tasks/cmmlu/cmmlu_default_chinese_civil_service_exam.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,502   copying lm_eval/tasks/cmmlu/cmmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,505   copying lm_eval/tasks/cmmlu/cmmlu_college_actuarial_science.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,507   copying lm_eval/tasks/cmmlu/cmmlu_public_relations.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,509   copying lm_eval/tasks/cmmlu/cmmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,511   copying lm_eval/tasks/cmmlu/cmmlu_chinese_foreign_policy.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,513   copying lm_eval/tasks/cmmlu/cmmlu_default_elementary_commonsense.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,515   copying lm_eval/tasks/cmmlu/cmmlu_chinese_teacher_qualification.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,517   copying lm_eval/tasks/cmmlu/cmmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,519   copying lm_eval/tasks/cmmlu/cmmlu_global_facts.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,521   copying lm_eval/tasks/cmmlu/cmmlu_default_business_ethics.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,523   copying lm_eval/tasks/cmmlu/cmmlu_default_international_law.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,525   copying lm_eval/tasks/cmmlu/cmmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,527   copying lm_eval/tasks/cmmlu/cmmlu_default_high_school_physics.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,529   copying lm_eval/tasks/cmmlu/cmmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:27:50,531   copying lm_eval/tasks/noticia/noticia.yaml -> build/lib/lm_eval/tasks/noticia
2025-08-31T08:27:50,533   copying lm_eval/tasks/pubmedqa/pubmedqa.yaml -> build/lib/lm_eval/tasks/pubmedqa
2025-08-31T08:27:50,536   copying lm_eval/tasks/squadv2/squadv2.yaml -> build/lib/lm_eval/tasks/squadv2
2025-08-31T08:27:50,538   copying lm_eval/tasks/med_text_classification/med_text_classification_hard.yaml -> build/lib/lm_eval/tasks/med_text_classification
2025-08-31T08:27:50,540   copying lm_eval/tasks/med_text_classification/med_text_classification_easy.yaml -> build/lib/lm_eval/tasks/med_text_classification
2025-08-31T08:27:50,542   copying lm_eval/tasks/truthfulqa/truthfulqa_mc2.yaml -> build/lib/lm_eval/tasks/truthfulqa
2025-08-31T08:27:50,544   copying lm_eval/tasks/truthfulqa/truthfulqa_gen.yaml -> build/lib/lm_eval/tasks/truthfulqa
2025-08-31T08:27:50,546   copying lm_eval/tasks/truthfulqa/truthfulqa_mc1.yaml -> build/lib/lm_eval/tasks/truthfulqa
2025-08-31T08:27:50,548   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,551   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,553   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,555   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,558   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,560   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,562   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,564   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,567   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,569   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,571   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,573   copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,575   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,577   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,580   copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,582   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,584   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,586   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,589   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,591   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,594   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,596   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,598   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,600   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,603   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,605   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,607   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,609   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,611   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,614   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,616   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,618   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,620   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,622   copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,624   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,626   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,629   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,631   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,634   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,636   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,638   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,641   copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,643   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,646   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,648   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,650   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,653   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,655   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,657   copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,659   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,661   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,664   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,666   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,668   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,671   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,673   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,676   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,678   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,680   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,683   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,686   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,689   copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:27:50,691   creating build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,692   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,694   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,696   copying lm_eval/tasks/llama3/instruct/mmlu/_mmlu_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,698   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,700   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,702   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,705   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,707   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,710   copying lm_eval/tasks/llama3/instruct/mmlu/_mmlu_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,712   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,714   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,716   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,718   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,721   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,723   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,725   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,727   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,729   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,732   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,734   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,736   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,739   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,741   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,743   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,745   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,747   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,749   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,752   copying lm_eval/tasks/llama3/instruct/mmlu/_mmlu_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,754   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,756   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,758   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,760   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,762   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,764   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,766   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,768   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,771   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,773   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,775   copying lm_eval/tasks/llama3/instruct/mmlu/_mmlu_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,777   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,779   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,782   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,784   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,786   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,788   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,790   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,792   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,795   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,798   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,800   copying lm_eval/tasks/llama3/instruct/mmlu/llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,805   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,807   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,809   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,811   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,814   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,816   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,818   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,820   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,822   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,824   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,826   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,828   copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:27:50,830   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,833   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,835   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,838   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,840   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,843   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,845   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,847   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,850   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,852   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,854   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,857   copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,859   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,861   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,864   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,866   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,869   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,871   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,873   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,876   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,879   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,881   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,883   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,885   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,887   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,890   copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,892   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,894   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,897   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,899   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,901   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,903   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,906   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,909   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,911   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,913   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,916   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,918   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,920   copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,923   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,925   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,927   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,930   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,932   copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,934   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,936   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,939   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,941   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,943   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,945   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,948   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,950   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,952   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,954   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,957   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,959   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,962   copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,964   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,966   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,969   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,971   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,974   copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:27:50,977   creating build/lib/lm_eval/tasks/llama3/instruct/gsm8k
2025-08-31T08:27:50,978   copying lm_eval/tasks/llama3/instruct/gsm8k/gsm8k.yaml -> build/lib/lm_eval/tasks/llama3/instruct/gsm8k
2025-08-31T08:27:50,980   creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:50,981   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:50,983   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:50,986   copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:50,988   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:50,990   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:50,992   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:50,995   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:50,997   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:50,999   copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,001   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,003   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,005   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,008   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,010   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,012   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,015   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,017   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,019   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,022   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,024   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,026   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,028   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,030   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,032   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,035   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,037   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,039   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,041   copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,044   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,046   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,048   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,050   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,053   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,055   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,058   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,060   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,063   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,065   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,067   copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,069   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,071   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,073   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,075   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,078   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,080   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,082   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,084   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,086   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,089   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,091   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,093   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,095   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,097   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,099   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,101   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,103   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,106   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,108   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,110   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,112   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,114   copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,117   copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:27:51,119   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,121   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,124   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,126   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,128   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,130   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,132   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,135   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,137   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,140   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,142   copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,144   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,146   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,148   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,151   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,153   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,155   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,158   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,160   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,162   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,164   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,167   copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,169   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,171   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,173   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,176   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,178   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,180   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,182   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,185   copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,187   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,189   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,191   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,193   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,195   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,198   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,200   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,202   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,204   copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,207   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,209   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,211   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,214   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,216   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,218   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,221   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,223   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,225   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,228   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,230   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,232   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,235   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,237   copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,239   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,241   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,243   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,246   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,248   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,250   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,252   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,254   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,256   copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:27:51,258   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,261   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,264   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,267   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,269   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,272   copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,274   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,277   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,279   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,282   copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,284   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,287   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,289   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,291   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,294   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,297   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,299   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,302   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,305   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,307   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,310   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,312   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,314   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,317   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,319   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,322   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,325   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,327   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,330   copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,332   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,335   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,337   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,340   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,342   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,345   copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,347   copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,349   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,351   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,354   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,356   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,359   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,361   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,364   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,366   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,370   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,372   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,374   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,377   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,379   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,382   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,384   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,387   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,389   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,392   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,394   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,397   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,399   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,402   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,404   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,407   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,410   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,413   copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:27:51,415   copying lm_eval/tasks/llama3/instruct/arc_challenge/arc_challenge_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/arc_challenge
2025-08-31T08:27:51,417   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,420   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,423   copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,425   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,427   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,429   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,432   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,435   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,438   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,440   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,443   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,445   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,447   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,450   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,453   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,455   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,458   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,460   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,463   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,465   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,467   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,470   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,472   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,475   copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,477   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,479   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,482   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,484   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,487   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,489   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,492   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,499   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,506   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,509   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,511   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,513   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,516   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,518   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,521   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,523   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,526   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,528   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,531   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,533   copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,535   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,538   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,541   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,543   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,546   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,548   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,551   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,553   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,556   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,559   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,562   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,564   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,567   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,570   copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,572   copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,574   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,576   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,579   copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:27:51,581   copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_health.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:27:51,583   copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:27:51,585   copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_business.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:27:51,587   copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_math.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:27:51,589   copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:27:51,591   copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:27:51,594   copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:27:51,596   copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_economics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:27:51,598   copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:27:51,600   copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:27:51,602   copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:27:51,604   copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:27:51,606   copying lm_eval/tasks/llama3/instruct/mmlu_pro/_mmlu_pro.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:27:51,608   copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:27:51,610   copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:27:51,612   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,614   copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,617   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,619   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,621   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,623   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,626   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,628   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,630   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,632   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,634   copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,636   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,638   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,641   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,643   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,645   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,647   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,650   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,652   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,654   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,657   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,659   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,661   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,663   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,666   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,668   copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,670   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,673   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,675   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,677   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,679   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,681   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,684   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,686   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,688   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,690   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,693   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,695   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,698   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,700   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,702   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,704   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,706   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,709   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,711   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,713   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,716   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,718   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,720   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,723   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,725   copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,727   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,730   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,732   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,734   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,737   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,739   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,741   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,743   copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,746   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,748   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,750   copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:27:51,752   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,754   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,757   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,759   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,761   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,764   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,766   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,768   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,770   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,773   copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,775   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,777   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,780   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,782   copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,784   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,787   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,789   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,792   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,794   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,797   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,799   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,801   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,803   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,806   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,808   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,810   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,812   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,815   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,817   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,819   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,821   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,824   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,827   copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,829   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,831   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,833   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,835   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,838   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,840   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,843   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,845   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,847   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,850   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,852   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,854   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,856   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,859   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,861   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,863   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,865   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,867   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,870   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,872   copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,874   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,877   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,879   copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,881   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,884   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,887   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,889   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,892   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,894   copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:27:51,896   copying lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc1.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks
2025-08-31T08:27:51,898   copying lm_eval/tasks/tinyBenchmarks/tinyHellaswag.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks
2025-08-31T08:27:51,900   copying lm_eval/tasks/tinyBenchmarks/tinyWinogrande.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks
2025-08-31T08:27:51,902   copying lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc2.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks
2025-08-31T08:27:51,904   copying lm_eval/tasks/tinyBenchmarks/tinyArc.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks
2025-08-31T08:27:51,907   copying lm_eval/tasks/tinyBenchmarks/tinyMMLU.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks
2025-08-31T08:27:51,909   copying lm_eval/tasks/tinyBenchmarks/tinyGSM8k.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks
2025-08-31T08:27:51,911   copying lm_eval/tasks/tinyBenchmarks/tinyBenchmarks.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks
2025-08-31T08:27:51,914   copying lm_eval/tasks/realtoxicityprompts/realtoxicityprompts.yaml -> build/lib/lm_eval/tasks/realtoxicityprompts
2025-08-31T08:27:51,916   creating build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot
2025-08-31T08:27:51,917   copying lm_eval/tasks/acpbench/mcq_cot_2shot/just.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot
2025-08-31T08:27:51,920   copying lm_eval/tasks/acpbench/mcq_cot_2shot/val.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot
2025-08-31T08:27:51,922   copying lm_eval/tasks/acpbench/mcq_cot_2shot/prog.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot
2025-08-31T08:27:51,924   copying lm_eval/tasks/acpbench/mcq_cot_2shot/land.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot
2025-08-31T08:27:51,927   copying lm_eval/tasks/acpbench/mcq_cot_2shot/reach.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot
2025-08-31T08:27:51,929   copying lm_eval/tasks/acpbench/mcq_cot_2shot/app.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot
2025-08-31T08:27:51,931   copying lm_eval/tasks/acpbench/mcq_cot_2shot/act_reach.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot
2025-08-31T08:27:51,933   copying lm_eval/tasks/acpbench/gen_2shot/just.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:27:51,936   copying lm_eval/tasks/acpbench/gen_2shot/val.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:27:51,939   copying lm_eval/tasks/acpbench/gen_2shot/prog.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:27:51,941   copying lm_eval/tasks/acpbench/gen_2shot/land.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:27:51,944   copying lm_eval/tasks/acpbench/gen_2shot/next_act.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:27:51,946   copying lm_eval/tasks/acpbench/gen_2shot/reach.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:27:51,948   copying lm_eval/tasks/acpbench/gen_2shot/app.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:27:51,950   copying lm_eval/tasks/acpbench/gen_2shot/act_reach.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:27:51,953   creating build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot
2025-08-31T08:27:51,953   copying lm_eval/tasks/acpbench/boolq_cot_2shot/just.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot
2025-08-31T08:27:51,956   copying lm_eval/tasks/acpbench/boolq_cot_2shot/val.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot
2025-08-31T08:27:51,958   copying lm_eval/tasks/acpbench/boolq_cot_2shot/prog.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot
2025-08-31T08:27:51,960   copying lm_eval/tasks/acpbench/boolq_cot_2shot/land.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot
2025-08-31T08:27:51,963   copying lm_eval/tasks/acpbench/boolq_cot_2shot/reach.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot
2025-08-31T08:27:51,965   copying lm_eval/tasks/acpbench/boolq_cot_2shot/app.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot
2025-08-31T08:27:51,967   copying lm_eval/tasks/acpbench/boolq_cot_2shot/act_reach.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot
2025-08-31T08:27:51,970   copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/just.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:27:51,972   copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/val.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:27:51,975   copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/prog.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:27:51,978   copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/land.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:27:51,981   copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/next_act.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:27:51,983   copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/reach.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:27:51,986   copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/app.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:27:51,989   copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/act_reach.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:27:51,991   creating build/lib/lm_eval/tasks/glue/wnli
2025-08-31T08:27:51,992   copying lm_eval/tasks/glue/wnli/default.yaml -> build/lib/lm_eval/tasks/glue/wnli
2025-08-31T08:27:51,994   creating build/lib/lm_eval/tasks/glue/qnli
2025-08-31T08:27:51,996   copying lm_eval/tasks/glue/qnli/default.yaml -> build/lib/lm_eval/tasks/glue/qnli
2025-08-31T08:27:51,998   creating build/lib/lm_eval/tasks/glue/cola
2025-08-31T08:27:51,999   copying lm_eval/tasks/glue/cola/default.yaml -> build/lib/lm_eval/tasks/glue/cola
2025-08-31T08:27:52,001   creating build/lib/lm_eval/tasks/glue/qqp
2025-08-31T08:27:52,002   copying lm_eval/tasks/glue/qqp/default.yaml -> build/lib/lm_eval/tasks/glue/qqp
2025-08-31T08:27:52,004   creating build/lib/lm_eval/tasks/glue/mrpc
2025-08-31T08:27:52,005   copying lm_eval/tasks/glue/mrpc/default.yaml -> build/lib/lm_eval/tasks/glue/mrpc
2025-08-31T08:27:52,008   creating build/lib/lm_eval/tasks/glue/sst2
2025-08-31T08:27:52,009   copying lm_eval/tasks/glue/sst2/default.yaml -> build/lib/lm_eval/tasks/glue/sst2
2025-08-31T08:27:52,011   creating build/lib/lm_eval/tasks/glue/rte
2025-08-31T08:27:52,012   copying lm_eval/tasks/glue/rte/default.yaml -> build/lib/lm_eval/tasks/glue/rte
2025-08-31T08:27:52,015   copying lm_eval/tasks/glue/mnli/default.yaml -> build/lib/lm_eval/tasks/glue/mnli
2025-08-31T08:27:52,017   copying lm_eval/tasks/glue/mnli/mismatch.yaml -> build/lib/lm_eval/tasks/glue/mnli
2025-08-31T08:27:52,019   copying lm_eval/tasks/hendrycks_ethics/commonsense.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics
2025-08-31T08:27:52,021   copying lm_eval/tasks/hendrycks_ethics/utilitarianism.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics
2025-08-31T08:27:52,023   copying lm_eval/tasks/hendrycks_ethics/justice.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics
2025-08-31T08:27:52,025   copying lm_eval/tasks/hendrycks_ethics/virtue.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics
2025-08-31T08:27:52,028   copying lm_eval/tasks/hendrycks_ethics/deontology.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics
2025-08-31T08:27:52,030   copying lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pathology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,032   copying lm_eval/tasks/tmmluplus/default/tmmluplus_optometry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,034   copying lm_eval/tasks/tmmluplus/default/tmmluplus_physical_education.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,036   copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_design.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,038   copying lm_eval/tasks/tmmluplus/default/_tmmluplus_STEM.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,040   copying lm_eval/tasks/tmmluplus/default/tmmluplus_management_accounting.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,042   copying lm_eval/tasks/tmmluplus/default/tmmluplus_advance_chemistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,044   copying lm_eval/tasks/tmmluplus/default/tmmluplus_chinese_language_and_literature.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,046   copying lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pharmacology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,049   copying lm_eval/tasks/tmmluplus/default/tmmluplus_education_(profession_level).yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,051   copying lm_eval/tasks/tmmluplus/default/tmmluplus_accounting.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,053   copying lm_eval/tasks/tmmluplus/default/tmmluplus_secondary_physics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,055   copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chinese_exam.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,058   copying lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,060   copying lm_eval/tasks/tmmluplus/default/tmmluplus_ttqav2.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,062   copying lm_eval/tasks/tmmluplus/default/tmmluplus_trade.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,064   copying lm_eval/tasks/tmmluplus/default/tmmluplus_engineering_math.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,066   copying lm_eval/tasks/tmmluplus/default/_tmmluplus_social_sciences.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,069   copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_math_exam.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,071   copying lm_eval/tasks/tmmluplus/default/tmmluplus_mechanical.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,073   copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chemistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,075   copying lm_eval/tasks/tmmluplus/default/_tmmluplus_humanities.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,077   copying lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacy.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,080   copying lm_eval/tasks/tmmluplus/default/tmmluplus_marketing_management.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,082   copying lm_eval/tasks/tmmluplus/default/tmmluplus_taxation.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,084   copying lm_eval/tasks/tmmluplus/default/tmmluplus_introduction_to_law.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,087   copying lm_eval/tasks/tmmluplus/default/tmmluplus_organic_chemistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,089   copying lm_eval/tasks/tmmluplus/default/tmmluplus_business_management.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,091   copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_natural_sciences.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,093   copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_mathematics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,096   copying lm_eval/tasks/tmmluplus/default/tmmluplus_fire_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,098   copying lm_eval/tasks/tmmluplus/default/tmmluplus_nautical_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,100   copying lm_eval/tasks/tmmluplus/default/tmmluplus_national_protection.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,101   copying lm_eval/tasks/tmmluplus/default/tmmluplus_trust_practice.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,103   copying lm_eval/tasks/tmmluplus/default/tmmluplus_insurance_studies.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,106   copying lm_eval/tasks/tmmluplus/default/tmmluplus_economics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,108   copying lm_eval/tasks/tmmluplus/default/tmmluplus_three_principles_of_people.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,110   copying lm_eval/tasks/tmmluplus/default/tmmluplus_politic_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,112   copying lm_eval/tasks/tmmluplus/default/tmmluplus_general_principles_of_law.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,114   copying lm_eval/tasks/tmmluplus/default/tmmluplus_clinical_psychology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,116   copying lm_eval/tasks/tmmluplus/default/tmmluplus_taiwanese_hokkien.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,119   copying lm_eval/tasks/tmmluplus/default/tmmluplus_computer_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,121   copying lm_eval/tasks/tmmluplus/default/tmmluplus_physics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,123   copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_science_exam.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,125   copying lm_eval/tasks/tmmluplus/default/tmmluplus_auditing.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,128   copying lm_eval/tasks/tmmluplus/default/tmmluplus_agriculture.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,130   copying lm_eval/tasks/tmmluplus/default/tmmluplus_macroeconomics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,132   copying lm_eval/tasks/tmmluplus/default/tmmluplus_anti_money_laundering.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,134   copying lm_eval/tasks/tmmluplus/default/_tmmluplus_other.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,137   copying lm_eval/tasks/tmmluplus/default/tmmluplus_educational_psychology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,139   copying lm_eval/tasks/tmmluplus/default/tmmluplus_geography_of_taiwan.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,141   copying lm_eval/tasks/tmmluplus/default/tmmluplus_education.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,144   copying lm_eval/tasks/tmmluplus/default/tmmluplus_human_behavior.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,146   copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_chinese_language.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,148   copying lm_eval/tasks/tmmluplus/default/tmmluplus_official_document_management.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,150   copying lm_eval/tasks/tmmluplus/default/tmmluplus_culinary_skills.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,153   copying lm_eval/tasks/tmmluplus/default/tmmluplus_dentistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,155   copying lm_eval/tasks/tmmluplus/default/tmmluplus_linear_algebra.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,158   copying lm_eval/tasks/tmmluplus/default/tmmluplus_basic_medical_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,160   copying lm_eval/tasks/tmmluplus/default/tmmluplus_real_estate.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,163   copying lm_eval/tasks/tmmluplus/default/tmmluplus_occupational_therapy_for_psychological_disorders.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,165   copying lm_eval/tasks/tmmluplus/default/tmmluplus_jce_humanities.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,168   copying lm_eval/tasks/tmmluplus/default/tmmluplus_music.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,170   copying lm_eval/tasks/tmmluplus/default/tmmluplus_statistics_and_machine_learning.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,173   copying lm_eval/tasks/tmmluplus/default/tmmluplus_administrative_law.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,175   copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_social_studies.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,177   copying lm_eval/tasks/tmmluplus/default/tmmluplus_finance_banking.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,179   copying lm_eval/tasks/tmmluplus/default/tmmluplus_technical.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,182   copying lm_eval/tasks/tmmluplus/default/tmmluplus_financial_analysis.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,184   copying lm_eval/tasks/tmmluplus/default/tmmluplus_traditional_chinese_medicine_clinical_medicine.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,186   copying lm_eval/tasks/tmmluplus/default/tmmluplus_logic_reasoning.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,188   copying lm_eval/tasks/tmmluplus/default/_tmmluplus.yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:27:52,191   copying lm_eval/tasks/afrobench/afrobench.yaml -> build/lib/lm_eval/tasks/afrobench
2025-08-31T08:27:52,193   copying lm_eval/tasks/afrobench/afrobench-lite.yaml -> build/lib/lm_eval/tasks/afrobench
2025-08-31T08:27:52,195   copying lm_eval/tasks/afrobench/uhura-arc-easy/uhura.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy
2025-08-31T08:27:52,197   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4
2025-08-31T08:27:52,199   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4
2025-08-31T08:27:52,201   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4
2025-08-31T08:27:52,204   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4
2025-08-31T08:27:52,206   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4
2025-08-31T08:27:52,208   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4
2025-08-31T08:27:52,211   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4
2025-08-31T08:27:52,213   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2
2025-08-31T08:27:52,216   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2
2025-08-31T08:27:52,218   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2
2025-08-31T08:27:52,220   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2
2025-08-31T08:27:52,223   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2
2025-08-31T08:27:52,225   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2
2025-08-31T08:27:52,227   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2
2025-08-31T08:27:52,229   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5
2025-08-31T08:27:52,231   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5
2025-08-31T08:27:52,233   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5
2025-08-31T08:27:52,236   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5
2025-08-31T08:27:52,238   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5
2025-08-31T08:27:52,241   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5
2025-08-31T08:27:52,243   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5
2025-08-31T08:27:52,245   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1
2025-08-31T08:27:52,247   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1
2025-08-31T08:27:52,249   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1
2025-08-31T08:27:52,251   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1
2025-08-31T08:27:52,254   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1
2025-08-31T08:27:52,256   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1
2025-08-31T08:27:52,259   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1
2025-08-31T08:27:52,261   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3
2025-08-31T08:27:52,264   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3
2025-08-31T08:27:52,266   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3
2025-08-31T08:27:52,268   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3
2025-08-31T08:27:52,270   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3
2025-08-31T08:27:52,273   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3
2025-08-31T08:27:52,275   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3
2025-08-31T08:27:52,277   copying lm_eval/tasks/afrobench/afriqa/afriqa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa
2025-08-31T08:27:52,279   copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:27:52,281   copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:27:52,284   copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:27:52,286   copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:27:52,288   copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:27:52,290   copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:27:52,292   copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:27:52,294   copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:27:52,296   copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:27:52,299   copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:27:52,301   copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:27:52,303   copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:27:52,305   copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:27:52,307   copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:27:52,309   copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:27:52,312   copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:27:52,314   copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:27:52,316   copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:27:52,318   copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:27:52,320   copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:27:52,323   copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:27:52,325   copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:27:52,327   copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:27:52,330   copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:27:52,332   copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:27:52,334   copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:27:52,336   copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:27:52,338   copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:27:52,340   copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:27:52,342   copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:27:52,345   copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:27:52,347   copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:27:52,349   copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:27:52,351   copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:27:52,353   copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:27:52,355   copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:27:52,357   copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:27:52,359   copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:27:52,361   copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:27:52,364   copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:27:52,366   copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:27:52,368   copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:27:52,370   copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:27:52,372   copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:27:52,375   copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:27:52,377   copying lm_eval/tasks/afrobench/mafand/mafand.yaml -> build/lib/lm_eval/tasks/afrobench/mafand
2025-08-31T08:27:52,379   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_wol-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:52,381   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_amh-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:52,384   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_fon-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:52,386   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_zul-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:52,388   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_swa-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:52,390   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_hau-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:52,392   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_kin-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:52,395   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bbj-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:52,397   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_luo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:52,399   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_tsn-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:52,401   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ewe-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:52,404   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_twi-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:52,406   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_mos-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:52,408   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_lug-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:52,410   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_sna-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:52,413   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ibo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:52,415   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bam-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:52,417   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_yor-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:52,419   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_xho-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:52,422   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_pcm-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:52,424   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_nya-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:27:52,426   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-ewe.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:52,428   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-lug.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:52,430   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-wol.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:52,433   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-mos.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:52,435   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-nya.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:52,437   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-tsn.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:52,440   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bam.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:52,442   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-amh.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:52,444   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-pcm.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:52,446   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-kin.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:52,448   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-luo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:52,451   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-xho.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:52,453   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-zul.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:52,455   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:52,457   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-sna.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:52,459   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-twi.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:52,461   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-hau.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:52,463   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bbj.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:52,466   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-fon.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:52,468   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-yor.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:52,470   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-swa.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:27:52,472   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_wol-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:52,474   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_amh-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:52,476   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_fon-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:52,479   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_zul-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:52,481   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_swa-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:52,483   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_hau-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:52,486   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_kin-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:52,488   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bbj-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:52,490   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_luo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:52,492   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_tsn-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:52,495   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ewe-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:52,497   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_twi-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:52,499   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_mos-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:52,501   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_lug-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:52,504   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_sna-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:52,506   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ibo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:52,509   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bam-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:52,511   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_yor-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:52,513   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_xho-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:52,515   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_pcm-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:52,517   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_nya-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:27:52,519   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-ewe.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:52,522   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-lug.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:52,524   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-wol.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:52,526   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-mos.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:52,528   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-nya.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:52,530   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-tsn.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:52,533   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bam.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:52,535   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-amh.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:52,537   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-pcm.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:52,539   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-kin.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:52,542   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-luo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:52,544   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-xho.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:52,546   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-zul.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:52,548   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:52,550   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-sna.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:52,552   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-twi.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:52,555   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-hau.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:52,557   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bbj.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:52,559   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-fon.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:52,562   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-yor.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:52,564   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-swa.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:27:52,566   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_wol-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:52,568   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_amh-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:52,570   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_fon-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:52,572   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_zul-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:52,574   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_swa-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:52,576   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_hau-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:52,579   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_kin-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:52,581   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bbj-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:52,584   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_luo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:52,586   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_tsn-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:52,588   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ewe-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:52,591   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_twi-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:52,593   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_mos-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:52,595   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_lug-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:52,597   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_sna-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:52,600   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ibo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:52,602   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bam-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:52,604   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_yor-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:52,606   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_xho-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:52,608   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_pcm-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:52,611   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_nya-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:27:52,617   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-ewe.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:52,620   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-lug.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:52,622   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-wol.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:52,624   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-mos.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:52,626   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-nya.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:52,629   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-tsn.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:52,631   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bam.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:52,634   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-amh.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:52,636   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-pcm.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:52,638   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-kin.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:52,640   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-luo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:52,643   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-xho.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:52,645   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-zul.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:52,647   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:52,649   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-sna.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:52,651   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-twi.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:52,653   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-hau.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:52,656   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bbj.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:52,658   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-fon.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:52,660   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-yor.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:52,662   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-swa.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:27:52,664   copying lm_eval/tasks/afrobench/masakhanews/masakhanews.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews
2025-08-31T08:27:52,667   copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:27:52,669   copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:27:52,671   copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:27:52,673   copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:27:52,675   copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:27:52,677   copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:27:52,679   copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:27:52,682   copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:27:52,684   copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:27:52,686   copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:27:52,688   copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:27:52,690   copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:27:52,693   copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:27:52,695   copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:27:52,697   copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:27:52,699   copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:27:52,702   copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:27:52,704   copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:27:52,706   copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:27:52,709   copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:27:52,711   copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:27:52,713   copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:27:52,715   copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:27:52,717   copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:27:52,719   copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:27:52,721   copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:27:52,723   copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:27:52,726   copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:27:52,728   copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:27:52,730   copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:27:52,732   copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:27:52,735   copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:27:52,737   copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:27:52,739   copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:27:52,741   copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:27:52,744   copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:27:52,746   copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:27:52,748   copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:27:52,751   copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:27:52,753   copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:27:52,755   copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:27:52,758   copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:27:52,760   copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:27:52,762   copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:27:52,764   copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:27:52,767   copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:27:52,769   copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:27:52,771   copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:27:52,773   copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:27:52,775   copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:27:52,778   copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:27:52,780   copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:27:52,782   copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:27:52,784   copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:27:52,786   copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:27:52,789   copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:27:52,791   copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:27:52,793   copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:27:52,795   copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:27:52,798   copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:27:52,800   copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:27:52,802   copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:27:52,805   copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:27:52,807   copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:27:52,809   copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:27:52,811   copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:27:52,813   copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:27:52,816   copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:27:52,820   copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:27:52,822   copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:27:52,825   copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:27:52,827   copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:27:52,829   copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:27:52,831   copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:27:52,833   copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:27:52,835   copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:27:52,837   copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:27:52,839   copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:27:52,841   copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:27:52,843   copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:27:52,845   copying lm_eval/tasks/afrobench/flores/flores.yaml -> build/lib/lm_eval/tasks/afrobench/flores
2025-08-31T08:27:52,847   creating build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,849   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,851   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,853   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,856   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,858   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,860   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ban_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,862   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,864   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_arz_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,866   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,868   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,870   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,872   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ary_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,874   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,878   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,880   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_acq_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,882   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sot_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,884   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tum_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,886   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,888   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,890   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,892   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lua_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,894   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,896   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,899   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,901   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sag_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,903   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_run_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,906   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_umb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,908   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,910   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,912   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,914   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_swh_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,917   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_luo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,919   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,921   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,923   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,926   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,928   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lug_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,930   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,932   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sun_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,935   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,937   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kab_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,939   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,941   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,943   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,945   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nus_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,948   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,950   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aka_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,952   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,954   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,957   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,959   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,961   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,963   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,965   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,967   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,970   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_plt_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,972   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,974   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_twi_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,977   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kea_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,979   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,981   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_mos_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,983   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:27:52,985   creating build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:52,986   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lug_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:52,988   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:52,990   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:52,993   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:52,995   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:52,998   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,000   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ban_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,002   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,004   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sag_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,007   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,009   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-twi_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,012   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,014   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tum_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,017   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,019   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,021   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,023   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,026   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,028   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,030   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,032   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,034   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,037   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,039   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,041   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lua_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,043   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-acq_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,045   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,048   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-umb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,050   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kab_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,052   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,054   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,057   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,059   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,061   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,064   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kea_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,066   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,068   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,070   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aka_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,072   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,075   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,077   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,079   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,082   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sun_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,084   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,086   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-luo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,088   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ary_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,091   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,093   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nus_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,095   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-run_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,098   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,100   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,102   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,104   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sot_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,107   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,109   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,111   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-arz_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,113   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-plt_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,115   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,118   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,120   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,122   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-swh_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,124   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-mos_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:27:53,126   creating build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,128   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,130   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,132   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,134   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,136   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,139   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ban_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,141   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,143   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_arz_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,146   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,148   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,151   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,153   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ary_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,156   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,158   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,160   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_acq_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,162   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sot_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,164   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tum_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,167   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,169   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,171   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,173   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lua_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,176   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,178   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,180   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,182   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sag_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,184   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_run_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,186   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_umb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,189   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,191   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,193   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,195   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_swh_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,197   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_luo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,199   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,202   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,204   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,206   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,209   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lug_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,211   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,213   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sun_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,215   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,218   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kab_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,220   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,222   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,224   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,226   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nus_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,229   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,231   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aka_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,233   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,235   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,237   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,240   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,242   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,244   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,246   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,248   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,250   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_plt_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,253   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,255   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_twi_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,257   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kea_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,259   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,262   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_mos_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,264   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:27:53,266   creating build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,267   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lug_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,269   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,271   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,273   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,276   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,278   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,280   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ban_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,282   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,284   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sag_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,287   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,289   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-twi_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,291   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,293   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tum_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,295   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,298   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,300   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,302   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,304   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,307   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,309   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,311   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,314   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,316   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,318   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,320   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lua_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,322   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-acq_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,324   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,326   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-umb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,329   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kab_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,331   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,333   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,336   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,338   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,340   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,342   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kea_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,344   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,346   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,348   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aka_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,351   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,353   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,355   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,357   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,360   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sun_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,362   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,364   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-luo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,366   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ary_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,368   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,371   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nus_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,373   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-run_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,376   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,378   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,380   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,382   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sot_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,385   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,387   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,389   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-arz_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,391   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-plt_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,394   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,396   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,399   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,401   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-swh_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,403   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-mos_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:27:53,405   creating build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,407   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,409   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,412   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,414   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,417   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,419   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ban_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,421   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,423   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_arz_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,426   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,428   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,430   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,433   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ary_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,435   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,437   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,439   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_acq_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,442   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sot_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,444   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tum_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,446   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,448   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,451   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,453   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lua_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,456   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,458   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,461   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,463   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sag_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,465   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_run_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,467   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_umb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,470   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,472   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,474   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,476   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_swh_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,478   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_luo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,480   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,482   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,484   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,486   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,488   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lug_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,491   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,493   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sun_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,495   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,497   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kab_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,499   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,501   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,504   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,506   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nus_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,508   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,511   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aka_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,513   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,516   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,519   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,522   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,524   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,527   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,529   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,532   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,534   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_plt_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,536   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,538   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_twi_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,540   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kea_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,543   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,545   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_mos_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,548   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:27:53,550   creating build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,551   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lug_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,553   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,555   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,557   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,560   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,562   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,564   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ban_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,567   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,569   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sag_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,571   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,573   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-twi_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,576   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,578   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tum_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,580   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,582   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,584   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,587   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,589   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,591   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,594   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,596   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,598   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,600   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,602   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,605   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lua_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,607   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-acq_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,609   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,612   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-umb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,614   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kab_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,617   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,619   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,621   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,624   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,626   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,628   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kea_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,630   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,632   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,634   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aka_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,636   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,639   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,641   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,643   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,646   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sun_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,648   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,650   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-luo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,652   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ary_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,654   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,657   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nus_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,659   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-run_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,661   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,663   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,665   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,667   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sot_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,669   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,671   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,673   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-arz_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,676   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-plt_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,678   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,680   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,682   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,684   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-swh_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,686   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-mos_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:27:53,689   copying lm_eval/tasks/afrobench/adr/afridiacritics.yaml -> build/lib/lm_eval/tasks/afrobench/adr
2025-08-31T08:27:53,691   creating build/lib/lm_eval/tasks/afrobench/adr/prompt_4
2025-08-31T08:27:53,692   copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4
2025-08-31T08:27:53,694   copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4
2025-08-31T08:27:53,696   copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4
2025-08-31T08:27:53,698   copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4
2025-08-31T08:27:53,700   copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4
2025-08-31T08:27:53,702   creating build/lib/lm_eval/tasks/afrobench/adr/prompt_2
2025-08-31T08:27:53,703   copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2
2025-08-31T08:27:53,706   copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2
2025-08-31T08:27:53,708   copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2
2025-08-31T08:27:53,710   copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2
2025-08-31T08:27:53,712   copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2
2025-08-31T08:27:53,714   creating build/lib/lm_eval/tasks/afrobench/adr/prompt_5
2025-08-31T08:27:53,715   copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5
2025-08-31T08:27:53,717   copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5
2025-08-31T08:27:53,719   copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5
2025-08-31T08:27:53,721   copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5
2025-08-31T08:27:53,724   copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5
2025-08-31T08:27:53,725   creating build/lib/lm_eval/tasks/afrobench/adr/prompt_1
2025-08-31T08:27:53,726   copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1
2025-08-31T08:27:53,729   copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1
2025-08-31T08:27:53,731   copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1
2025-08-31T08:27:53,733   copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1
2025-08-31T08:27:53,735   copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1
2025-08-31T08:27:53,737   creating build/lib/lm_eval/tasks/afrobench/adr/prompt_3
2025-08-31T08:27:53,738   copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3
2025-08-31T08:27:53,740   copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3
2025-08-31T08:27:53,742   copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3
2025-08-31T08:27:53,744   copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3
2025-08-31T08:27:53,746   copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3
2025-08-31T08:27:53,748   copying lm_eval/tasks/afrobench/salt/salt.yaml -> build/lib/lm_eval/tasks/afrobench/salt
2025-08-31T08:27:53,750   creating build/lib/lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:27:53,751   copying lm_eval/tasks/afrobench/salt/prompt_2/salt_lgg-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:27:53,754   copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-swa.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:27:53,756   copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lug.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:27:53,758   copying lm_eval/tasks/afrobench/salt/prompt_2/salt_teo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:27:53,761   copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-nyn.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:27:53,763   copying lm_eval/tasks/afrobench/salt/prompt_2/salt_swa-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:27:53,765   copying lm_eval/tasks/afrobench/salt/prompt_2/salt_nyn-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:27:53,767   copying lm_eval/tasks/afrobench/salt/prompt_2/salt_ach-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:27:53,769   copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lgg.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:27:53,772   copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ach.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:27:53,774   copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:27:53,776   copying lm_eval/tasks/afrobench/salt/prompt_2/salt_ibo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:27:53,777   copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-teo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:27:53,779   copying lm_eval/tasks/afrobench/salt/prompt_2/salt_lug-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:27:53,782   creating build/lib/lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:27:53,783   copying lm_eval/tasks/afrobench/salt/prompt_1/salt_lgg-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:27:53,785   copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-swa.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:27:53,787   copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lug.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:27:53,789   copying lm_eval/tasks/afrobench/salt/prompt_1/salt_teo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:27:53,791   copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-nyn.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:27:53,793   copying lm_eval/tasks/afrobench/salt/prompt_1/salt_swa-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:27:53,795   copying lm_eval/tasks/afrobench/salt/prompt_1/salt_nyn-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:27:53,797   copying lm_eval/tasks/afrobench/salt/prompt_1/salt_ach-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:27:53,799   copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lgg.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:27:53,801   copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ach.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:27:53,803   copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:27:53,805   copying lm_eval/tasks/afrobench/salt/prompt_1/salt_ibo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:27:53,807   copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-teo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:27:53,810   copying lm_eval/tasks/afrobench/salt/prompt_1/salt_lug-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:27:53,812   creating build/lib/lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:27:53,813   copying lm_eval/tasks/afrobench/salt/prompt_3/salt_lgg-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:27:53,815   copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-swa.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:27:53,817   copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lug.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:27:53,819   copying lm_eval/tasks/afrobench/salt/prompt_3/salt_teo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:27:53,821   copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-nyn.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:27:53,823   copying lm_eval/tasks/afrobench/salt/prompt_3/salt_swa-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:27:53,826   copying lm_eval/tasks/afrobench/salt/prompt_3/salt_nyn-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:27:53,828   copying lm_eval/tasks/afrobench/salt/prompt_3/salt_ach-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:27:53,830   copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lgg.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:27:53,832   copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ach.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:27:53,834   copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:27:53,836   copying lm_eval/tasks/afrobench/salt/prompt_3/salt_ibo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:27:53,838   copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-teo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:27:53,840   copying lm_eval/tasks/afrobench/salt/prompt_3/salt_lug-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:27:53,842   copying lm_eval/tasks/afrobench/belebele/belebele.yaml -> build/lib/lm_eval/tasks/afrobench/belebele
2025-08-31T08:27:53,844   creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,845   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,848   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,850   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,852   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,854   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,856   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,859   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,861   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,863   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,865   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,867   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,869   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,871   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,873   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,875   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,877   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,880   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,882   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,884   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,886   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,888   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,890   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,892   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,894   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,896   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,898   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,900   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,903   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,904   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,907   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,909   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:27:53,911   creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,912   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,914   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,916   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,918   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,920   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,922   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,924   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,926   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,929   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,931   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,933   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,935   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,937   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,939   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,941   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,943   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,945   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,947   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,949   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,951   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,953   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,955   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,957   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,959   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,962   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,964   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,966   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,968   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,970   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,972   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,974   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:27:53,976   creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:53,977   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:53,980   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:53,982   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:53,984   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:53,986   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:53,988   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:53,990   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:53,992   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:53,994   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:53,996   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:53,998   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:54,000   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:54,002   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:54,004   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:54,006   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:54,008   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:54,010   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:54,012   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:54,014   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:54,017   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:54,019   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:54,021   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:54,023   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:54,025   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:54,027   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:54,029   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:54,031   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:54,033   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:54,035   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:54,038   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:54,040   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:27:54,042   creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,042   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,045   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,047   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,049   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,051   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,054   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,056   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,058   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,060   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,062   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,064   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,066   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,068   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,070   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,072   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,074   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,076   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,078   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,080   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,082   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,084   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,086   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,089   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,091   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,093   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,095   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,097   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,099   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,102   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,104   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,106   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:27:54,108   creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,108   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,111   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,113   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,115   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,117   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,119   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,121   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,123   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,125   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,127   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,129   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,131   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,133   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,135   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,137   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,139   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,141   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,143   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,145   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,147   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,149   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,151   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,154   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,156   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,158   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,160   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,162   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,164   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,166   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,168   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,171   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:27:54,173   copying lm_eval/tasks/afrobench/sib/sib.yaml -> build/lib/lm_eval/tasks/afrobench/sib
2025-08-31T08:27:54,175   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,177   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,179   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,180   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,182   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,184   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,186   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,188   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,190   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,192   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,194   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,196   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,198   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,200   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,203   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,204   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,207   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,209   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,211   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,214   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,216   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,218   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,220   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,222   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,224   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,226   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,228   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,230   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,232   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,235   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,237   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,239   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,241   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,243   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,244   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,246   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,248   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,250   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,252   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,254   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,257   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,259   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,261   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,263   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,265   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,267   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,269   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,271   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,273   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,275   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,277   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,279   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,281   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,283   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,285   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,287   copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:27:54,289   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,291   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,293   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,296   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,298   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,300   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,302   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,304   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,306   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,308   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,310   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,312   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,314   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,316   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,318   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,320   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,322   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,324   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,326   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,328   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,330   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,332   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,334   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,336   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,338   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,340   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,342   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,344   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,346   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,348   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,350   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,352   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,354   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,356   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,359   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,361   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,362   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,364   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,366   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,368   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,370   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,372   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,374   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,376   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,378   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,380   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,383   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,385   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,387   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,389   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,391   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,393   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,396   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,398   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,400   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,402   copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:27:54,404   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,406   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,408   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,410   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,412   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,414   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,416   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,419   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,421   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,423   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,425   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,427   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,429   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,431   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,433   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,435   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,437   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,440   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,442   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,444   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,446   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,448   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,450   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,452   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,454   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,456   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,458   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,461   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,463   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,465   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,467   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,469   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,471   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,473   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,475   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,477   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,480   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,482   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,484   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,486   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,489   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,491   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,493   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,495   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,497   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,499   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,501   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,503   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,505   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,508   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,510   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,512   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,514   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,516   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,518   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,521   copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:27:54,523   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,525   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,527   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,529   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,531   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,533   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,535   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,537   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,540   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,542   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,544   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,546   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,548   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,550   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,552   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,554   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,556   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,558   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,560   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,562   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,564   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,566   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,568   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,570   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,572   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,575   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,577   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,579   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,581   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,583   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,585   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,588   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,590   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,592   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,594   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,596   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,598   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,600   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,602   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,604   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,607   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,609   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,611   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,613   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,616   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,618   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,620   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,622   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,624   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,626   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,628   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,630   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,632   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,634   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,636   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,638   copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:27:54,640   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,642   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,644   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,647   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,649   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,651   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,654   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,656   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,658   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,660   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,663   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,665   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,667   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,669   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,671   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,673   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,675   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,678   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,680   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,682   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,684   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,686   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,688   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,690   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,692   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,694   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,696   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,698   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,700   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,702   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,704   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,706   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,708   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,710   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,712   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,714   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,716   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,718   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,720   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,722   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,724   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,727   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,729   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,731   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,733   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,735   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,737   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,739   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,741   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,743   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,745   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,748   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,749   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,751   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,753   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,756   copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:27:54,757   copying lm_eval/tasks/afrobench/openai_mmlu/openai_mmlu.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu
2025-08-31T08:27:54,759   creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4
2025-08-31T08:27:54,760   copying lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4
2025-08-31T08:27:54,762   copying lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4
2025-08-31T08:27:54,764   copying lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4
2025-08-31T08:27:54,766   creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2
2025-08-31T08:27:54,767   copying lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2
2025-08-31T08:27:54,769   copying lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2
2025-08-31T08:27:54,771   copying lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2
2025-08-31T08:27:54,773   creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5
2025-08-31T08:27:54,774   copying lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5
2025-08-31T08:27:54,776   copying lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5
2025-08-31T08:27:54,778   copying lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5
2025-08-31T08:27:54,780   creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1
2025-08-31T08:27:54,781   copying lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1
2025-08-31T08:27:54,784   copying lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1
2025-08-31T08:27:54,786   copying lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1
2025-08-31T08:27:54,788   creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3
2025-08-31T08:27:54,789   copying lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3
2025-08-31T08:27:54,791   copying lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3
2025-08-31T08:27:54,793   copying lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3
2025-08-31T08:27:54,795   copying lm_eval/tasks/afrobench/masakhaner/masakhaner.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner
2025-08-31T08:27:54,798   copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:27:54,800   copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:27:54,802   copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:27:54,804   copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:27:54,806   copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:27:54,808   copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:27:54,810   copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:27:54,812   copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:27:54,814   copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:27:54,816   copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:27:54,817   copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:27:54,820   copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:27:54,822   copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:27:54,824   copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:27:54,826   copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:27:54,828   copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:27:54,830   copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:27:54,832   copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:27:54,834   copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:27:54,836   copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:27:54,840   copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:27:54,842   copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:27:54,844   copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:27:54,846   copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:27:54,848   copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:27:54,850   copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:27:54,853   copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:27:54,855   copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:27:54,857   copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:27:54,859   copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:27:54,861   copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:27:54,863   copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:27:54,865   copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:27:54,867   copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:27:54,869   copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:27:54,871   copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:27:54,873   copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:27:54,875   copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:27:54,877   copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:27:54,880   copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:27:54,882   copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:27:54,884   copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:27:54,886   copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:27:54,889   copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:27:54,891   copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:27:54,894   copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:27:54,896   copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:27:54,898   copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:27:54,901   copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:27:54,903   copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:27:54,906   copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:27:54,908   copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:27:54,910   copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:27:54,913   copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:27:54,915   copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:27:54,918   copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:27:54,920   copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:27:54,923   copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:27:54,925   copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:27:54,927   copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:27:54,929   copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:27:54,932   copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:27:54,934   copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:27:54,936   copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:27:54,939   copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:27:54,941   copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:27:54,943   copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:27:54,946   copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:27:54,948   copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:27:54,950   copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:27:54,953   copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:27:54,955   copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:27:54,957   copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:27:54,960   copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:27:54,962   copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:27:54,964   copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:27:54,967   copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:27:54,969   copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:27:54,971   copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:27:54,974   copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:27:54,976   copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:27:54,978   copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:27:54,981   copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:27:54,983   copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:27:54,986   copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:27:54,988   copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:27:54,990   copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:27:54,993   copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:27:54,995   copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:27:54,998   copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:27:55,000   copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:27:55,002   copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:27:55,004   copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:27:55,007   copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:27:55,009   copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:27:55,012   copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:27:55,014   copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:27:55,016   copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:27:55,019   copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:27:55,021   copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:27:55,023   copying lm_eval/tasks/afrobench/naijarc/naijarc.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc
2025-08-31T08:27:55,026   creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4
2025-08-31T08:27:55,027   copying lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4
2025-08-31T08:27:55,030   copying lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4
2025-08-31T08:27:55,032   copying lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4
2025-08-31T08:27:55,034   creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2
2025-08-31T08:27:55,036   copying lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2
2025-08-31T08:27:55,038   copying lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2
2025-08-31T08:27:55,041   copying lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2
2025-08-31T08:27:55,043   creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5
2025-08-31T08:27:55,044   copying lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5
2025-08-31T08:27:55,047   copying lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5
2025-08-31T08:27:55,049   copying lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5
2025-08-31T08:27:55,051   creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1
2025-08-31T08:27:55,053   copying lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1
2025-08-31T08:27:55,055   copying lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1
2025-08-31T08:27:55,057   copying lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1
2025-08-31T08:27:55,060   creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3
2025-08-31T08:27:55,061   copying lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3
2025-08-31T08:27:55,064   copying lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3
2025-08-31T08:27:55,066   copying lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3
2025-08-31T08:27:55,068   copying lm_eval/tasks/afrobench/ntrex/ntrex.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex
2025-08-31T08:27:55,071   creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,073   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,075   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,078   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,080   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,082   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,085   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,087   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,089   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,092   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,094   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,097   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,099   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,101   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,103   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,105   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,107   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,109   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,111   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,113   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,116   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,118   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,120   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,122   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,124   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,126   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,128   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,130   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,132   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,134   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,136   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,138   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,140   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:27:55,142   creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,143   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,146   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,148   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,150   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,152   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,154   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,156   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,158   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,160   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,162   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,164   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,166   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,168   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,170   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,172   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,174   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,176   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,178   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,180   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,182   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,184   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,187   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,189   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,191   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,193   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,195   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,197   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,200   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,202   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,203   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,206   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,208   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:27:55,210   creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,212   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,214   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,216   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,218   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,220   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,222   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,224   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,226   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,229   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,231   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,233   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,235   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,237   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,239   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,241   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,243   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,245   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,247   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,249   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,252   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,254   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,256   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,258   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,260   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,262   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,264   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,266   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,269   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,271   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,273   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,275   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,277   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:27:55,280   creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,281   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,283   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,285   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,287   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,289   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,291   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,293   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,295   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,297   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,300   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,301   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,304   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,306   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,308   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,310   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,312   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,314   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,316   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,319   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,321   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,323   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,325   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,328   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,330   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,332   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,334   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,336   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,338   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,340   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,342   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,344   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,346   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:27:55,348   creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,350   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,352   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,354   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,356   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,358   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,361   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,363   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,365   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,367   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,369   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,371   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,374   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,376   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,378   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,380   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,382   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,384   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,386   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,388   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,390   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,392   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,394   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,396   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,399   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,401   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,403   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,405   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,407   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,409   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,411   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,413   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,415   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:27:55,417   creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,418   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,421   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,423   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,425   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,428   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,430   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,432   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,434   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,436   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,437   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,439   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,441   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,443   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,445   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,447   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,450   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,452   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,454   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,456   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,459   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,461   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,463   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,465   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,468   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,470   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,472   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,474   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,476   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,478   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,480   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,482   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,484   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:27:55,486   copying lm_eval/tasks/afrobench/masakhapos/masakhapos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos
2025-08-31T08:27:55,488   copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:27:55,490   copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:27:55,492   copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:27:55,494   copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:27:55,497   copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:27:55,499   copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:27:55,501   copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:27:55,503   copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:27:55,505   copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:27:55,507   copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:27:55,509   copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:27:55,512   copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:27:55,514   copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:27:55,516   copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:27:55,518   copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:27:55,520   copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:27:55,522   copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:27:55,524   copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:27:55,526   copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:27:55,528   copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:27:55,530   copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:27:55,532   copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:27:55,534   copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:27:55,537   copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:27:55,539   copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:27:55,541   copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:27:55,543   copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:27:55,545   copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:27:55,547   copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:27:55,549   copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:27:55,551   copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:27:55,554   copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:27:55,556   copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:27:55,558   copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:27:55,560   copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:27:55,562   copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:27:55,564   copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:27:55,567   copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:27:55,569   copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:27:55,571   copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:27:55,573   copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:27:55,575   copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:27:55,578   copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:27:55,580   copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:27:55,582   copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:27:55,585   copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:27:55,587   copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:27:55,589   copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:27:55,591   copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:27:55,593   copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:27:55,595   copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:27:55,597   copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:27:55,599   copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:27:55,601   copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:27:55,604   copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:27:55,606   copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:27:55,608   copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:27:55,610   copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:27:55,612   copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:27:55,614   copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:27:55,616   copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:27:55,618   copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:27:55,620   copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:27:55,623   copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:27:55,625   copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:27:55,627   copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:27:55,629   copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:27:55,631   copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:27:55,633   copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:27:55,635   copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:27:55,637   copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:27:55,640   copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:27:55,642   copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:27:55,644   copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:27:55,646   copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:27:55,648   copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:27:55,650   copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:27:55,652   copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:27:55,654   copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:27:55,656   copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:27:55,658   copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:27:55,660   copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:27:55,662   copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:27:55,664   copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:27:55,667   copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:27:55,669   copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:27:55,671   copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:27:55,673   copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:27:55,675   copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:27:55,677   copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:27:55,680   copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:27:55,682   copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:27:55,684   copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:27:55,686   copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:27:55,688   copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:27:55,690   copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:27:55,692   copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:27:55,694   copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:27:55,696   copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:27:55,698   copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:27:55,701   copying lm_eval/tasks/afrobench/nollysenti/nollysenti.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti
2025-08-31T08:27:55,704   copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4
2025-08-31T08:27:55,706   copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4
2025-08-31T08:27:55,709   copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4
2025-08-31T08:27:55,712   copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4
2025-08-31T08:27:55,714   copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4
2025-08-31T08:27:55,717   copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2
2025-08-31T08:27:55,719   copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2
2025-08-31T08:27:55,722   copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2
2025-08-31T08:27:55,724   copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2
2025-08-31T08:27:55,727   copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2
2025-08-31T08:27:55,730   copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5
2025-08-31T08:27:55,732   copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5
2025-08-31T08:27:55,735   copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5
2025-08-31T08:27:55,738   copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5
2025-08-31T08:27:55,740   copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5
2025-08-31T08:27:55,743   copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1
2025-08-31T08:27:55,746   copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1
2025-08-31T08:27:55,748   copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1
2025-08-31T08:27:55,751   copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1
2025-08-31T08:27:55,753   copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1
2025-08-31T08:27:55,756   copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3
2025-08-31T08:27:55,759   copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3
2025-08-31T08:27:55,762   copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3
2025-08-31T08:27:55,764   copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3
2025-08-31T08:27:55,767   copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3
2025-08-31T08:27:55,770   copying lm_eval/tasks/afrobench/xlsum/xlsum.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum
2025-08-31T08:27:55,772   copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_tigrinya.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:27:55,775   copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_arabic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:27:55,778   copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_hausa.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:27:55,780   copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_yoruba.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:27:55,782   copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_amharic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:27:55,785   copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_igbo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:27:55,788   copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_kirundi.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:27:55,791   copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_swahili.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:27:55,794   copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_oromo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:27:55,797   copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_telugu.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:27:55,801   copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_pidgin.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:27:55,803   copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_somali.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:27:55,805   copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_tigrinya.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:27:55,808   copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_arabic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:27:55,810   copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_hausa.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:27:55,813   copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_yoruba.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:27:55,816   copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_amharic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:27:55,819   copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_igbo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:27:55,822   copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_kirundi.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:27:55,824   copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_swahili.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:27:55,826   copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_oromo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:27:55,828   copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_telugu.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:27:55,830   copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_pidgin.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:27:55,832   copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_somali.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:27:55,834   copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_tigrinya.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:27:55,837   copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_arabic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:27:55,839   copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_hausa.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:27:55,841   copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_yoruba.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:27:55,843   copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_amharic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:27:55,845   copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_igbo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:27:55,847   copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_kirundi.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:27:55,850   copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_swahili.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:27:55,852   copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_oromo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:27:55,854   copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_telugu.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:27:55,856   copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_pidgin.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:27:55,858   copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_somali.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:27:55,860   copying lm_eval/tasks/afrobench/afrisenti/afrisenti.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti
2025-08-31T08:27:55,862   copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:27:55,865   copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:27:55,867   copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:27:55,869   copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:27:55,872   copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:27:55,874   copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:27:55,876   copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:27:55,878   copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:27:55,881   copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:27:55,883   copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:27:55,885   copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:27:55,888   copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:27:55,890   copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:27:55,892   copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:27:55,894   copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:27:55,897   copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:27:55,899   copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:27:55,902   copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:27:55,905   copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:27:55,907   copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:27:55,909   copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:27:55,911   copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:27:55,913   copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:27:55,915   copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:27:55,917   copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:27:55,919   copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:27:55,921   copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:27:55,924   copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:27:55,926   copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:27:55,928   copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:27:55,930   copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:27:55,932   copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:27:55,935   copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:27:55,937   copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:27:55,939   copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:27:55,942   copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:27:55,944   copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:27:55,946   copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:27:55,948   copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:27:55,950   copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:27:55,952   copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:27:55,954   copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:27:55,957   copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:27:55,959   copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:27:55,961   copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:27:55,963   copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:27:55,965   copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:27:55,967   copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:27:55,969   copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:27:55,971   copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:27:55,974   copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:27:55,976   copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:27:55,978   copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:27:55,980   copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:27:55,982   copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:27:55,984   copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:27:55,986   copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:27:55,988   copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:27:55,990   copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:27:55,992   copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:27:55,994   copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:27:55,997   copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:27:55,999   copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:27:56,001   copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:27:56,003   copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:27:56,005   copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:27:56,007   copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:27:56,009   copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:27:56,011   copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:27:56,013   copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:27:56,016   copying lm_eval/tasks/afrobench/injongointent/injongointent.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent
2025-08-31T08:27:56,018   copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:27:56,020   copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:27:56,022   copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:27:56,024   copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:27:56,026   copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:27:56,028   copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:27:56,030   copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:27:56,032   copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:27:56,034   copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:27:56,036   copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:27:56,038   copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:27:56,040   copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:27:56,043   copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:27:56,045   copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:27:56,047   copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:27:56,049   copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:27:56,051   copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:27:56,053   copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:27:56,055   copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:27:56,057   copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:27:56,059   copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:27:56,062   copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:27:56,064   copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:27:56,066   copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:27:56,068   copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:27:56,070   copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:27:56,072   copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:27:56,074   copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:27:56,076   copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:27:56,078   copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:27:56,080   copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:27:56,083   copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:27:56,085   copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:27:56,087   copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:27:56,089   copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:27:56,091   copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:27:56,093   copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:27:56,095   copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:27:56,097   copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:27:56,099   copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:27:56,101   copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:27:56,104   copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:27:56,106   copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:27:56,108   copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:27:56,111   copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:27:56,113   copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:27:56,115   copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:27:56,117   copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:27:56,119   copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:27:56,121   copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:27:56,123   copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:27:56,125   copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:27:56,127   copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:27:56,129   copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:27:56,131   copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:27:56,133   copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:27:56,135   copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:27:56,137   copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:27:56,139   copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:27:56,141   copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:27:56,143   copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:27:56,146   copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:27:56,148   copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:27:56,150   copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:27:56,152   copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:27:56,154   copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:27:56,156   copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:27:56,158   copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:27:56,160   copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:27:56,162   copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:27:56,165   copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:27:56,167   copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:27:56,169   copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:27:56,171   copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:27:56,173   copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:27:56,175   copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:27:56,177   copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:27:56,179   copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:27:56,181   copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:27:56,183   copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:27:56,185   copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:27:56,187   copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:27:56,189   copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:27:56,191   copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:27:56,193   copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:27:56,195   creating build/lib/lm_eval/tasks/polemo2
2025-08-31T08:27:56,196   copying lm_eval/tasks/polemo2/polemo2_in.yaml -> build/lib/lm_eval/tasks/polemo2
2025-08-31T08:27:56,198   copying lm_eval/tasks/polemo2/polemo2_out.yaml -> build/lib/lm_eval/tasks/polemo2
2025-08-31T08:27:56,200   copying lm_eval/tasks/wsc273/default.yaml -> build/lib/lm_eval/tasks/wsc273
2025-08-31T08:27:56,203   copying lm_eval/tasks/c4/c4.yaml -> build/lib/lm_eval/tasks/c4
2025-08-31T08:27:56,205   copying lm_eval/tasks/humaneval/humaneval_64.yaml -> build/lib/lm_eval/tasks/humaneval
2025-08-31T08:27:56,207   copying lm_eval/tasks/humaneval/humaneval.yaml -> build/lib/lm_eval/tasks/humaneval
2025-08-31T08:27:56,209   copying lm_eval/tasks/humaneval/humaneval_instruct.yaml -> build/lib/lm_eval/tasks/humaneval
2025-08-31T08:27:56,211   copying lm_eval/tasks/humaneval/humaneval_64_instruct.yaml -> build/lib/lm_eval/tasks/humaneval
2025-08-31T08:27:56,213   copying lm_eval/tasks/humaneval/humaneval_plus.yaml -> build/lib/lm_eval/tasks/humaneval
2025-08-31T08:27:56,215   creating build/lib/lm_eval/tasks/eus_proficiency
2025-08-31T08:27:56,216   copying lm_eval/tasks/eus_proficiency/eus_proficiency.yaml -> build/lib/lm_eval/tasks/eus_proficiency
2025-08-31T08:27:56,219   creating build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,219   copying lm_eval/tasks/multiblimp/multiblimp_pcm.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,222   copying lm_eval/tasks/multiblimp/multiblimp_frm.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,224   copying lm_eval/tasks/multiblimp/multiblimp_kaz.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,226   copying lm_eval/tasks/multiblimp/multiblimp_wbp.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,228   copying lm_eval/tasks/multiblimp/multiblimp_urb.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,230   copying lm_eval/tasks/multiblimp/multiblimp_fas.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,232   copying lm_eval/tasks/multiblimp/multiblimp_bho.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,234   copying lm_eval/tasks/multiblimp/multiblimp_arb.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,236   copying lm_eval/tasks/multiblimp/multiblimp_sms.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,239   copying lm_eval/tasks/multiblimp/multiblimp_pol.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,241   copying lm_eval/tasks/multiblimp/multiblimp_lit.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,243   copying lm_eval/tasks/multiblimp/multiblimp_aln.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,245   copying lm_eval/tasks/multiblimp/multiblimp_olo.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,247   copying lm_eval/tasks/multiblimp/multiblimp_lat.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,249   copying lm_eval/tasks/multiblimp/multiblimp_kir.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,251   copying lm_eval/tasks/multiblimp/multiblimp_tpn.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,253   copying lm_eval/tasks/multiblimp/multiblimp_hsb.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,256   copying lm_eval/tasks/multiblimp/multiblimp_uzb.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,258   copying lm_eval/tasks/multiblimp/multiblimp_fin.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,262   copying lm_eval/tasks/multiblimp/multiblimp_yrl.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,265   copying lm_eval/tasks/multiblimp/multiblimp_fao.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,268   copying lm_eval/tasks/multiblimp/multiblimp_bul.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,270   copying lm_eval/tasks/multiblimp/multiblimp_xcl.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,272   copying lm_eval/tasks/multiblimp/multiblimp_orv.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,275   copying lm_eval/tasks/multiblimp/multiblimp_kmr.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,279   copying lm_eval/tasks/multiblimp/multiblimp_gla.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,281   copying lm_eval/tasks/multiblimp/multiblimp_kxh.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,283   copying lm_eval/tasks/multiblimp/multiblimp_aqz.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,285   copying lm_eval/tasks/multiblimp/multiblimp_grc.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,287   copying lm_eval/tasks/multiblimp/multiblimp_isl.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,289   copying lm_eval/tasks/multiblimp/multiblimp_hyw.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,291   copying lm_eval/tasks/multiblimp/multiblimp_krl.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,293   copying lm_eval/tasks/multiblimp/multiblimp_wol.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,295   copying lm_eval/tasks/multiblimp/multiblimp_nhi.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,297   copying lm_eval/tasks/multiblimp/multiblimp_lav.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,299   copying lm_eval/tasks/multiblimp/multiblimp_sme.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,301   copying lm_eval/tasks/multiblimp/multiblimp_mdf.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,303   copying lm_eval/tasks/multiblimp/multiblimp_apu.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,305   copying lm_eval/tasks/multiblimp/multiblimp_uig.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,307   copying lm_eval/tasks/multiblimp/multiblimp_por.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,310   copying lm_eval/tasks/multiblimp/multiblimp_ita.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,312   copying lm_eval/tasks/multiblimp/multiblimp_got.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,314   copying lm_eval/tasks/multiblimp/multiblimp_kat.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,316   copying lm_eval/tasks/multiblimp/multiblimp_kpv.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,318   copying lm_eval/tasks/multiblimp/multiblimp_xpg.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,320   copying lm_eval/tasks/multiblimp/multiblimp_xnr.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,322   copying lm_eval/tasks/multiblimp/multiblimp_bel.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,324   copying lm_eval/tasks/multiblimp/multiblimp_est.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,326   copying lm_eval/tasks/multiblimp/multiblimp_koi.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,328   copying lm_eval/tasks/multiblimp/multiblimp_sqi.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,330   copying lm_eval/tasks/multiblimp/multiblimp_hye.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,332   copying lm_eval/tasks/multiblimp/multiblimp_amh.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,334   copying lm_eval/tasks/multiblimp/multiblimp_eng.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,336   copying lm_eval/tasks/multiblimp/multiblimp_rus.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,338   copying lm_eval/tasks/multiblimp/multiblimp_swe.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,340   copying lm_eval/tasks/multiblimp/multiblimp_chu.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,342   copying lm_eval/tasks/multiblimp/multiblimp_abk.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,344   copying lm_eval/tasks/multiblimp/multiblimp_ttc.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,346   copying lm_eval/tasks/multiblimp/multiblimp_hun.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,348   copying lm_eval/tasks/multiblimp/multiblimp_bre.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,350   copying lm_eval/tasks/multiblimp/multiblimp_fra.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,352   copying lm_eval/tasks/multiblimp/multiblimp_heb.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,354   copying lm_eval/tasks/multiblimp/multiblimp_glg.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,356   copying lm_eval/tasks/multiblimp/multiblimp_azz.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,358   copying lm_eval/tasks/multiblimp/multiblimp_vep.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,360   copying lm_eval/tasks/multiblimp/multiblimp_cat.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,362   copying lm_eval/tasks/multiblimp/multiblimp_hbs.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,365   copying lm_eval/tasks/multiblimp/multiblimp_ces.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,367   copying lm_eval/tasks/multiblimp/multiblimp_guj.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,369   copying lm_eval/tasks/multiblimp/multiblimp_myv.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,371   copying lm_eval/tasks/multiblimp/multiblimp_gle.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,373   copying lm_eval/tasks/multiblimp/multiblimp_ron.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,375   copying lm_eval/tasks/multiblimp/multiblimp_hit.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,377   copying lm_eval/tasks/multiblimp/multiblimp_slk.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,379   copying lm_eval/tasks/multiblimp/multiblimp_hbo.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,381   copying lm_eval/tasks/multiblimp/multiblimp_egy.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,383   copying lm_eval/tasks/multiblimp/multiblimp_nld.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,385   copying lm_eval/tasks/multiblimp/multiblimp_quc.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,387   copying lm_eval/tasks/multiblimp/multiblimp_tam.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,390   copying lm_eval/tasks/multiblimp/multiblimp_ell.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,392   copying lm_eval/tasks/multiblimp/multiblimp_mkd.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,394   copying lm_eval/tasks/multiblimp/multiblimp_nds.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,396   copying lm_eval/tasks/multiblimp/multiblimp_bor.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,399   copying lm_eval/tasks/multiblimp/multiblimp_bua.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,400   copying lm_eval/tasks/multiblimp/multiblimp_sah.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,402   copying lm_eval/tasks/multiblimp/multiblimp_urd.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,404   copying lm_eval/tasks/multiblimp/multiblimp_hin.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,406   copying lm_eval/tasks/multiblimp/multiblimp_mar.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,408   copying lm_eval/tasks/multiblimp/multiblimp_ota.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,410   copying lm_eval/tasks/multiblimp/multiblimp_ukr.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,412   copying lm_eval/tasks/multiblimp/multiblimp_fro.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,414   copying lm_eval/tasks/multiblimp/multiblimp_spa.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,416   copying lm_eval/tasks/multiblimp/multiblimp_dan.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,418   copying lm_eval/tasks/multiblimp/multiblimp_tur.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,420   copying lm_eval/tasks/multiblimp/multiblimp_slv.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,422   copying lm_eval/tasks/multiblimp/multiblimp_deu.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,424   copying lm_eval/tasks/multiblimp/multiblimp_ben.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,426   copying lm_eval/tasks/multiblimp/multiblimp_lij.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,428   copying lm_eval/tasks/multiblimp/multiblimp_cym.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,430   copying lm_eval/tasks/multiblimp/multiblimp_eus.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,432   copying lm_eval/tasks/multiblimp/multiblimp_san.yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:27:56,434   copying lm_eval/tasks/coqa/default.yaml -> build/lib/lm_eval/tasks/coqa
2025-08-31T08:27:56,437   copying lm_eval/tasks/score/score_robustness.yaml -> build/lib/lm_eval/tasks/score
2025-08-31T08:27:56,439   copying lm_eval/tasks/score/agi_eval/score_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,441   copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_lr.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,443   copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lsat_rc.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,445   copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_logiqa_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,447   copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,449   copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_lr.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,451   copying lm_eval/tasks/score/agi_eval/score_non_greedy_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,453   copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_ar.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,455   copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_math.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,458   copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,459   copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,461   copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_math.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,463   copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_rc.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,465   copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_aqua_rat.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,467   copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_aqua_rat.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,470   copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_ar.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,472   copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_logiqa_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,474   copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_ar.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,477   copying lm_eval/tasks/score/agi_eval/score_option_order_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,479   copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_lr.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,481   copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_aqua_rat.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,483   copying lm_eval/tasks/score/agi_eval/score_prompt_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,485   copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_logiqa_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,487   copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_math.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,489   copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lsat_rc.yaml -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:27:56,491   copying lm_eval/tasks/score/mmlu_pro/score_prompt_robustness_mmlu_pro.yaml -> build/lib/lm_eval/tasks/score/mmlu_pro
2025-08-31T08:27:56,493   copying lm_eval/tasks/score/mmlu_pro/score_non_greedy_robustness_mmlu_pro.yaml -> build/lib/lm_eval/tasks/score/mmlu_pro
2025-08-31T08:27:56,495   copying lm_eval/tasks/score/mmlu_pro/score_option_order_robustness_mmlu_pro.yaml -> build/lib/lm_eval/tasks/score/mmlu_pro
2025-08-31T08:27:56,498   copying lm_eval/tasks/score/math/prompt_robustness_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/score/math
2025-08-31T08:27:56,500   copying lm_eval/tasks/score/math/non_greedy_robustness_math_geometry.yaml -> build/lib/lm_eval/tasks/score/math
2025-08-31T08:27:56,502   copying lm_eval/tasks/score/math/prompt_robustness_math_precalc.yaml -> build/lib/lm_eval/tasks/score/math
2025-08-31T08:27:56,504   copying lm_eval/tasks/score/math/prompt_robustness_math_geometry.yaml -> build/lib/lm_eval/tasks/score/math
2025-08-31T08:27:56,507   copying lm_eval/tasks/score/math/prompt_robustness_math_num_theory.yaml -> build/lib/lm_eval/tasks/score/math
2025-08-31T08:27:56,510   copying lm_eval/tasks/score/math/score_non_greedy_robustness_math.yaml -> build/lib/lm_eval/tasks/score/math
2025-08-31T08:27:56,513   copying lm_eval/tasks/score/math/prompt_robustness_math_prealgebra.yaml -> build/lib/lm_eval/tasks/score/math
2025-08-31T08:27:56,515   copying lm_eval/tasks/score/math/non_greedy_robustness_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/score/math
2025-08-31T08:27:56,518   copying lm_eval/tasks/score/math/non_greedy_robustness_math_algebra.yaml -> build/lib/lm_eval/tasks/score/math
2025-08-31T08:27:56,521   copying lm_eval/tasks/score/math/non_greedy_robustness_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/score/math
2025-08-31T08:27:56,524   copying lm_eval/tasks/score/math/score_prompt_robustness_math.yaml -> build/lib/lm_eval/tasks/score/math
2025-08-31T08:27:56,526   copying lm_eval/tasks/score/math/score_robustness_math.yaml -> build/lib/lm_eval/tasks/score/math
2025-08-31T08:27:56,529   copying lm_eval/tasks/score/math/prompt_robustness_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/score/math
2025-08-31T08:27:56,532   copying lm_eval/tasks/score/math/non_greedy_robustness_math_num_theory.yaml -> build/lib/lm_eval/tasks/score/math
2025-08-31T08:27:56,535   copying lm_eval/tasks/score/math/prompt_robustness_math_algebra.yaml -> build/lib/lm_eval/tasks/score/math
2025-08-31T08:27:56,537   copying lm_eval/tasks/score/math/non_greedy_robustness_math_precalc.yaml -> build/lib/lm_eval/tasks/score/math
2025-08-31T08:27:56,540   copying lm_eval/tasks/score/math/non_greedy_robustness_math_prealgebra.yaml -> build/lib/lm_eval/tasks/score/math
2025-08-31T08:27:56,543   copying lm_eval/tasks/paloma/paloma_c4_100_domains.yaml -> build/lib/lm_eval/tasks/paloma
2025-08-31T08:27:56,545   copying lm_eval/tasks/paloma/paloma_m2d2_s2orc_unsplit.yaml -> build/lib/lm_eval/tasks/paloma
2025-08-31T08:27:56,548   copying lm_eval/tasks/paloma/paloma_falcon-refinedweb.yaml -> build/lib/lm_eval/tasks/paloma
2025-08-31T08:27:56,551   copying lm_eval/tasks/paloma/paloma_c4_en.yaml -> build/lib/lm_eval/tasks/paloma
2025-08-31T08:27:56,553   copying lm_eval/tasks/paloma/paloma_dolma_100_programing_languages.yaml -> build/lib/lm_eval/tasks/paloma
2025-08-31T08:27:56,556   copying lm_eval/tasks/paloma/paloma_redpajama.yaml -> build/lib/lm_eval/tasks/paloma
2025-08-31T08:27:56,558   copying lm_eval/tasks/paloma/paloma_dolma-v1_5.yaml -> build/lib/lm_eval/tasks/paloma
2025-08-31T08:27:56,561   copying lm_eval/tasks/paloma/paloma_gab.yaml -> build/lib/lm_eval/tasks/paloma
2025-08-31T08:27:56,564   copying lm_eval/tasks/paloma/paloma_mc4.yaml -> build/lib/lm_eval/tasks/paloma
2025-08-31T08:27:56,567   copying lm_eval/tasks/paloma/paloma_dolma_100_subreddits.yaml -> build/lib/lm_eval/tasks/paloma
2025-08-31T08:27:56,570   copying lm_eval/tasks/paloma/paloma_twitterAAE_HELM_fixed.yaml -> build/lib/lm_eval/tasks/paloma
2025-08-31T08:27:56,573   copying lm_eval/tasks/paloma/paloma_manosphere_meta_sep.yaml -> build/lib/lm_eval/tasks/paloma
2025-08-31T08:27:56,575   copying lm_eval/tasks/paloma/paloma_4chan_meta_sep.yaml -> build/lib/lm_eval/tasks/paloma
2025-08-31T08:27:56,578   copying lm_eval/tasks/paloma/paloma_m2d2_wikipedia_unsplit.yaml -> build/lib/lm_eval/tasks/paloma
2025-08-31T08:27:56,581   copying lm_eval/tasks/paloma/paloma_ptb.yaml -> build/lib/lm_eval/tasks/paloma
2025-08-31T08:27:56,583   copying lm_eval/tasks/paloma/paloma_wikitext_103.yaml -> build/lib/lm_eval/tasks/paloma
2025-08-31T08:27:56,586   creating build/lib/lm_eval/tasks/storycloze
2025-08-31T08:27:56,587   copying lm_eval/tasks/storycloze/storycloze_2018.yaml -> build/lib/lm_eval/tasks/storycloze
2025-08-31T08:27:56,590   copying lm_eval/tasks/storycloze/storycloze_2016.yaml -> build/lib/lm_eval/tasks/storycloze
2025-08-31T08:27:56,593   copying lm_eval/tasks/olaph/olaph_perplexity.yaml -> build/lib/lm_eval/tasks/olaph
2025-08-31T08:27:56,596   copying lm_eval/tasks/olaph/olaph.yaml -> build/lib/lm_eval/tasks/olaph
2025-08-31T08:27:56,599   copying lm_eval/tasks/xcopa/default_sw.yaml -> build/lib/lm_eval/tasks/xcopa
2025-08-31T08:27:56,601   copying lm_eval/tasks/xcopa/default_tr.yaml -> build/lib/lm_eval/tasks/xcopa
2025-08-31T08:27:56,604   copying lm_eval/tasks/xcopa/default_zh.yaml -> build/lib/lm_eval/tasks/xcopa
2025-08-31T08:27:56,606   copying lm_eval/tasks/xcopa/default_it.yaml -> build/lib/lm_eval/tasks/xcopa
2025-08-31T08:27:56,609   copying lm_eval/tasks/xcopa/_xcopa.yaml -> build/lib/lm_eval/tasks/xcopa
2025-08-31T08:27:56,611   copying lm_eval/tasks/xcopa/default_ta.yaml -> build/lib/lm_eval/tasks/xcopa
2025-08-31T08:27:56,613   copying lm_eval/tasks/xcopa/default_et.yaml -> build/lib/lm_eval/tasks/xcopa
2025-08-31T08:27:56,615   copying lm_eval/tasks/xcopa/default_th.yaml -> build/lib/lm_eval/tasks/xcopa
2025-08-31T08:27:56,617   copying lm_eval/tasks/xcopa/default_id.yaml -> build/lib/lm_eval/tasks/xcopa
2025-08-31T08:27:56,619   copying lm_eval/tasks/xcopa/default_ht.yaml -> build/lib/lm_eval/tasks/xcopa
2025-08-31T08:27:56,621   copying lm_eval/tasks/xcopa/default_vi.yaml -> build/lib/lm_eval/tasks/xcopa
2025-08-31T08:27:56,623   copying lm_eval/tasks/xcopa/default_qu.yaml -> build/lib/lm_eval/tasks/xcopa
2025-08-31T08:27:56,625   creating build/lib/lm_eval/tasks/mastermind
2025-08-31T08:27:56,626   copying lm_eval/tasks/mastermind/mastermind_24_easy.yaml -> build/lib/lm_eval/tasks/mastermind
2025-08-31T08:27:56,628   copying lm_eval/tasks/mastermind/mastermind_46_hard.yaml -> build/lib/lm_eval/tasks/mastermind
2025-08-31T08:27:56,630   copying lm_eval/tasks/mastermind/mastermind_24_hard.yaml -> build/lib/lm_eval/tasks/mastermind
2025-08-31T08:27:56,632   copying lm_eval/tasks/mastermind/mastermind_46_easy.yaml -> build/lib/lm_eval/tasks/mastermind
2025-08-31T08:27:56,634   copying lm_eval/tasks/mastermind/mastermind_35_easy.yaml -> build/lib/lm_eval/tasks/mastermind
2025-08-31T08:27:56,636   copying lm_eval/tasks/mastermind/mastermind_35_hard.yaml -> build/lib/lm_eval/tasks/mastermind
2025-08-31T08:27:56,638   copying lm_eval/tasks/meddialog/meddialog_raw_dialogues.yaml -> build/lib/lm_eval/tasks/meddialog
2025-08-31T08:27:56,640   copying lm_eval/tasks/meddialog/meddialog_raw_perplexity.yaml -> build/lib/lm_eval/tasks/meddialog
2025-08-31T08:27:56,642   copying lm_eval/tasks/meddialog/meddialog_qsumm.yaml -> build/lib/lm_eval/tasks/meddialog
2025-08-31T08:27:56,644   copying lm_eval/tasks/meddialog/meddialog_qsumm_perplexity.yaml -> build/lib/lm_eval/tasks/meddialog
2025-08-31T08:27:56,646   copying lm_eval/tasks/french_bench/french_bench_multifquad.yaml -> build/lib/lm_eval/tasks/french_bench
2025-08-31T08:27:56,648   copying lm_eval/tasks/french_bench/french_bench_boolqa.yaml -> build/lib/lm_eval/tasks/french_bench
2025-08-31T08:27:56,650   copying lm_eval/tasks/french_bench/french_bench_orangesum_title.yaml -> build/lib/lm_eval/tasks/french_bench
2025-08-31T08:27:56,652   copying lm_eval/tasks/french_bench/french_bench_fquadv2_genq.yaml -> build/lib/lm_eval/tasks/french_bench
2025-08-31T08:27:56,654   copying lm_eval/tasks/french_bench/french_bench_xnli.yaml -> build/lib/lm_eval/tasks/french_bench
2025-08-31T08:27:56,656   copying lm_eval/tasks/french_bench/french_bench_reading_comp.yaml -> build/lib/lm_eval/tasks/french_bench
2025-08-31T08:27:56,659   copying lm_eval/tasks/french_bench/french_bench_hellaswag.yaml -> build/lib/lm_eval/tasks/french_bench
2025-08-31T08:27:56,661   copying lm_eval/tasks/french_bench/french_bench_orangesum_abstract.yaml -> build/lib/lm_eval/tasks/french_bench
2025-08-31T08:27:56,662   copying lm_eval/tasks/french_bench/french_bench_fquadv2_hasAns.yaml -> build/lib/lm_eval/tasks/french_bench
2025-08-31T08:27:56,665   copying lm_eval/tasks/french_bench/french_bench_fquadv2.yaml -> build/lib/lm_eval/tasks/french_bench
2025-08-31T08:27:56,667   copying lm_eval/tasks/french_bench/french_bench_trivia.yaml -> build/lib/lm_eval/tasks/french_bench
2025-08-31T08:27:56,669   copying lm_eval/tasks/french_bench/french_bench_wikitext_fr.yaml -> build/lib/lm_eval/tasks/french_bench
2025-08-31T08:27:56,671   copying lm_eval/tasks/french_bench/french_bench_opus_perplexity.yaml -> build/lib/lm_eval/tasks/french_bench
2025-08-31T08:27:56,673   copying lm_eval/tasks/french_bench/french_bench_grammar.yaml -> build/lib/lm_eval/tasks/french_bench
2025-08-31T08:27:56,675   copying lm_eval/tasks/french_bench/french_bench_arc_challenge.yaml -> build/lib/lm_eval/tasks/french_bench
2025-08-31T08:27:56,677   copying lm_eval/tasks/french_bench/french_bench_fquadv2_bool.yaml -> build/lib/lm_eval/tasks/french_bench
2025-08-31T08:27:56,679   copying lm_eval/tasks/french_bench/french_bench_vocab.yaml -> build/lib/lm_eval/tasks/french_bench
2025-08-31T08:27:56,681   copying lm_eval/tasks/french_bench/french_bench_topic_based_nli.yaml -> build/lib/lm_eval/tasks/french_bench
2025-08-31T08:27:56,683   creating build/lib/lm_eval/tasks/haerae
2025-08-31T08:27:56,684   copying lm_eval/tasks/haerae/haerae_gk.yaml -> build/lib/lm_eval/tasks/haerae
2025-08-31T08:27:56,686   copying lm_eval/tasks/haerae/_haerae.yaml -> build/lib/lm_eval/tasks/haerae
2025-08-31T08:27:56,688   copying lm_eval/tasks/haerae/haerae_lw.yaml -> build/lib/lm_eval/tasks/haerae
2025-08-31T08:27:56,690   copying lm_eval/tasks/haerae/haerae_hi.yaml -> build/lib/lm_eval/tasks/haerae
2025-08-31T08:27:56,692   copying lm_eval/tasks/haerae/haerae_rw.yaml -> build/lib/lm_eval/tasks/haerae
2025-08-31T08:27:56,693   copying lm_eval/tasks/haerae/haerae_sn.yaml -> build/lib/lm_eval/tasks/haerae
2025-08-31T08:27:56,695   copying lm_eval/tasks/kobest/kobest_sentineg.yaml -> build/lib/lm_eval/tasks/kobest
2025-08-31T08:27:56,697   copying lm_eval/tasks/kobest/kobest_hellaswag.yaml -> build/lib/lm_eval/tasks/kobest
2025-08-31T08:27:56,699   copying lm_eval/tasks/kobest/_kobest.yaml -> build/lib/lm_eval/tasks/kobest
2025-08-31T08:27:56,701   copying lm_eval/tasks/kobest/kobest_boolq.yaml -> build/lib/lm_eval/tasks/kobest
2025-08-31T08:27:56,703   copying lm_eval/tasks/kobest/kobest_wic.yaml -> build/lib/lm_eval/tasks/kobest
2025-08-31T08:27:56,705   copying lm_eval/tasks/kobest/kobest_copa.yaml -> build/lib/lm_eval/tasks/kobest
2025-08-31T08:27:56,708   copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:56,710   copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10cm.yaml -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:56,712   copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:56,714   copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:56,716   copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9proc.yaml -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:56,718   copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9cm.yaml -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:56,720   copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:56,722   copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_atc.yaml -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:56,724   copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:56,726   copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:56,728   copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:56,730   copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa.yaml -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:56,732   copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10proc.yaml -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:56,734   copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:56,736   copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:56,738   copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:56,740   copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:56,743   copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:56,745   copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:56,746   copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:56,748   copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:27:56,750   copying lm_eval/tasks/mbpp/mbpp.yaml -> build/lib/lm_eval/tasks/mbpp
2025-08-31T08:27:56,752   copying lm_eval/tasks/mbpp/mbpp_instruct.yaml -> build/lib/lm_eval/tasks/mbpp
2025-08-31T08:27:56,754   copying lm_eval/tasks/mbpp/mbpp_plus.yaml -> build/lib/lm_eval/tasks/mbpp
2025-08-31T08:27:56,756   copying lm_eval/tasks/mbpp/mbpp_plus_instruct.yaml -> build/lib/lm_eval/tasks/mbpp
2025-08-31T08:27:56,758   copying lm_eval/tasks/squad_completion/squad_completion.yaml -> build/lib/lm_eval/tasks/squad_completion
2025-08-31T08:27:56,760   copying lm_eval/tasks/logiqa/logiqa.yaml -> build/lib/lm_eval/tasks/logiqa
2025-08-31T08:27:56,762   creating build/lib/lm_eval/tasks/xnli_eu
2025-08-31T08:27:56,763   copying lm_eval/tasks/xnli_eu/xnli_eu.yaml -> build/lib/lm_eval/tasks/xnli_eu
2025-08-31T08:27:56,765   copying lm_eval/tasks/xnli_eu/xnli_eu_mt.yaml -> build/lib/lm_eval/tasks/xnli_eu
2025-08-31T08:27:56,767   copying lm_eval/tasks/xnli_eu/xnli_eu_native.yaml -> build/lib/lm_eval/tasks/xnli_eu
2025-08-31T08:27:56,769   creating build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,771   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,773   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,775   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,777   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,779   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,781   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,783   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,785   copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,787   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,789   copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_other.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,791   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,793   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,795   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,797   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,799   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,802   copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,804   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,806   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,808   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,810   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,812   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,814   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,816   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,818   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,820   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,822   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,824   copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,826   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_math.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,828   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,830   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,832   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,834   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,836   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,838   copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,840   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,842   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,844   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,846   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,849   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_education.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,852   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,854   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,856   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_health.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,858   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,860   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,862   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,864   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,866   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,868   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,870   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,872   copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:27:56,875   creating build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,876   copying lm_eval/tasks/kmmlu/default/_kmmlu_other.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,878   copying lm_eval/tasks/kmmlu/default/kmmlu_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,880   copying lm_eval/tasks/kmmlu/default/kmmlu_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,881   copying lm_eval/tasks/kmmlu/default/kmmlu_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,883   copying lm_eval/tasks/kmmlu/default/kmmlu_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,885   copying lm_eval/tasks/kmmlu/default/kmmlu_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,887   copying lm_eval/tasks/kmmlu/default/kmmlu_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,889   copying lm_eval/tasks/kmmlu/default/kmmlu_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,891   copying lm_eval/tasks/kmmlu/default/kmmlu_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,893   copying lm_eval/tasks/kmmlu/default/kmmlu_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,895   copying lm_eval/tasks/kmmlu/default/kmmlu_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,898   copying lm_eval/tasks/kmmlu/default/kmmlu_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,900   copying lm_eval/tasks/kmmlu/default/kmmlu_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,902   copying lm_eval/tasks/kmmlu/default/kmmlu_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,904   copying lm_eval/tasks/kmmlu/default/kmmlu_math.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,906   copying lm_eval/tasks/kmmlu/default/kmmlu_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,908   copying lm_eval/tasks/kmmlu/default/kmmlu_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,910   copying lm_eval/tasks/kmmlu/default/kmmlu_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,912   copying lm_eval/tasks/kmmlu/default/kmmlu_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,914   copying lm_eval/tasks/kmmlu/default/kmmlu_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,916   copying lm_eval/tasks/kmmlu/default/kmmlu_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,918   copying lm_eval/tasks/kmmlu/default/kmmlu_law.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,921   copying lm_eval/tasks/kmmlu/default/kmmlu_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,923   copying lm_eval/tasks/kmmlu/default/kmmlu_education.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,925   copying lm_eval/tasks/kmmlu/default/kmmlu_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,927   copying lm_eval/tasks/kmmlu/default/kmmlu_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,929   copying lm_eval/tasks/kmmlu/default/kmmlu_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,931   copying lm_eval/tasks/kmmlu/default/kmmlu_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,933   copying lm_eval/tasks/kmmlu/default/kmmlu_health.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,935   copying lm_eval/tasks/kmmlu/default/kmmlu_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,937   copying lm_eval/tasks/kmmlu/default/kmmlu_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,939   copying lm_eval/tasks/kmmlu/default/kmmlu_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,941   copying lm_eval/tasks/kmmlu/default/_kmmlu_default.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,944   copying lm_eval/tasks/kmmlu/default/kmmlu_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,946   copying lm_eval/tasks/kmmlu/default/kmmlu_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,948   copying lm_eval/tasks/kmmlu/default/kmmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,950   copying lm_eval/tasks/kmmlu/default/_kmmlu_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,952   copying lm_eval/tasks/kmmlu/default/kmmlu_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,954   copying lm_eval/tasks/kmmlu/default/kmmlu_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,956   copying lm_eval/tasks/kmmlu/default/kmmlu_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,958   copying lm_eval/tasks/kmmlu/default/kmmlu_management.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,960   copying lm_eval/tasks/kmmlu/default/kmmlu_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,962   copying lm_eval/tasks/kmmlu/default/_kmmlu_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,964   copying lm_eval/tasks/kmmlu/default/kmmlu_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,966   copying lm_eval/tasks/kmmlu/default/kmmlu_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,968   copying lm_eval/tasks/kmmlu/default/_kmmlu_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,970   copying lm_eval/tasks/kmmlu/default/kmmlu_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,972   copying lm_eval/tasks/kmmlu/default/kmmlu_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,974   copying lm_eval/tasks/kmmlu/default/kmmlu_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,977   copying lm_eval/tasks/kmmlu/default/kmmlu_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:27:56,979   creating build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:56,979   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:56,982   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:56,984   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:56,986   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:56,988   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:56,990   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:56,993   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:56,995   copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct_other.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:56,997   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:56,999   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,001   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,003   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_education.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,005   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,007   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,009   copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,011   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,013   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,016   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,018   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,020   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,022   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,024   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,026   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,028   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,030   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,032   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,034   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_math.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,036   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,038   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,040   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,043   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,045   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,047   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,049   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,051   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,054   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,056   copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,058   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,060   copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,062   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,064   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_health.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,066   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,068   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,070   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,072   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,074   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,076   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,079   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,081   copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,083   copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:27:57,085   creating build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,086   copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,088   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,090   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,092   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_law.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,094   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,096   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,098   copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,100   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_management.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,103   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,105   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,107   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,109   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,111   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,113   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,115   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,117   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,119   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,122   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,124   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,126   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,128   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,130   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,132   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,134   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,136   copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard_other.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,138   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,140   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,142   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,144   copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,146   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_education.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,148   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,150   copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,152   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,155   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,157   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,159   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,161   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,163   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,166   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,168   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,170   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,172   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,174   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,176   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,178   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_math.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,180   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,183   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,185   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,188   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,190   copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_health.yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:27:57,192   creating build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,193   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,195   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,198   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,200   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,203   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,205   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,208   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,210   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,213   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,216   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,219   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,221   copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,223   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,226   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_management.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,228   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,231   copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_other.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,233   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,235   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,238   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_education.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,240   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,243   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_law.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,246   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,249   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,252   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,254   copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,256   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,259   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,261   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,264   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,266   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,268   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,271   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,274   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,277   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,279   copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,281   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,284   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,286   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,289   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,291   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,294   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,297   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,299   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_health.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,302   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,305   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,307   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,310   copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,312   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_math.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,315   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,317   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:27:57,320   creating build/lib/lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:27:57,322   copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:27:57,324   copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:27:57,326   copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:27:57,328   copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:27:57,331   copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:27:57,333   copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:27:57,335   copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2024.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:27:57,337   copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:27:57,339   copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:27:57,341   copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:27:57,343   copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:27:57,345   copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:27:57,347   copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:27:57,349   creating build/lib/lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:27:57,350   copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:27:57,352   copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:27:57,354   copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2025.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:27:57,357   copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:27:57,359   copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:27:57,361   copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2024.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:27:57,363   copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:27:57,365   copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:27:57,367   copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:27:57,369   copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:27:57,371   copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:27:57,373   copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:27:57,376   copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:27:57,378   copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:27:57,380   creating build/lib/lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:27:57,381   copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:27:57,383   copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2024.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:27:57,385   copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:27:57,387   copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:27:57,389   copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:27:57,391   copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:27:57,393   copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:27:57,395   copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:27:57,397   copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:27:57,399   copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:27:57,402   copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:27:57,404   copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:27:57,406   copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:27:57,408   creating build/lib/lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:27:57,409   copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2010.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:27:57,412   copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:27:57,414   copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2011.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:27:57,416   copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:27:57,418   copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:27:57,420   copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:27:57,422   copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:27:57,424   copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:27:57,426   copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:27:57,428   copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:27:57,431   copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:27:57,433   copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:27:57,435   copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:27:57,437   copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:27:57,439   creating build/lib/lm_eval/tasks/kbl/knowledge
2025-08-31T08:27:57,440   copying lm_eval/tasks/kbl/knowledge/kbl_query_statute_matching_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge
2025-08-31T08:27:57,442   copying lm_eval/tasks/kbl/knowledge/kbl_offense_component_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge
2025-08-31T08:27:57,445   copying lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_reasoning_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge
2025-08-31T08:27:57,447   copying lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge
2025-08-31T08:27:57,449   copying lm_eval/tasks/kbl/knowledge/kbl_statute_number_and_content_matching_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge
2025-08-31T08:27:57,451   copying lm_eval/tasks/kbl/knowledge/kbl_statute_hallucination_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge
2025-08-31T08:27:57,452   copying lm_eval/tasks/kbl/knowledge/kbl_legal_concept_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge
2025-08-31T08:27:57,454   creating build/lib/lm_eval/tasks/kbl/reasoning
2025-08-31T08:27:57,455   copying lm_eval/tasks/kbl/reasoning/kbl_statement_consistency_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning
2025-08-31T08:27:57,457   copying lm_eval/tasks/kbl/reasoning/kbl_causal_reasoning_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning
2025-08-31T08:27:57,459   copying lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_q_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning
2025-08-31T08:27:57,462   copying lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_p_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning
2025-08-31T08:27:57,464   copying lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias.yaml -> build/lib/lm_eval/tasks/simple_cooccurrence_bias
2025-08-31T08:27:57,466   copying lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias_gen.yaml -> build/lib/lm_eval/tasks/simple_cooccurrence_bias
2025-08-31T08:27:57,468   creating build/lib/lm_eval/tasks/mela
2025-08-31T08:27:57,469   copying lm_eval/tasks/mela/mela_ar.yaml -> build/lib/lm_eval/tasks/mela
2025-08-31T08:27:57,471   copying lm_eval/tasks/mela/mela_zh.yaml -> build/lib/lm_eval/tasks/mela
2025-08-31T08:27:57,473   copying lm_eval/tasks/mela/mela_is.yaml -> build/lib/lm_eval/tasks/mela
2025-08-31T08:27:57,475   copying lm_eval/tasks/mela/mela_it.yaml -> build/lib/lm_eval/tasks/mela
2025-08-31T08:27:57,477   copying lm_eval/tasks/mela/mela_en.yaml -> build/lib/lm_eval/tasks/mela
2025-08-31T08:27:57,479   copying lm_eval/tasks/mela/mela_ru.yaml -> build/lib/lm_eval/tasks/mela
2025-08-31T08:27:57,481   copying lm_eval/tasks/mela/mela_de.yaml -> build/lib/lm_eval/tasks/mela
2025-08-31T08:27:57,483   copying lm_eval/tasks/mela/_mela.yaml -> build/lib/lm_eval/tasks/mela
2025-08-31T08:27:57,485   copying lm_eval/tasks/mela/mela_ja.yaml -> build/lib/lm_eval/tasks/mela
2025-08-31T08:27:57,488   copying lm_eval/tasks/mela/mela_fr.yaml -> build/lib/lm_eval/tasks/mela
2025-08-31T08:27:57,490   copying lm_eval/tasks/mela/mela_es.yaml -> build/lib/lm_eval/tasks/mela
2025-08-31T08:27:57,492   creating build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,493   copying lm_eval/tasks/bigbench/generate_until/presuppositions_as_nli.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,495   copying lm_eval/tasks/bigbench/generate_until/topical_chat.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,497   copying lm_eval/tasks/bigbench/generate_until/swedish_to_german_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,499   copying lm_eval/tasks/bigbench/generate_until/analytic_entailment.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,502   copying lm_eval/tasks/bigbench/generate_until/abstract_narrative_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,504   copying lm_eval/tasks/bigbench/generate_until/logical_args.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,506   copying lm_eval/tasks/bigbench/generate_until/gre_reading_comprehension.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,508   copying lm_eval/tasks/bigbench/generate_until/identify_math_theorems.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,510   copying lm_eval/tasks/bigbench/generate_until/polish_sequence_labeling.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,512   copying lm_eval/tasks/bigbench/generate_until/human_organs_senses.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,514   copying lm_eval/tasks/bigbench/generate_until/contextual_parametric_knowledge_conflicts.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,516   copying lm_eval/tasks/bigbench/generate_until/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,518   copying lm_eval/tasks/bigbench/generate_until/modified_arithmetic.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,520   copying lm_eval/tasks/bigbench/generate_until/simple_text_editing.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,522   copying lm_eval/tasks/bigbench/generate_until/similarities_abstraction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,525   copying lm_eval/tasks/bigbench/generate_until/ruin_names.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,527   copying lm_eval/tasks/bigbench/generate_until/hindu_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,528   copying lm_eval/tasks/bigbench/generate_until/dark_humor_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,530   copying lm_eval/tasks/bigbench/generate_until/common_morpheme.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,532   copying lm_eval/tasks/bigbench/generate_until/crash_blossom.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,534   copying lm_eval/tasks/bigbench/generate_until/logical_sequence.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,537   copying lm_eval/tasks/bigbench/generate_until/implicatures.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,539   copying lm_eval/tasks/bigbench/generate_until/list_functions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,541   copying lm_eval/tasks/bigbench/generate_until/semantic_parsing_in_context_sparc.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,543   copying lm_eval/tasks/bigbench/generate_until/authorship_verification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,545   copying lm_eval/tasks/bigbench/generate_until/intent_recognition.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,547   copying lm_eval/tasks/bigbench/generate_until/empirical_judgments.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,549   copying lm_eval/tasks/bigbench/generate_until/chinese_remainder_theorem.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,551   copying lm_eval/tasks/bigbench/generate_until/language_identification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,553   copying lm_eval/tasks/bigbench/generate_until/checkmate_in_one.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,556   copying lm_eval/tasks/bigbench/generate_until/disfl_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,558   copying lm_eval/tasks/bigbench/generate_until/auto_categorization.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,560   copying lm_eval/tasks/bigbench/generate_until/crass_ai.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,562   copying lm_eval/tasks/bigbench/generate_until/key_value_maps.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,564   copying lm_eval/tasks/bigbench/generate_until/hyperbaton.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,566   copying lm_eval/tasks/bigbench/generate_until/riddle_sense.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,568   copying lm_eval/tasks/bigbench/generate_until/fact_checker.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,570   copying lm_eval/tasks/bigbench/generate_until/word_sorting.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,572   copying lm_eval/tasks/bigbench/generate_until/navigate.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,574   copying lm_eval/tasks/bigbench/generate_until/english_russian_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,576   copying lm_eval/tasks/bigbench/generate_until/cryptonite.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,578   copying lm_eval/tasks/bigbench/generate_until/sentence_ambiguity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,580   copying lm_eval/tasks/bigbench/generate_until/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,582   copying lm_eval/tasks/bigbench/generate_until/what_is_the_tao.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,585   copying lm_eval/tasks/bigbench/generate_until/unnatural_in_context_learning.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,587   copying lm_eval/tasks/bigbench/generate_until/bbq_lite_json.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,588   copying lm_eval/tasks/bigbench/generate_until/real_or_fake_text.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,591   copying lm_eval/tasks/bigbench/generate_until/winowhy.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,593   copying lm_eval/tasks/bigbench/generate_until/formal_fallacies_syllogisms_negation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,595   copying lm_eval/tasks/bigbench/generate_until/hhh_alignment.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,597   copying lm_eval/tasks/bigbench/generate_until/emoji_movie.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,599   copying lm_eval/tasks/bigbench/generate_until/auto_debugging.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,601   copying lm_eval/tasks/bigbench/generate_until/logical_fallacy_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,603   copying lm_eval/tasks/bigbench/generate_until/which_wiki_edit.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,605   copying lm_eval/tasks/bigbench/generate_until/emojis_emotion_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,608   copying lm_eval/tasks/bigbench/generate_until/conceptual_combinations.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,610   copying lm_eval/tasks/bigbench/generate_until/conlang_translation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,612   copying lm_eval/tasks/bigbench/generate_until/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,614   copying lm_eval/tasks/bigbench/generate_until/movie_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,616   copying lm_eval/tasks/bigbench/generate_until/natural_instructions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,618   copying lm_eval/tasks/bigbench/generate_until/causal_judgment.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,620   copying lm_eval/tasks/bigbench/generate_until/arithmetic.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,622   copying lm_eval/tasks/bigbench/generate_until/tracking_shuffled_objects.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,624   copying lm_eval/tasks/bigbench/generate_until/moral_permissibility.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,626   copying lm_eval/tasks/bigbench/generate_until/misconceptions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,629   copying lm_eval/tasks/bigbench/generate_until/entailed_polarity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,631   copying lm_eval/tasks/bigbench/generate_until/snarks.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,633   copying lm_eval/tasks/bigbench/generate_until/hindi_question_answering.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,635   copying lm_eval/tasks/bigbench/generate_until/metaphor_boolean.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,637   copying lm_eval/tasks/bigbench/generate_until/social_support.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,639   copying lm_eval/tasks/bigbench/generate_until/english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,641   copying lm_eval/tasks/bigbench/generate_until/kannada.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,644   copying lm_eval/tasks/bigbench/generate_until/codenames.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,646   copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,648   copying lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_transliterate.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,650   copying lm_eval/tasks/bigbench/generate_until/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,652   copying lm_eval/tasks/bigbench/generate_until/cifar10_classification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,654   copying lm_eval/tasks/bigbench/generate_until/parsinlu_reading_comprehension.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,657   copying lm_eval/tasks/bigbench/generate_until/misconceptions_russian.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,659   copying lm_eval/tasks/bigbench/generate_until/discourse_marker_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,661   copying lm_eval/tasks/bigbench/generate_until/rephrase.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,663   copying lm_eval/tasks/bigbench/generate_until/identify_odd_metaphor.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,665   copying lm_eval/tasks/bigbench/generate_until/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,667   copying lm_eval/tasks/bigbench/generate_until/mnist_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,669   copying lm_eval/tasks/bigbench/generate_until/nonsense_words_grammar.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,671   copying lm_eval/tasks/bigbench/generate_until/date_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,673   copying lm_eval/tasks/bigbench/generate_until/multiemo.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,675   copying lm_eval/tasks/bigbench/generate_until/fantasy_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,677   copying lm_eval/tasks/bigbench/generate_until/simple_ethical_questions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,679   copying lm_eval/tasks/bigbench/generate_until/linguistics_puzzles.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,681   copying lm_eval/tasks/bigbench/generate_until/persian_idioms.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,683   copying lm_eval/tasks/bigbench/generate_until/bridging_anaphora_resolution_barqa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,685   copying lm_eval/tasks/bigbench/generate_until/elementary_math_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,687   copying lm_eval/tasks/bigbench/generate_until/strange_stories.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,689   copying lm_eval/tasks/bigbench/generate_until/kanji_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,691   copying lm_eval/tasks/bigbench/generate_until/object_counting.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,693   copying lm_eval/tasks/bigbench/generate_until/repeat_copy_logic.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,695   copying lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_nli.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,697   copying lm_eval/tasks/bigbench/generate_until/novel_concepts.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,699   copying lm_eval/tasks/bigbench/generate_until/epistemic_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,701   copying lm_eval/tasks/bigbench/generate_until/strategyqa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,703   copying lm_eval/tasks/bigbench/generate_until/cause_and_effect.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,705   copying lm_eval/tasks/bigbench/generate_until/social_iqa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,707   copying lm_eval/tasks/bigbench/generate_until/known_unknowns.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,709   copying lm_eval/tasks/bigbench/generate_until/understanding_fables.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,711   copying lm_eval/tasks/bigbench/generate_until/minute_mysteries_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,713   copying lm_eval/tasks/bigbench/generate_until/mathematical_induction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,715   copying lm_eval/tasks/bigbench/generate_until/evaluating_information_essentiality.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,718   copying lm_eval/tasks/bigbench/generate_until/sufficient_information.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,720   copying lm_eval/tasks/bigbench/generate_until/gem.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,722   copying lm_eval/tasks/bigbench/generate_until/vitaminc_fact_verification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,724   copying lm_eval/tasks/bigbench/generate_until/periodic_elements.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,726   copying lm_eval/tasks/bigbench/generate_until/undo_permutation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,728   copying lm_eval/tasks/bigbench/generate_until/linguistic_mappings.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,731   copying lm_eval/tasks/bigbench/generate_until/dyck_languages.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,733   copying lm_eval/tasks/bigbench/generate_until/cryobiology_spanish.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,735   copying lm_eval/tasks/bigbench/generate_until/timedial.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,737   copying lm_eval/tasks/bigbench/generate_until/physics.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,739   copying lm_eval/tasks/bigbench/generate_until/matrixshapes.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,741   copying lm_eval/tasks/bigbench/generate_until/hinglish_toxicity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,743   copying lm_eval/tasks/bigbench/generate_until/cs_algorithms.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,745   copying lm_eval/tasks/bigbench/generate_until/color.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,747   copying lm_eval/tasks/bigbench/generate_until/language_games.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,749   copying lm_eval/tasks/bigbench/generate_until/sports_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,751   copying lm_eval/tasks/bigbench/generate_until/play_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,753   copying lm_eval/tasks/bigbench/generate_until/physical_intuition.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,755   copying lm_eval/tasks/bigbench/generate_until/gender_inclusive_sentences_german.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,757   copying lm_eval/tasks/bigbench/generate_until/figure_of_speech_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,759   copying lm_eval/tasks/bigbench/generate_until/anachronisms.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,761   copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_multiple_targets_json.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,763   copying lm_eval/tasks/bigbench/generate_until/logic_grid_puzzle.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,765   copying lm_eval/tasks/bigbench/generate_until/parsinlu_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,767   copying lm_eval/tasks/bigbench/generate_until/general_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,769   copying lm_eval/tasks/bigbench/generate_until/intersect_geometry.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,771   copying lm_eval/tasks/bigbench/generate_until/code_line_description.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,773   copying lm_eval/tasks/bigbench/generate_until/unit_conversion.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,775   copying lm_eval/tasks/bigbench/generate_until/operators.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,777   copying lm_eval/tasks/bigbench/generate_until/physics_questions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,779   copying lm_eval/tasks/bigbench/generate_until/phrase_relatedness.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,781   copying lm_eval/tasks/bigbench/generate_until/chess_state_tracking.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,783   copying lm_eval/tasks/bigbench/generate_until/odd_one_out.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,785   copying lm_eval/tasks/bigbench/generate_until/question_selection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,787   copying lm_eval/tasks/bigbench/generate_until/paragraph_segmentation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,789   copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_subtasks.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,791   copying lm_eval/tasks/bigbench/generate_until/qa_wikidata.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,793   copying lm_eval/tasks/bigbench/generate_until/implicit_relations.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,796   copying lm_eval/tasks/bigbench/generate_until/metaphor_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,798   copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_multiple_choice.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,800   copying lm_eval/tasks/bigbench/generate_until/analogical_similarity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,801   copying lm_eval/tasks/bigbench/generate_until/suicide_risk.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,803   copying lm_eval/tasks/bigbench/generate_until/irony_identification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,805   copying lm_eval/tasks/bigbench/generate_until/goal_step_wikihow.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,807   copying lm_eval/tasks/bigbench/generate_until/symbol_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,809   copying lm_eval/tasks/bigbench/generate_until/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,811   copying lm_eval/tasks/bigbench/generate_until/entailed_polarity_hindi.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,813   copying lm_eval/tasks/bigbench/generate_until/scientific_press_release.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,815   copying lm_eval/tasks/bigbench/generate_until/unit_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,817   copying lm_eval/tasks/bigbench/generate_until/ascii_word_recognition.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,819   copying lm_eval/tasks/bigbench/generate_until/simp_turing_concept.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,821   copying lm_eval/tasks/bigbench/generate_until/few_shot_nlg.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,823   copying lm_eval/tasks/bigbench/generate_until/semantic_parsing_spider.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,825   copying lm_eval/tasks/bigbench/generate_until/word_unscrambling.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,827   copying lm_eval/tasks/bigbench/generate_until/swahili_english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,829   copying lm_eval/tasks/bigbench/generate_until/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,831   copying lm_eval/tasks/bigbench/generate_until/tense.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,833   copying lm_eval/tasks/bigbench/generate_until/mult_data_wrangling.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,835   copying lm_eval/tasks/bigbench/generate_until/logical_deduction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:27:57,837   creating build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,838   copying lm_eval/tasks/bigbench/multiple_choice/presuppositions_as_nli.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,840   copying lm_eval/tasks/bigbench/multiple_choice/swedish_to_german_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,843   copying lm_eval/tasks/bigbench/multiple_choice/analytic_entailment.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,845   copying lm_eval/tasks/bigbench/multiple_choice/abstract_narrative_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,847   copying lm_eval/tasks/bigbench/multiple_choice/logical_args.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,849   copying lm_eval/tasks/bigbench/multiple_choice/gre_reading_comprehension.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,851   copying lm_eval/tasks/bigbench/multiple_choice/identify_math_theorems.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,853   copying lm_eval/tasks/bigbench/multiple_choice/human_organs_senses.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,855   copying lm_eval/tasks/bigbench/multiple_choice/contextual_parametric_knowledge_conflicts.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,857   copying lm_eval/tasks/bigbench/multiple_choice/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,859   copying lm_eval/tasks/bigbench/multiple_choice/similarities_abstraction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,861   copying lm_eval/tasks/bigbench/multiple_choice/ruin_names.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,863   copying lm_eval/tasks/bigbench/multiple_choice/hindu_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,865   copying lm_eval/tasks/bigbench/multiple_choice/dark_humor_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,867   copying lm_eval/tasks/bigbench/multiple_choice/common_morpheme.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,869   copying lm_eval/tasks/bigbench/multiple_choice/crash_blossom.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,871   copying lm_eval/tasks/bigbench/multiple_choice/logical_sequence.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,873   copying lm_eval/tasks/bigbench/multiple_choice/implicatures.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,875   copying lm_eval/tasks/bigbench/multiple_choice/authorship_verification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,877   copying lm_eval/tasks/bigbench/multiple_choice/intent_recognition.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,879   copying lm_eval/tasks/bigbench/multiple_choice/empirical_judgments.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,881   copying lm_eval/tasks/bigbench/multiple_choice/language_identification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,884   copying lm_eval/tasks/bigbench/multiple_choice/checkmate_in_one.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,886   copying lm_eval/tasks/bigbench/multiple_choice/crass_ai.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,888   copying lm_eval/tasks/bigbench/multiple_choice/key_value_maps.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,890   copying lm_eval/tasks/bigbench/multiple_choice/hyperbaton.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,892   copying lm_eval/tasks/bigbench/multiple_choice/riddle_sense.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,894   copying lm_eval/tasks/bigbench/multiple_choice/fact_checker.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,896   copying lm_eval/tasks/bigbench/multiple_choice/navigate.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,898   copying lm_eval/tasks/bigbench/multiple_choice/english_russian_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,900   copying lm_eval/tasks/bigbench/multiple_choice/sentence_ambiguity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,902   copying lm_eval/tasks/bigbench/multiple_choice/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,904   copying lm_eval/tasks/bigbench/multiple_choice/what_is_the_tao.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,906   copying lm_eval/tasks/bigbench/multiple_choice/bbq_lite_json.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,908   copying lm_eval/tasks/bigbench/multiple_choice/real_or_fake_text.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,911   copying lm_eval/tasks/bigbench/multiple_choice/winowhy.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,912   copying lm_eval/tasks/bigbench/multiple_choice/formal_fallacies_syllogisms_negation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,914   copying lm_eval/tasks/bigbench/multiple_choice/hhh_alignment.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,916   copying lm_eval/tasks/bigbench/multiple_choice/emoji_movie.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,918   copying lm_eval/tasks/bigbench/multiple_choice/logical_fallacy_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,920   copying lm_eval/tasks/bigbench/multiple_choice/which_wiki_edit.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,922   copying lm_eval/tasks/bigbench/multiple_choice/emojis_emotion_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,924   copying lm_eval/tasks/bigbench/multiple_choice/conceptual_combinations.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,926   copying lm_eval/tasks/bigbench/multiple_choice/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,928   copying lm_eval/tasks/bigbench/multiple_choice/movie_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,930   copying lm_eval/tasks/bigbench/multiple_choice/causal_judgment.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,932   copying lm_eval/tasks/bigbench/multiple_choice/arithmetic.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,934   copying lm_eval/tasks/bigbench/multiple_choice/tracking_shuffled_objects.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,936   copying lm_eval/tasks/bigbench/multiple_choice/moral_permissibility.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,938   copying lm_eval/tasks/bigbench/multiple_choice/misconceptions.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,940   copying lm_eval/tasks/bigbench/multiple_choice/entailed_polarity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,942   copying lm_eval/tasks/bigbench/multiple_choice/snarks.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,944   copying lm_eval/tasks/bigbench/multiple_choice/metaphor_boolean.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,947   copying lm_eval/tasks/bigbench/multiple_choice/social_support.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,949   copying lm_eval/tasks/bigbench/multiple_choice/english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,951   copying lm_eval/tasks/bigbench/multiple_choice/kannada.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,953   copying lm_eval/tasks/bigbench/multiple_choice/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,955   copying lm_eval/tasks/bigbench/multiple_choice/cifar10_classification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,957   copying lm_eval/tasks/bigbench/multiple_choice/misconceptions_russian.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,959   copying lm_eval/tasks/bigbench/multiple_choice/discourse_marker_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,961   copying lm_eval/tasks/bigbench/multiple_choice/identify_odd_metaphor.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,963   copying lm_eval/tasks/bigbench/multiple_choice/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,965   copying lm_eval/tasks/bigbench/multiple_choice/mnist_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,967   copying lm_eval/tasks/bigbench/multiple_choice/nonsense_words_grammar.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,969   copying lm_eval/tasks/bigbench/multiple_choice/date_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,971   copying lm_eval/tasks/bigbench/multiple_choice/multiemo.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,973   copying lm_eval/tasks/bigbench/multiple_choice/fantasy_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,975   copying lm_eval/tasks/bigbench/multiple_choice/simple_ethical_questions.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,977   copying lm_eval/tasks/bigbench/multiple_choice/persian_idioms.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,979   copying lm_eval/tasks/bigbench/multiple_choice/elementary_math_qa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,981   copying lm_eval/tasks/bigbench/multiple_choice/strange_stories.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,983   copying lm_eval/tasks/bigbench/multiple_choice/kanji_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,985   copying lm_eval/tasks/bigbench/multiple_choice/international_phonetic_alphabet_nli.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,987   copying lm_eval/tasks/bigbench/multiple_choice/novel_concepts.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,989   copying lm_eval/tasks/bigbench/multiple_choice/epistemic_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,991   copying lm_eval/tasks/bigbench/multiple_choice/strategyqa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,993   copying lm_eval/tasks/bigbench/multiple_choice/cause_and_effect.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,995   copying lm_eval/tasks/bigbench/multiple_choice/social_iqa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,997   copying lm_eval/tasks/bigbench/multiple_choice/known_unknowns.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:57,999   copying lm_eval/tasks/bigbench/multiple_choice/understanding_fables.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,001   copying lm_eval/tasks/bigbench/multiple_choice/mathematical_induction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,003   copying lm_eval/tasks/bigbench/multiple_choice/evaluating_information_essentiality.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,005   copying lm_eval/tasks/bigbench/multiple_choice/vitaminc_fact_verification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,007   copying lm_eval/tasks/bigbench/multiple_choice/periodic_elements.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,009   copying lm_eval/tasks/bigbench/multiple_choice/undo_permutation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,011   copying lm_eval/tasks/bigbench/multiple_choice/dyck_languages.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,013   copying lm_eval/tasks/bigbench/multiple_choice/cryobiology_spanish.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,016   copying lm_eval/tasks/bigbench/multiple_choice/timedial.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,018   copying lm_eval/tasks/bigbench/multiple_choice/physics.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,020   copying lm_eval/tasks/bigbench/multiple_choice/hinglish_toxicity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,022   copying lm_eval/tasks/bigbench/multiple_choice/cs_algorithms.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,024   copying lm_eval/tasks/bigbench/multiple_choice/color.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,026   copying lm_eval/tasks/bigbench/multiple_choice/sports_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,028   copying lm_eval/tasks/bigbench/multiple_choice/play_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,030   copying lm_eval/tasks/bigbench/multiple_choice/physical_intuition.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,032   copying lm_eval/tasks/bigbench/multiple_choice/figure_of_speech_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,034   copying lm_eval/tasks/bigbench/multiple_choice/anachronisms.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,036   copying lm_eval/tasks/bigbench/multiple_choice/logic_grid_puzzle.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,038   copying lm_eval/tasks/bigbench/multiple_choice/parsinlu_qa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,040   copying lm_eval/tasks/bigbench/multiple_choice/general_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,042   copying lm_eval/tasks/bigbench/multiple_choice/intersect_geometry.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,044   copying lm_eval/tasks/bigbench/multiple_choice/code_line_description.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,046   copying lm_eval/tasks/bigbench/multiple_choice/unit_conversion.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,048   copying lm_eval/tasks/bigbench/multiple_choice/phrase_relatedness.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,050   copying lm_eval/tasks/bigbench/multiple_choice/odd_one_out.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,052   copying lm_eval/tasks/bigbench/multiple_choice/question_selection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,054   copying lm_eval/tasks/bigbench/multiple_choice/implicit_relations.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,056   copying lm_eval/tasks/bigbench/multiple_choice/metaphor_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,058   copying lm_eval/tasks/bigbench/multiple_choice/analogical_similarity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,060   copying lm_eval/tasks/bigbench/multiple_choice/suicide_risk.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,062   copying lm_eval/tasks/bigbench/multiple_choice/irony_identification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,064   copying lm_eval/tasks/bigbench/multiple_choice/goal_step_wikihow.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,066   copying lm_eval/tasks/bigbench/multiple_choice/symbol_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,069   copying lm_eval/tasks/bigbench/multiple_choice/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,071   copying lm_eval/tasks/bigbench/multiple_choice/entailed_polarity_hindi.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,073   copying lm_eval/tasks/bigbench/multiple_choice/unit_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,075   copying lm_eval/tasks/bigbench/multiple_choice/swahili_english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,077   copying lm_eval/tasks/bigbench/multiple_choice/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,079   copying lm_eval/tasks/bigbench/multiple_choice/logical_deduction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:27:58,081   creating build/lib/lm_eval/tasks/asdiv
2025-08-31T08:27:58,081   copying lm_eval/tasks/asdiv/asdiv-cot-llama.yaml -> build/lib/lm_eval/tasks/asdiv
2025-08-31T08:27:58,083   copying lm_eval/tasks/asdiv/default.yaml -> build/lib/lm_eval/tasks/asdiv
2025-08-31T08:27:58,086   copying lm_eval/tasks/crows_pairs/crows_pairs_english_disability.yaml -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:58,088   copying lm_eval/tasks/crows_pairs/crows_pairs_english_sexual_orientation.yaml -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:58,090   copying lm_eval/tasks/crows_pairs/crows_pairs_english_race_color.yaml -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:58,092   copying lm_eval/tasks/crows_pairs/crows_pairs_french_nationality.yaml -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:58,094   copying lm_eval/tasks/crows_pairs/crows_pairs_english_physical_appearance.yaml -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:58,096   copying lm_eval/tasks/crows_pairs/crows_pairs_french.yaml -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:58,097   copying lm_eval/tasks/crows_pairs/crows_pairs_english_gender.yaml -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:58,099   copying lm_eval/tasks/crows_pairs/crows_pairs_english_autre.yaml -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:58,101   copying lm_eval/tasks/crows_pairs/crows_pairs_english_age.yaml -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:58,103   copying lm_eval/tasks/crows_pairs/crows_pairs_french_age.yaml -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:58,105   copying lm_eval/tasks/crows_pairs/crows_pairs_english_nationality.yaml -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:58,107   copying lm_eval/tasks/crows_pairs/crows_pairs_french_sexual_orientation.yaml -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:58,109   copying lm_eval/tasks/crows_pairs/crows_pairs_french_physical_appearance.yaml -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:58,111   copying lm_eval/tasks/crows_pairs/crows_pairs_english.yaml -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:58,113   copying lm_eval/tasks/crows_pairs/crows_pairs_french_gender.yaml -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:58,116   copying lm_eval/tasks/crows_pairs/crows_pairs_english_socioeconomic.yaml -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:58,118   copying lm_eval/tasks/crows_pairs/crows_pairs_french_socioeconomic.yaml -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:58,120   copying lm_eval/tasks/crows_pairs/crows_pairs_french_disability.yaml -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:58,122   copying lm_eval/tasks/crows_pairs/crows_pairs_english_religion.yaml -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:58,124   copying lm_eval/tasks/crows_pairs/crows_pairs_french_religion.yaml -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:58,126   copying lm_eval/tasks/crows_pairs/crows_pairs_french_race_color.yaml -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:58,128   copying lm_eval/tasks/crows_pairs/crows_pairs_french_autre.yaml -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:27:58,131   copying lm_eval/tasks/groundcocoa/groundcocoa.yaml -> build/lib/lm_eval/tasks/groundcocoa
2025-08-31T08:27:58,132   copying lm_eval/tasks/mmlu_pro/mmlu_pro_health.yaml -> build/lib/lm_eval/tasks/mmlu_pro
2025-08-31T08:27:58,135   copying lm_eval/tasks/mmlu_pro/mmlu_pro_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_pro
2025-08-31T08:27:58,137   copying lm_eval/tasks/mmlu_pro/mmlu_pro_business.yaml -> build/lib/lm_eval/tasks/mmlu_pro
2025-08-31T08:27:58,139   copying lm_eval/tasks/mmlu_pro/mmlu_pro_math.yaml -> build/lib/lm_eval/tasks/mmlu_pro
2025-08-31T08:27:58,141   copying lm_eval/tasks/mmlu_pro/mmlu_pro_other.yaml -> build/lib/lm_eval/tasks/mmlu_pro
2025-08-31T08:27:58,143   copying lm_eval/tasks/mmlu_pro/mmlu_pro_biology.yaml -> build/lib/lm_eval/tasks/mmlu_pro
2025-08-31T08:27:58,145   copying lm_eval/tasks/mmlu_pro/mmlu_pro_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_pro
2025-08-31T08:27:58,147   copying lm_eval/tasks/mmlu_pro/mmlu_pro_economics.yaml -> build/lib/lm_eval/tasks/mmlu_pro
2025-08-31T08:27:58,149   copying lm_eval/tasks/mmlu_pro/mmlu_pro_history.yaml -> build/lib/lm_eval/tasks/mmlu_pro
2025-08-31T08:27:58,151   copying lm_eval/tasks/mmlu_pro/mmlu_pro_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_pro
2025-08-31T08:27:58,153   copying lm_eval/tasks/mmlu_pro/mmlu_pro_law.yaml -> build/lib/lm_eval/tasks/mmlu_pro
2025-08-31T08:27:58,155   copying lm_eval/tasks/mmlu_pro/mmlu_pro_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_pro
2025-08-31T08:27:58,157   copying lm_eval/tasks/mmlu_pro/_mmlu_pro.yaml -> build/lib/lm_eval/tasks/mmlu_pro
2025-08-31T08:27:58,159   copying lm_eval/tasks/mmlu_pro/mmlu_pro_physics.yaml -> build/lib/lm_eval/tasks/mmlu_pro
2025-08-31T08:27:58,161   copying lm_eval/tasks/mmlu_pro/mmlu_pro_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_pro
2025-08-31T08:27:58,163   copying lm_eval/tasks/wmt2016/ro_en-t5_prompt.yaml -> build/lib/lm_eval/tasks/wmt2016
2025-08-31T08:27:58,165   creating build/lib/lm_eval/tasks/gsm8k_platinum
2025-08-31T08:27:58,166   copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-zeroshot.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum
2025-08-31T08:27:58,168   copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-self-consistency.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum
2025-08-31T08:27:58,170   copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum
2025-08-31T08:27:58,173   copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-llama.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum
2025-08-31T08:27:58,175   copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum
2025-08-31T08:27:58,177   copying lm_eval/tasks/mmmu/mmmu_computer_science.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,179   copying lm_eval/tasks/mmmu/mmmu_psychology.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,182   copying lm_eval/tasks/mmmu/mmmu_history.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,184   copying lm_eval/tasks/mmmu/mmmu_electronics.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,186   copying lm_eval/tasks/mmmu/mmmu_clinical_medicine.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,188   copying lm_eval/tasks/mmmu/mmmu_art.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,190   copying lm_eval/tasks/mmmu/mmmu_pharmacy.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,192   copying lm_eval/tasks/mmmu/mmmu_chemistry.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,194   copying lm_eval/tasks/mmmu/mmmu_finance.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,197   copying lm_eval/tasks/mmmu/mmmu_economics.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,199   copying lm_eval/tasks/mmmu/_art_and_design.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,201   copying lm_eval/tasks/mmmu/mmmu_public_health.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,203   copying lm_eval/tasks/mmmu/_business.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,205   copying lm_eval/tasks/mmmu/mmmu_diagnostics_and_laboratory_medicine.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,207   copying lm_eval/tasks/mmmu/mmmu_literature.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,209   copying lm_eval/tasks/mmmu/mmmu_design.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,212   copying lm_eval/tasks/mmmu/mmmu_art_theory.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,214   copying lm_eval/tasks/mmmu/mmmu_materials.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,216   copying lm_eval/tasks/mmmu/mmmu_manage.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,218   copying lm_eval/tasks/mmmu/mmmu_geography.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,220   copying lm_eval/tasks/mmmu/mmmu_music.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,222   copying lm_eval/tasks/mmmu/_health_and_medicine.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,224   copying lm_eval/tasks/mmmu/mmmu_agriculture.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,226   copying lm_eval/tasks/mmmu/mmmu_energy_and_power.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,228   copying lm_eval/tasks/mmmu/mmmu_architecture_and_engineering.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,230   copying lm_eval/tasks/mmmu/_humanities_and_social_sciences.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,232   copying lm_eval/tasks/mmmu/mmmu_basic_medical_science.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,234   copying lm_eval/tasks/mmmu/_science.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,236   copying lm_eval/tasks/mmmu/mmmu_accounting.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,238   copying lm_eval/tasks/mmmu/mmmu_biology.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,240   copying lm_eval/tasks/mmmu/mmmu_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,242   copying lm_eval/tasks/mmmu/mmmu_sociology.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,244   copying lm_eval/tasks/mmmu/mmmu_marketing.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,246   copying lm_eval/tasks/mmmu/mmmu_math.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,248   copying lm_eval/tasks/mmmu/_tech_and_engineering.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,250   copying lm_eval/tasks/mmmu/mmmu_physics.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,252   copying lm_eval/tasks/mmmu/_mmmu.yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:27:58,254   copying lm_eval/tasks/medqa/medqa.yaml -> build/lib/lm_eval/tasks/medqa
2025-08-31T08:27:58,256   creating build/lib/lm_eval/tasks/sciq
2025-08-31T08:27:58,257   copying lm_eval/tasks/sciq/sciq.yaml -> build/lib/lm_eval/tasks/sciq
2025-08-31T08:27:58,260   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,262   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,264   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,266   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,268   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,270   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,273   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,275   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,277   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,279   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,281   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,283   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,285   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,287   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,289   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,291   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,293   copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,295   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,298   copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,300   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,302   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,304   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,306   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,308   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,310   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,312   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,314   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,316   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,318   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,320   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,323   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,325   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,327   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,329   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,331   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,333   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,336   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,338   copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,340   copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,342   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,344   copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,346   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,347   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,349   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,351   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,353   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,356   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,358   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,360   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,362   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,364   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,366   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,369   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,371   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,373   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,375   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,377   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,379   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,381   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,384   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,386   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,389   copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:27:58,391   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,393   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,395   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,397   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,399   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,401   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,403   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,405   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,407   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,409   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,411   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,413   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,415   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,418   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,420   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,422   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,424   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,426   copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,428   copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,430   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,432   copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,434   copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,437   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,439   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,441   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,443   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,446   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,448   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,450   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,452   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,454   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,456   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,458   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,460   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,462   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,464   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,466   copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,468   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,470   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,472   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,474   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,477   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,479   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,481   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,483   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,485   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,487   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,489   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,491   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,493   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,495   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,497   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,499   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,502   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,504   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,507   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,509   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,511   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,513   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,515   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,517   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,519   copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:27:58,521   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,523   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,525   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,527   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,529   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,531   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,533   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,535   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,537   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,539   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,542   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,544   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,546   copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,548   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,550   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,552   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,554   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,556   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,559   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,561   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,563   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,565   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,567   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,568   copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,571   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,572   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,575   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,577   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,579   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,581   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,583   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,585   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,587   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,589   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,591   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,593   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,595   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,597   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,599   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,601   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,603   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,605   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,608   copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,610   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,612   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,614   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,616   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,618   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,620   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,622   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,624   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,626   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,628   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,630   copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,632   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,634   copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,636   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,638   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,640   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,642   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,644   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,646   copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:27:58,648   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,650   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,652   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,654   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,656   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,658   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,660   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,662   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,664   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,666   copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,668   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,670   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,673   copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,675   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,677   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,679   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,681   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,683   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,685   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,687   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,689   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,691   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,693   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,695   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,697   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,699   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,702   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,704   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,706   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,708   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,710   copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,712   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,714   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,716   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,718   copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,720   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,722   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,724   copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,726   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,728   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,730   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,732   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,735   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,737   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,739   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,741   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,743   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,745   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,747   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,749   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,751   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,753   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,755   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,757   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,759   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,761   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,763   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,766   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,768   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,770   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,772   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,774   copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:27:58,776   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,778   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,780   copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,782   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,784   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,786   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,789   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,791   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,793   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,795   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,797   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,799   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,801   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,804   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,806   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,808   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,810   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,812   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,814   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,816   copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,818   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,820   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,822   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,824   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,827   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,829   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,831   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,833   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,835   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,836   copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,838   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,840   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,843   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,844   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,847   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,849   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,851   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,853   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,855   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,857   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,859   copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,861   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,863   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,866   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,869   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,871   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,873   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,875   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,877   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,880   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,882   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,884   copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,886   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,888   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,890   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,892   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,894   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,896   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,898   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,900   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,903   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,905   copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:27:58,907   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,909   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,912   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,914   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,916   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,918   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,920   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,922   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,924   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,926   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,928   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,930   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,933   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,935   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,937   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,939   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,941   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,944   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,945   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,947   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,949   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,951   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,953   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,955   copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,957   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,959   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,962   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,964   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,966   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,968   copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,970   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,972   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,974   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,976   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,978   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,980   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,982   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,984   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,987   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,989   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,991   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,994   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,996   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:58,998   copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:59,000   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:59,002   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:59,004   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:59,006   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:59,008   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:59,010   copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:59,013   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:59,015   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:59,017   copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:59,020   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:59,022   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:59,024   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:59,026   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:59,028   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:59,030   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:59,032   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:59,034   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:59,036   copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:27:59,038   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,041   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,043   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,045   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,047   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,049   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,051   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,053   copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,055   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,057   copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,059   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,061   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,063   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,065   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,067   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,069   copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,072   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,074   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,076   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,078   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,080   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,082   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,085   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,087   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,089   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,091   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,093   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,095   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,097   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,099   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,102   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,104   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,106   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,108   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,110   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,112   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,114   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,116   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,118   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,120   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,122   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,124   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,126   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,128   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,130   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,132   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,134   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,136   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,138   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,141   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,143   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,145   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,147   copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,149   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,151   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,153   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,155   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,158   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,160   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,162   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,164   copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,166   copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:27:59,168   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,170   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,172   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,174   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,176   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,178   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,180   copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,182   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,184   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,187   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,189   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,191   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,193   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,195   copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,197   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,199   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,201   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,203   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,205   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,207   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,210   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,211   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,213   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,216   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,219   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,221   copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,223   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,225   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,227   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,229   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,231   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,233   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,235   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,237   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,239   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,242   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,244   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,246   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,248   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,251   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,253   copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,255   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,257   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,259   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,261   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,263   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,266   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,268   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,270   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,272   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,275   copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,277   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,279   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,282   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,284   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,286   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,288   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,290   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,293   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,295   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,297   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,299   copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:27:59,301   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,304   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,306   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,308   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,310   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,312   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,314   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,316   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,319   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,321   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,323   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,325   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,327   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,329   copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,331   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,334   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,336   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,338   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,340   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,342   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,344   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,346   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,348   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,350   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,352   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,354   copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,356   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,359   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,361   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,363   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,365   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,367   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,369   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,372   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,374   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,377   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,379   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,381   copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,383   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,385   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,387   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,389   copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,391   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,393   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,395   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,397   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,399   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,401   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,403   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,405   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,407   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,409   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,411   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,413   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,416   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,418   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,420   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,422   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,425   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,427   copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,430   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,433   copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:27:59,435   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,438   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,441   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,443   copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,446   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,449   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,451   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,454   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,457   copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,460   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,463   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,466   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,468   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,471   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,473   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,476   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,478   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,481   copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,483   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,486   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,489   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,491   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,494   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,497   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,499   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,502   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,507   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,509   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,512   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,514   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,517   copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,519   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,522   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,524   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,527   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,529   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,531   copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,533   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,535   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,537   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,539   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,541   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,543   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,546   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,548   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,550   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,552   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,554   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,556   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,558   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,561   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,563   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,565   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,567   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,569   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,571   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,573   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,575   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,577   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,579   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,581   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,583   copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:27:59,586   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,588   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,590   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,592   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,594   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,596   copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,598   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,601   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,603   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,605   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,607   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,609   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,611   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,613   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,616   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,618   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,620   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,622   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,624   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,627   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,629   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,631   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,633   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,635   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,637   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,639   copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,641   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,643   copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,646   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,648   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,650   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,652   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,654   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,656   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,658   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,660   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,663   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,665   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,667   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,669   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,671   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,673   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,675   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,677   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,679   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,681   copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,683   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,685   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,687   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,690   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,692   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,694   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,696   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,698   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,700   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,703   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,705   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,707   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,709   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,711   copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,714   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,716   copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:27:59,718   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,720   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,722   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,724   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,726   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,728   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,730   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,732   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,734   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,736   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,738   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,740   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,742   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,744   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,746   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,748   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,750   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,752   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,754   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,757   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,759   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,761   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,763   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,765   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,767   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,769   copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,771   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,773   copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,776   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,778   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,780   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,782   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,784   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,786   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,788   copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,790   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,792   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,794   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,796   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,798   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,800   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,802   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,804   copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,807   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,809   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,811   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,813   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,815   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,817   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,819   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,821   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,824   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,826   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,828   copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,830   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,832   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,834   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,836   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,838   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,840   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,842   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,844   copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:27:59,846   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,848   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,850   copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,852   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,854   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,856   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,858   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,861   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,863   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,865   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,867   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,869   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,871   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,873   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,876   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,878   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,880   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,882   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,884   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,886   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,888   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,890   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,892   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,894   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,896   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,898   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,900   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,902   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,904   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,906   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,908   copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,910   copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,912   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,914   copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,915   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,917   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,920   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,922   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,924   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,926   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,928   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,930   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,932   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,934   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,937   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,939   copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,941   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,943   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,945   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,947   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,949   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,951   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,954   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,956   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,958   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,960   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,962   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,964   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,966   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,968   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,971   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,973   copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:27:59,975   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:27:59,977   copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:27:59,979   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:27:59,981   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:27:59,983   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:27:59,985   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:27:59,987   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:27:59,989   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:27:59,991   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:27:59,993   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:27:59,995   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:27:59,997   copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,000   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,002   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,004   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,006   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,008   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,010   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,012   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,014   copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,016   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,018   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,020   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,022   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,024   copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,026   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,028   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,030   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,033   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,035   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,037   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,039   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,042   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,044   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,046   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,048   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,051   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,053   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,055   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,057   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,059   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,061   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,063   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,065   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,068   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,069   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,071   copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,073   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,075   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,077   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,079   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,082   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,084   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,086   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,088   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,090   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,092   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,094   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,096   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,098   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,100   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,102   copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:00,104   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,107   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,109   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,111   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,113   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,115   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,117   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,119   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,121   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,123   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,125   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,127   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,129   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,131   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,133   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,135   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,137   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,139   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,141   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,143   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,145   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,148   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,150   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,152   copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,154   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,157   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,159   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,161   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,163   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,165   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,167   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,169   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,171   copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,173   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,175   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,177   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,179   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,181   copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,183   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,185   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,187   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,189   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,191   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,193   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,195   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,197   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,200   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,202   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,204   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,206   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,208   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,210   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,213   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,216   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,218   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,220   copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,222   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,224   copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,226   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,228   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,230   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,232   copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:00,234   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,236   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,238   copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,240   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,242   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,244   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,246   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,248   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,250   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,252   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,254   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,256   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,259   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,262   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,264   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,266   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,268   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,271   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,273   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,275   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,277   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,279   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,281   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,283   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,285   copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,287   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,289   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,291   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,294   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,296   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,298   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,300   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,302   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,304   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,306   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,308   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,310   copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,312   copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,314   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,316   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,318   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,321   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,323   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,325   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,327   copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,329   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,331   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,333   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,335   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,338   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,340   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,342   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,344   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,346   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,348   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,350   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,352   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,354   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,356   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,358   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,360   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,362   copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:00,364   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,367   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,369   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,371   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,373   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,375   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,378   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,380   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,382   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,384   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,386   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,388   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,390   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,392   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,394   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,396   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,398   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,400   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,402   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,404   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,406   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,408   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,410   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,412   copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,414   copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,417   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,419   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,421   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,423   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,425   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,427   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,429   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,431   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,434   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,436   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,438   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,440   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,442   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,444   copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,446   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,448   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,450   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,452   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,454   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,456   copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,458   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,460   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,462   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,464   copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,467   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,469   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,471   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,473   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,475   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,477   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,479   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,481   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,483   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,485   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,487   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,489   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,491   copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:00,494   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,496   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,497   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,499   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,502   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,504   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,506   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,508   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,510   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,512   copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,514   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,517   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,519   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,521   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,523   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,525   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,527   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,529   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,531   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,533   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,535   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,537   copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,539   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,541   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,543   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,545   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,547   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,549   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,551   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,553   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,555   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,557   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,559   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,561   copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,563   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,566   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,568   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,570   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,572   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,575   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,577   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,579   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,581   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,583   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,585   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,588   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,590   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,592   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,594   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,596   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,598   copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,600   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,602   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,604   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,606   copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,609   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,611   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,614   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,616   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,619   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,621   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,623   copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:00,625   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,628   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,630   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,632   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,634   copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,636   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,638   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,640   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,642   copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,644   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,646   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,649   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,651   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,653   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,655   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,658   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,660   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,662   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,664   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,666   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,668   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,670   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,672   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,675   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,677   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,679   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,681   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,683   copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,685   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,687   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,689   copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,691   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,693   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,695   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,697   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,700   copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,702   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,704   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,706   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,708   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,710   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,712   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,714   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,716   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,718   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,721   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,723   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,726   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,728   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,730   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,732   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,734   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,736   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,739   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,741   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,743   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,745   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,748   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,750   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,752   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,754   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,756   copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:00,758   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,760   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,762   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,764   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,766   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,768   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,770   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,772   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,774   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,777   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,779   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,781   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,783   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,785   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,787   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,789   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,792   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,794   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,796   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,798   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,800   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,802   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,805   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,807   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,809   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,811   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,813   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,815   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,817   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,819   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,821   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,823   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,825   copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,827   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,829   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,831   copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,833   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,835   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,837   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,839   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,841   copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,843   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,845   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,847   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,849   copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,852   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,854   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,856   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,858   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,860   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,862   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,865   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,867   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,869   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,871   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,873   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,875   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,877   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,879   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,881   copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,883   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,885   copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:00,887   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,890   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,892   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,894   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,896   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,898   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,900   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,902   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,904   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,907   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,909   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,911   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,913   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,915   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,917   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,919   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,921   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,923   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,925   copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,927   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,929   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,932   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,934   copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,936   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,938   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,940   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,942   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,944   copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,946   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,948   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,950   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,952   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,955   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,957   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,959   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,961   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,963   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,965   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,967   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,969   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,971   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,973   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,976   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,978   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,980   copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,982   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,984   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,986   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,988   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,990   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,992   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,994   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,997   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:00,999   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:01,001   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:01,003   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:01,006   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:01,008   copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:01,010   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:01,013   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:01,015   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:01,017   copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:01,019   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,021   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,023   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,026   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,028   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,031   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,033   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,035   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,037   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,039   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,041   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,044   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,046   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,048   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,050   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,052   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,054   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,056   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,058   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,060   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,062   copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,064   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,066   copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,068   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,070   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,072   copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,074   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,077   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,079   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,081   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,083   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,085   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,087   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,089   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,091   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,094   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,096   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,098   copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,100   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,102   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,104   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,106   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,108   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,110   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,112   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,114   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,116   copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,118   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,120   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,122   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,124   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,126   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,129   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,131   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,133   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,135   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,137   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,140   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,142   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,144   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,146   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,148   copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:01,150   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,152   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,154   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,156   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,159   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,161   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,162   copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,164   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,167   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,169   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,171   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,173   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,175   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,177   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,179   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,181   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,183   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,185   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,187   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,189   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,191   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,193   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,195   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,198   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,200   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,202   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,204   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,207   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,209   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,211   copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,213   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,216   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,218   copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,220   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,222   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,224   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,226   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,229   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,231   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,234   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,237   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,239   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,241   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,244   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,246   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,248   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,250   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,253   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,255   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,257   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,260   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,262   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,264   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,266   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,268   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,270   copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,272   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,275   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,278   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,280   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,282   copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,285   copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:01,287   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,289   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,291   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,293   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,296   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,298   copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,300   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,302   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,304   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,306   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,308   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,310   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,313   copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,315   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,317   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,319   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,321   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,323   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,325   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,328   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,330   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,332   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,334   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,336   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,338   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,341   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,343   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,345   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,347   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,349   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,352   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,354   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,356   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,359   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,361   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,363   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,365   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,367   copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,369   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,371   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,374   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,376   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,378   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,380   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,381   copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,383   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,385   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,387   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,389   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,391   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,393   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,396   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,398   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,400   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,402   copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,404   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,406   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,408   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,410   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,412   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,415   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,417   copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:01,419   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,422   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,424   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,426   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,428   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,431   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,433   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,435   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,437   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,438   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,440   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,442   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,444   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,446   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,448   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,450   copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,452   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,454   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,457   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,459   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,461   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,463   copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,465   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,467   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,469   copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,471   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,473   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,476   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,478   copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,480   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,482   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,485   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,487   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,489   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,491   copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,493   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,496   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,498   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,500   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,502   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,504   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,506   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,508   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,510   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,512   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,514   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,516   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,518   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,520   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,522   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,524   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,526   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,528   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,531   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,533   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,535   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,537   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,540   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,542   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,544   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,546   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,548   copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:01,550   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,553   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,555   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,557   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,560   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,562   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,564   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,566   copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,568   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,570   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,572   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,574   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,576   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,578   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,580   copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,583   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,585   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,587   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,589   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,591   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,593   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,595   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,597   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,599   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,601   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,604   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,606   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,607   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,610   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,612   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,614   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,616   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,618   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,620   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,622   copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,624   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,627   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,629   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,631   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,633   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,635   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,637   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,639   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,642   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,644   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,646   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,648   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,651   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,653   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,655   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,657   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,659   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,661   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,663   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,665   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,667   copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,669   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,671   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,673   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,675   copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,677   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,679   copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:01,681   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,683   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,685   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,688   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,690   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,692   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,694   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,696   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,698   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,700   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,702   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,705   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,707   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,709   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,711   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,713   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,715   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,717   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,719   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,721   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,723   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,726   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,728   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,730   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,732   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,734   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,736   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,738   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,740   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,742   copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,744   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,746   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,748   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,750   copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,752   copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,754   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,756   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,759   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,761   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,763   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,766   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,768   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,770   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,772   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,775   copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,777   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,779   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,781   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,783   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,785   copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,788   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,789   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,792   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,794   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,796   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,798   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,800   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,802   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,804   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,807   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,809   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,811   copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:01,814   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,816   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,819   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,821   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,823   copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,825   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,827   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,829   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,831   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,833   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,835   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,837   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,839   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,841   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,844   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,846   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,848   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,851   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,853   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,855   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,858   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,860   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,862   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,864   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,866   copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,869   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,871   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,873   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,875   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,877   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,879   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,881   copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,883   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,885   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,887   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,889   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,891   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,893   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,895   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,897   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,900   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,902   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,904   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,907   copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,909   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,911   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,913   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,915   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,918   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,920   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,922   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,924   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,926   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,928   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,930   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,932   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,934   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,936   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,939   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,941   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,943   copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,945   copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:01,947   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,949   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,951   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,953   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,955   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,957   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,959   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,961   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,963   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,965   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,967   copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,969   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,971   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,974   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,976   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,978   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,980   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,983   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,985   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,987   copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,988   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,991   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,993   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,995   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,997   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:01,999   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,001   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,004   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,006   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,008   copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,010   copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,012   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,014   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,016   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,018   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,021   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,023   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,025   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,027   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,029   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,031   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,034   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,036   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,038   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,040   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,042   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,044   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,047   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,049   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,051   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,053   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,055   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,057   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,059   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,061   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,063   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,066   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,068   copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,070   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,072   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,074   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,076   copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:02,078   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,080   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,083   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,085   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,088   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,090   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,092   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,094   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,096   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,098   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,100   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,102   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,104   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,106   copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,108   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,110   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,112   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,114   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,117   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,120   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,122   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,124   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,127   copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,129   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,131   copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,133   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,135   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,138   copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,140   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,142   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,144   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,146   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,148   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,150   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,153   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,155   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,157   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,159   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,161   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,163   copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,165   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,167   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,169   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,171   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,173   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,175   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,177   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,179   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,181   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,183   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,186   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,188   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,190   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,193   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,195   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,197   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,199   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,201   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,204   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,206   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,208   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,210   copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:02,213   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,214   copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,217   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,219   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,221   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,223   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,225   copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,227   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,230   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,231   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,233   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,236   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,238   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,240   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,242   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,244   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,246   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,248   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,250   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,252   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,254   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,256   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,258   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,261   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,263   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,265   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,267   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,269   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,271   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,273   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,275   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,277   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,279   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,281   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,283   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,286   copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,288   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,290   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,292   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,294   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,297   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,299   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,301   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,303   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,305   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,307   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,309   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,311   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,313   copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,316   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,318   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,320   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,322   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,324   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,326   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,328   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,330   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,332   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,334   copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,336   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,338   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,340   copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:02,343   copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,345   copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,347   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,349   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,352   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,354   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,356   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,359   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,361   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,363   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,365   copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,367   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,370   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,372   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,374   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,376   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,378   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,380   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,382   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,384   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,386   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,388   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,390   copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,392   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,394   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,396   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,398   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,400   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,402   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,404   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,406   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,408   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,410   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,412   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,415   copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,418   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,420   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,422   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,424   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,427   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,429   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,431   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,434   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,436   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,438   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,441   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,443   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,445   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,447   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,449   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,451   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,453   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,455   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,457   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,459   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,461   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,463   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,466   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,468   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,470   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,472   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,474   copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:02,476   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,478   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,481   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,483   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,485   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,488   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,490   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,492   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,494   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,496   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,498   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,500   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,502   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,504   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,507   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,509   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,526   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,528   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,530   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,532   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,534   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,536   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,539   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,541   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,543   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,545   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,547   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,549   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,552   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,554   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,556   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,558   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,560   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,562   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,564   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,567   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,569   copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,571   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,573   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,575   copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,577   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,579   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,582   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,584   copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,586   copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,588   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,590   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,592   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,594   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,596   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,598   copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,600   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,603   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,605   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,607   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,609   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,611   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,613   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,615   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,617   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,619   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,621   copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:02,623   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,626   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,628   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,630   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,632   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,634   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,637   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,639   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,641   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,643   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,645   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,647   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,649   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,651   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,654   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,656   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,658   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,660   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,662   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,664   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,666   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,668   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,670   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,672   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,674   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,676   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,678   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,680   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,682   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,684   copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,686   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,688   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,691   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,693   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,695   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,697   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,699   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,701   copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,703   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,706   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,708   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,710   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,712   copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,714   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,717   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,719   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,722   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,723   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,725   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,728   copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,729   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,731   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,733   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,735   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,737   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,739   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,741   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,743   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,746   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,748   copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,750   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,752   copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:02,754   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,757   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,759   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,761   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,763   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,766   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,768   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,770   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,773   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,775   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,777   copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,779   copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,781   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,783   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,785   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,787   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,789   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,791   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,793   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,795   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,797   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,799   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,801   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,803   copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,805   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,807   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,810   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,812   copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,814   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,816   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,818   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,820   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,822   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,824   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,826   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,828   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,831   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,833   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,835   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,837   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,839   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,841   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,843   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,845   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,847   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,850   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,852   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,854   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,857   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,859   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,861   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,863   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,865   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,867   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,869   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,871   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,873   copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,875   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,877   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,879   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,881   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,883   copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:02,885   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,887   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,889   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,892   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,894   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,896   copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,898   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,900   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,904   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,906   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,908   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,910   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,912   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,914   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,917   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,919   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,921   copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,923   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,925   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,928   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,930   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,932   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,934   copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,936   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,938   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,940   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,942   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,944   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,946   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,948   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,950   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,952   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,954   copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,956   copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,958   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,960   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,962   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,965   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,967   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,969   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,971   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,974   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,976   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,979   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,981   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,983   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,985   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,988   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,990   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,992   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,994   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,997   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:02,999   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:03,001   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:03,003   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:03,005   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:03,007   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:03,009   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:03,011   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:03,014   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:03,016   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:03,018   copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:03,020   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,022   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,024   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,027   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,029   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,031   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,033   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,035   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,037   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,039   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,041   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,044   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,046   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,048   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,051   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,053   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,056   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,058   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,060   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,062   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,064   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,066   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,068   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,071   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,073   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,075   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,077   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,079   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,081   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,083   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,085   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,087   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,089   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,092   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,094   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,096   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,098   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,100   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,102   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,104   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,106   copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,108   copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,110   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,112   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,115   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,117   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,119   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,121   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,123   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,125   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,127   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,130   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,132   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,134   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,136   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,138   copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,140   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,142   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,145   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,147   copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,149   copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,151   copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:03,153   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,155   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,157   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,159   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,161   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,163   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,166   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,168   copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,169   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,171   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,173   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,175   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,177   copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,179   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,181   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,183   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,185   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,188   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,190   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,192   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,194   copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,196   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,199   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,201   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,203   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,206   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,208   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,211   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,213   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,215   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,218   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,220   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,222   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,224   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,226   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,228   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,230   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,232   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,234   copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,236   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,238   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,240   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,243   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,245   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,247   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,249   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,251   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,253   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,255   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,257   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,259   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,262   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,264   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,266   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,269   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,271   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,273   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,276   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,278   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,280   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,282   copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,284   copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:03,286   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,288   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,290   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,292   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,294   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,296   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,298   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,300   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,303   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,305   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,307   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,309   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,311   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,313   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,315   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,317   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,319   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,322   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,324   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,326   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,328   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,330   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,333   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,335   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,337   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,340   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,342   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,344   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,346   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,348   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,350   copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,352   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,355   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,357   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,359   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,361   copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,363   copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,365   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,367   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,370   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,372   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,374   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,376   copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,378   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,380   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,382   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,384   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,386   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,388   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,390   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,393   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,395   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,397   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,399   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,401   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,403   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,405   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,408   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,410   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,412   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,414   copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,416   copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:03,419   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,421   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,423   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,426   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,428   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,430   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,432   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,434   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,436   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,438   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,440   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,442   copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,444   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,446   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,448   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,450   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,452   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,454   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,456   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,458   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,460   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,463   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,465   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,467   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,469   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,472   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,474   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,476   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,478   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,481   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,483   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,485   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,488   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,490   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,492   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,495   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,497   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,499   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,501   copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,503   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,505   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,507   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,509   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,510   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,513   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,515   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,517   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,519   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,521   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,523   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,525   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,527   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,529   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,531   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,533   copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,536   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,538   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,540   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,543   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,545   copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,547   copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,549   copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:03,552   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,554   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,556   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,559   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,561   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,563   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,565   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,567   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,569   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,572   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,574   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,576   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,578   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,580   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,582   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,584   copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,586   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,588   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,590   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,592   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,594   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,596   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,598   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,600   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,602   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,604   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,606   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,608   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,610   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,613   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,615   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,617   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,619   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,621   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,623   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,626   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,628   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,630   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,632   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,635   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,637   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,639   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,641   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,644   copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,646   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,648   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,650   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,652   copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,654   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,656   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,658   copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,660   copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,662   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,665   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,667   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,669   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,671   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,673   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,675   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,677   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,679   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,681   copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:03,684   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,686   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,688   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,691   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,693   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,696   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,698   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,700   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,702   copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,704   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,707   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,709   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,711   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,713   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,715   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,718   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,720   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,722   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,724   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,726   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,728   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,730   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,732   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,734   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,736   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,738   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,740   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,742   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,744   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,746   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,748   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,750   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,753   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,755   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,757   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,759   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,761   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,763   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,766   copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,768   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,771   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,773   copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,776   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,779   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,781   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,783   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,786   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,788   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,790   copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,792   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,794   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,796   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,798   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,801   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,803   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,805   copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,807   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,809   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,812   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,814   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,816   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,818   copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:03,820   copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn
2025-08-31T08:28:03,823   copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn
2025-08-31T08:28:03,825   copying lm_eval/tasks/global_mmlu/default/bn/_global_mmlu_bn.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn
2025-08-31T08:28:03,827   copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn
2025-08-31T08:28:03,830   copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn
2025-08-31T08:28:03,832   copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn
2025-08-31T08:28:03,834   copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn
2025-08-31T08:28:03,837   copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi
2025-08-31T08:28:03,839   copying lm_eval/tasks/global_mmlu/default/hi/_global_mmlu_hi.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi
2025-08-31T08:28:03,841   copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi
2025-08-31T08:28:03,844   copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi
2025-08-31T08:28:03,846   copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi
2025-08-31T08:28:03,849   copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi
2025-08-31T08:28:03,851   copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi
2025-08-31T08:28:03,854   copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr
2025-08-31T08:28:03,856   copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr
2025-08-31T08:28:03,858   copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr
2025-08-31T08:28:03,861   copying lm_eval/tasks/global_mmlu/default/fr/_global_mmlu_fr.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr
2025-08-31T08:28:03,863   copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr
2025-08-31T08:28:03,865   copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr
2025-08-31T08:28:03,867   copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr
2025-08-31T08:28:03,870   copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en
2025-08-31T08:28:03,872   copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en
2025-08-31T08:28:03,874   copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en
2025-08-31T08:28:03,876   copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en
2025-08-31T08:28:03,879   copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en
2025-08-31T08:28:03,881   copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en
2025-08-31T08:28:03,883   copying lm_eval/tasks/global_mmlu/default/en/_global_mmlu_en.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en
2025-08-31T08:28:03,886   copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar
2025-08-31T08:28:03,888   copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar
2025-08-31T08:28:03,890   copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar
2025-08-31T08:28:03,892   copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar
2025-08-31T08:28:03,894   copying lm_eval/tasks/global_mmlu/default/ar/_global_mmlu_ar.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar
2025-08-31T08:28:03,897   copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar
2025-08-31T08:28:03,899   copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar
2025-08-31T08:28:03,902   copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo
2025-08-31T08:28:03,905   copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo
2025-08-31T08:28:03,907   copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo
2025-08-31T08:28:03,910   copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo
2025-08-31T08:28:03,912   copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo
2025-08-31T08:28:03,914   copying lm_eval/tasks/global_mmlu/default/yo/_global_mmlu_yo.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo
2025-08-31T08:28:03,917   copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo
2025-08-31T08:28:03,919   copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es
2025-08-31T08:28:03,922   copying lm_eval/tasks/global_mmlu/default/es/_global_mmlu_es.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es
2025-08-31T08:28:03,924   copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es
2025-08-31T08:28:03,927   copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es
2025-08-31T08:28:03,929   copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es
2025-08-31T08:28:03,931   copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es
2025-08-31T08:28:03,934   copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es
2025-08-31T08:28:03,936   copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw
2025-08-31T08:28:03,938   copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw
2025-08-31T08:28:03,940   copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw
2025-08-31T08:28:03,942   copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw
2025-08-31T08:28:03,945   copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw
2025-08-31T08:28:03,947   copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw
2025-08-31T08:28:03,949   copying lm_eval/tasks/global_mmlu/default/sw/_global_mmlu_sw.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw
2025-08-31T08:28:03,953   copying lm_eval/tasks/global_mmlu/default/ja/_global_mmlu_ja.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja
2025-08-31T08:28:03,955   copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja
2025-08-31T08:28:03,957   copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja
2025-08-31T08:28:03,960   copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja
2025-08-31T08:28:03,962   copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja
2025-08-31T08:28:03,966   copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja
2025-08-31T08:28:03,970   copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja
2025-08-31T08:28:03,975   copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko
2025-08-31T08:28:03,979   copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko
2025-08-31T08:28:03,983   copying lm_eval/tasks/global_mmlu/default/ko/_global_mmlu_ko.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko
2025-08-31T08:28:03,985   copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko
2025-08-31T08:28:03,987   copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko
2025-08-31T08:28:03,990   copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko
2025-08-31T08:28:03,992   copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko
2025-08-31T08:28:03,994   copying lm_eval/tasks/global_mmlu/default/pt/_global_mmlu_pt.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt
2025-08-31T08:28:03,997   copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt
2025-08-31T08:28:03,999   copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt
2025-08-31T08:28:04,002   copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt
2025-08-31T08:28:04,004   copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt
2025-08-31T08:28:04,006   copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt
2025-08-31T08:28:04,009   copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt
2025-08-31T08:28:04,011   copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id
2025-08-31T08:28:04,013   copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id
2025-08-31T08:28:04,016   copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id
2025-08-31T08:28:04,018   copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id
2025-08-31T08:28:04,020   copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id
2025-08-31T08:28:04,022   copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id
2025-08-31T08:28:04,024   copying lm_eval/tasks/global_mmlu/default/id/_global_mmlu_id.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id
2025-08-31T08:28:04,026   copying lm_eval/tasks/global_mmlu/default/it/_global_mmlu_it.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it
2025-08-31T08:28:04,029   copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it
2025-08-31T08:28:04,031   copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it
2025-08-31T08:28:04,033   copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it
2025-08-31T08:28:04,035   copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it
2025-08-31T08:28:04,038   copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it
2025-08-31T08:28:04,040   copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it
2025-08-31T08:28:04,043   copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de
2025-08-31T08:28:04,045   copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de
2025-08-31T08:28:04,047   copying lm_eval/tasks/global_mmlu/default/de/_global_mmlu_de.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de
2025-08-31T08:28:04,049   copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de
2025-08-31T08:28:04,051   copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de
2025-08-31T08:28:04,054   copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de
2025-08-31T08:28:04,056   copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de
2025-08-31T08:28:04,058   copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh
2025-08-31T08:28:04,060   copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh
2025-08-31T08:28:04,062   copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh
2025-08-31T08:28:04,065   copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh
2025-08-31T08:28:04,067   copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh
2025-08-31T08:28:04,070   copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh
2025-08-31T08:28:04,072   copying lm_eval/tasks/global_mmlu/default/zh/_global_mmlu_zh.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh
2025-08-31T08:28:04,076   creating build/lib/lm_eval/tasks/kormedmcqa
2025-08-31T08:28:04,081   copying lm_eval/tasks/kormedmcqa/dentist.yaml -> build/lib/lm_eval/tasks/kormedmcqa
2025-08-31T08:28:04,083   copying lm_eval/tasks/kormedmcqa/doctor.yaml -> build/lib/lm_eval/tasks/kormedmcqa
2025-08-31T08:28:04,086   copying lm_eval/tasks/kormedmcqa/nurse.yaml -> build/lib/lm_eval/tasks/kormedmcqa
2025-08-31T08:28:04,088   copying lm_eval/tasks/kormedmcqa/pharm.yaml -> build/lib/lm_eval/tasks/kormedmcqa
2025-08-31T08:28:04,091   copying lm_eval/tasks/kormedmcqa/_kormedmcqa.yaml -> build/lib/lm_eval/tasks/kormedmcqa
2025-08-31T08:28:04,094   creating build/lib/lm_eval/tasks/siqa
2025-08-31T08:28:04,095   copying lm_eval/tasks/siqa/siqa.yaml -> build/lib/lm_eval/tasks/siqa
2025-08-31T08:28:04,099   copying lm_eval/tasks/minerva_math/minerva_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/minerva_math
2025-08-31T08:28:04,103   copying lm_eval/tasks/minerva_math/minerva_math_precalc.yaml -> build/lib/lm_eval/tasks/minerva_math
2025-08-31T08:28:04,107   copying lm_eval/tasks/minerva_math/minerva_math_num_theory.yaml -> build/lib/lm_eval/tasks/minerva_math
2025-08-31T08:28:04,112   copying lm_eval/tasks/minerva_math/minerva_math_prealgebra.yaml -> build/lib/lm_eval/tasks/minerva_math
2025-08-31T08:28:04,121   copying lm_eval/tasks/minerva_math/minerva_math_geometry.yaml -> build/lib/lm_eval/tasks/minerva_math
2025-08-31T08:28:04,128   copying lm_eval/tasks/minerva_math/minerva_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/minerva_math
2025-08-31T08:28:04,132   copying lm_eval/tasks/minerva_math/minerva_math_algebra.yaml -> build/lib/lm_eval/tasks/minerva_math
2025-08-31T08:28:04,141   copying lm_eval/tasks/logiqa2/logieval.yaml -> build/lib/lm_eval/tasks/logiqa2
2025-08-31T08:28:04,147   copying lm_eval/tasks/logiqa2/logiqa2.yaml -> build/lib/lm_eval/tasks/logiqa2
2025-08-31T08:28:04,152   copying lm_eval/tasks/mmlusr/answer_only/answer_only_philosophy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,157   copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,161   copying lm_eval/tasks/mmlusr/answer_only/answer_only_human_aging.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,164   copying lm_eval/tasks/mmlusr/answer_only/_answer_only.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,168   copying lm_eval/tasks/mmlusr/answer_only/answer_only_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,170   copying lm_eval/tasks/mmlusr/answer_only/answer_only_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,173   copying lm_eval/tasks/mmlusr/answer_only/answer_only_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,175   copying lm_eval/tasks/mmlusr/answer_only/answer_only_public_relations.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,177   copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,180   copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,182   copying lm_eval/tasks/mmlusr/answer_only/answer_only_management.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,184   copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,187   copying lm_eval/tasks/mmlusr/answer_only/answer_only_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,189   copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,191   copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,193   copying lm_eval/tasks/mmlusr/answer_only/answer_only_nutrition.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,196   copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,198   copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,200   copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,202   copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,205   copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,207   copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,210   copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,212   copying lm_eval/tasks/mmlusr/answer_only/answer_only_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,214   copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,217   copying lm_eval/tasks/mmlusr/answer_only/answer_only_prehistory.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,219   copying lm_eval/tasks/mmlusr/answer_only/answer_only_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,222   copying lm_eval/tasks/mmlusr/answer_only/answer_only_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,224   copying lm_eval/tasks/mmlusr/answer_only/answer_only_global_facts.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,227   copying lm_eval/tasks/mmlusr/answer_only/answer_only_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,229   copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,231   copying lm_eval/tasks/mmlusr/answer_only/answer_only_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,233   copying lm_eval/tasks/mmlusr/answer_only/answer_only_anatomy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,235   copying lm_eval/tasks/mmlusr/answer_only/answer_only_econometrics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,237   copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,239   copying lm_eval/tasks/mmlusr/answer_only/answer_only_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,241   copying lm_eval/tasks/mmlusr/answer_only/answer_only_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,243   copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,246   copying lm_eval/tasks/mmlusr/answer_only/answer_only_computer_security.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,248   copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,251   copying lm_eval/tasks/mmlusr/answer_only/answer_only_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,253   copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,256   copying lm_eval/tasks/mmlusr/answer_only/answer_only_virology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,258   copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,261   copying lm_eval/tasks/mmlusr/answer_only/answer_only_world_religions.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,264   copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,266   copying lm_eval/tasks/mmlusr/answer_only/answer_only_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,268   copying lm_eval/tasks/mmlusr/answer_only/answer_only_sociology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,271   copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,273   copying lm_eval/tasks/mmlusr/answer_only/answer_only_astronomy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,276   copying lm_eval/tasks/mmlusr/answer_only/answer_only_marketing.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,278   copying lm_eval/tasks/mmlusr/answer_only/answer_only_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,281   copying lm_eval/tasks/mmlusr/answer_only/answer_only_international_law.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,285   copying lm_eval/tasks/mmlusr/answer_only/answer_only_security_studies.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,289   copying lm_eval/tasks/mmlusr/answer_only/answer_only_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,293   copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_law.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,296   copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,298   copying lm_eval/tasks/mmlusr/answer_only/answer_only_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:04,300   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,302   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,304   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_astronomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,307   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,309   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,311   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,313   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,315   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_nutrition.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,317   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,320   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_virology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,322   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,324   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,327   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,329   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,331   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,334   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,336   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,338   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_philosophy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,340   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,342   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,345   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_security_studies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,347   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,350   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,352   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,354   copying lm_eval/tasks/mmlusr/question_and_answer/_question_and_answer.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,357   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,359   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,361   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,363   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_prehistory.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,365   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_computer_security.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,368   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,370   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_econometrics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,372   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,374   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_global_facts.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,376   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,378   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,381   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,383   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,385   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_international_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,387   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,390   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_aging.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,392   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,394   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,396   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_sociology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,399   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,401   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,403   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_management.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,406   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,408   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,410   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_marketing.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,412   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,414   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_anatomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,417   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,419   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,421   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_public_relations.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,424   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_world_religions.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,426   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,428   copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:04,431   copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,433   copying lm_eval/tasks/mmlusr/question_only/question_only_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,436   copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,438   copying lm_eval/tasks/mmlusr/question_only/question_only_nutrition.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,440   copying lm_eval/tasks/mmlusr/question_only/question_only_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,442   copying lm_eval/tasks/mmlusr/question_only/question_only_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,445   copying lm_eval/tasks/mmlusr/question_only/question_only_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,447   copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,449   copying lm_eval/tasks/mmlusr/question_only/question_only_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,451   copying lm_eval/tasks/mmlusr/question_only/question_only_anatomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,454   copying lm_eval/tasks/mmlusr/question_only/question_only_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,456   copying lm_eval/tasks/mmlusr/question_only/question_only_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,458   copying lm_eval/tasks/mmlusr/question_only/_question_only.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,460   copying lm_eval/tasks/mmlusr/question_only/question_only_management.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,463   copying lm_eval/tasks/mmlusr/question_only/question_only_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,466   copying lm_eval/tasks/mmlusr/question_only/question_only_public_relations.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,469   copying lm_eval/tasks/mmlusr/question_only/question_only_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,471   copying lm_eval/tasks/mmlusr/question_only/question_only_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,474   copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,477   copying lm_eval/tasks/mmlusr/question_only/question_only_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,479   copying lm_eval/tasks/mmlusr/question_only/question_only_security_studies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,482   copying lm_eval/tasks/mmlusr/question_only/question_only_human_aging.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,485   copying lm_eval/tasks/mmlusr/question_only/question_only_virology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,488   copying lm_eval/tasks/mmlusr/question_only/question_only_world_religions.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,491   copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,493   copying lm_eval/tasks/mmlusr/question_only/question_only_professional_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,496   copying lm_eval/tasks/mmlusr/question_only/question_only_international_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,499   copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,502   copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,505   copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,508   copying lm_eval/tasks/mmlusr/question_only/question_only_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,510   copying lm_eval/tasks/mmlusr/question_only/question_only_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,513   copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,516   copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,519   copying lm_eval/tasks/mmlusr/question_only/question_only_prehistory.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,521   copying lm_eval/tasks/mmlusr/question_only/question_only_astronomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,524   copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,527   copying lm_eval/tasks/mmlusr/question_only/question_only_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,530   copying lm_eval/tasks/mmlusr/question_only/question_only_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,532   copying lm_eval/tasks/mmlusr/question_only/question_only_sociology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,535   copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,538   copying lm_eval/tasks/mmlusr/question_only/question_only_college_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,541   copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,544   copying lm_eval/tasks/mmlusr/question_only/question_only_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,547   copying lm_eval/tasks/mmlusr/question_only/question_only_philosophy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,550   copying lm_eval/tasks/mmlusr/question_only/question_only_marketing.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,553   copying lm_eval/tasks/mmlusr/question_only/question_only_econometrics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,556   copying lm_eval/tasks/mmlusr/question_only/question_only_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,558   copying lm_eval/tasks/mmlusr/question_only/question_only_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,561   copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,564   copying lm_eval/tasks/mmlusr/question_only/question_only_computer_security.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,566   copying lm_eval/tasks/mmlusr/question_only/question_only_global_facts.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,568   copying lm_eval/tasks/mmlusr/question_only/question_only_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,570   copying lm_eval/tasks/mmlusr/question_only/question_only_college_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,573   copying lm_eval/tasks/mmlusr/question_only/question_only_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,575   copying lm_eval/tasks/mmlusr/question_only/question_only_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,577   copying lm_eval/tasks/mmlusr/question_only/question_only_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,579   copying lm_eval/tasks/mmlusr/question_only/question_only_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:04,582   copying lm_eval/tasks/swde/swde.yaml -> build/lib/lm_eval/tasks/swde
2025-08-31T08:28:04,584   creating build/lib/lm_eval/tasks/lambada
2025-08-31T08:28:04,585   copying lm_eval/tasks/lambada/lambada_openai.yaml -> build/lib/lm_eval/tasks/lambada
2025-08-31T08:28:04,588   copying lm_eval/tasks/lambada/lambada_standard.yaml -> build/lib/lm_eval/tasks/lambada
2025-08-31T08:28:04,590   copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:04,592   copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:04,594   copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:04,597   copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:04,599   copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:04,601   copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:04,604   copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:04,606   copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:04,608   copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:04,610   copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:04,612   copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:04,614   copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:04,617   copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:04,619   copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:04,621   copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:04,624   copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:04,626   copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:04,628   copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:04,630   copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:04,633   copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:04,635   copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:04,638   copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:04,640   copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:04,643   copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:04,645   copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:04,647   copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:04,650   copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:04,652   copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:04,654   copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:04,657   copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:04,659   copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:04,661   copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:04,663   copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:04,666   copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:04,668   copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:04,670   copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:04,672   copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:04,674   copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:04,677   copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:04,679   copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:04,682   copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:04,684   copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:04,687   copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:04,689   copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:04,691   copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:04,693   copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:04,696   copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:04,698   copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:04,701   copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:04,703   copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:04,705   copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:04,708   copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:04,710   copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:04,713   copying lm_eval/tasks/afrixnli/translate/afrixnli_tt.yaml -> build/lib/lm_eval/tasks/afrixnli/translate
2025-08-31T08:28:04,715   copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:04,717   copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:04,719   copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:04,721   copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:04,724   copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:04,726   copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:04,728   copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:04,730   copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:04,732   copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:04,735   copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:04,737   copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:04,739   copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:04,741   copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:04,744   copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:04,746   copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:04,748   copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:04,751   copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:04,754   copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:04,756   copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:04,758   copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:04,761   copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:04,763   copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:04,766   copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:04,768   copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:04,770   copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:04,772   copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:04,775   copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:04,777   copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:04,780   copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:04,782   copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:04,784   copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:04,786   copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:04,789   copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:04,791   copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:04,794   copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:04,796   copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:04,798   copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:04,800   copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:04,803   copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:04,805   copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:04,807   copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:04,809   copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:04,811   copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:04,813   copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:04,816   copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:04,818   copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:04,821   copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:04,823   copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:04,826   copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:04,828   copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:04,830   copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:04,833   copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:04,835   copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:04,837   copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:04,840   copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:04,842   copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:04,844   copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:04,846   copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:04,849   copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:04,851   copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:04,853   copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:04,856   copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:04,858   copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:04,861   copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:04,863   copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:04,865   copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:04,868   copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:04,870   copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:04,873   copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:04,875   copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:04,878   copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:04,880   copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:04,882   copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:04,885   copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:04,887   copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:04,889   copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:04,891   copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:04,894   copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:04,896   copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:04,898   copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:04,901   copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:04,903   copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:04,905   copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:04,908   copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:04,910   copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:04,912   copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:04,917   copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:04,920   copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:04,922   copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:04,925   copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:04,927   copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:04,929   copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:04,931   copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:04,934   copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:04,936   copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:04,938   copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:04,940   copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:04,942   copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:04,944   copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:04,947   copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:04,949   copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:04,951   copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:04,954   copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:04,956   copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:04,958   copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:04,960   copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:04,963   copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:04,965   copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:04,968   copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:04,970   copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:04,972   copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:04,975   copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:04,977   copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:04,979   copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:04,981   copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:04,983   copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:04,986   copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:04,988   copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:04,991   copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:04,993   copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:04,996   copying lm_eval/tasks/afrixnli/direct/afrixnli.yaml -> build/lib/lm_eval/tasks/afrixnli/direct
2025-08-31T08:28:04,999   copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:05,001   copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:05,003   copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:05,005   copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:05,008   copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:05,010   copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:05,012   copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:05,015   copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:05,017   copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:05,019   copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:05,021   copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:05,023   copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:05,025   copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:05,027   copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:05,030   copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:05,032   copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:05,035   copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:05,037   copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:05,039   copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:05,042   copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:05,044   copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:05,047   copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:05,049   copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:05,051   copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:05,054   copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:05,056   copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:05,059   copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:05,061   copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:05,063   copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:05,065   copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:05,068   copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:05,070   copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:05,072   copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:05,074   copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:05,077   copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:05,079   copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:05,081   copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:05,083   copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:05,086   copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:05,088   copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:05,090   copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:05,092   copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:05,094   copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:05,096   copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:05,099   copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:05,101   copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:05,103   copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:05,106   copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:05,108   copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:05,110   copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:05,113   copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:05,115   copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:05,118   copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:05,121   copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:05,123   copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:05,125   copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:05,128   copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:05,130   copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:05,133   copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:05,135   copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:05,137   copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:05,139   copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:05,142   copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:05,144   copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:05,147   copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:05,149   copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:05,151   copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:05,153   copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:05,155   copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:05,157   copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:05,159   copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:05,162   copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:05,164   copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:05,167   copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:05,169   copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:05,172   copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:05,174   copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:05,177   copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:05,179   copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:05,181   copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:05,184   copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:05,186   copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:05,188   copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:05,191   copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:05,193   copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:05,196   copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:05,198   copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:05,201   copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:05,203   copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:05,205   copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:05,207   copying lm_eval/tasks/copal_id/standard.yaml -> build/lib/lm_eval/tasks/copal_id
2025-08-31T08:28:05,209   copying lm_eval/tasks/copal_id/colloquial.yaml -> build/lib/lm_eval/tasks/copal_id
2025-08-31T08:28:05,212   copying lm_eval/tasks/blimp/wh_vs_that_with_gap_long_distance.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,214   copying lm_eval/tasks/blimp/determiner_noun_agreement_irregular_1.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,216   copying lm_eval/tasks/blimp/adjunct_island.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,218   copying lm_eval/tasks/blimp/_blimp.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,220   copying lm_eval/tasks/blimp/principle_A_case_1.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,222   copying lm_eval/tasks/blimp/passive_2.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,224   copying lm_eval/tasks/blimp/wh_questions_object_gap.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,227   copying lm_eval/tasks/blimp/drop_argument.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,229   copying lm_eval/tasks/blimp/ellipsis_n_bar_1.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,231   copying lm_eval/tasks/blimp/anaphor_gender_agreement.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,233   copying lm_eval/tasks/blimp/expletive_it_object_raising.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,235   copying lm_eval/tasks/blimp/principle_A_domain_2.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,238   copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_2.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,240   copying lm_eval/tasks/blimp/npi_present_2.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,242   copying lm_eval/tasks/blimp/matrix_question_npi_licensor_present.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,244   copying lm_eval/tasks/blimp/complex_NP_island.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,247   copying lm_eval/tasks/blimp/wh_vs_that_no_gap_long_distance.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,249   copying lm_eval/tasks/blimp/ellipsis_n_bar_2.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,251   copying lm_eval/tasks/blimp/principle_A_case_2.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,253   copying lm_eval/tasks/blimp/only_npi_licensor_present.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,256   copying lm_eval/tasks/blimp/coordinate_structure_constraint_object_extraction.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,258   copying lm_eval/tasks/blimp/intransitive.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,260   copying lm_eval/tasks/blimp/existential_there_subject_raising.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,262   copying lm_eval/tasks/blimp/animate_subject_trans.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,265   copying lm_eval/tasks/blimp/animate_subject_passive.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,267   copying lm_eval/tasks/blimp/principle_A_reconstruction.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,269   copying lm_eval/tasks/blimp/wh_questions_subject_gap_long_distance.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,272   copying lm_eval/tasks/blimp/principle_A_c_command.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,274   copying lm_eval/tasks/blimp/left_branch_island_simple_question.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,276   copying lm_eval/tasks/blimp/determiner_noun_agreement_2.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,278   copying lm_eval/tasks/blimp/sentential_subject_island.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,281   copying lm_eval/tasks/blimp/tough_vs_raising_1.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,283   copying lm_eval/tasks/blimp/distractor_agreement_relational_noun.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,285   copying lm_eval/tasks/blimp/distractor_agreement_relative_clause.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,287   copying lm_eval/tasks/blimp/irregular_past_participle_verbs.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,289   copying lm_eval/tasks/blimp/determiner_noun_agreement_irregular_2.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,292   copying lm_eval/tasks/blimp/causative.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,294   copying lm_eval/tasks/blimp/anaphor_number_agreement.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,296   copying lm_eval/tasks/blimp/irregular_past_participle_adjectives.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,298   copying lm_eval/tasks/blimp/principle_A_domain_1.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,300   copying lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_2.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,302   copying lm_eval/tasks/blimp/passive_1.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,304   copying lm_eval/tasks/blimp/tough_vs_raising_2.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,307   copying lm_eval/tasks/blimp/sentential_negation_npi_scope.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,309   copying lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_2.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,311   copying lm_eval/tasks/blimp/existential_there_quantifiers_1.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,313   copying lm_eval/tasks/blimp/superlative_quantifiers_1.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,316   copying lm_eval/tasks/blimp/only_npi_scope.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,318   copying lm_eval/tasks/blimp/existential_there_object_raising.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,320   copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adjective_1.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,322   copying lm_eval/tasks/blimp/superlative_quantifiers_2.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,325   copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_1.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,327   copying lm_eval/tasks/blimp/left_branch_island_echo_question.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,329   copying lm_eval/tasks/blimp/principle_A_domain_3.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,332   copying lm_eval/tasks/blimp/transitive.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,334   copying lm_eval/tasks/blimp/inchoative.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,336   copying lm_eval/tasks/blimp/wh_vs_that_no_gap.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,339   copying lm_eval/tasks/blimp/wh_island.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,341   copying lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_1.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,343   copying lm_eval/tasks/blimp/existential_there_quantifiers_2.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,345   copying lm_eval/tasks/blimp/determiner_noun_agreement_1.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,348   copying lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_1.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,350   copying lm_eval/tasks/blimp/coordinate_structure_constraint_complex_left_branch.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,352   copying lm_eval/tasks/blimp/wh_questions_subject_gap.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,354   copying lm_eval/tasks/blimp/sentential_negation_npi_licensor_present.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,356   copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_2.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,359   copying lm_eval/tasks/blimp/wh_vs_that_with_gap.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,361   copying lm_eval/tasks/blimp/npi_present_1.yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:05,363   copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:05,366   copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:05,369   copying lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_bn.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:05,371   copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:05,373   copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:05,376   copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:05,378   copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:05,381   copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:05,383   copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:05,385   copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:05,387   copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:05,389   copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:05,391   copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:05,394   copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:05,396   copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:05,398   copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:05,400   copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:05,403   copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:05,405   copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:05,408   copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:05,410   copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:05,413   copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:05,416   copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:05,418   copying lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_hi.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:05,420   copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:05,422   copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:05,424   copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:05,426   copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:05,429   copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:05,431   copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:05,433   copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:05,435   copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:05,438   copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:05,440   copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:05,443   copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:05,445   copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:05,447   copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:05,450   copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:05,452   copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:05,455   copying lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_fr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:05,457   copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:05,459   copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:05,463   copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:05,465   copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:05,467   copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:05,470   copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:05,472   copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:05,474   copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:05,477   copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:05,479   copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:05,481   copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:05,484   copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:05,486   copying lm_eval/tasks/mmlu_prox/en/_mmlu_prox_en.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:05,488   copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:05,490   copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:05,492   copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:05,494   copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:05,497   copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:05,499   copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:05,501   copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:05,503   copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:05,506   copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:05,508   copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:05,510   copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:05,513   copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:05,515   copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:05,517   copying lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_ar.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:05,520   copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:05,522   copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:05,525   copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:05,527   copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:05,529   copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:05,532   copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:05,534   copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:05,536   copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:05,539   copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:05,542   copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:05,544   copying lm_eval/tasks/mmlu_prox/es/_mmlu_prox_es.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:05,546   copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:05,549   copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:05,551   copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:05,554   copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:05,556   copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:05,558   copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:05,560   copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:05,563   copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:05,565   copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:05,567   copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:05,569   copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:05,572   copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:05,574   copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:05,576   copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:05,579   copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:05,581   copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:05,583   copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:05,586   copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:05,588   copying lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_sw.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:05,590   copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:05,593   copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:05,595   copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:05,597   copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:05,599   copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:05,602   copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:05,604   copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:05,606   copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:05,608   copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:05,611   copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:05,613   copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:05,616   copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:05,618   copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:05,620   copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:05,622   copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:05,624   copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:05,627   copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:05,629   copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:05,631   copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:05,633   copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:05,635   copying lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_ja.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:05,638   copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:05,640   copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:05,642   copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:05,644   copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:05,647   copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:05,649   copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:05,651   copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:05,654   copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:05,656   copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:05,658   copying lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_ko.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:05,661   copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:05,663   copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:05,665   copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:05,668   copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:05,670   copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:05,672   copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:05,674   copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:05,677   copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:05,679   copying lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_pt.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:05,681   copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:05,683   copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:05,686   copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:05,688   copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:05,690   copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:05,693   copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:05,695   copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:05,697   copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:05,699   copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:05,701   copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:05,703   copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:05,705   copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:05,707   copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:05,710   copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:05,712   copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:05,714   copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:05,716   copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:05,719   copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:05,721   copying lm_eval/tasks/mmlu_prox/th/_mmlu_prox_th.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:05,723   copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:05,726   copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:05,728   copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:05,730   copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:05,732   copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:05,734   copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:05,737   copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:05,739   copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:05,741   copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:05,744   copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:05,746   copying lm_eval/tasks/mmlu_prox/de/_mmlu_prox_de.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:05,749   copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:05,751   copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:05,753   copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:05,755   copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:05,757   copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:05,759   copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:05,761   copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:05,764   copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:05,766   copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:05,768   copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:05,770   copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:05,772   copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:05,774   copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:05,777   copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:05,779   copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:05,781   copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:05,783   copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:05,786   copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:05,788   copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:05,790   copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:05,793   copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:05,795   copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:05,797   copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:05,800   copying lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_zh.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:05,802   copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:05,805   copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:05,807   copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:05,809   copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:05,813   copying lm_eval/tasks/leaderboard/leaderboard.yaml -> build/lib/lm_eval/tasks/leaderboard
2025-08-31T08:28:05,815   copying lm_eval/tasks/leaderboard/gpqa/gpqa_diamond_zeroshot.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa
2025-08-31T08:28:05,817   copying lm_eval/tasks/leaderboard/gpqa/_leaderboard_gpqa.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa
2025-08-31T08:28:05,820   copying lm_eval/tasks/leaderboard/gpqa/gpqa_main_zeroshot.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa
2025-08-31T08:28:05,822   copying lm_eval/tasks/leaderboard/gpqa/gpqa_extended_zeroshot.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa
2025-08-31T08:28:05,824   copying lm_eval/tasks/leaderboard/musr/musr_team_allocation.yaml -> build/lib/lm_eval/tasks/leaderboard/musr
2025-08-31T08:28:05,826   copying lm_eval/tasks/leaderboard/musr/_musr.yaml -> build/lib/lm_eval/tasks/leaderboard/musr
2025-08-31T08:28:05,829   copying lm_eval/tasks/leaderboard/musr/musr_object_placements.yaml -> build/lib/lm_eval/tasks/leaderboard/musr
2025-08-31T08:28:05,831   copying lm_eval/tasks/leaderboard/musr/musr_murder_mysteries.yaml -> build/lib/lm_eval/tasks/leaderboard/musr
2025-08-31T08:28:05,833   copying lm_eval/tasks/leaderboard/ifeval/_leaderboard_instruction_following.yaml -> build/lib/lm_eval/tasks/leaderboard/ifeval
2025-08-31T08:28:05,835   copying lm_eval/tasks/leaderboard/ifeval/ifeval.yaml -> build/lib/lm_eval/tasks/leaderboard/ifeval
2025-08-31T08:28:05,837   creating build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,838   copying lm_eval/tasks/leaderboard/bbh_mc/movie_recommendation.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,841   copying lm_eval/tasks/leaderboard/bbh_mc/ruin_names.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,843   copying lm_eval/tasks/leaderboard/bbh_mc/formal_fallacies.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,845   copying lm_eval/tasks/leaderboard/bbh_mc/hyperbaton.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,848   copying lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,850   copying lm_eval/tasks/leaderboard/bbh_mc/navigate.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,852   copying lm_eval/tasks/leaderboard/bbh_mc/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,855   copying lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,857   copying lm_eval/tasks/leaderboard/bbh_mc/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,860   copying lm_eval/tasks/leaderboard/bbh_mc/causal_judgement.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,862   copying lm_eval/tasks/leaderboard/bbh_mc/snarks.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,865   copying lm_eval/tasks/leaderboard/bbh_mc/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,867   copying lm_eval/tasks/leaderboard/bbh_mc/geometric_shapes.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,869   copying lm_eval/tasks/leaderboard/bbh_mc/date_understanding.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,872   copying lm_eval/tasks/leaderboard/bbh_mc/object_counting.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,875   copying lm_eval/tasks/leaderboard/bbh_mc/sports_understanding.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,877   copying lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,880   copying lm_eval/tasks/leaderboard/bbh_mc/web_of_lies.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,882   copying lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,884   copying lm_eval/tasks/leaderboard/bbh_mc/_leaderboard_bbh.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,887   copying lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,890   copying lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,892   copying lm_eval/tasks/leaderboard/bbh_mc/temporal_sequences.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,894   copying lm_eval/tasks/leaderboard/bbh_mc/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,897   copying lm_eval/tasks/leaderboard/bbh_mc/boolean_expressions.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:05,899   copying lm_eval/tasks/leaderboard/mmlu_pro/mmlu_pro.yaml -> build/lib/lm_eval/tasks/leaderboard/mmlu_pro
2025-08-31T08:28:05,901   copying lm_eval/tasks/leaderboard/math/math_precalculus.yaml -> build/lib/lm_eval/tasks/leaderboard/math
2025-08-31T08:28:05,904   copying lm_eval/tasks/leaderboard/math/_leaderboard_math.yaml -> build/lib/lm_eval/tasks/leaderboard/math
2025-08-31T08:28:05,906   copying lm_eval/tasks/leaderboard/math/math_num_theory.yaml -> build/lib/lm_eval/tasks/leaderboard/math
2025-08-31T08:28:05,908   copying lm_eval/tasks/leaderboard/math/math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/leaderboard/math
2025-08-31T08:28:05,910   copying lm_eval/tasks/leaderboard/math/math_algebra.yaml -> build/lib/lm_eval/tasks/leaderboard/math
2025-08-31T08:28:05,912   copying lm_eval/tasks/leaderboard/math/math_prealgebra.yaml -> build/lib/lm_eval/tasks/leaderboard/math
2025-08-31T08:28:05,914   copying lm_eval/tasks/leaderboard/math/math_geometry.yaml -> build/lib/lm_eval/tasks/leaderboard/math
2025-08-31T08:28:05,917   copying lm_eval/tasks/leaderboard/math/math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/leaderboard/math
2025-08-31T08:28:05,919   creating build/lib/lm_eval/tasks/mc_taco
2025-08-31T08:28:05,920   copying lm_eval/tasks/mc_taco/default.yaml -> build/lib/lm_eval/tasks/mc_taco
2025-08-31T08:28:05,922   copying lm_eval/tasks/mediqa_qa2019/mediqa_qa2019.yaml -> build/lib/lm_eval/tasks/mediqa_qa2019
2025-08-31T08:28:05,924   copying lm_eval/tasks/mediqa_qa2019/mediqa_qa2019_perplexity.yaml -> build/lib/lm_eval/tasks/mediqa_qa2019
2025-08-31T08:28:05,927   creating build/lib/lm_eval/tasks/headqa
2025-08-31T08:28:05,928   copying lm_eval/tasks/headqa/headqa_en.yaml -> build/lib/lm_eval/tasks/headqa
2025-08-31T08:28:05,930   copying lm_eval/tasks/headqa/headqa_es.yaml -> build/lib/lm_eval/tasks/headqa
2025-08-31T08:28:05,933   copying lm_eval/tasks/fda/fda.yaml -> build/lib/lm_eval/tasks/fda
2025-08-31T08:28:05,935   copying lm_eval/tasks/hrm8k/en/hrm8k_omni_math_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en
2025-08-31T08:28:05,938   copying lm_eval/tasks/hrm8k/en/hrm8k_ksm_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en
2025-08-31T08:28:05,940   copying lm_eval/tasks/hrm8k/en/hrm8k_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en
2025-08-31T08:28:05,942   copying lm_eval/tasks/hrm8k/en/hrm8k_gsm8k_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en
2025-08-31T08:28:05,945   copying lm_eval/tasks/hrm8k/en/hrm8k_math_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en
2025-08-31T08:28:05,947   copying lm_eval/tasks/hrm8k/en/hrm8k_mmmlu_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en
2025-08-31T08:28:05,950   copying lm_eval/tasks/hrm8k/default/hrm8k.yaml -> build/lib/lm_eval/tasks/hrm8k/default
2025-08-31T08:28:05,952   copying lm_eval/tasks/hrm8k/default/hrm8k_mmmlu.yaml -> build/lib/lm_eval/tasks/hrm8k/default
2025-08-31T08:28:05,955   copying lm_eval/tasks/hrm8k/default/hrm8k_ksm.yaml -> build/lib/lm_eval/tasks/hrm8k/default
2025-08-31T08:28:05,957   copying lm_eval/tasks/hrm8k/default/hrm8k_omni_math.yaml -> build/lib/lm_eval/tasks/hrm8k/default
2025-08-31T08:28:05,960   copying lm_eval/tasks/hrm8k/default/hrm8k_math.yaml -> build/lib/lm_eval/tasks/hrm8k/default
2025-08-31T08:28:05,962   copying lm_eval/tasks/hrm8k/default/hrm8k_gsm8k.yaml -> build/lib/lm_eval/tasks/hrm8k/default
2025-08-31T08:28:05,964   copying lm_eval/tasks/arab_culture/arab_culture_morocco.yaml -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:28:05,966   copying lm_eval/tasks/arab_culture/arab_culture_palestine.yaml -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:28:05,969   copying lm_eval/tasks/arab_culture/arab_culture_egypt.yaml -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:28:05,971   copying lm_eval/tasks/arab_culture/_arab_culture_levant.yaml -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:28:05,973   copying lm_eval/tasks/arab_culture/_arab_culture_gulf.yaml -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:28:05,975   copying lm_eval/tasks/arab_culture/arab_culture_yemen.yaml -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:28:05,977   copying lm_eval/tasks/arab_culture/arab_culture_libya.yaml -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:28:05,979   copying lm_eval/tasks/arab_culture/arab_culture_sudan.yaml -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:28:05,981   copying lm_eval/tasks/arab_culture/_arab_culture.yaml -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:28:05,983   copying lm_eval/tasks/arab_culture/_arab_culture_north_africa.yaml -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:28:05,985   copying lm_eval/tasks/arab_culture/arab_culture_algeria.yaml -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:28:05,988   copying lm_eval/tasks/arab_culture/_arab_culture_nile_valley.yaml -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:28:05,990   copying lm_eval/tasks/arab_culture/arab_culture_tunisia.yaml -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:28:05,992   copying lm_eval/tasks/arab_culture/arab_culture_lebanon.yaml -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:28:05,994   copying lm_eval/tasks/arab_culture/arab_culture_ksa.yaml -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:28:05,997   copying lm_eval/tasks/arab_culture/arab_culture_syria.yaml -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:28:06,000   copying lm_eval/tasks/arab_culture/arab_culture_uae.yaml -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:28:06,002   copying lm_eval/tasks/arab_culture/arab_culture_jordan.yaml -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:28:06,004   creating build/lib/lm_eval/tasks/fld
2025-08-31T08:28:06,005   copying lm_eval/tasks/fld/fld_logical_formula_default.yaml -> build/lib/lm_eval/tasks/fld
2025-08-31T08:28:06,007   copying lm_eval/tasks/fld/fld_logical_formula_star.yaml -> build/lib/lm_eval/tasks/fld
2025-08-31T08:28:06,010   copying lm_eval/tasks/fld/fld_default.yaml -> build/lib/lm_eval/tasks/fld
2025-08-31T08:28:06,012   copying lm_eval/tasks/fld/fld_star.yaml -> build/lib/lm_eval/tasks/fld
2025-08-31T08:28:06,014   copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_gl.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:06,017   copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_ca.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:06,019   copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_gl.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:06,022   copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_ca.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:06,024   copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_es.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:06,026   copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_eu.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:06,029   copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_eu.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:06,031   copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_en.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:06,034   copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_ca.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:06,036   copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_eu.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:06,038   copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_en.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:06,040   copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_es.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:06,042   copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_gl.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:06,044   copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_es.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:06,047   copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_en.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:06,049   copying lm_eval/tasks/mutual/mutual.yaml -> build/lib/lm_eval/tasks/mutual
2025-08-31T08:28:06,051   copying lm_eval/tasks/mutual/multual_plus.yaml -> build/lib/lm_eval/tasks/mutual
2025-08-31T08:28:06,054   copying lm_eval/tasks/aclue/aclue_ancient_medical.yaml -> build/lib/lm_eval/tasks/aclue
2025-08-31T08:28:06,056   copying lm_eval/tasks/aclue/aclue_poetry_quality_assessment.yaml -> build/lib/lm_eval/tasks/aclue
2025-08-31T08:28:06,058   copying lm_eval/tasks/aclue/aclue_sentence_segmentation.yaml -> build/lib/lm_eval/tasks/aclue
2025-08-31T08:28:06,060   copying lm_eval/tasks/aclue/aclue_poetry_sentiment_analysis.yaml -> build/lib/lm_eval/tasks/aclue
2025-08-31T08:28:06,063   copying lm_eval/tasks/aclue/aclue_polysemy_resolution.yaml -> build/lib/lm_eval/tasks/aclue
2025-08-31T08:28:06,065   copying lm_eval/tasks/aclue/aclue_poetry_appreciate.yaml -> build/lib/lm_eval/tasks/aclue
2025-08-31T08:28:06,067   copying lm_eval/tasks/aclue/aclue_poetry_context_prediction.yaml -> build/lib/lm_eval/tasks/aclue
2025-08-31T08:28:06,069   copying lm_eval/tasks/aclue/_aclue.yaml -> build/lib/lm_eval/tasks/aclue
2025-08-31T08:28:06,072   copying lm_eval/tasks/aclue/aclue_ancient_phonetics.yaml -> build/lib/lm_eval/tasks/aclue
2025-08-31T08:28:06,074   copying lm_eval/tasks/aclue/aclue_basic_ancient_chinese.yaml -> build/lib/lm_eval/tasks/aclue
2025-08-31T08:28:06,077   copying lm_eval/tasks/aclue/aclue_reading_comprehension.yaml -> build/lib/lm_eval/tasks/aclue
2025-08-31T08:28:06,079   copying lm_eval/tasks/aclue/aclue_homographic_character_resolution.yaml -> build/lib/lm_eval/tasks/aclue
2025-08-31T08:28:06,082   copying lm_eval/tasks/aclue/aclue_ancient_literature.yaml -> build/lib/lm_eval/tasks/aclue
2025-08-31T08:28:06,084   copying lm_eval/tasks/aclue/aclue_couplet_prediction.yaml -> build/lib/lm_eval/tasks/aclue
2025-08-31T08:28:06,086   copying lm_eval/tasks/aclue/aclue_ancient_chinese_culture.yaml -> build/lib/lm_eval/tasks/aclue
2025-08-31T08:28:06,089   copying lm_eval/tasks/aclue/aclue_named_entity_recognition.yaml -> build/lib/lm_eval/tasks/aclue
2025-08-31T08:28:06,091   copying lm_eval/tasks/portuguese_bench/assin_entailment.yaml -> build/lib/lm_eval/tasks/portuguese_bench
2025-08-31T08:28:06,094   copying lm_eval/tasks/portuguese_bench/portuguese_bench.yaml -> build/lib/lm_eval/tasks/portuguese_bench
2025-08-31T08:28:06,096   copying lm_eval/tasks/portuguese_bench/assin_paraphrase.yaml -> build/lib/lm_eval/tasks/portuguese_bench
2025-08-31T08:28:06,099   copying lm_eval/tasks/portuguese_bench/flores_pt/flores_es-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:06,101   copying lm_eval/tasks/portuguese_bench/flores_pt/flores_de-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:06,104   copying lm_eval/tasks/portuguese_bench/flores_pt/flores_fr-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:06,106   copying lm_eval/tasks/portuguese_bench/flores_pt/flores_eu-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:06,108   copying lm_eval/tasks/portuguese_bench/flores_pt/flores_gl-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:06,110   copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-de.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:06,112   copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-ca.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:06,114   copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-it.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:06,117   copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-en.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:06,119   copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:06,121   copying lm_eval/tasks/portuguese_bench/flores_pt/flores_en-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:06,123   copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-es.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:06,125   copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-gl.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:06,127   copying lm_eval/tasks/portuguese_bench/flores_pt/flores_it-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:06,130   copying lm_eval/tasks/portuguese_bench/flores_pt/flores_ca-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:06,132   copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-eu.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:06,134   copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-fr.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:06,137   copying lm_eval/tasks/basqueglue/vaxx.yaml -> build/lib/lm_eval/tasks/basqueglue
2025-08-31T08:28:06,139   copying lm_eval/tasks/basqueglue/bhtc.yaml -> build/lib/lm_eval/tasks/basqueglue
2025-08-31T08:28:06,141   copying lm_eval/tasks/basqueglue/coref.yaml -> build/lib/lm_eval/tasks/basqueglue
2025-08-31T08:28:06,144   copying lm_eval/tasks/basqueglue/qnli.yaml -> build/lib/lm_eval/tasks/basqueglue
2025-08-31T08:28:06,146   copying lm_eval/tasks/basqueglue/wic.yaml -> build/lib/lm_eval/tasks/basqueglue
2025-08-31T08:28:06,149   copying lm_eval/tasks/basqueglue/bec.yaml -> build/lib/lm_eval/tasks/basqueglue
2025-08-31T08:28:06,152   copying lm_eval/tasks/noreval/norquad/norquad_p3.yaml -> build/lib/lm_eval/tasks/noreval/norquad
2025-08-31T08:28:06,154   copying lm_eval/tasks/noreval/norquad/norquad_p4.yaml -> build/lib/lm_eval/tasks/noreval/norquad
2025-08-31T08:28:06,156   copying lm_eval/tasks/noreval/norquad/norquad_p1.yaml -> build/lib/lm_eval/tasks/noreval/norquad
2025-08-31T08:28:06,159   copying lm_eval/tasks/noreval/norquad/norquad_p2.yaml -> build/lib/lm_eval/tasks/noreval/norquad
2025-08-31T08:28:06,161   copying lm_eval/tasks/noreval/norquad/norquad_p0.yaml -> build/lib/lm_eval/tasks/noreval/norquad
2025-08-31T08:28:06,163   creating build/lib/lm_eval/tasks/noreval/norsummarize-instruct
2025-08-31T08:28:06,165   copying lm_eval/tasks/noreval/norsummarize-instruct/norsummarize_instruct.yaml -> build/lib/lm_eval/tasks/noreval/norsummarize-instruct
2025-08-31T08:28:06,167   creating build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno
2025-08-31T08:28:06,169   copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno
2025-08-31T08:28:06,171   copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno
2025-08-31T08:28:06,174   copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno
2025-08-31T08:28:06,176   copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno
2025-08-31T08:28:06,178   copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno
2025-08-31T08:28:06,180   creating build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob
2025-08-31T08:28:06,181   copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob
2025-08-31T08:28:06,183   copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob
2025-08-31T08:28:06,186   copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob
2025-08-31T08:28:06,188   copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob
2025-08-31T08:28:06,190   copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob
2025-08-31T08:28:06,192   creating build/lib/lm_eval/tasks/noreval/ncb
2025-08-31T08:28:06,193   copying lm_eval/tasks/noreval/ncb/ncb.yaml -> build/lib/lm_eval/tasks/noreval/ncb
2025-08-31T08:28:06,195   creating build/lib/lm_eval/tasks/noreval/norec/norec_document
2025-08-31T08:28:06,196   copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p0.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document
2025-08-31T08:28:06,199   copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p3.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document
2025-08-31T08:28:06,201   copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p2.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document
2025-08-31T08:28:06,203   copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p1.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document
2025-08-31T08:28:06,206   copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p4.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document
2025-08-31T08:28:06,208   creating build/lib/lm_eval/tasks/noreval/norec/norec_sentence
2025-08-31T08:28:06,209   copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p0.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence
2025-08-31T08:28:06,212   copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p4.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence
2025-08-31T08:28:06,214   copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p1.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence
2025-08-31T08:28:06,217   copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p3.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence
2025-08-31T08:28:06,219   copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p2.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence
2025-08-31T08:28:06,221   creating build/lib/lm_eval/tasks/noreval/norrewrite-instruct
2025-08-31T08:28:06,222   copying lm_eval/tasks/noreval/norrewrite-instruct/norrewrite_instruct.yaml -> build/lib/lm_eval/tasks/noreval/norrewrite-instruct
2025-08-31T08:28:06,224   creating build/lib/lm_eval/tasks/noreval/noridiom/nno
2025-08-31T08:28:06,226   copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno
2025-08-31T08:28:06,228   copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno
2025-08-31T08:28:06,230   copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno
2025-08-31T08:28:06,233   copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno
2025-08-31T08:28:06,235   copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno
2025-08-31T08:28:06,237   creating build/lib/lm_eval/tasks/noreval/noridiom/nob
2025-08-31T08:28:06,239   copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob
2025-08-31T08:28:06,241   copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob
2025-08-31T08:28:06,244   copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob
2025-08-31T08:28:06,246   copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob
2025-08-31T08:28:06,249   copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob
2025-08-31T08:28:06,251   copying lm_eval/tasks/noreval/ask_gec/ask_gec_p1.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec
2025-08-31T08:28:06,253   copying lm_eval/tasks/noreval/ask_gec/ask_gec_p3.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec
2025-08-31T08:28:06,255   copying lm_eval/tasks/noreval/ask_gec/ask_gec_p0.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec
2025-08-31T08:28:06,257   copying lm_eval/tasks/noreval/ask_gec/ask_gec_p4.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec
2025-08-31T08:28:06,259   copying lm_eval/tasks/noreval/ask_gec/ask_gec_p2.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec
2025-08-31T08:28:06,261   creating build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng
2025-08-31T08:28:06,263   copying lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p3.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng
2025-08-31T08:28:06,266   copying lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p0.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng
2025-08-31T08:28:06,268   copying lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p1.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng
2025-08-31T08:28:06,270   copying lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p2.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng
2025-08-31T08:28:06,272   creating build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng
2025-08-31T08:28:06,273   copying lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p1.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng
2025-08-31T08:28:06,276   copying lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p2.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng
2025-08-31T08:28:06,278   copying lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p3.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng
2025-08-31T08:28:06,280   copying lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p0.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng
2025-08-31T08:28:06,283   creating build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno
2025-08-31T08:28:06,284   copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno
2025-08-31T08:28:06,286   copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno
2025-08-31T08:28:06,288   copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno
2025-08-31T08:28:06,291   copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno
2025-08-31T08:28:06,293   creating build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob
2025-08-31T08:28:06,294   copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob
2025-08-31T08:28:06,297   copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob
2025-08-31T08:28:06,299   copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob
2025-08-31T08:28:06,301   copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob
2025-08-31T08:28:06,304   copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno
2025-08-31T08:28:06,307   copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno
2025-08-31T08:28:06,309   copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno
2025-08-31T08:28:06,312   copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno
2025-08-31T08:28:06,314   copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno
2025-08-31T08:28:06,317   copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob
2025-08-31T08:28:06,319   copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob
2025-08-31T08:28:06,321   copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob
2025-08-31T08:28:06,323   copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob
2025-08-31T08:28:06,325   copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob
2025-08-31T08:28:06,327   creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno
2025-08-31T08:28:06,328   copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno
2025-08-31T08:28:06,330   copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno
2025-08-31T08:28:06,332   copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno
2025-08-31T08:28:06,335   copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno
2025-08-31T08:28:06,337   copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno
2025-08-31T08:28:06,339   creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob
2025-08-31T08:28:06,340   copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob
2025-08-31T08:28:06,342   copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob
2025-08-31T08:28:06,345   copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob
2025-08-31T08:28:06,347   copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob
2025-08-31T08:28:06,349   copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob
2025-08-31T08:28:06,352   creating build/lib/lm_eval/tasks/noreval/norbelebele
2025-08-31T08:28:06,353   copying lm_eval/tasks/noreval/norbelebele/norbelebele_p4.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele
2025-08-31T08:28:06,355   copying lm_eval/tasks/noreval/norbelebele/norbelebele_p1.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele
2025-08-31T08:28:06,357   copying lm_eval/tasks/noreval/norbelebele/norbelebele_p2.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele
2025-08-31T08:28:06,360   copying lm_eval/tasks/noreval/norbelebele/norbelebele_p0.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele
2025-08-31T08:28:06,362   copying lm_eval/tasks/noreval/norbelebele/norbelebele_p3.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele
2025-08-31T08:28:06,365   copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno
2025-08-31T08:28:06,367   copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno
2025-08-31T08:28:06,369   copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno
2025-08-31T08:28:06,372   copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno
2025-08-31T08:28:06,374   copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno
2025-08-31T08:28:06,376   copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob
2025-08-31T08:28:06,379   copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob
2025-08-31T08:28:06,381   copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob
2025-08-31T08:28:06,383   copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob
2025-08-31T08:28:06,386   copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob
2025-08-31T08:28:06,388   creating build/lib/lm_eval/tasks/noreval/norsumm/nno
2025-08-31T08:28:06,389   copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno
2025-08-31T08:28:06,391   copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno
2025-08-31T08:28:06,393   copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno
2025-08-31T08:28:06,395   copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p5.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno
2025-08-31T08:28:06,397   copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno
2025-08-31T08:28:06,400   copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno
2025-08-31T08:28:06,401   creating build/lib/lm_eval/tasks/noreval/norsumm/nob
2025-08-31T08:28:06,403   copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob
2025-08-31T08:28:06,405   copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob
2025-08-31T08:28:06,407   copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob
2025-08-31T08:28:06,410   copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob
2025-08-31T08:28:06,412   copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob
2025-08-31T08:28:06,414   copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p5.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob
2025-08-31T08:28:06,417   creating build/lib/lm_eval/tasks/noreval/noropenbookqa/nno
2025-08-31T08:28:06,418   copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno
2025-08-31T08:28:06,420   copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno
2025-08-31T08:28:06,422   copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno
2025-08-31T08:28:06,425   copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno
2025-08-31T08:28:06,427   copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno
2025-08-31T08:28:06,429   creating build/lib/lm_eval/tasks/noreval/noropenbookqa/nob
2025-08-31T08:28:06,430   copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob
2025-08-31T08:28:06,432   copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob
2025-08-31T08:28:06,434   copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob
2025-08-31T08:28:06,437   copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob
2025-08-31T08:28:06,439   copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob
2025-08-31T08:28:06,441   copying lm_eval/tasks/README.md -> build/lib/lm_eval/tasks
2025-08-31T08:28:06,447   copying lm_eval/tasks/lingoly/README.md -> build/lib/lm_eval/tasks/lingoly
2025-08-31T08:28:06,451   copying lm_eval/tasks/drop/README.md -> build/lib/lm_eval/tasks/drop
2025-08-31T08:28:06,453   copying lm_eval/tasks/wikitext/README.md -> build/lib/lm_eval/tasks/wikitext
2025-08-31T08:28:06,457   copying lm_eval/tasks/darija_bench/README.md -> build/lib/lm_eval/tasks/darija_bench
2025-08-31T08:28:06,460   copying lm_eval/tasks/darija_bench/darija_summarization/README.md -> build/lib/lm_eval/tasks/darija_bench/darija_summarization
2025-08-31T08:28:06,463   copying lm_eval/tasks/darija_bench/darija_summarization/summarization_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_summarization
2025-08-31T08:28:06,465   copying lm_eval/tasks/darija_bench/darija_translation/doda_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:06,467   copying lm_eval/tasks/darija_bench/darija_translation/translation_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:06,470   copying lm_eval/tasks/darija_bench/darija_translation/README.md -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:06,472   copying lm_eval/tasks/darija_bench/darija_translation/seed_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:06,475   copying lm_eval/tasks/darija_bench/darija_translation/madar_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:06,477   copying lm_eval/tasks/darija_bench/darija_translation/flores_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:06,479   copying lm_eval/tasks/darija_bench/darija_transliteration/transliteration_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration
2025-08-31T08:28:06,482   copying lm_eval/tasks/darija_bench/darija_transliteration/README.md -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration
2025-08-31T08:28:06,485   copying lm_eval/tasks/darija_bench/darija_sentiment/default_darija_sentiment_template_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment
2025-08-31T08:28:06,488   copying lm_eval/tasks/darija_bench/darija_sentiment/README.md -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment
2025-08-31T08:28:06,492   copying lm_eval/tasks/libra/README.md -> build/lib/lm_eval/tasks/libra
2025-08-31T08:28:06,494   copying lm_eval/tasks/libra/_template_yaml -> build/lib/lm_eval/tasks/libra
2025-08-31T08:28:06,496   copying lm_eval/tasks/bertaqa/README.md -> build/lib/lm_eval/tasks/bertaqa
2025-08-31T08:28:06,499   copying lm_eval/tasks/bertaqa/_bertaqa_template -> build/lib/lm_eval/tasks/bertaqa
2025-08-31T08:28:06,501   copying lm_eval/tasks/anli/README.md -> build/lib/lm_eval/tasks/anli
2025-08-31T08:28:06,505   copying lm_eval/tasks/agieval/README.md -> build/lib/lm_eval/tasks/agieval
2025-08-31T08:28:06,510   copying lm_eval/tasks/afrimgsm/README.md -> build/lib/lm_eval/tasks/afrimgsm
2025-08-31T08:28:06,512   copying lm_eval/tasks/afrimgsm/run.sh -> build/lib/lm_eval/tasks/afrimgsm
2025-08-31T08:28:06,515   copying lm_eval/tasks/afrimgsm/gen_yaml.sh -> build/lib/lm_eval/tasks/afrimgsm
2025-08-31T08:28:06,517   copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:28:06,519   copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:28:06,521   copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:28:06,523   copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:28:06,525   copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:28:06,527   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:28:06,530   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:28:06,532   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:28:06,534   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:28:06,537   copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:28:06,539   copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:28:06,541   copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:28:06,544   copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:28:06,547   copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:28:06,549   copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:28:06,552   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:28:06,555   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:28:06,558   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:28:06,560   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:28:06,563   copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:28:06,565   copying lm_eval/tasks/eus_exams/eus_exams -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:28:06,568   copying lm_eval/tasks/eus_exams/eus_exams_eu -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:28:06,571   copying lm_eval/tasks/eus_exams/eus_exams_es -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:28:06,574   copying lm_eval/tasks/eus_exams/README.md -> build/lib/lm_eval/tasks/eus_exams
2025-08-31T08:28:06,578   copying lm_eval/tasks/winogender/README.md -> build/lib/lm_eval/tasks/winogender
2025-08-31T08:28:06,582   copying lm_eval/tasks/hellaswag/README.md -> build/lib/lm_eval/tasks/hellaswag
2025-08-31T08:28:06,587   copying lm_eval/tasks/ruler/README.md -> build/lib/lm_eval/tasks/ruler
2025-08-31T08:28:06,592   copying lm_eval/tasks/babi/README.md -> build/lib/lm_eval/tasks/babi
2025-08-31T08:28:06,594   copying lm_eval/tasks/pile_10k/README.md -> build/lib/lm_eval/tasks/pile_10k
2025-08-31T08:28:06,597   copying lm_eval/tasks/egyhellaswag/README.md -> build/lib/lm_eval/tasks/egyhellaswag
2025-08-31T08:28:06,599   copying lm_eval/tasks/openbookqa/README.md -> build/lib/lm_eval/tasks/openbookqa
2025-08-31T08:28:06,601   copying lm_eval/tasks/xstorycloze/README.md -> build/lib/lm_eval/tasks/xstorycloze
2025-08-31T08:28:06,604   copying lm_eval/tasks/include/README.md -> build/lib/lm_eval/tasks/include
2025-08-31T08:28:06,607   copying lm_eval/tasks/include/few_shot_og/North Macedonian/_north macedonian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian
2025-08-31T08:28:06,610   copying lm_eval/tasks/include/few_shot_og/Basque/_basque_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Basque
2025-08-31T08:28:06,613   copying lm_eval/tasks/include/few_shot_og/Nepali/_nepali_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali
2025-08-31T08:28:06,616   copying lm_eval/tasks/include/few_shot_og/Hindi/_hindi_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:28:06,620   copying lm_eval/tasks/include/few_shot_og/Armenian/_armenian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian
2025-08-31T08:28:06,623   copying lm_eval/tasks/include/few_shot_og/Dutch/_dutch_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch
2025-08-31T08:28:06,626   copying lm_eval/tasks/include/few_shot_og/Albanian/_albanian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian
2025-08-31T08:28:06,629   copying lm_eval/tasks/include/few_shot_og/Serbian/_serbian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian
2025-08-31T08:28:06,632   copying lm_eval/tasks/include/few_shot_og/Russian/_russian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:28:06,636   copying lm_eval/tasks/include/few_shot_og/Finnish/_finnish_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish
2025-08-31T08:28:06,639   copying lm_eval/tasks/include/few_shot_og/German/_german_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German
2025-08-31T08:28:06,642   copying lm_eval/tasks/include/few_shot_og/Telugu/_telugu_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu
2025-08-31T08:28:06,645   copying lm_eval/tasks/include/few_shot_og/Azerbaijani/_azerbaijani_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani
2025-08-31T08:28:06,648   copying lm_eval/tasks/include/few_shot_og/Hungarian/_hungarian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian
2025-08-31T08:28:06,652   copying lm_eval/tasks/include/few_shot_og/Uzbek/_uzbek_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek
2025-08-31T08:28:06,654   copying lm_eval/tasks/include/few_shot_og/Korean/_korean_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Korean
2025-08-31T08:28:06,658   copying lm_eval/tasks/include/few_shot_og/Hebrew/_hebrew_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew
2025-08-31T08:28:06,662   copying lm_eval/tasks/include/few_shot_og/Belarusian/_belarusian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian
2025-08-31T08:28:06,664   copying lm_eval/tasks/include/few_shot_og/Japanese/_japanese_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese
2025-08-31T08:28:06,667   copying lm_eval/tasks/include/few_shot_og/Kazakh/_kazakh_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Kazakh
2025-08-31T08:28:06,669   copying lm_eval/tasks/include/few_shot_og/Georgian/_georgian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Georgian
2025-08-31T08:28:06,673   copying lm_eval/tasks/include/few_shot_og/Persian/_persian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian
2025-08-31T08:28:06,676   copying lm_eval/tasks/include/few_shot_og/Indonesian/_indonesian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian
2025-08-31T08:28:06,678   copying lm_eval/tasks/include/few_shot_og/Vietnamese/_vietnamese_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese
2025-08-31T08:28:06,681   copying lm_eval/tasks/include/few_shot_og/Spanish/_spanish_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish
2025-08-31T08:28:06,684   copying lm_eval/tasks/include/few_shot_og/Greek/_greek_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek
2025-08-31T08:28:06,687   copying lm_eval/tasks/include/few_shot_og/Chinese/_chinese_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:28:06,690   copying lm_eval/tasks/include/few_shot_og/Turkish/_turkish_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish
2025-08-31T08:28:06,693   copying lm_eval/tasks/include/few_shot_og/Tagalog/_tagalog_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog
2025-08-31T08:28:06,696   copying lm_eval/tasks/include/few_shot_og/French/_french_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French
2025-08-31T08:28:06,700   copying lm_eval/tasks/include/few_shot_og/Bulgarian/_bulgarian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian
2025-08-31T08:28:06,703   copying lm_eval/tasks/include/few_shot_og/Lithuanian/_lithuanian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian
2025-08-31T08:28:06,706   copying lm_eval/tasks/include/few_shot_og/Urdu/_urdu_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu
2025-08-31T08:28:06,709   copying lm_eval/tasks/include/few_shot_og/Polish/_polish_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish
2025-08-31T08:28:06,712   copying lm_eval/tasks/include/few_shot_og/Tamil/_tamil_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil
2025-08-31T08:28:06,715   copying lm_eval/tasks/include/few_shot_og/Italian/_italian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian
2025-08-31T08:28:06,718   copying lm_eval/tasks/include/few_shot_og/Portuguese/_portuguese_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese
2025-08-31T08:28:06,722   copying lm_eval/tasks/include/few_shot_og/Estonian/_estonian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian
2025-08-31T08:28:06,726   copying lm_eval/tasks/include/few_shot_og/Bengali/_bengali_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali
2025-08-31T08:28:06,728   copying lm_eval/tasks/include/few_shot_og/Croatian/_croatian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian
2025-08-31T08:28:06,731   copying lm_eval/tasks/include/few_shot_og/Malay/_malay_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay
2025-08-31T08:28:06,735   copying lm_eval/tasks/include/few_shot_og/Ukrainian/_ukrainian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian
2025-08-31T08:28:06,737   copying lm_eval/tasks/include/few_shot_og/Arabic/_arabic_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic
2025-08-31T08:28:06,740   copying lm_eval/tasks/include/few_shot_og/Malayalam/_malayalam_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam
2025-08-31T08:28:06,743   copying lm_eval/tasks/include/default/North Macedonian/_north macedonian_template_yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian
2025-08-31T08:28:06,746   copying lm_eval/tasks/include/default/Basque/_basque_template_yaml -> build/lib/lm_eval/tasks/include/default/Basque
2025-08-31T08:28:06,749   copying lm_eval/tasks/include/default/Nepali/_nepali_template_yaml -> build/lib/lm_eval/tasks/include/default/Nepali
2025-08-31T08:28:06,751   copying lm_eval/tasks/include/default/Hindi/_hindi_template_yaml -> build/lib/lm_eval/tasks/include/default/Hindi
2025-08-31T08:28:06,754   copying lm_eval/tasks/include/default/Armenian/_armenian_template_yaml -> build/lib/lm_eval/tasks/include/default/Armenian
2025-08-31T08:28:06,757   copying lm_eval/tasks/include/default/Dutch/_dutch_template_yaml -> build/lib/lm_eval/tasks/include/default/Dutch
2025-08-31T08:28:06,760   copying lm_eval/tasks/include/default/Albanian/_albanian_template_yaml -> build/lib/lm_eval/tasks/include/default/Albanian
2025-08-31T08:28:06,763   copying lm_eval/tasks/include/default/Serbian/_serbian_template_yaml -> build/lib/lm_eval/tasks/include/default/Serbian
2025-08-31T08:28:06,766   copying lm_eval/tasks/include/default/Russian/_russian_template_yaml -> build/lib/lm_eval/tasks/include/default/Russian
2025-08-31T08:28:06,769   copying lm_eval/tasks/include/default/Finnish/_finnish_template_yaml -> build/lib/lm_eval/tasks/include/default/Finnish
2025-08-31T08:28:06,772   copying lm_eval/tasks/include/default/German/_german_template_yaml -> build/lib/lm_eval/tasks/include/default/German
2025-08-31T08:28:06,776   copying lm_eval/tasks/include/default/Telugu/_telugu_template_yaml -> build/lib/lm_eval/tasks/include/default/Telugu
2025-08-31T08:28:06,778   copying lm_eval/tasks/include/default/Azerbaijani/_azerbaijani_template_yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani
2025-08-31T08:28:06,782   copying lm_eval/tasks/include/default/Hungarian/_hungarian_template_yaml -> build/lib/lm_eval/tasks/include/default/Hungarian
2025-08-31T08:28:06,785   copying lm_eval/tasks/include/default/Uzbek/_uzbek_template_yaml -> build/lib/lm_eval/tasks/include/default/Uzbek
2025-08-31T08:28:06,788   copying lm_eval/tasks/include/default/Korean/_korean_template_yaml -> build/lib/lm_eval/tasks/include/default/Korean
2025-08-31T08:28:06,792   copying lm_eval/tasks/include/default/Hebrew/_hebrew_template_yaml -> build/lib/lm_eval/tasks/include/default/Hebrew
2025-08-31T08:28:06,795   copying lm_eval/tasks/include/default/Belarusian/_belarusian_template_yaml -> build/lib/lm_eval/tasks/include/default/Belarusian
2025-08-31T08:28:06,797   copying lm_eval/tasks/include/default/Japanese/_japanese_template_yaml -> build/lib/lm_eval/tasks/include/default/Japanese
2025-08-31T08:28:06,800   copying lm_eval/tasks/include/default/Kazakh/_kazakh_template_yaml -> build/lib/lm_eval/tasks/include/default/Kazakh
2025-08-31T08:28:06,802   copying lm_eval/tasks/include/default/Georgian/_georgian_template_yaml -> build/lib/lm_eval/tasks/include/default/Georgian
2025-08-31T08:28:06,806   copying lm_eval/tasks/include/default/Persian/_persian_template_yaml -> build/lib/lm_eval/tasks/include/default/Persian
2025-08-31T08:28:06,809   copying lm_eval/tasks/include/default/Indonesian/_indonesian_template_yaml -> build/lib/lm_eval/tasks/include/default/Indonesian
2025-08-31T08:28:06,812   copying lm_eval/tasks/include/default/Vietnamese/_vietnamese_template_yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese
2025-08-31T08:28:06,815   copying lm_eval/tasks/include/default/Spanish/_spanish_template_yaml -> build/lib/lm_eval/tasks/include/default/Spanish
2025-08-31T08:28:06,817   copying lm_eval/tasks/include/default/Greek/_greek_template_yaml -> build/lib/lm_eval/tasks/include/default/Greek
2025-08-31T08:28:06,820   copying lm_eval/tasks/include/default/Chinese/_chinese_template_yaml -> build/lib/lm_eval/tasks/include/default/Chinese
2025-08-31T08:28:06,823   copying lm_eval/tasks/include/default/Turkish/_turkish_template_yaml -> build/lib/lm_eval/tasks/include/default/Turkish
2025-08-31T08:28:06,826   copying lm_eval/tasks/include/default/Tagalog/_tagalog_template_yaml -> build/lib/lm_eval/tasks/include/default/Tagalog
2025-08-31T08:28:06,829   copying lm_eval/tasks/include/default/French/_french_template_yaml -> build/lib/lm_eval/tasks/include/default/French
2025-08-31T08:28:06,833   copying lm_eval/tasks/include/default/Bulgarian/_bulgarian_template_yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian
2025-08-31T08:28:06,836   copying lm_eval/tasks/include/default/Lithuanian/_lithuanian_template_yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian
2025-08-31T08:28:06,839   copying lm_eval/tasks/include/default/Urdu/_urdu_template_yaml -> build/lib/lm_eval/tasks/include/default/Urdu
2025-08-31T08:28:06,842   copying lm_eval/tasks/include/default/Polish/_polish_template_yaml -> build/lib/lm_eval/tasks/include/default/Polish
2025-08-31T08:28:06,845   copying lm_eval/tasks/include/default/Tamil/_tamil_template_yaml -> build/lib/lm_eval/tasks/include/default/Tamil
2025-08-31T08:28:06,848   copying lm_eval/tasks/include/default/Italian/_italian_template_yaml -> build/lib/lm_eval/tasks/include/default/Italian
2025-08-31T08:28:06,851   copying lm_eval/tasks/include/default/Portuguese/_portuguese_template_yaml -> build/lib/lm_eval/tasks/include/default/Portuguese
2025-08-31T08:28:06,854   copying lm_eval/tasks/include/default/Estonian/_estonian_template_yaml -> build/lib/lm_eval/tasks/include/default/Estonian
2025-08-31T08:28:06,857   copying lm_eval/tasks/include/default/Bengali/_bengali_template_yaml -> build/lib/lm_eval/tasks/include/default/Bengali
2025-08-31T08:28:06,860   copying lm_eval/tasks/include/default/Croatian/_croatian_template_yaml -> build/lib/lm_eval/tasks/include/default/Croatian
2025-08-31T08:28:06,864   copying lm_eval/tasks/include/default/Malay/_malay_template_yaml -> build/lib/lm_eval/tasks/include/default/Malay
2025-08-31T08:28:06,867   copying lm_eval/tasks/include/default/Ukrainian/_ukrainian_template_yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian
2025-08-31T08:28:06,869   copying lm_eval/tasks/include/default/Arabic/_arabic_template_yaml -> build/lib/lm_eval/tasks/include/default/Arabic
2025-08-31T08:28:06,873   copying lm_eval/tasks/include/default/Malayalam/_malayalam_template_yaml -> build/lib/lm_eval/tasks/include/default/Malayalam
2025-08-31T08:28:06,876   copying lm_eval/tasks/include/few_shot_en/North Macedonian/_north macedonian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian
2025-08-31T08:28:06,878   copying lm_eval/tasks/include/few_shot_en/Basque/_basque_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Basque
2025-08-31T08:28:06,881   copying lm_eval/tasks/include/few_shot_en/Nepali/_nepali_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali
2025-08-31T08:28:06,883   copying lm_eval/tasks/include/few_shot_en/Hindi/_hindi_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:28:06,886   copying lm_eval/tasks/include/few_shot_en/Armenian/_armenian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian
2025-08-31T08:28:06,890   copying lm_eval/tasks/include/few_shot_en/Dutch/_dutch_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch
2025-08-31T08:28:06,893   copying lm_eval/tasks/include/few_shot_en/Albanian/_albanian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian
2025-08-31T08:28:06,896   copying lm_eval/tasks/include/few_shot_en/Serbian/_serbian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian
2025-08-31T08:28:06,898   copying lm_eval/tasks/include/few_shot_en/Russian/_russian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:28:06,902   copying lm_eval/tasks/include/few_shot_en/Finnish/_finnish_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish
2025-08-31T08:28:06,905   copying lm_eval/tasks/include/few_shot_en/German/_german_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German
2025-08-31T08:28:06,908   copying lm_eval/tasks/include/few_shot_en/Telugu/_telugu_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu
2025-08-31T08:28:06,912   copying lm_eval/tasks/include/few_shot_en/Azerbaijani/_azerbaijani_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani
2025-08-31T08:28:06,914   copying lm_eval/tasks/include/few_shot_en/Hungarian/_hungarian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian
2025-08-31T08:28:06,917   copying lm_eval/tasks/include/few_shot_en/Uzbek/_uzbek_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek
2025-08-31T08:28:06,921   copying lm_eval/tasks/include/few_shot_en/Korean/_korean_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Korean
2025-08-31T08:28:06,923   copying lm_eval/tasks/include/few_shot_en/Hebrew/_hebrew_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew
2025-08-31T08:28:06,927   copying lm_eval/tasks/include/few_shot_en/Belarusian/_belarusian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian
2025-08-31T08:28:06,929   copying lm_eval/tasks/include/few_shot_en/Japanese/_japanese_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese
2025-08-31T08:28:06,933   copying lm_eval/tasks/include/few_shot_en/Kazakh/_kazakh_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Kazakh
2025-08-31T08:28:06,936   copying lm_eval/tasks/include/few_shot_en/Georgian/_georgian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Georgian
2025-08-31T08:28:06,940   copying lm_eval/tasks/include/few_shot_en/Persian/_persian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian
2025-08-31T08:28:06,942   copying lm_eval/tasks/include/few_shot_en/Indonesian/_indonesian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian
2025-08-31T08:28:06,946   copying lm_eval/tasks/include/few_shot_en/Vietnamese/_vietnamese_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese
2025-08-31T08:28:06,948   copying lm_eval/tasks/include/few_shot_en/Spanish/_spanish_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish
2025-08-31T08:28:06,951   copying lm_eval/tasks/include/few_shot_en/Greek/_greek_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek
2025-08-31T08:28:06,954   copying lm_eval/tasks/include/few_shot_en/Chinese/_chinese_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:28:06,957   copying lm_eval/tasks/include/few_shot_en/Turkish/_turkish_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish
2025-08-31T08:28:06,959   copying lm_eval/tasks/include/few_shot_en/Tagalog/_tagalog_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog
2025-08-31T08:28:06,963   copying lm_eval/tasks/include/few_shot_en/French/_french_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French
2025-08-31T08:28:06,966   copying lm_eval/tasks/include/few_shot_en/Bulgarian/_bulgarian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian
2025-08-31T08:28:06,969   copying lm_eval/tasks/include/few_shot_en/Lithuanian/_lithuanian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian
2025-08-31T08:28:06,972   copying lm_eval/tasks/include/few_shot_en/Urdu/_urdu_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu
2025-08-31T08:28:06,975   copying lm_eval/tasks/include/few_shot_en/Polish/_polish_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish
2025-08-31T08:28:06,978   copying lm_eval/tasks/include/few_shot_en/Tamil/_tamil_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil
2025-08-31T08:28:06,981   copying lm_eval/tasks/include/few_shot_en/Italian/_italian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian
2025-08-31T08:28:06,985   copying lm_eval/tasks/include/few_shot_en/Portuguese/_portuguese_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese
2025-08-31T08:28:06,988   copying lm_eval/tasks/include/few_shot_en/Estonian/_estonian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian
2025-08-31T08:28:06,990   copying lm_eval/tasks/include/few_shot_en/Bengali/_bengali_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali
2025-08-31T08:28:06,993   copying lm_eval/tasks/include/few_shot_en/Croatian/_croatian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian
2025-08-31T08:28:06,996   copying lm_eval/tasks/include/few_shot_en/Malay/_malay_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay
2025-08-31T08:28:07,000   copying lm_eval/tasks/include/few_shot_en/Ukrainian/_ukrainian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian
2025-08-31T08:28:07,003   copying lm_eval/tasks/include/few_shot_en/Arabic/_arabic_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic
2025-08-31T08:28:07,005   copying lm_eval/tasks/include/few_shot_en/Malayalam/_malayalam_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam
2025-08-31T08:28:07,009   copying lm_eval/tasks/winogrande/README.md -> build/lib/lm_eval/tasks/winogrande
2025-08-31T08:28:07,012   copying lm_eval/tasks/arab_culture_completion/README.md -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:07,016   copying lm_eval/tasks/arab_culture_completion/_default_arab_culture_completion_template_yaml -> build/lib/lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:07,018   copying lm_eval/tasks/prost/README.md -> build/lib/lm_eval/tasks/prost
2025-08-31T08:28:07,020   copying lm_eval/tasks/gsm_plus/README.md -> build/lib/lm_eval/tasks/gsm_plus
2025-08-31T08:28:07,023   copying lm_eval/tasks/moral_stories/README.md -> build/lib/lm_eval/tasks/moral_stories
2025-08-31T08:28:07,026   copying lm_eval/tasks/histoires_morales/README.md -> build/lib/lm_eval/tasks/histoires_morales
2025-08-31T08:28:07,029   copying lm_eval/tasks/bbh/README.md -> build/lib/lm_eval/tasks/bbh
2025-08-31T08:28:07,033   copying lm_eval/tasks/bbh/zeroshot/_zeroshot_template_yaml -> build/lib/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:07,035   copying lm_eval/tasks/bbh/cot_zeroshot/_cot_zeroshot_template_yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:07,038   copying lm_eval/tasks/bbh/fewshot/_fewshot_template_yaml -> build/lib/lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:07,041   copying lm_eval/tasks/bbh/cot_fewshot/_cot_fewshot_template_yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:07,044   copying lm_eval/tasks/mmlu/README.md -> build/lib/lm_eval/tasks/mmlu
2025-08-31T08:28:07,047   copying lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu_flan_cot_fewshot_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:07,049   copying lm_eval/tasks/mmlu/flan_cot_fewshot/_cot_prompts.json -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:07,056   copying lm_eval/tasks/mmlu/generative/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu/generative
2025-08-31T08:28:07,058   copying lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu_flan_cot_zeroshot_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:07,062   copying lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu_flan_generative_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:07,064   copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu_flan_loglikelihood_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:07,067   copying lm_eval/tasks/mmlu/continuation/_continuation_template_yaml -> build/lib/lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:07,069   copying lm_eval/tasks/mmlu/default/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu/default
2025-08-31T08:28:07,072   copying lm_eval/tasks/translation/README.md -> build/lib/lm_eval/tasks/translation
2025-08-31T08:28:07,074   copying lm_eval/tasks/translation/wmt_common_yaml -> build/lib/lm_eval/tasks/translation
2025-08-31T08:28:07,077   copying lm_eval/tasks/gpqa/README.md -> build/lib/lm_eval/tasks/gpqa
2025-08-31T08:28:07,080   copying lm_eval/tasks/gpqa/zeroshot/_gpqa_zeroshot_yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot
2025-08-31T08:28:07,084   copying lm_eval/tasks/gpqa/generative/_gpqa_generative_n_shot_yaml -> build/lib/lm_eval/tasks/gpqa/generative
2025-08-31T08:28:07,086   copying lm_eval/tasks/gpqa/cot_zeroshot/_gpqa_cot_zeroshot_yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot
2025-08-31T08:28:07,090   copying lm_eval/tasks/gpqa/cot_n_shot/_gpqa_cot_n_shot_yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot
2025-08-31T08:28:07,094   copying lm_eval/tasks/gpqa/n_shot/_gpqa_n_shot_yaml -> build/lib/lm_eval/tasks/gpqa/n_shot
2025-08-31T08:28:07,097   copying lm_eval/tasks/tmlu/subject.tsv -> build/lib/lm_eval/tasks/tmlu
2025-08-31T08:28:07,100   copying lm_eval/tasks/tmlu/README.md -> build/lib/lm_eval/tasks/tmlu
2025-08-31T08:28:07,103   copying lm_eval/tasks/tmlu/default/_default_template_yaml -> build/lib/lm_eval/tasks/tmlu/default
2025-08-31T08:28:07,106   copying lm_eval/tasks/arabicmmlu/_default_arabicmmlu_template_yaml -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:28:07,109   copying lm_eval/tasks/arabicmmlu/README.md -> build/lib/lm_eval/tasks/arabicmmlu
2025-08-31T08:28:07,113   copying lm_eval/tasks/mgsm/README.md -> build/lib/lm_eval/tasks/mgsm
2025-08-31T08:28:07,115   copying lm_eval/tasks/mgsm/gen_yaml.sh -> build/lib/lm_eval/tasks/mgsm
2025-08-31T08:28:07,118   copying lm_eval/tasks/mgsm/en_cot/cot_yaml -> build/lib/lm_eval/tasks/mgsm/en_cot
2025-08-31T08:28:07,120   copying lm_eval/tasks/mgsm/native_cot/cot_yaml -> build/lib/lm_eval/tasks/mgsm/native_cot
2025-08-31T08:28:07,122   copying lm_eval/tasks/mgsm/direct/direct_yaml -> build/lib/lm_eval/tasks/mgsm/direct
2025-08-31T08:28:07,126   copying lm_eval/tasks/basque_bench/README.md -> build/lib/lm_eval/tasks/basque_bench
2025-08-31T08:28:07,129   copying lm_eval/tasks/basque_bench/flores_eu/_flores_common_yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:28:07,133   copying lm_eval/tasks/chartqa/README.md -> build/lib/lm_eval/tasks/chartqa
2025-08-31T08:28:07,136   copying lm_eval/tasks/race/README.md -> build/lib/lm_eval/tasks/race
2025-08-31T08:28:07,139   copying lm_eval/tasks/glianorex/README.md -> build/lib/lm_eval/tasks/glianorex
2025-08-31T08:28:07,142   copying lm_eval/tasks/triviaqa/README.md -> build/lib/lm_eval/tasks/triviaqa
2025-08-31T08:28:07,145   copying lm_eval/tasks/mathqa/README.md -> build/lib/lm_eval/tasks/mathqa
2025-08-31T08:28:07,147   copying lm_eval/tasks/unscramble/README.md -> build/lib/lm_eval/tasks/unscramble
2025-08-31T08:28:07,149   copying lm_eval/tasks/arithmetic/README.md -> build/lib/lm_eval/tasks/arithmetic
2025-08-31T08:28:07,152   copying lm_eval/tasks/evalita_llm/_sum_template_fp-small_yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:28:07,154   copying lm_eval/tasks/evalita_llm/_ner_template_yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:28:07,156   copying lm_eval/tasks/evalita_llm/_re_template_yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:28:07,158   copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:28:07,161   copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:28:07,163   copying lm_eval/tasks/evalita_llm/_sa_template_yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:28:07,165   copying lm_eval/tasks/evalita_llm/_ls_template_yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:28:07,167   copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:28:07,171   copying lm_eval/tasks/evalita_llm/_sa_template_v2_yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:28:07,173   copying lm_eval/tasks/evalita_llm/README.md -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:28:07,176   copying lm_eval/tasks/evalita_llm/_te_template_yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:28:07,178   copying lm_eval/tasks/evalita_llm/_sum_template_yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:28:07,180   copying lm_eval/tasks/evalita_llm/_at_template_yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:28:07,182   copying lm_eval/tasks/evalita_llm/_sum_template_fp_yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:28:07,185   copying lm_eval/tasks/evalita_llm/_wic_template_yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:28:07,187   copying lm_eval/tasks/evalita_llm/_hs_template_yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:28:07,190   copying lm_eval/tasks/evalita_llm/_faq_template_yaml -> build/lib/lm_eval/tasks/evalita_llm
2025-08-31T08:28:07,193   copying lm_eval/tasks/xnli/README.md -> build/lib/lm_eval/tasks/xnli
2025-08-31T08:28:07,195   copying lm_eval/tasks/xnli/xnli_common_yaml -> build/lib/lm_eval/tasks/xnli
2025-08-31T08:28:07,197   copying lm_eval/tasks/jsonschema_bench/README.md -> build/lib/lm_eval/tasks/jsonschema_bench
2025-08-31T08:28:07,201   copying lm_eval/tasks/xwinograd/xwinograd_common_yaml -> build/lib/lm_eval/tasks/xwinograd
2025-08-31T08:28:07,204   copying lm_eval/tasks/xwinograd/README.md -> build/lib/lm_eval/tasks/xwinograd
2025-08-31T08:28:07,206   copying lm_eval/tasks/alghafa/piqa_ar/README.md -> build/lib/lm_eval/tasks/alghafa/piqa_ar
2025-08-31T08:28:07,209   copying lm_eval/tasks/alghafa/copa_ar/README.md -> build/lib/lm_eval/tasks/alghafa/copa_ar
2025-08-31T08:28:07,211   copying lm_eval/tasks/commonsense_qa/README.md -> build/lib/lm_eval/tasks/commonsense_qa
2025-08-31T08:28:07,213   copying lm_eval/tasks/gsm8k/README.md -> build/lib/lm_eval/tasks/gsm8k
2025-08-31T08:28:07,217   copying lm_eval/tasks/galician_bench/README.md -> build/lib/lm_eval/tasks/galician_bench
2025-08-31T08:28:07,221   copying lm_eval/tasks/galician_bench/flores_gl/_flores_common_yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:28:07,223   copying lm_eval/tasks/turkishmmlu/README.md -> build/lib/lm_eval/tasks/turkishmmlu
2025-08-31T08:28:07,226   copying lm_eval/tasks/turkishmmlu/config/_turkishmmlu_default_yaml -> build/lib/lm_eval/tasks/turkishmmlu/config
2025-08-31T08:28:07,228   copying lm_eval/tasks/turkishmmlu/config_cot/_turkishmmlu_cot_default_yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot
2025-08-31T08:28:07,231   copying lm_eval/tasks/xquad/xquad_common_yaml -> build/lib/lm_eval/tasks/xquad
2025-08-31T08:28:07,234   copying lm_eval/tasks/xquad/README.md -> build/lib/lm_eval/tasks/xquad
2025-08-31T08:28:07,236   copying lm_eval/tasks/arc_mt/README.md -> build/lib/lm_eval/tasks/arc_mt
2025-08-31T08:28:07,240   copying lm_eval/tasks/careqa/README.md -> build/lib/lm_eval/tasks/careqa
2025-08-31T08:28:07,243   copying lm_eval/tasks/catalan_bench/README.md -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:28:07,246   copying lm_eval/tasks/catalan_bench/_cabreu_common_yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:28:07,249   copying lm_eval/tasks/catalan_bench/_arc_ca_common_yaml -> build/lib/lm_eval/tasks/catalan_bench
2025-08-31T08:28:07,251   copying lm_eval/tasks/catalan_bench/phrases_va/_phrases_va_common -> build/lib/lm_eval/tasks/catalan_bench/phrases_va
2025-08-31T08:28:07,254   copying lm_eval/tasks/catalan_bench/flores_ca/_flores_common_yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:28:07,257   copying lm_eval/tasks/unitxt/unitxt_multimodal -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:28:07,259   copying lm_eval/tasks/unitxt/unitxt -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:28:07,262   copying lm_eval/tasks/unitxt/README.md -> build/lib/lm_eval/tasks/unitxt
2025-08-31T08:28:07,265   copying lm_eval/tasks/darijammlu/_default_darijammlu_template_yaml -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:28:07,268   copying lm_eval/tasks/darijammlu/README.md -> build/lib/lm_eval/tasks/darijammlu
2025-08-31T08:28:07,273   copying lm_eval/tasks/mts_dialog/README.md -> build/lib/lm_eval/tasks/mts_dialog
2025-08-31T08:28:07,277   copying lm_eval/tasks/japanese_leaderboard/requirements.txt -> build/lib/lm_eval/tasks/japanese_leaderboard
2025-08-31T08:28:07,281   copying lm_eval/tasks/japanese_leaderboard/README.md -> build/lib/lm_eval/tasks/japanese_leaderboard
2025-08-31T08:28:07,286   copying lm_eval/tasks/medtext/README.md -> build/lib/lm_eval/tasks/medtext
2025-08-31T08:28:07,290   copying lm_eval/tasks/qasper/README.md -> build/lib/lm_eval/tasks/qasper
2025-08-31T08:28:07,293   copying lm_eval/tasks/lambada_multilingual_stablelm/README.md -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm
2025-08-31T08:28:07,296   copying lm_eval/tasks/eq_bench/README.md -> build/lib/lm_eval/tasks/eq_bench
2025-08-31T08:28:07,299   copying lm_eval/tasks/bbq/README.md -> build/lib/lm_eval/tasks/bbq
2025-08-31T08:28:07,302   copying lm_eval/tasks/swag/README.md -> build/lib/lm_eval/tasks/swag
2025-08-31T08:28:07,305   copying lm_eval/tasks/okapi/mmlu_multilingual/_default_yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:07,307   copying lm_eval/tasks/okapi/arc_multilingual/_arc_yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:07,310   copying lm_eval/tasks/okapi/arc_multilingual/README.md -> build/lib/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:07,313   copying lm_eval/tasks/okapi/hellaswag_multilingual/_hellaswag_yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:07,316   copying lm_eval/tasks/okapi/hellaswag_multilingual/README.md -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:07,318   copying lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc2_yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:07,321   copying lm_eval/tasks/okapi/truthfulqa_multilingual/README.md -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:07,323   copying lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc1_yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:07,328   copying lm_eval/tasks/ifeval/README.md -> build/lib/lm_eval/tasks/ifeval
2025-08-31T08:28:07,331   copying lm_eval/tasks/darijahellaswag/README.md -> build/lib/lm_eval/tasks/darijahellaswag
2025-08-31T08:28:07,334   copying lm_eval/tasks/arc/README.md -> build/lib/lm_eval/tasks/arc
2025-08-31T08:28:07,336   copying lm_eval/tasks/qa4mre/README.md -> build/lib/lm_eval/tasks/qa4mre
2025-08-31T08:28:07,339   copying lm_eval/tasks/arabic_leaderboard_complete/README.md -> build/lib/lm_eval/tasks/arabic_leaderboard_complete
2025-08-31T08:28:07,354   copying lm_eval/tasks/eus_trivia/README.md -> build/lib/lm_eval/tasks/eus_trivia
2025-08-31T08:28:07,357   copying lm_eval/tasks/mmlu-pro-plus/README.md -> build/lib/lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:28:07,360   copying lm_eval/tasks/mmlu-pro-plus/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:28:07,362   copying lm_eval/tasks/lambada_cloze/README.md -> build/lib/lm_eval/tasks/lambada_cloze
2025-08-31T08:28:07,365   copying lm_eval/tasks/aexams/README.md -> build/lib/lm_eval/tasks/aexams
2025-08-31T08:28:07,367   copying lm_eval/tasks/aexams/_default_template_yaml -> build/lib/lm_eval/tasks/aexams
2025-08-31T08:28:07,371   copying lm_eval/tasks/inverse_scaling/_some_results -> build/lib/lm_eval/tasks/inverse_scaling
2025-08-31T08:28:07,374   copying lm_eval/tasks/inverse_scaling/_inverse_scaling_mc_yaml -> build/lib/lm_eval/tasks/inverse_scaling
2025-08-31T08:28:07,376   copying lm_eval/tasks/inverse_scaling/README.md -> build/lib/lm_eval/tasks/inverse_scaling
2025-08-31T08:28:07,378   copying lm_eval/tasks/aradice/README.md -> build/lib/lm_eval/tasks/aradice
2025-08-31T08:28:07,386   copying lm_eval/tasks/aradice/ArabicMMLU/EGY/_default_template_yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:07,390   copying lm_eval/tasks/aradice/ArabicMMLU/LEV/_default_template_yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:07,399   copying lm_eval/tasks/wmdp/README.md -> build/lib/lm_eval/tasks/wmdp
2025-08-31T08:28:07,402   copying lm_eval/tasks/wmdp/_default_template_yaml -> build/lib/lm_eval/tasks/wmdp
2025-08-31T08:28:07,405   copying lm_eval/tasks/longbench/README.md -> build/lib/lm_eval/tasks/longbench
2025-08-31T08:28:07,409   copying lm_eval/tasks/scrolls/README.md -> build/lib/lm_eval/tasks/scrolls
2025-08-31T08:28:07,412   copying lm_eval/tasks/benchmarks/README.md -> build/lib/lm_eval/tasks/benchmarks
2025-08-31T08:28:07,414   copying lm_eval/tasks/benchmarks/multimedqa/README.md -> build/lib/lm_eval/tasks/benchmarks/multimedqa
2025-08-31T08:28:07,416   copying lm_eval/tasks/benchmarks/flan/_held_in_template_yaml -> build/lib/lm_eval/tasks/benchmarks/flan
2025-08-31T08:28:07,419   copying lm_eval/tasks/egymmlu/_default_egymmlu_template_yaml -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:28:07,421   copying lm_eval/tasks/egymmlu/README.md -> build/lib/lm_eval/tasks/egymmlu
2025-08-31T08:28:07,424   copying lm_eval/tasks/pile/README.md -> build/lib/lm_eval/tasks/pile
2025-08-31T08:28:07,428   copying lm_eval/tasks/model_written_evals/advanced_ai_risk/_template_yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:07,430   creating build/lib/lm_eval/tasks/model_written_evals/winogenerated
2025-08-31T08:28:07,431   copying lm_eval/tasks/model_written_evals/winogenerated/winogenerated -> build/lib/lm_eval/tasks/model_written_evals/winogenerated
2025-08-31T08:28:07,434   copying lm_eval/tasks/model_written_evals/persona/_template_yaml -> build/lib/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:07,437   copying lm_eval/tasks/piqa/README.md -> build/lib/lm_eval/tasks/piqa
2025-08-31T08:28:07,440   copying lm_eval/tasks/metabench/README.md -> build/lib/lm_eval/tasks/metabench
2025-08-31T08:28:07,443   copying lm_eval/tasks/paws-x/pawsx_template_yaml -> build/lib/lm_eval/tasks/paws-x
2025-08-31T08:28:07,447   copying lm_eval/tasks/paws-x/README.md -> build/lib/lm_eval/tasks/paws-x
2025-08-31T08:28:07,449   copying lm_eval/tasks/spanish_bench/README.md -> build/lib/lm_eval/tasks/spanish_bench
2025-08-31T08:28:07,452   copying lm_eval/tasks/spanish_bench/phrases_es/_phrases_es_common -> build/lib/lm_eval/tasks/spanish_bench/phrases_es
2025-08-31T08:28:07,455   copying lm_eval/tasks/spanish_bench/flores_es/_flores_common_yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:28:07,458   copying lm_eval/tasks/hendrycks_math/README.md -> build/lib/lm_eval/tasks/hendrycks_math
2025-08-31T08:28:07,460   copying lm_eval/tasks/lambada_multilingual/README.md -> build/lib/lm_eval/tasks/lambada_multilingual
2025-08-31T08:28:07,463   copying lm_eval/tasks/afrimmlu/fewshot.sh -> build/lib/lm_eval/tasks/afrimmlu
2025-08-31T08:28:07,466   copying lm_eval/tasks/afrimmlu/README.md -> build/lib/lm_eval/tasks/afrimmlu
2025-08-31T08:28:07,469   copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:28:07,472   copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:28:07,476   copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:28:07,479   copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:28:07,482   copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:28:07,487   copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:28:07,490   copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:28:07,493   copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:28:07,496   copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:28:07,499   copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:28:07,501   copying lm_eval/tasks/belebele/README.md -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:28:07,503   copying lm_eval/tasks/belebele/_default_template_yaml -> build/lib/lm_eval/tasks/belebele
2025-08-31T08:28:07,506   copying lm_eval/tasks/mlqa/mlqa_common_yaml -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:28:07,510   copying lm_eval/tasks/mlqa/README.md -> build/lib/lm_eval/tasks/mlqa
2025-08-31T08:28:07,513   copying lm_eval/tasks/eus_reading/README.md -> build/lib/lm_eval/tasks/eus_reading
2025-08-31T08:28:07,515   copying lm_eval/tasks/ceval/_default_ceval_yaml -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:28:07,517   copying lm_eval/tasks/ceval/README.md -> build/lib/lm_eval/tasks/ceval
2025-08-31T08:28:07,520   copying lm_eval/tasks/nq_open/README.md -> build/lib/lm_eval/tasks/nq_open
2025-08-31T08:28:07,523   copying lm_eval/tasks/webqs/README.md -> build/lib/lm_eval/tasks/webqs
2025-08-31T08:28:07,525   copying lm_eval/tasks/super_glue/README.md -> build/lib/lm_eval/tasks/super_glue
2025-08-31T08:28:07,535   copying lm_eval/tasks/mimic_repsum/README.md -> build/lib/lm_eval/tasks/mimic_repsum
2025-08-31T08:28:07,538   copying lm_eval/tasks/meqsum/README.md -> build/lib/lm_eval/tasks/meqsum
2025-08-31T08:28:07,542   copying lm_eval/tasks/csatqa/_default_csatqa_yaml -> build/lib/lm_eval/tasks/csatqa
2025-08-31T08:28:07,546   copying lm_eval/tasks/toxigen/README.md -> build/lib/lm_eval/tasks/toxigen
2025-08-31T08:28:07,549   copying lm_eval/tasks/arabic_leaderboard_light/README.md -> build/lib/lm_eval/tasks/arabic_leaderboard_light
2025-08-31T08:28:07,562   copying lm_eval/tasks/cmmlu/README.md -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:28:07,564   copying lm_eval/tasks/cmmlu/_default_template_yaml -> build/lib/lm_eval/tasks/cmmlu
2025-08-31T08:28:07,568   copying lm_eval/tasks/noticia/README.md -> build/lib/lm_eval/tasks/noticia
2025-08-31T08:28:07,570   copying lm_eval/tasks/pubmedqa/README.md -> build/lib/lm_eval/tasks/pubmedqa
2025-08-31T08:28:07,573   copying lm_eval/tasks/squadv2/README.md -> build/lib/lm_eval/tasks/squadv2
2025-08-31T08:28:07,577   copying lm_eval/tasks/truthfulqa/README.md -> build/lib/lm_eval/tasks/truthfulqa
2025-08-31T08:28:07,580   copying lm_eval/tasks/llama3/README.md -> build/lib/lm_eval/tasks/llama3
2025-08-31T08:28:07,582   copying lm_eval/tasks/llama3/instruct/mmlu_it/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:07,585   copying lm_eval/tasks/llama3/instruct/mmlu/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:07,587   copying lm_eval/tasks/llama3/instruct/mmlu_de/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:07,590   copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:07,592   copying lm_eval/tasks/llama3/instruct/mmlu_fr/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:07,596   copying lm_eval/tasks/llama3/instruct/mmlu_hi/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:07,600   copying lm_eval/tasks/llama3/instruct/mmlu_th/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:07,604   copying lm_eval/tasks/llama3/instruct/mmlu_pro/_default_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:28:07,607   copying lm_eval/tasks/llama3/instruct/mmlu_es/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:07,610   copying lm_eval/tasks/llama3/instruct/mmlu_pt/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:07,614   copying lm_eval/tasks/tinyBenchmarks/README.md -> build/lib/lm_eval/tasks/tinyBenchmarks
2025-08-31T08:28:07,619   copying lm_eval/tasks/acpbench/README.md -> build/lib/lm_eval/tasks/acpbench
2025-08-31T08:28:07,622   copying lm_eval/tasks/acpbench/mcq_cot_2shot/_mcq_cot_2shot_yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot
2025-08-31T08:28:07,625   copying lm_eval/tasks/acpbench/gen_2shot/_gen_yaml_2shot -> build/lib/lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:28:07,627   copying lm_eval/tasks/acpbench/gen_2shot/acp_grammar.lark -> build/lib/lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:28:07,630   copying lm_eval/tasks/acpbench/boolq_cot_2shot/_boolq_cot_2shot_yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot
2025-08-31T08:28:07,633   copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/_gen_yaml_2shot -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:28:07,635   copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_grammar.lark -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:28:07,638   copying lm_eval/tasks/glue/README.md -> build/lib/lm_eval/tasks/glue
2025-08-31T08:28:07,642   copying lm_eval/tasks/hendrycks_ethics/README.md -> build/lib/lm_eval/tasks/hendrycks_ethics
2025-08-31T08:28:07,644   copying lm_eval/tasks/hendrycks_ethics/utilitarianism_original_yaml -> build/lib/lm_eval/tasks/hendrycks_ethics
2025-08-31T08:28:07,646   copying lm_eval/tasks/tmmluplus/subject.tsv -> build/lib/lm_eval/tasks/tmmluplus
2025-08-31T08:28:07,649   copying lm_eval/tasks/tmmluplus/README.md -> build/lib/lm_eval/tasks/tmmluplus
2025-08-31T08:28:07,651   copying lm_eval/tasks/tmmluplus/default/_tmmluplus_template_yaml -> build/lib/lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:07,655   copying lm_eval/tasks/afrobench/README.md -> build/lib/lm_eval/tasks/afrobench
2025-08-31T08:28:07,658   copying lm_eval/tasks/afrobench/uhura-arc-easy/README.md -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy
2025-08-31T08:28:07,660   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4
2025-08-31T08:28:07,664   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2
2025-08-31T08:28:07,667   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5
2025-08-31T08:28:07,670   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1
2025-08-31T08:28:07,673   copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3
2025-08-31T08:28:07,677   copying lm_eval/tasks/afrobench/afriqa/README.md -> build/lib/lm_eval/tasks/afrobench/afriqa
2025-08-31T08:28:07,679   copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:28:07,682   copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:28:07,686   copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:28:07,689   copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:28:07,692   copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:28:07,695   copying lm_eval/tasks/afrobench/mafand/README.md -> build/lib/lm_eval/tasks/afrobench/mafand
2025-08-31T08:28:07,698   copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:07,701   copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:07,704   copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:07,707   copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:07,710   copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:07,713   copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:07,715   creating build/lib/lm_eval/tasks/afrobench/sample_run_scripts
2025-08-31T08:28:07,717   copying lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench_lite.sh -> build/lib/lm_eval/tasks/afrobench/sample_run_scripts
2025-08-31T08:28:07,719   copying lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench.sh -> build/lib/lm_eval/tasks/afrobench/sample_run_scripts
2025-08-31T08:28:07,722   copying lm_eval/tasks/afrobench/masakhanews/README.md -> build/lib/lm_eval/tasks/afrobench/masakhanews
2025-08-31T08:28:07,724   copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:28:07,727   copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:28:07,730   copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:28:07,733   copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:28:07,737   copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:28:07,740   copying lm_eval/tasks/afrobench/flores/README.md -> build/lib/lm_eval/tasks/afrobench/flores
2025-08-31T08:28:07,743   copying lm_eval/tasks/afrobench/flores/prompt_2/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2
2025-08-31T08:28:07,746   copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:07,748   copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:07,751   copying lm_eval/tasks/afrobench/flores/prompt_1/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1
2025-08-31T08:28:07,753   copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:07,756   copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:07,758   copying lm_eval/tasks/afrobench/flores/prompt_3/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3
2025-08-31T08:28:07,761   copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:07,763   copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:07,766   copying lm_eval/tasks/afrobench/adr/README.md -> build/lib/lm_eval/tasks/afrobench/adr
2025-08-31T08:28:07,769   copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4
2025-08-31T08:28:07,772   copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2
2025-08-31T08:28:07,774   copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5
2025-08-31T08:28:07,777   copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1
2025-08-31T08:28:07,779   copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3
2025-08-31T08:28:07,781   copying lm_eval/tasks/afrobench/salt/README.md -> build/lib/lm_eval/tasks/afrobench/salt
2025-08-31T08:28:07,783   copying lm_eval/tasks/afrobench/salt/prompt_2/salt -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:28:07,786   copying lm_eval/tasks/afrobench/salt/prompt_1/salt -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:28:07,788   copying lm_eval/tasks/afrobench/salt/prompt_3/salt -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:28:07,791   copying lm_eval/tasks/afrobench/belebele/README.md -> build/lib/lm_eval/tasks/afrobench/belebele
2025-08-31T08:28:07,793   copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:07,795   copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:07,797   copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:07,799   copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:07,802   copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:07,805   copying lm_eval/tasks/afrobench/sib/README.md -> build/lib/lm_eval/tasks/afrobench/sib
2025-08-31T08:28:07,808   copying lm_eval/tasks/afrobench/sib/prompt_4/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:07,811   copying lm_eval/tasks/afrobench/sib/prompt_2/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:07,814   copying lm_eval/tasks/afrobench/sib/prompt_5/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:07,818   copying lm_eval/tasks/afrobench/sib/prompt_1/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:07,821   copying lm_eval/tasks/afrobench/sib/prompt_3/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:07,825   copying lm_eval/tasks/afrobench/openai_mmlu/README.md -> build/lib/lm_eval/tasks/afrobench/openai_mmlu
2025-08-31T08:28:07,827   copying lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4
2025-08-31T08:28:07,830   copying lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2
2025-08-31T08:28:07,832   copying lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5
2025-08-31T08:28:07,834   copying lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1
2025-08-31T08:28:07,837   copying lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3
2025-08-31T08:28:07,839   copying lm_eval/tasks/afrobench/masakhaner/README.md -> build/lib/lm_eval/tasks/afrobench/masakhaner
2025-08-31T08:28:07,843   copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:07,846   copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:07,848   copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:07,852   copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:07,855   copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:07,858   copying lm_eval/tasks/afrobench/naijarc/README.md -> build/lib/lm_eval/tasks/afrobench/naijarc
2025-08-31T08:28:07,860   copying lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4
2025-08-31T08:28:07,862   copying lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2
2025-08-31T08:28:07,865   copying lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5
2025-08-31T08:28:07,867   copying lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1
2025-08-31T08:28:07,869   copying lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3
2025-08-31T08:28:07,871   copying lm_eval/tasks/afrobench/ntrex/README.md -> build/lib/lm_eval/tasks/afrobench/ntrex
2025-08-31T08:28:07,875   copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:07,877   copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:07,879   copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:07,882   copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:07,884   copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:07,887   copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:07,889   copying lm_eval/tasks/afrobench/masakhapos/README.md -> build/lib/lm_eval/tasks/afrobench/masakhapos
2025-08-31T08:28:07,893   copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:07,896   copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:07,899   copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:07,902   copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:07,905   copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:07,907   copying lm_eval/tasks/afrobench/nollysenti/README.md -> build/lib/lm_eval/tasks/afrobench/nollysenti
2025-08-31T08:28:07,910   copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4
2025-08-31T08:28:07,913   copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2
2025-08-31T08:28:07,916   copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5
2025-08-31T08:28:07,919   copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1
2025-08-31T08:28:07,922   copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3
2025-08-31T08:28:07,924   copying lm_eval/tasks/afrobench/xlsum/README.md -> build/lib/lm_eval/tasks/afrobench/xlsum
2025-08-31T08:28:07,927   copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:28:07,930   copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:28:07,933   copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:28:07,935   copying lm_eval/tasks/afrobench/afrisenti/fewshot.sh -> build/lib/lm_eval/tasks/afrobench/afrisenti
2025-08-31T08:28:07,939   copying lm_eval/tasks/afrobench/afrisenti/README.md -> build/lib/lm_eval/tasks/afrobench/afrisenti
2025-08-31T08:28:07,943   copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:28:07,947   copying lm_eval/tasks/afrobench/afrisenti/prompt_2/run.sh -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:28:07,949   copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:28:07,953   copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:28:07,957   copying lm_eval/tasks/afrobench/afrisenti/prompt_1/run.sh -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:28:07,959   copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:28:07,963   copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:28:07,965   copying lm_eval/tasks/afrobench/injongointent/README.md -> build/lib/lm_eval/tasks/afrobench/injongointent
2025-08-31T08:28:07,969   copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:28:07,971   copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:28:07,974   copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:28:07,977   copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:28:07,980   copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:28:07,982   copying lm_eval/tasks/polemo2/README.md -> build/lib/lm_eval/tasks/polemo2
2025-08-31T08:28:07,985   copying lm_eval/tasks/wsc273/README.md -> build/lib/lm_eval/tasks/wsc273
2025-08-31T08:28:07,988   copying lm_eval/tasks/c4/README.md -> build/lib/lm_eval/tasks/c4
2025-08-31T08:28:07,991   copying lm_eval/tasks/humaneval/README.md -> build/lib/lm_eval/tasks/humaneval
2025-08-31T08:28:07,993   copying lm_eval/tasks/eus_proficiency/README.md -> build/lib/lm_eval/tasks/eus_proficiency
2025-08-31T08:28:07,995   copying lm_eval/tasks/multiblimp/README.md -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:28:07,998   copying lm_eval/tasks/multiblimp/_template_yaml -> build/lib/lm_eval/tasks/multiblimp
2025-08-31T08:28:08,001   copying lm_eval/tasks/coqa/README.md -> build/lib/lm_eval/tasks/coqa
2025-08-31T08:28:08,003   copying lm_eval/tasks/score/NON_GREEDY.md -> build/lib/lm_eval/tasks/score
2025-08-31T08:28:08,007   copying lm_eval/tasks/score/README.md -> build/lib/lm_eval/tasks/score
2025-08-31T08:28:08,010   copying lm_eval/tasks/score/non_greedy.sh -> build/lib/lm_eval/tasks/score
2025-08-31T08:28:08,012   copying lm_eval/tasks/score/agi_eval/prompt_templates.json -> build/lib/lm_eval/tasks/score/agi_eval
2025-08-31T08:28:08,016   copying lm_eval/tasks/score/mmlu_pro/prompt_templates.json -> build/lib/lm_eval/tasks/score/mmlu_pro
2025-08-31T08:28:08,019   copying lm_eval/tasks/score/math/to_be_fixed_questions.json -> build/lib/lm_eval/tasks/score/math
2025-08-31T08:28:08,022   copying lm_eval/tasks/score/math/prompt_templates.json -> build/lib/lm_eval/tasks/score/math
2025-08-31T08:28:08,026   copying lm_eval/tasks/paloma/README.md -> build/lib/lm_eval/tasks/paloma
2025-08-31T08:28:08,029   copying lm_eval/tasks/paloma/_paloma_template -> build/lib/lm_eval/tasks/paloma
2025-08-31T08:28:08,031   copying lm_eval/tasks/storycloze/README.md -> build/lib/lm_eval/tasks/storycloze
2025-08-31T08:28:08,035   copying lm_eval/tasks/olaph/README.md -> build/lib/lm_eval/tasks/olaph
2025-08-31T08:28:08,038   copying lm_eval/tasks/xcopa/README.md -> build/lib/lm_eval/tasks/xcopa
2025-08-31T08:28:08,040   copying lm_eval/tasks/mastermind/README.md -> build/lib/lm_eval/tasks/mastermind
2025-08-31T08:28:08,044   copying lm_eval/tasks/meddialog/README.md -> build/lib/lm_eval/tasks/meddialog
2025-08-31T08:28:08,047   copying lm_eval/tasks/french_bench/README.md -> build/lib/lm_eval/tasks/french_bench
2025-08-31T08:28:08,049   copying lm_eval/tasks/french_bench/_default_template_yaml -> build/lib/lm_eval/tasks/french_bench
2025-08-31T08:28:08,052   copying lm_eval/tasks/haerae/README.md -> build/lib/lm_eval/tasks/haerae
2025-08-31T08:28:08,055   copying lm_eval/tasks/haerae/_default_haerae_yaml -> build/lib/lm_eval/tasks/haerae
2025-08-31T08:28:08,058   copying lm_eval/tasks/kobest/README.md -> build/lib/lm_eval/tasks/kobest
2025-08-31T08:28:08,060   copying lm_eval/tasks/med_concepts_qa/README.md -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:08,063   copying lm_eval/tasks/med_concepts_qa/_default_template_yaml -> build/lib/lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:08,066   copying lm_eval/tasks/mbpp/README.md -> build/lib/lm_eval/tasks/mbpp
2025-08-31T08:28:08,069   copying lm_eval/tasks/squad_completion/README.md -> build/lib/lm_eval/tasks/squad_completion
2025-08-31T08:28:08,072   copying lm_eval/tasks/logiqa/README.md -> build/lib/lm_eval/tasks/logiqa
2025-08-31T08:28:08,075   copying lm_eval/tasks/xnli_eu/README.md -> build/lib/lm_eval/tasks/xnli_eu
2025-08-31T08:28:08,077   copying lm_eval/tasks/xnli_eu/xnli_common_yaml -> build/lib/lm_eval/tasks/xnli_eu
2025-08-31T08:28:08,080   copying lm_eval/tasks/kmmlu/README.md -> build/lib/lm_eval/tasks/kmmlu
2025-08-31T08:28:08,082   copying lm_eval/tasks/kmmlu/direct_hard/_direct_hard_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:08,085   copying lm_eval/tasks/kmmlu/default/_default_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/default
2025-08-31T08:28:08,087   copying lm_eval/tasks/kmmlu/direct/_direct_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:08,089   copying lm_eval/tasks/kmmlu/hard/_hard_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:08,091   copying lm_eval/tasks/kmmlu/cot_hard/_cot_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:08,094   copying lm_eval/tasks/kbl/README.md -> build/lib/lm_eval/tasks/kbl
2025-08-31T08:28:08,097   copying lm_eval/tasks/kbl/bar_exam/criminal/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:28:08,099   copying lm_eval/tasks/kbl/bar_exam/civil/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:28:08,101   copying lm_eval/tasks/kbl/bar_exam/public/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:28:08,104   copying lm_eval/tasks/kbl/bar_exam/responsibility/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:28:08,106   copying lm_eval/tasks/kbl/knowledge/_kbl_knowledge_yaml -> build/lib/lm_eval/tasks/kbl/knowledge
2025-08-31T08:28:08,108   copying lm_eval/tasks/kbl/reasoning/_kbl_reasoning_yaml -> build/lib/lm_eval/tasks/kbl/reasoning
2025-08-31T08:28:08,111   copying lm_eval/tasks/simple_cooccurrence_bias/README.md -> build/lib/lm_eval/tasks/simple_cooccurrence_bias
2025-08-31T08:28:08,113   copying lm_eval/tasks/mela/README.md -> build/lib/lm_eval/tasks/mela
2025-08-31T08:28:08,116   copying lm_eval/tasks/bigbench/multiple_choice_template_b_yaml -> build/lib/lm_eval/tasks/bigbench
2025-08-31T08:28:08,118   copying lm_eval/tasks/bigbench/multiple_choice_template_a_yaml -> build/lib/lm_eval/tasks/bigbench
2025-08-31T08:28:08,121   copying lm_eval/tasks/bigbench/README.md -> build/lib/lm_eval/tasks/bigbench
2025-08-31T08:28:08,124   copying lm_eval/tasks/bigbench/generate_until_template_yaml -> build/lib/lm_eval/tasks/bigbench
2025-08-31T08:28:08,126   copying lm_eval/tasks/asdiv/README.md -> build/lib/lm_eval/tasks/asdiv
2025-08-31T08:28:08,129   copying lm_eval/tasks/crows_pairs/README.md -> build/lib/lm_eval/tasks/crows_pairs
2025-08-31T08:28:08,132   copying lm_eval/tasks/groundcocoa/README.md -> build/lib/lm_eval/tasks/groundcocoa
2025-08-31T08:28:08,136   copying lm_eval/tasks/mmlu_pro/README.md -> build/lib/lm_eval/tasks/mmlu_pro
2025-08-31T08:28:08,139   copying lm_eval/tasks/mmlu_pro/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu_pro
2025-08-31T08:28:08,141   copying lm_eval/tasks/wmt2016/README.md -> build/lib/lm_eval/tasks/wmt2016
2025-08-31T08:28:08,144   copying lm_eval/tasks/gsm8k_platinum/README.md -> build/lib/lm_eval/tasks/gsm8k_platinum
2025-08-31T08:28:08,148   copying lm_eval/tasks/mmmu/README.md -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:28:08,150   copying lm_eval/tasks/mmmu/_template_yaml -> build/lib/lm_eval/tasks/mmmu
2025-08-31T08:28:08,153   copying lm_eval/tasks/sciq/README.md -> build/lib/lm_eval/tasks/sciq
2025-08-31T08:28:08,156   copying lm_eval/tasks/global_mmlu/README.md -> build/lib/lm_eval/tasks/global_mmlu
2025-08-31T08:28:08,159   copying lm_eval/tasks/global_mmlu/full/sr/_sr_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:08,163   copying lm_eval/tasks/global_mmlu/full/bn/_bn_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:08,166   copying lm_eval/tasks/global_mmlu/full/hi/_hi_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:08,169   copying lm_eval/tasks/global_mmlu/full/fr/_fr_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:08,172   copying lm_eval/tasks/global_mmlu/full/he/_he_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:08,174   copying lm_eval/tasks/global_mmlu/full/en/_en_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:08,178   copying lm_eval/tasks/global_mmlu/full/uk/_uk_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:08,180   copying lm_eval/tasks/global_mmlu/full/sn/_sn_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:08,183   copying lm_eval/tasks/global_mmlu/full/si/_si_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:08,187   copying lm_eval/tasks/global_mmlu/full/vi/_vi_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:08,189   copying lm_eval/tasks/global_mmlu/full/ar/_ar_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:08,192   copying lm_eval/tasks/global_mmlu/full/nl/_nl_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:08,194   copying lm_eval/tasks/global_mmlu/full/yo/_yo_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:08,199   copying lm_eval/tasks/global_mmlu/full/ig/_ig_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:08,201   copying lm_eval/tasks/global_mmlu/full/fil/_fil_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:08,205   copying lm_eval/tasks/global_mmlu/full/cs/_cs_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:08,210   copying lm_eval/tasks/global_mmlu/full/es/_es_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:08,213   copying lm_eval/tasks/global_mmlu/full/lt/_lt_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:08,217   copying lm_eval/tasks/global_mmlu/full/am/_am_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:08,221   copying lm_eval/tasks/global_mmlu/full/sw/_sw_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:08,225   copying lm_eval/tasks/global_mmlu/full/fa/_fa_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:08,228   copying lm_eval/tasks/global_mmlu/full/ja/_ja_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:08,233   copying lm_eval/tasks/global_mmlu/full/ko/_ko_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:08,237   copying lm_eval/tasks/global_mmlu/full/pl/_pl_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:08,242   copying lm_eval/tasks/global_mmlu/full/ne/_ne_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:08,245   copying lm_eval/tasks/global_mmlu/full/pt/_pt_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:08,249   copying lm_eval/tasks/global_mmlu/full/ny/_ny_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:08,252   copying lm_eval/tasks/global_mmlu/full/tr/_tr_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:08,255   copying lm_eval/tasks/global_mmlu/full/te/_te_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:08,258   copying lm_eval/tasks/global_mmlu/full/ky/_ky_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:08,260   copying lm_eval/tasks/global_mmlu/full/ms/_ms_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:08,263   copying lm_eval/tasks/global_mmlu/full/mg/_mg_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:08,266   copying lm_eval/tasks/global_mmlu/full/el/_el_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:08,270   copying lm_eval/tasks/global_mmlu/full/sv/_sv_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:08,275   copying lm_eval/tasks/global_mmlu/full/so/_so_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:08,279   copying lm_eval/tasks/global_mmlu/full/id/_id_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:08,283   copying lm_eval/tasks/global_mmlu/full/it/_it_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:08,287   copying lm_eval/tasks/global_mmlu/full/ru/_ru_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:08,291   copying lm_eval/tasks/global_mmlu/full/ro/_ro_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:08,294   copying lm_eval/tasks/global_mmlu/full/de/_de_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:08,296   copying lm_eval/tasks/global_mmlu/full/zh/_zh_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:08,300   copying lm_eval/tasks/global_mmlu/full/ha/_ha_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:08,303   copying lm_eval/tasks/global_mmlu/default/bn/_bn_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn
2025-08-31T08:28:08,306   copying lm_eval/tasks/global_mmlu/default/hi/_hi_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi
2025-08-31T08:28:08,309   copying lm_eval/tasks/global_mmlu/default/fr/_fr_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr
2025-08-31T08:28:08,312   copying lm_eval/tasks/global_mmlu/default/en/_en_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en
2025-08-31T08:28:08,316   copying lm_eval/tasks/global_mmlu/default/ar/_ar_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar
2025-08-31T08:28:08,318   copying lm_eval/tasks/global_mmlu/default/yo/_yo_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo
2025-08-31T08:28:08,322   copying lm_eval/tasks/global_mmlu/default/es/_es_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es
2025-08-31T08:28:08,325   copying lm_eval/tasks/global_mmlu/default/sw/_sw_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw
2025-08-31T08:28:08,327   copying lm_eval/tasks/global_mmlu/default/ja/_ja_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja
2025-08-31T08:28:08,330   copying lm_eval/tasks/global_mmlu/default/ko/_ko_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko
2025-08-31T08:28:08,333   copying lm_eval/tasks/global_mmlu/default/pt/_pt_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt
2025-08-31T08:28:08,336   copying lm_eval/tasks/global_mmlu/default/id/_id_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id
2025-08-31T08:28:08,338   copying lm_eval/tasks/global_mmlu/default/it/_it_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it
2025-08-31T08:28:08,342   copying lm_eval/tasks/global_mmlu/default/de/_de_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de
2025-08-31T08:28:08,344   copying lm_eval/tasks/global_mmlu/default/zh/_zh_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh
2025-08-31T08:28:08,347   copying lm_eval/tasks/kormedmcqa/README.md -> build/lib/lm_eval/tasks/kormedmcqa
2025-08-31T08:28:08,349   copying lm_eval/tasks/kormedmcqa/_template_yaml -> build/lib/lm_eval/tasks/kormedmcqa
2025-08-31T08:28:08,352   copying lm_eval/tasks/siqa/README.md -> build/lib/lm_eval/tasks/siqa
2025-08-31T08:28:08,354   copying lm_eval/tasks/minerva_math/README.md -> build/lib/lm_eval/tasks/minerva_math
2025-08-31T08:28:08,357   copying lm_eval/tasks/logiqa2/README.md -> build/lib/lm_eval/tasks/logiqa2
2025-08-31T08:28:08,360   copying lm_eval/tasks/mmlusr/README.md -> build/lib/lm_eval/tasks/mmlusr
2025-08-31T08:28:08,364   copying lm_eval/tasks/mmlusr/answer_only/_mmlusr_a_yml -> build/lib/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:08,367   copying lm_eval/tasks/mmlusr/question_and_answer/_mmlusr_qna_yml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:08,369   copying lm_eval/tasks/mmlusr/question_only/_mmlusr_q_yml -> build/lib/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:08,373   copying lm_eval/tasks/swde/README.md -> build/lib/lm_eval/tasks/swde
2025-08-31T08:28:08,376   copying lm_eval/tasks/lambada/README.md -> build/lib/lm_eval/tasks/lambada
2025-08-31T08:28:08,381   copying lm_eval/tasks/afrixnli/README.md -> build/lib/lm_eval/tasks/afrixnli
2025-08-31T08:28:08,384   copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:08,387   copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:08,390   copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:08,393   copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:08,395   copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:08,398   copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:08,401   copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:08,404   copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:08,407   copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:08,410   copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:08,413   copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:08,416   copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:08,419   copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:08,422   copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:08,425   copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:08,429   copying lm_eval/tasks/copal_id/README.md -> build/lib/lm_eval/tasks/copal_id
2025-08-31T08:28:08,432   copying lm_eval/tasks/blimp/README.md -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:08,434   copying lm_eval/tasks/blimp/_template_yaml -> build/lib/lm_eval/tasks/blimp
2025-08-31T08:28:08,437   copying lm_eval/tasks/mmlu_prox/README.md -> build/lib/lm_eval/tasks/mmlu_prox
2025-08-31T08:28:08,441   copying lm_eval/tasks/mmlu_prox/bn/_bn_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:08,445   copying lm_eval/tasks/mmlu_prox/hi/_hi_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:08,447   copying lm_eval/tasks/mmlu_prox/fr/_fr_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:08,450   copying lm_eval/tasks/mmlu_prox/en/_en_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:08,454   copying lm_eval/tasks/mmlu_prox/ar/_ar_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:08,457   copying lm_eval/tasks/mmlu_prox/es/_es_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:08,460   copying lm_eval/tasks/mmlu_prox/sw/_sw_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:08,462   copying lm_eval/tasks/mmlu_prox/ja/_ja_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:08,465   copying lm_eval/tasks/mmlu_prox/ko/_ko_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:08,468   copying lm_eval/tasks/mmlu_prox/pt/_pt_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:08,471   copying lm_eval/tasks/mmlu_prox/th/_th_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:08,474   copying lm_eval/tasks/mmlu_prox/template/_lang_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/template
2025-08-31T08:28:08,477   copying lm_eval/tasks/mmlu_prox/de/_de_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:08,479   copying lm_eval/tasks/mmlu_prox/zh/_zh_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:08,482   copying lm_eval/tasks/leaderboard/README.md -> build/lib/lm_eval/tasks/leaderboard
2025-08-31T08:28:08,485   copying lm_eval/tasks/leaderboard/gpqa/_template_yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa
2025-08-31T08:28:08,488   copying lm_eval/tasks/leaderboard/musr/_template_yaml -> build/lib/lm_eval/tasks/leaderboard/musr
2025-08-31T08:28:08,493   copying lm_eval/tasks/leaderboard/bbh_mc/_fewshot_template_yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:08,497   copying lm_eval/tasks/leaderboard/math/_template_yaml -> build/lib/lm_eval/tasks/leaderboard/math
2025-08-31T08:28:08,499   copying lm_eval/tasks/mc_taco/README.md -> build/lib/lm_eval/tasks/mc_taco
2025-08-31T08:28:08,503   copying lm_eval/tasks/mediqa_qa2019/README.md -> build/lib/lm_eval/tasks/mediqa_qa2019
2025-08-31T08:28:08,506   copying lm_eval/tasks/headqa/README.md -> build/lib/lm_eval/tasks/headqa
2025-08-31T08:28:08,508   copying lm_eval/tasks/fda/README.md -> build/lib/lm_eval/tasks/fda
2025-08-31T08:28:08,511   copying lm_eval/tasks/hrm8k/README.md -> build/lib/lm_eval/tasks/hrm8k
2025-08-31T08:28:08,515   copying lm_eval/tasks/hrm8k/en/_hrm8k_en_yaml -> build/lib/lm_eval/tasks/hrm8k/en
2025-08-31T08:28:08,518   copying lm_eval/tasks/hrm8k/default/_hrm8k_yaml -> build/lib/lm_eval/tasks/hrm8k/default
2025-08-31T08:28:08,521   copying lm_eval/tasks/arab_culture/_default_arab_culture_mcq_template_yaml -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:28:08,523   copying lm_eval/tasks/arab_culture/README.md -> build/lib/lm_eval/tasks/arab_culture
2025-08-31T08:28:08,527   copying lm_eval/tasks/fld/README.md -> build/lib/lm_eval/tasks/fld
2025-08-31T08:28:08,529   copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_common -> build/lib/lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:08,532   copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc_common -> build/lib/lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:08,535   copying lm_eval/tasks/truthfulqa-multi/README.md -> build/lib/lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:08,537   copying lm_eval/tasks/mutual/README.md -> build/lib/lm_eval/tasks/mutual
2025-08-31T08:28:08,540   copying lm_eval/tasks/aclue/README.md -> build/lib/lm_eval/tasks/aclue
2025-08-31T08:28:08,542   copying lm_eval/tasks/aclue/_default_template_yaml -> build/lib/lm_eval/tasks/aclue
2025-08-31T08:28:08,545   copying lm_eval/tasks/portuguese_bench/README.md -> build/lib/lm_eval/tasks/portuguese_bench
2025-08-31T08:28:08,548   copying lm_eval/tasks/portuguese_bench/flores_pt/_flores_common_yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:08,550   copying lm_eval/tasks/basqueglue/README.md -> build/lib/lm_eval/tasks/basqueglue
2025-08-31T08:28:08,553   copying lm_eval/tasks/noreval/README.md -> build/lib/lm_eval/tasks/noreval
2025-08-31T08:28:08,556   copying lm_eval/tasks/noreval/noreval.jpg -> build/lib/lm_eval/tasks/noreval
2025-08-31T08:28:08,569   copying lm_eval/tasks/noreval/norquad/_norquad_yaml -> build/lib/lm_eval/tasks/noreval/norquad
2025-08-31T08:28:08,572   copying lm_eval/tasks/noreval/norcommonsenseqa/_norcommonsenseqa_yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa
2025-08-31T08:28:08,575   copying lm_eval/tasks/noreval/norec/_norec_yaml -> build/lib/lm_eval/tasks/noreval/norec
2025-08-31T08:28:08,577   copying lm_eval/tasks/noreval/noridiom/_noridiom_yaml -> build/lib/lm_eval/tasks/noreval/noridiom
2025-08-31T08:28:08,581   copying lm_eval/tasks/noreval/ask_gec/README.md -> build/lib/lm_eval/tasks/noreval/ask_gec
2025-08-31T08:28:08,583   copying lm_eval/tasks/noreval/ask_gec/_ask_gec_yaml -> build/lib/lm_eval/tasks/noreval/ask_gec
2025-08-31T08:28:08,586   copying lm_eval/tasks/noreval/tatoeba/_tatoeba_yaml -> build/lib/lm_eval/tasks/noreval/tatoeba
2025-08-31T08:28:08,588   copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/_nortruthfulqa_mc_yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice
2025-08-31T08:28:08,593   copying lm_eval/tasks/noreval/nortruthfulqa/generation/_nortruthfulqa_gen_yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation
2025-08-31T08:28:08,596   copying lm_eval/tasks/noreval/norbelebele/_norbelebele_yaml -> build/lib/lm_eval/tasks/noreval/norbelebele
2025-08-31T08:28:08,598   copying lm_eval/tasks/noreval/nrk_quiz_qa/_nrk_quiz_qa_yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa
2025-08-31T08:28:08,602   copying lm_eval/tasks/noreval/norsumm/_norsumm_yaml -> build/lib/lm_eval/tasks/noreval/norsumm
2025-08-31T08:28:08,605   copying lm_eval/tasks/noreval/noropenbookqa/_noropenbookqa_yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa
2025-08-31T08:28:13,477   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:13,480   copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:16,204   installing to build/bdist.linux-armv7l/wheel
2025-08-31T08:28:16,205   running install
2025-08-31T08:28:16,229   running install_lib
2025-08-31T08:28:16,235   creating build/bdist.linux-armv7l/wheel
2025-08-31T08:28:16,237   creating build/bdist.linux-armv7l/wheel/lm_eval
2025-08-31T08:28:16,239   creating build/bdist.linux-armv7l/wheel/lm_eval/api
2025-08-31T08:28:16,241   copying build/lib/lm_eval/api/filter.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api
2025-08-31T08:28:16,243   copying build/lib/lm_eval/api/group.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api
2025-08-31T08:28:16,245   copying build/lib/lm_eval/api/instance.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api
2025-08-31T08:28:16,247   copying build/lib/lm_eval/api/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api
2025-08-31T08:28:16,248   copying build/lib/lm_eval/api/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api
2025-08-31T08:28:16,252   copying build/lib/lm_eval/api/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api
2025-08-31T08:28:16,254   copying build/lib/lm_eval/api/registry.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api
2025-08-31T08:28:16,256   copying build/lib/lm_eval/api/model.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api
2025-08-31T08:28:16,259   copying build/lib/lm_eval/api/samplers.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api
2025-08-31T08:28:16,262   copying build/lib/lm_eval/evaluator.py -> build/bdist.linux-armv7l/wheel/./lm_eval
2025-08-31T08:28:16,265   creating build/bdist.linux-armv7l/wheel/lm_eval/loggers
2025-08-31T08:28:16,266   copying build/lib/lm_eval/loggers/evaluation_tracker.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers
2025-08-31T08:28:16,269   copying build/lib/lm_eval/loggers/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers
2025-08-31T08:28:16,272   copying build/lib/lm_eval/loggers/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers
2025-08-31T08:28:16,274   copying build/lib/lm_eval/loggers/wandb_logger.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers
2025-08-31T08:28:16,279   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks
2025-08-31T08:28:16,282   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lingoly
2025-08-31T08:28:16,283   copying build/lib/lm_eval/tasks/lingoly/lingoly_context.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly
2025-08-31T08:28:16,285   copying build/lib/lm_eval/tasks/lingoly/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly
2025-08-31T08:28:16,287   copying build/lib/lm_eval/tasks/lingoly/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly
2025-08-31T08:28:16,290   copying build/lib/lm_eval/tasks/lingoly/lingoly_nocontext.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly
2025-08-31T08:28:16,292   copying build/lib/lm_eval/tasks/lingoly/lingoly_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly
2025-08-31T08:28:16,294   copying build/lib/lm_eval/tasks/lingoly/script.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly
2025-08-31T08:28:16,297   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/drop
2025-08-31T08:28:16,299   copying build/lib/lm_eval/tasks/drop/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/drop
2025-08-31T08:28:16,301   copying build/lib/lm_eval/tasks/drop/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/drop
2025-08-31T08:28:16,303   copying build/lib/lm_eval/tasks/drop/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/drop
2025-08-31T08:28:16,306   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wikitext
2025-08-31T08:28:16,308   copying build/lib/lm_eval/tasks/wikitext/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wikitext
2025-08-31T08:28:16,310   copying build/lib/lm_eval/tasks/wikitext/wikitext.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wikitext
2025-08-31T08:28:16,312   copying build/lib/lm_eval/tasks/wikitext/preprocess_wikitext.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wikitext
2025-08-31T08:28:16,315   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench
2025-08-31T08:28:16,317   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench/darija_summarization
2025-08-31T08:28:16,319   copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/summarization_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization
2025-08-31T08:28:16,321   copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization
2025-08-31T08:28:16,324   copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization
2025-08-31T08:28:16,326   copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/summarization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization
2025-08-31T08:28:16,328   copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/summarization_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization
2025-08-31T08:28:16,331   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,333   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,335   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_fr_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,337   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_translation_dr_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,339   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,341   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,343   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,345   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_translation_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,348   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/translation_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,350   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,352   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,354   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,356   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,359   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,361   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,363   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,366   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_fr_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,368   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,370   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_translation_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,373   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_translation_en_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,375   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,378   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,380   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_en_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,383   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_translation_msa_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,386   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,388   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_translation_dr_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,390   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_msa_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,392   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,394   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_msa_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,397   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,399   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,401   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,404   copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_en_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation
2025-08-31T08:28:16,406   copying build/lib/lm_eval/tasks/darija_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench
2025-08-31T08:28:16,409   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench/darija_transliteration
2025-08-31T08:28:16,411   copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/transliteration_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration
2025-08-31T08:28:16,413   copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/translation_dr_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration
2025-08-31T08:28:16,415   copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/transliteration_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration
2025-08-31T08:28:16,417   copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration
2025-08-31T08:28:16,420   copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/transliteration_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration
2025-08-31T08:28:16,422   copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration
2025-08-31T08:28:16,425   copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/translation_ar_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration
2025-08-31T08:28:16,427   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench/darija_sentiment
2025-08-31T08:28:16,429   copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/default_darija_sentiment_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment
2025-08-31T08:28:16,431   copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_myc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment
2025-08-31T08:28:16,433   copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msac.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment
2025-08-31T08:28:16,435   copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_electrom.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment
2025-08-31T08:28:16,438   copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment
2025-08-31T08:28:16,440   copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment
2025-08-31T08:28:16,442   copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment
2025-08-31T08:28:16,444   copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment
2025-08-31T08:28:16,446   copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_mac.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment
2025-08-31T08:28:16,449   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/libra
2025-08-31T08:28:16,451   copying build/lib/lm_eval/tasks/libra/ru_babilong_qa2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,453   copying build/lib/lm_eval/tasks/libra/librusec_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,455   copying build/lib/lm_eval/tasks/libra/ru_quality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,457   copying build/lib/lm_eval/tasks/libra/librusec_mhqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,460   copying build/lib/lm_eval/tasks/libra/ru_gsm100.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,463   copying build/lib/lm_eval/tasks/libra/_multi_hop_question_answering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,466   copying build/lib/lm_eval/tasks/libra/ru_babilong_qa4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,469   copying build/lib/lm_eval/tasks/libra/ru_sci_abstract_retrieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,471   copying build/lib/lm_eval/tasks/libra/ru_babilong_qa5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,473   copying build/lib/lm_eval/tasks/libra/ru_qasper.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,476   copying build/lib/lm_eval/tasks/libra/long_context_multiq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,478   copying build/lib/lm_eval/tasks/libra/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,481   copying build/lib/lm_eval/tasks/libra/_simple_information_retrieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,483   copying build/lib/lm_eval/tasks/libra/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,485   copying build/lib/lm_eval/tasks/libra/_question_answering_and_multiple_choice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,487   copying build/lib/lm_eval/tasks/libra/ru_babilong_qa1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,489   copying build/lib/lm_eval/tasks/libra/ru_babilong_qa3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,491   copying build/lib/lm_eval/tasks/libra/matreshka_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,493   copying build/lib/lm_eval/tasks/libra/ru_2wikimultihopqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,496   copying build/lib/lm_eval/tasks/libra/passkey_with_librusec.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,498   copying build/lib/lm_eval/tasks/libra/ru_sci_passage_count.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,500   copying build/lib/lm_eval/tasks/libra/matreshka_yes_no.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,501   copying build/lib/lm_eval/tasks/libra/passkey.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,504   copying build/lib/lm_eval/tasks/libra/_complex_reasoning_and_mathematical_problems.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,506   copying build/lib/lm_eval/tasks/libra/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra
2025-08-31T08:28:16,509   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bertaqa
2025-08-31T08:28:16,510   copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa
2025-08-31T08:28:16,513   copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_itzuli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa
2025-08-31T08:28:16,515   copying build/lib/lm_eval/tasks/bertaqa/bertaqa_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa
2025-08-31T08:28:16,517   copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-13b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa
2025-08-31T08:28:16,519   copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa
2025-08-31T08:28:16,522   copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-70b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa
2025-08-31T08:28:16,524   copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_nllb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa
2025-08-31T08:28:16,526   copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa
2025-08-31T08:28:16,528   copying build/lib/lm_eval/tasks/bertaqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa
2025-08-31T08:28:16,531   copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_gemma-7b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa
2025-08-31T08:28:16,533   copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa
2025-08-31T08:28:16,535   copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_hitz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa
2025-08-31T08:28:16,537   copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa
2025-08-31T08:28:16,540   copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa
2025-08-31T08:28:16,542   copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa
2025-08-31T08:28:16,545   copying build/lib/lm_eval/tasks/bertaqa/_bertaqa_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa
2025-08-31T08:28:16,548   copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_madlad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa
2025-08-31T08:28:16,550   copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-7b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa
2025-08-31T08:28:16,553   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/anli
2025-08-31T08:28:16,555   copying build/lib/lm_eval/tasks/anli/anli_r1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli
2025-08-31T08:28:16,557   copying build/lib/lm_eval/tasks/anli/anli_r3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli
2025-08-31T08:28:16,559   copying build/lib/lm_eval/tasks/anli/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli
2025-08-31T08:28:16,561   copying build/lib/lm_eval/tasks/anli/anli_r2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli
2025-08-31T08:28:16,565   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/agieval
2025-08-31T08:28:16,566   copying build/lib/lm_eval/tasks/agieval/jec-qa-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,569   copying build/lib/lm_eval/tasks/agieval/gaokao-mathqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,571   copying build/lib/lm_eval/tasks/agieval/gaokao-history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,573   copying build/lib/lm_eval/tasks/agieval/math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,575   copying build/lib/lm_eval/tasks/agieval/logiqa-zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,578   copying build/lib/lm_eval/tasks/agieval/agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,580   copying build/lib/lm_eval/tasks/agieval/agieval_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,582   copying build/lib/lm_eval/tasks/agieval/gaokao-biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,585   copying build/lib/lm_eval/tasks/agieval/gaokao-geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,586   copying build/lib/lm_eval/tasks/agieval/sat-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,588   copying build/lib/lm_eval/tasks/agieval/jec-qa-kd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,590   copying build/lib/lm_eval/tasks/agieval/gaokao-physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,592   copying build/lib/lm_eval/tasks/agieval/lsat-ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,594   copying build/lib/lm_eval/tasks/agieval/lsat-rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,595   copying build/lib/lm_eval/tasks/agieval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,598   copying build/lib/lm_eval/tasks/agieval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,600   copying build/lib/lm_eval/tasks/agieval/gaokao-english.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,602   copying build/lib/lm_eval/tasks/agieval/gaokao-chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,604   copying build/lib/lm_eval/tasks/agieval/agieval_nous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,606   copying build/lib/lm_eval/tasks/agieval/aqua-rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,607   copying build/lib/lm_eval/tasks/agieval/gaokao-mathcloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,610   copying build/lib/lm_eval/tasks/agieval/logiqa-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,611   copying build/lib/lm_eval/tasks/agieval/sat-en-without-passage.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,613   copying build/lib/lm_eval/tasks/agieval/agieval_cn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,615   copying build/lib/lm_eval/tasks/agieval/lsat-lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,617   copying build/lib/lm_eval/tasks/agieval/gaokao-chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,618   copying build/lib/lm_eval/tasks/agieval/sat-math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval
2025-08-31T08:28:16,621   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm
2025-08-31T08:28:16,622   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate
2025-08-31T08:28:16,624   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:28:16,625   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:28:16,627   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:28:16,629   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:28:16,632   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:28:16,634   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:28:16,636   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:28:16,638   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:28:16,640   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:28:16,642   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:28:16,644   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:28:16,646   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:28:16,648   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:28:16,649   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:28:16,651   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:28:16,653   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:28:16,655   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:28:16,657   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:28:16,659   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4
2025-08-31T08:28:16,661   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:28:16,662   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:28:16,664   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:28:16,665   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:28:16,667   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:28:16,669   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:28:16,671   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:28:16,672   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:28:16,674   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:28:16,676   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:28:16,678   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:28:16,679   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:28:16,681   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:28:16,683   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:28:16,684   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:28:16,686   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:28:16,688   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:28:16,690   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:28:16,692   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2
2025-08-31T08:28:16,693   copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_tt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate
2025-08-31T08:28:16,696   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:28:16,697   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:28:16,699   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:28:16,700   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:28:16,702   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:28:16,704   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:28:16,706   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:28:16,707   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:28:16,709   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:28:16,711   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:28:16,713   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:28:16,716   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:28:16,718   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:28:16,720   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:28:16,722   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:28:16,724   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:28:16,726   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:28:16,727   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:28:16,729   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5
2025-08-31T08:28:16,731   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:28:16,733   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:28:16,735   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:28:16,736   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:28:16,738   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:28:16,740   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:28:16,741   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:28:16,743   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:28:16,745   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:28:16,747   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:28:16,748   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:28:16,750   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:28:16,752   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:28:16,754   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:28:16,755   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:28:16,758   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:28:16,760   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:28:16,762   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:28:16,764   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1
2025-08-31T08:28:16,767   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:28:16,769   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:28:16,771   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:28:16,773   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:28:16,776   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:28:16,778   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:28:16,781   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:28:16,783   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:28:16,785   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:28:16,787   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:28:16,790   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:28:16,792   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:28:16,794   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:28:16,797   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:28:16,800   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:28:16,802   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:28:16,805   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:28:16,807   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:28:16,809   copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3
2025-08-31T08:28:16,812   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot
2025-08-31T08:28:16,814   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:28:16,816   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:28:16,818   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:28:16,820   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:28:16,823   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:28:16,825   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:28:16,827   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:28:16,830   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:28:16,832   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:28:16,834   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:28:16,836   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:28:16,838   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:28:16,841   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:28:16,843   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:28:16,845   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:28:16,847   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:28:16,849   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:28:16,851   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:28:16,854   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:28:16,856   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4
2025-08-31T08:28:16,859   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:28:16,860   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:28:16,862   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:28:16,864   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:28:16,865   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:28:16,867   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:28:16,869   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:28:16,871   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:28:16,872   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:28:16,874   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:28:16,876   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:28:16,877   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:28:16,879   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:28:16,881   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:28:16,883   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:28:16,885   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:28:16,888   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:28:16,890   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:28:16,891   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:28:16,893   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2
2025-08-31T08:28:16,895   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/afrimgsm_tt_cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot
2025-08-31T08:28:16,897   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:28:16,898   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:28:16,900   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:28:16,902   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:28:16,904   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:28:16,906   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:28:16,907   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:28:16,909   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:28:16,911   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:28:16,913   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:28:16,914   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:28:16,916   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:28:16,918   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:28:16,919   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:28:16,921   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:28:16,923   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:28:16,925   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:28:16,927   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:28:16,928   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:28:16,930   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5
2025-08-31T08:28:16,932   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:28:16,933   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:28:16,935   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:28:16,937   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:28:16,939   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:28:16,941   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:28:16,943   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:28:16,945   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:28:16,947   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:28:16,949   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:28:16,950   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:28:16,952   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:28:16,954   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:28:16,955   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:28:16,957   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:28:16,959   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:28:16,960   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:28:16,962   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:28:16,964   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:28:16,966   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1
2025-08-31T08:28:16,968   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:28:16,969   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:28:16,972   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:28:16,974   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:28:16,977   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:28:16,979   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:28:16,981   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:28:16,982   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:28:16,984   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:28:16,986   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:28:16,988   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:28:16,990   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:28:16,991   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:28:16,993   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:28:16,995   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:28:16,996   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:28:16,998   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:28:17,000   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:28:17,002   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:28:17,004   copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3
2025-08-31T08:28:17,006   copying build/lib/lm_eval/tasks/afrimgsm/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm
2025-08-31T08:28:17,008   copying build/lib/lm_eval/tasks/afrimgsm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm
2025-08-31T08:28:17,010   copying build/lib/lm_eval/tasks/afrimgsm/run.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm
2025-08-31T08:28:17,012   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct
2025-08-31T08:28:17,014   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:28:17,015   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:28:17,017   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:28:17,019   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:28:17,021   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:28:17,023   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:28:17,025   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:28:17,028   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:28:17,033   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:28:17,037   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:28:17,039   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:28:17,041   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:28:17,043   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:28:17,045   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:28:17,047   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:28:17,049   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:28:17,051   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:28:17,053   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:28:17,055   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:28:17,058   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:28:17,060   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4
2025-08-31T08:28:17,062   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:28:17,063   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:28:17,065   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:28:17,067   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:28:17,069   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:28:17,071   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:28:17,073   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:28:17,074   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:28:17,076   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:28:17,078   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:28:17,080   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:28:17,081   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:28:17,083   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:28:17,085   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:28:17,087   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:28:17,088   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:28:17,090   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:28:17,091   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:28:17,093   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:28:17,095   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:28:17,096   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2
2025-08-31T08:28:17,098   copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct
2025-08-31T08:28:17,101   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:28:17,102   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:28:17,103   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:28:17,105   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:28:17,107   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:28:17,109   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:28:17,110   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:28:17,112   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:28:17,114   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:28:17,116   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:28:17,117   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:28:17,119   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:28:17,121   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:28:17,123   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:28:17,124   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:28:17,126   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:28:17,128   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:28:17,129   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:28:17,131   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:28:17,133   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:28:17,135   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5
2025-08-31T08:28:17,138   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:28:17,143   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:28:17,146   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:28:17,148   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:28:17,149   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:28:17,151   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:28:17,153   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:28:17,155   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:28:17,156   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:28:17,158   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:28:17,160   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:28:17,162   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:28:17,164   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:28:17,165   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:28:17,167   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:28:17,169   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:28:17,171   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:28:17,172   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:28:17,174   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:28:17,176   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:28:17,178   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1
2025-08-31T08:28:17,180   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:28:17,181   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:28:17,183   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:28:17,185   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:28:17,186   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:28:17,188   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:28:17,190   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:28:17,192   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:28:17,194   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:28:17,196   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:28:17,199   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:28:17,200   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:28:17,202   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:28:17,204   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:28:17,206   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:28:17,208   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:28:17,210   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:28:17,211   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:28:17,213   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:28:17,215   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:28:17,217   copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3
2025-08-31T08:28:17,218   copying build/lib/lm_eval/tasks/afrimgsm/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm
2025-08-31T08:28:17,220   copying build/lib/lm_eval/tasks/afrimgsm/gen_yaml.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm
2025-08-31T08:28:17,222   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot
2025-08-31T08:28:17,224   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:28:17,225   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:28:17,227   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:28:17,229   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:28:17,231   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:28:17,234   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:28:17,236   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:28:17,238   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:28:17,240   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:28:17,242   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:28:17,243   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:28:17,245   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:28:17,247   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:28:17,249   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:28:17,251   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:28:17,252   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:28:17,254   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:28:17,256   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:28:17,258   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:28:17,260   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:28:17,261   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4
2025-08-31T08:28:17,264   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:28:17,265   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:28:17,266   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:28:17,268   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:28:17,270   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:28:17,271   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:28:17,273   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:28:17,275   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:28:17,277   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:28:17,279   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:28:17,280   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:28:17,282   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:28:17,284   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:28:17,285   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:28:17,287   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:28:17,289   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:28:17,290   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:28:17,292   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:28:17,294   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:28:17,296   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:28:17,298   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2
2025-08-31T08:28:17,299   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/afrimgsm_cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot
2025-08-31T08:28:17,302   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:28:17,303   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:28:17,304   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:28:17,306   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:28:17,308   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:28:17,310   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:28:17,311   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:28:17,313   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:28:17,315   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:28:17,317   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:28:17,319   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:28:17,320   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:28:17,322   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:28:17,324   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:28:17,326   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:28:17,328   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:28:17,329   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:28:17,331   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:28:17,333   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:28:17,335   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:28:17,337   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5
2025-08-31T08:28:17,339   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:28:17,340   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:28:17,342   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:28:17,344   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:28:17,346   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:28:17,348   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:28:17,349   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:28:17,351   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:28:17,353   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:28:17,356   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:28:17,358   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:28:17,359   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:28:17,361   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:28:17,363   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:28:17,365   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:28:17,367   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:28:17,368   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:28:17,370   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:28:17,372   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:28:17,374   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:28:17,376   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1
2025-08-31T08:28:17,378   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:28:17,379   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:28:17,381   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:28:17,383   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:28:17,385   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:28:17,387   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:28:17,389   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:28:17,391   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:28:17,393   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:28:17,395   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:28:17,397   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:28:17,399   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:28:17,401   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:28:17,403   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:28:17,405   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:28:17,407   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:28:17,409   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:28:17,411   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:28:17,413   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:28:17,415   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:28:17,418   copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3
2025-08-31T08:28:17,422   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_exams
2025-08-31T08:28:17,423   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,426   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza4c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,428   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehubiblioeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,429   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehueconomicaseu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,431   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,433   copying build/lib/lm_eval/tasks/eus_exams/eus_exams -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,435   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakivarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,438   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiceladoreu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,439   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakitecnicoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,442   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehubiblio.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,444   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehueconomicas.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,447   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,449   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza5e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,452   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakiadmin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,454   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejteknikari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,456   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakiaux.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,458   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejadministrativo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,460   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakitecnico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,462   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejsubalterno.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,464   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxenfeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,466   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakivarioseu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,468   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntza.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,471   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza6c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,473   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakiauxenf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,475   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza9c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,477   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuaux.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,479   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuderechoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,481   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza7c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,483   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntzaile.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,485   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,487   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejtecnico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,489   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakienfeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,491   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza3e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,493   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehutecnicoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,495   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakioperario.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,497   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opebilbao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,499   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza5c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,501   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza2e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,503   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuempresariales.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,505   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuempresarialeseu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,507   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza6e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,509   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehusubalterno.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,511   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza1c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,513   copying build/lib/lm_eval/tasks/eus_exams/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,515   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnicob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,517   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakicelador.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,519   copying build/lib/lm_eval/tasks/eus_exams/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,521   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuauxeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,523   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakijuridico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,526   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejauxiliar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,528   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuderecho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,531   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeayuntamientovitoria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,534   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejadministrari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,536   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opebilbaoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,538   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuteknikarib.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,540   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza3c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,542   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuadmineu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,543   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza8c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,545   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuadmin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,547   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza1e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,549   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza2c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,551   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakienf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,553   copying build/lib/lm_eval/tasks/eus_exams/configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,555   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opegasteizkoudala.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,557   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza7e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,559   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehusubalternoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,561   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakioperarioeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,563   copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiadmineu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams
2025-08-31T08:28:17,566   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/winogender
2025-08-31T08:28:17,567   copying build/lib/lm_eval/tasks/winogender/winogender_gotcha_male.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender
2025-08-31T08:28:17,569   copying build/lib/lm_eval/tasks/winogender/winogender_female.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender
2025-08-31T08:28:17,571   copying build/lib/lm_eval/tasks/winogender/winogender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender
2025-08-31T08:28:17,573   copying build/lib/lm_eval/tasks/winogender/winogender_male.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender
2025-08-31T08:28:17,575   copying build/lib/lm_eval/tasks/winogender/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender
2025-08-31T08:28:17,577   copying build/lib/lm_eval/tasks/winogender/winogender_gotcha_female.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender
2025-08-31T08:28:17,579   copying build/lib/lm_eval/tasks/winogender/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender
2025-08-31T08:28:17,581   copying build/lib/lm_eval/tasks/winogender/winogender_gotcha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender
2025-08-31T08:28:17,583   copying build/lib/lm_eval/tasks/winogender/winogender_neutral.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender
2025-08-31T08:28:17,586   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hellaswag
2025-08-31T08:28:17,587   copying build/lib/lm_eval/tasks/hellaswag/hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hellaswag
2025-08-31T08:28:17,589   copying build/lib/lm_eval/tasks/hellaswag/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hellaswag
2025-08-31T08:28:17,591   copying build/lib/lm_eval/tasks/hellaswag/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hellaswag
2025-08-31T08:28:17,594   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ruler
2025-08-31T08:28:17,595   copying build/lib/lm_eval/tasks/ruler/ruler.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,598   copying build/lib/lm_eval/tasks/ruler/common_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,600   copying build/lib/lm_eval/tasks/ruler/cwe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,602   copying build/lib/lm_eval/tasks/ruler/niah_multiquery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,604   copying build/lib/lm_eval/tasks/ruler/niah_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,606   copying build/lib/lm_eval/tasks/ruler/vt_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,609   copying build/lib/lm_eval/tasks/ruler/niah_single_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,611   copying build/lib/lm_eval/tasks/ruler/fwe_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,614   copying build/lib/lm_eval/tasks/ruler/niah_multikey_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,617   copying build/lib/lm_eval/tasks/ruler/niah_multikey_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,619   copying build/lib/lm_eval/tasks/ruler/cwe_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,622   copying build/lib/lm_eval/tasks/ruler/niah_multikey_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,624   copying build/lib/lm_eval/tasks/ruler/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,626   copying build/lib/lm_eval/tasks/ruler/essays.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,628   copying build/lib/lm_eval/tasks/ruler/prepare_niah.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,631   copying build/lib/lm_eval/tasks/ruler/niah_single_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,633   copying build/lib/lm_eval/tasks/ruler/qa_hotpot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,634   copying build/lib/lm_eval/tasks/ruler/niah_single_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,636   copying build/lib/lm_eval/tasks/ruler/qa_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,639   copying build/lib/lm_eval/tasks/ruler/vt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,641   copying build/lib/lm_eval/tasks/ruler/niah_multivalue.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,643   copying build/lib/lm_eval/tasks/ruler/qa_squad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,645   copying build/lib/lm_eval/tasks/ruler/fwe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler
2025-08-31T08:28:17,647   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/babi
2025-08-31T08:28:17,649   copying build/lib/lm_eval/tasks/babi/babi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babi
2025-08-31T08:28:17,651   copying build/lib/lm_eval/tasks/babi/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babi
2025-08-31T08:28:17,654   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/pile_10k
2025-08-31T08:28:17,655   copying build/lib/lm_eval/tasks/pile_10k/pile_10k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile_10k
2025-08-31T08:28:17,657   copying build/lib/lm_eval/tasks/pile_10k/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile_10k
2025-08-31T08:28:17,660   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/egyhellaswag
2025-08-31T08:28:17,661   copying build/lib/lm_eval/tasks/egyhellaswag/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egyhellaswag
2025-08-31T08:28:17,663   copying build/lib/lm_eval/tasks/egyhellaswag/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egyhellaswag
2025-08-31T08:28:17,665   copying build/lib/lm_eval/tasks/egyhellaswag/egyhellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egyhellaswag
2025-08-31T08:28:17,668   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/openbookqa
2025-08-31T08:28:17,669   copying build/lib/lm_eval/tasks/openbookqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openbookqa
2025-08-31T08:28:17,671   copying build/lib/lm_eval/tasks/openbookqa/openbookqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openbookqa
2025-08-31T08:28:17,674   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xstorycloze
2025-08-31T08:28:17,675   copying build/lib/lm_eval/tasks/xstorycloze/default_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze
2025-08-31T08:28:17,677   copying build/lib/lm_eval/tasks/xstorycloze/default_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze
2025-08-31T08:28:17,679   copying build/lib/lm_eval/tasks/xstorycloze/default_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze
2025-08-31T08:28:17,681   copying build/lib/lm_eval/tasks/xstorycloze/default_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze
2025-08-31T08:28:17,683   copying build/lib/lm_eval/tasks/xstorycloze/default_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze
2025-08-31T08:28:17,686   copying build/lib/lm_eval/tasks/xstorycloze/default_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze
2025-08-31T08:28:17,688   copying build/lib/lm_eval/tasks/xstorycloze/default_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze
2025-08-31T08:28:17,690   copying build/lib/lm_eval/tasks/xstorycloze/default_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze
2025-08-31T08:28:17,692   copying build/lib/lm_eval/tasks/xstorycloze/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze
2025-08-31T08:28:17,694   copying build/lib/lm_eval/tasks/xstorycloze/default_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze
2025-08-31T08:28:17,696   copying build/lib/lm_eval/tasks/xstorycloze/_xstorycloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze
2025-08-31T08:28:17,699   copying build/lib/lm_eval/tasks/xstorycloze/default_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze
2025-08-31T08:28:17,701   copying build/lib/lm_eval/tasks/xstorycloze/default_my.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze
2025-08-31T08:28:17,705   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include
2025-08-31T08:28:17,708   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og
2025-08-31T08:28:17,710   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/North Macedonian
2025-08-31T08:28:17,711   copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/_north macedonian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian
2025-08-31T08:28:17,713   copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian
2025-08-31T08:28:17,715   copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/_include_base_44_north macedonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian
2025-08-31T08:28:17,718   copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian
2025-08-31T08:28:17,720   copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian
2025-08-31T08:28:17,722   copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian
2025-08-31T08:28:17,724   copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian
2025-08-31T08:28:17,726   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Basque
2025-08-31T08:28:17,728   copying build/lib/lm_eval/tasks/include/few_shot_og/Basque/_include_base_44_basque.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Basque
2025-08-31T08:28:17,730   copying build/lib/lm_eval/tasks/include/few_shot_og/Basque/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Basque
2025-08-31T08:28:17,732   copying build/lib/lm_eval/tasks/include/few_shot_og/Basque/_basque_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Basque
2025-08-31T08:28:17,734   copying build/lib/lm_eval/tasks/include/few_shot_og/Basque/include_base_44_basque_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Basque
2025-08-31T08:28:17,737   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Nepali
2025-08-31T08:28:17,739   copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali
2025-08-31T08:28:17,741   copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/_nepali_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali
2025-08-31T08:28:17,743   copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali
2025-08-31T08:28:17,745   copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/_include_base_44_nepali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali
2025-08-31T08:28:17,747   copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali
2025-08-31T08:28:17,750   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:28:17,752   copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:28:17,754   copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:28:17,756   copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:28:17,758   copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:28:17,761   copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/_hindi_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:28:17,763   copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/_include_base_44_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:28:17,765   copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:28:17,767   copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:28:17,770   copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:28:17,772   copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:28:17,774   copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi
2025-08-31T08:28:17,777   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Armenian
2025-08-31T08:28:17,778   copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian
2025-08-31T08:28:17,780   copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian
2025-08-31T08:28:17,783   copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian
2025-08-31T08:28:17,785   copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian
2025-08-31T08:28:17,788   copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/_armenian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian
2025-08-31T08:28:17,790   copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/_include_base_44_armenian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian
2025-08-31T08:28:17,792   copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian
2025-08-31T08:28:17,795   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Dutch
2025-08-31T08:28:17,797   copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch
2025-08-31T08:28:17,799   copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch
2025-08-31T08:28:17,801   copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/_dutch_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch
2025-08-31T08:28:17,803   copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch
2025-08-31T08:28:17,805   copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch
2025-08-31T08:28:17,807   copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch
2025-08-31T08:28:17,809   copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch
2025-08-31T08:28:17,811   copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/_include_base_44_dutch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch
2025-08-31T08:28:17,814   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Albanian
2025-08-31T08:28:17,815   copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/_albanian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian
2025-08-31T08:28:17,818   copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian
2025-08-31T08:28:17,820   copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian
2025-08-31T08:28:17,822   copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian
2025-08-31T08:28:17,824   copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian
2025-08-31T08:28:17,826   copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/_include_base_44_albanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian
2025-08-31T08:28:17,828   copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian
2025-08-31T08:28:17,831   copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian
2025-08-31T08:28:17,834   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Serbian
2025-08-31T08:28:17,835   copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian
2025-08-31T08:28:17,838   copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/_serbian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian
2025-08-31T08:28:17,840   copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian
2025-08-31T08:28:17,842   copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian
2025-08-31T08:28:17,844   copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian
2025-08-31T08:28:17,846   copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/_include_base_44_serbian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian
2025-08-31T08:28:17,849   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:28:17,851   copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/_include_base_44_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:28:17,853   copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:28:17,856   copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:28:17,858   copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:28:17,861   copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:28:17,863   copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/_russian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:28:17,865   copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:28:17,867   copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:28:17,869   copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:28:17,872   copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:28:17,874   copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian
2025-08-31T08:28:17,878   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Finnish
2025-08-31T08:28:17,879   copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish
2025-08-31T08:28:17,881   copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish
2025-08-31T08:28:17,884   copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish
2025-08-31T08:28:17,886   copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/_finnish_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish
2025-08-31T08:28:17,888   copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish
2025-08-31T08:28:17,890   copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish
2025-08-31T08:28:17,893   copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish
2025-08-31T08:28:17,895   copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/_include_base_44_finnish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish
2025-08-31T08:28:17,898   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/German
2025-08-31T08:28:17,899   copying build/lib/lm_eval/tasks/include/few_shot_og/German/include_base_44_german_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German
2025-08-31T08:28:17,901   copying build/lib/lm_eval/tasks/include/few_shot_og/German/_include_base_44_german.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German
2025-08-31T08:28:17,904   copying build/lib/lm_eval/tasks/include/few_shot_og/German/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German
2025-08-31T08:28:17,906   copying build/lib/lm_eval/tasks/include/few_shot_og/German/include_base_44_german_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German
2025-08-31T08:28:17,908   copying build/lib/lm_eval/tasks/include/few_shot_og/German/include_base_44_german_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German
2025-08-31T08:28:17,911   copying build/lib/lm_eval/tasks/include/few_shot_og/German/_german_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German
2025-08-31T08:28:17,913   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Telugu
2025-08-31T08:28:17,915   copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu
2025-08-31T08:28:17,917   copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/_include_base_44_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu
2025-08-31T08:28:17,919   copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/_telugu_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu
2025-08-31T08:28:17,921   copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu
2025-08-31T08:28:17,924   copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu
2025-08-31T08:28:17,926   copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu
2025-08-31T08:28:17,928   copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu
2025-08-31T08:28:17,930   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Azerbaijani
2025-08-31T08:28:17,932   copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani
2025-08-31T08:28:17,934   copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani
2025-08-31T08:28:17,937   copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/_azerbaijani_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani
2025-08-31T08:28:17,939   copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani
2025-08-31T08:28:17,941   copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani
2025-08-31T08:28:17,943   copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani
2025-08-31T08:28:17,945   copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani
2025-08-31T08:28:17,948   copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani
2025-08-31T08:28:17,950   copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani
2025-08-31T08:28:17,952   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Hungarian
2025-08-31T08:28:17,954   copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian
2025-08-31T08:28:17,957   copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/_include_base_44_hungarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian
2025-08-31T08:28:17,959   copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/_hungarian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian
2025-08-31T08:28:17,962   copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian
2025-08-31T08:28:17,965   copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian
2025-08-31T08:28:17,967   copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian
2025-08-31T08:28:17,970   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Uzbek
2025-08-31T08:28:17,972   copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/_include_base_44_uzbek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek
2025-08-31T08:28:17,974   copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek
2025-08-31T08:28:17,976   copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek
2025-08-31T08:28:17,978   copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek
2025-08-31T08:28:17,980   copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/_uzbek_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek
2025-08-31T08:28:17,982   copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek
2025-08-31T08:28:17,984   copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek
2025-08-31T08:28:17,987   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Korean
2025-08-31T08:28:17,989   copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/_korean_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean
2025-08-31T08:28:17,991   copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean
2025-08-31T08:28:17,993   copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean
2025-08-31T08:28:17,995   copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/_include_base_44_korean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean
2025-08-31T08:28:17,998   copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean
2025-08-31T08:28:18,001   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Hebrew
2025-08-31T08:28:18,002   copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew
2025-08-31T08:28:18,004   copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/_hebrew_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew
2025-08-31T08:28:18,007   copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/_include_base_44_hebrew.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew
2025-08-31T08:28:18,009   copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew
2025-08-31T08:28:18,011   copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew
2025-08-31T08:28:18,013   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Belarusian
2025-08-31T08:28:18,015   copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian
2025-08-31T08:28:18,018   copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian
2025-08-31T08:28:18,020   copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/_include_base_44_belarusian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian
2025-08-31T08:28:18,023   copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian
2025-08-31T08:28:18,025   copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian
2025-08-31T08:28:18,027   copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/_belarusian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian
2025-08-31T08:28:18,030   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Japanese
2025-08-31T08:28:18,031   copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/_japanese_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese
2025-08-31T08:28:18,034   copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/_include_base_44_japanese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese
2025-08-31T08:28:18,036   copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese
2025-08-31T08:28:18,038   copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese
2025-08-31T08:28:18,040   copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese
2025-08-31T08:28:18,043   copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese
2025-08-31T08:28:18,046   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Kazakh
2025-08-31T08:28:18,048   copying build/lib/lm_eval/tasks/include/few_shot_og/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Kazakh
2025-08-31T08:28:18,051   copying build/lib/lm_eval/tasks/include/few_shot_og/Kazakh/_kazakh_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Kazakh
2025-08-31T08:28:18,053   copying build/lib/lm_eval/tasks/include/few_shot_og/Kazakh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Kazakh
2025-08-31T08:28:18,056   copying build/lib/lm_eval/tasks/include/few_shot_og/Kazakh/_include_base_44_kazakh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Kazakh
2025-08-31T08:28:18,059   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Georgian
2025-08-31T08:28:18,060   copying build/lib/lm_eval/tasks/include/few_shot_og/Georgian/_include_base_44_georgian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Georgian
2025-08-31T08:28:18,062   copying build/lib/lm_eval/tasks/include/few_shot_og/Georgian/_georgian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Georgian
2025-08-31T08:28:18,064   copying build/lib/lm_eval/tasks/include/few_shot_og/Georgian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Georgian
2025-08-31T08:28:18,067   copying build/lib/lm_eval/tasks/include/few_shot_og/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Georgian
2025-08-31T08:28:18,070   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Persian
2025-08-31T08:28:18,071   copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/_include_base_44_persian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian
2025-08-31T08:28:18,074   copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian
2025-08-31T08:28:18,076   copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian
2025-08-31T08:28:18,079   copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian
2025-08-31T08:28:18,081   copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian
2025-08-31T08:28:18,083   copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian
2025-08-31T08:28:18,085   copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/_persian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian
2025-08-31T08:28:18,087   copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian
2025-08-31T08:28:18,090   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Indonesian
2025-08-31T08:28:18,091   copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/_include_base_44_indonesian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian
2025-08-31T08:28:18,093   copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian
2025-08-31T08:28:18,096   copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian
2025-08-31T08:28:18,098   copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian
2025-08-31T08:28:18,100   copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian
2025-08-31T08:28:18,102   copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian
2025-08-31T08:28:18,104   copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/_indonesian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian
2025-08-31T08:28:18,107   copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian
2025-08-31T08:28:18,109   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Vietnamese
2025-08-31T08:28:18,110   copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese
2025-08-31T08:28:18,113   copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese
2025-08-31T08:28:18,115   copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/_include_base_44_vietnamese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese
2025-08-31T08:28:18,117   copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese
2025-08-31T08:28:18,119   copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/_vietnamese_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese
2025-08-31T08:28:18,121   copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese
2025-08-31T08:28:18,124   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Spanish
2025-08-31T08:28:18,125   copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/_spanish_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish
2025-08-31T08:28:18,128   copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish
2025-08-31T08:28:18,131   copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish
2025-08-31T08:28:18,133   copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/_include_base_44_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish
2025-08-31T08:28:18,136   copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish
2025-08-31T08:28:18,138   copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish
2025-08-31T08:28:18,140   copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish
2025-08-31T08:28:18,142   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Greek
2025-08-31T08:28:18,143   copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek
2025-08-31T08:28:18,146   copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/_include_base_44_greek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek
2025-08-31T08:28:18,147   copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek
2025-08-31T08:28:18,149   copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek
2025-08-31T08:28:18,151   copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek
2025-08-31T08:28:18,153   copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek
2025-08-31T08:28:18,155   copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/_greek_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek
2025-08-31T08:28:18,157   copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek
2025-08-31T08:28:18,159   copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek
2025-08-31T08:28:18,161   copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek
2025-08-31T08:28:18,163   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:28:18,164   copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/_chinese_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:28:18,166   copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:28:18,168   copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:28:18,170   copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:28:18,172   copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:28:18,174   copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:28:18,176   copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:28:18,178   copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:28:18,180   copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:28:18,182   copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:28:18,184   copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/_include_base_44_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese
2025-08-31T08:28:18,186   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Turkish
2025-08-31T08:28:18,187   copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish
2025-08-31T08:28:18,189   copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish
2025-08-31T08:28:18,191   copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/_turkish_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish
2025-08-31T08:28:18,193   copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish
2025-08-31T08:28:18,195   copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish
2025-08-31T08:28:18,197   copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish
2025-08-31T08:28:18,199   copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/_include_base_44_turkish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish
2025-08-31T08:28:18,201   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Tagalog
2025-08-31T08:28:18,202   copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/_tagalog_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog
2025-08-31T08:28:18,204   copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog
2025-08-31T08:28:18,206   copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog
2025-08-31T08:28:18,208   copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog
2025-08-31T08:28:18,210   copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/_include_base_44_tagalog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog
2025-08-31T08:28:18,212   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/French
2025-08-31T08:28:18,213   copying build/lib/lm_eval/tasks/include/few_shot_og/French/_include_base_44_french.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French
2025-08-31T08:28:18,216   copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French
2025-08-31T08:28:18,219   copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French
2025-08-31T08:28:18,221   copying build/lib/lm_eval/tasks/include/few_shot_og/French/_french_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French
2025-08-31T08:28:18,222   copying build/lib/lm_eval/tasks/include/few_shot_og/French/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French
2025-08-31T08:28:18,224   copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French
2025-08-31T08:28:18,226   copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French
2025-08-31T08:28:18,228   copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French
2025-08-31T08:28:18,231   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Bulgarian
2025-08-31T08:28:18,232   copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian
2025-08-31T08:28:18,234   copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian
2025-08-31T08:28:18,236   copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/_include_base_44_bulgarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian
2025-08-31T08:28:18,238   copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian
2025-08-31T08:28:18,240   copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian
2025-08-31T08:28:18,242   copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/_bulgarian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian
2025-08-31T08:28:18,244   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Lithuanian
2025-08-31T08:28:18,245   copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian
2025-08-31T08:28:18,247   copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian
2025-08-31T08:28:18,249   copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian
2025-08-31T08:28:18,251   copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian
2025-08-31T08:28:18,253   copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian
2025-08-31T08:28:18,255   copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/_include_base_44_lithuanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian
2025-08-31T08:28:18,257   copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/_lithuanian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian
2025-08-31T08:28:18,259   copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian
2025-08-31T08:28:18,261   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Urdu
2025-08-31T08:28:18,263   copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu
2025-08-31T08:28:18,265   copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu
2025-08-31T08:28:18,267   copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu
2025-08-31T08:28:18,269   copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/_urdu_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu
2025-08-31T08:28:18,271   copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu
2025-08-31T08:28:18,273   copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/_include_base_44_urdu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu
2025-08-31T08:28:18,275   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Polish
2025-08-31T08:28:18,277   copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish
2025-08-31T08:28:18,279   copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish
2025-08-31T08:28:18,281   copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/_polish_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish
2025-08-31T08:28:18,282   copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish
2025-08-31T08:28:18,284   copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish
2025-08-31T08:28:18,286   copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/_include_base_44_polish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish
2025-08-31T08:28:18,288   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Tamil
2025-08-31T08:28:18,289   copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil
2025-08-31T08:28:18,291   copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil
2025-08-31T08:28:18,293   copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil
2025-08-31T08:28:18,295   copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/_tamil_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil
2025-08-31T08:28:18,297   copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/_include_base_44_tamil.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil
2025-08-31T08:28:18,299   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Italian
2025-08-31T08:28:18,301   copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/_include_base_44_italian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian
2025-08-31T08:28:18,303   copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian
2025-08-31T08:28:18,304   copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian
2025-08-31T08:28:18,306   copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian
2025-08-31T08:28:18,308   copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/_italian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian
2025-08-31T08:28:18,310   copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian
2025-08-31T08:28:18,312   copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian
2025-08-31T08:28:18,314   copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian
2025-08-31T08:28:18,316   copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian
2025-08-31T08:28:18,318   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Portuguese
2025-08-31T08:28:18,319   copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/_portuguese_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese
2025-08-31T08:28:18,321   copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/_include_base_44_portuguese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese
2025-08-31T08:28:18,323   copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese
2025-08-31T08:28:18,325   copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese
2025-08-31T08:28:18,327   copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese
2025-08-31T08:28:18,328   copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese
2025-08-31T08:28:18,330   copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese
2025-08-31T08:28:18,332   copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese
2025-08-31T08:28:18,334   copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese
2025-08-31T08:28:18,336   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Estonian
2025-08-31T08:28:18,337   copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian
2025-08-31T08:28:18,339   copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian
2025-08-31T08:28:18,341   copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/_estonian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian
2025-08-31T08:28:18,342   copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/_include_base_44_estonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian
2025-08-31T08:28:18,344   copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian
2025-08-31T08:28:18,346   copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian
2025-08-31T08:28:18,348   copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian
2025-08-31T08:28:18,349   copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian
2025-08-31T08:28:18,352   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Bengali
2025-08-31T08:28:18,353   copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali
2025-08-31T08:28:18,355   copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali
2025-08-31T08:28:18,357   copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali
2025-08-31T08:28:18,358   copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/_bengali_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali
2025-08-31T08:28:18,361   copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali
2025-08-31T08:28:18,362   copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali
2025-08-31T08:28:18,364   copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/_include_base_44_bengali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali
2025-08-31T08:28:18,367   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Croatian
2025-08-31T08:28:18,368   copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/_croatian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian
2025-08-31T08:28:18,370   copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian
2025-08-31T08:28:18,372   copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian
2025-08-31T08:28:18,374   copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian
2025-08-31T08:28:18,376   copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian
2025-08-31T08:28:18,378   copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/_include_base_44_croatian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian
2025-08-31T08:28:18,380   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Malay
2025-08-31T08:28:18,381   copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay
2025-08-31T08:28:18,383   copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/_malay_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay
2025-08-31T08:28:18,385   copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay
2025-08-31T08:28:18,387   copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay
2025-08-31T08:28:18,389   copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay
2025-08-31T08:28:18,390   copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/_include_base_44_malay.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay
2025-08-31T08:28:18,393   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Ukrainian
2025-08-31T08:28:18,394   copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian
2025-08-31T08:28:18,396   copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian
2025-08-31T08:28:18,398   copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/_include_base_44_ukrainian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian
2025-08-31T08:28:18,400   copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian
2025-08-31T08:28:18,402   copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian
2025-08-31T08:28:18,403   copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/_ukrainian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian
2025-08-31T08:28:18,406   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Arabic
2025-08-31T08:28:18,407   copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic
2025-08-31T08:28:18,409   copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/_arabic_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic
2025-08-31T08:28:18,412   copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic
2025-08-31T08:28:18,413   copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic
2025-08-31T08:28:18,415   copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/_include_base_44_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic
2025-08-31T08:28:18,417   copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic
2025-08-31T08:28:18,419   copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic
2025-08-31T08:28:18,421   copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic
2025-08-31T08:28:18,423   copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic
2025-08-31T08:28:18,425   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Malayalam
2025-08-31T08:28:18,427   copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/_malayalam_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam
2025-08-31T08:28:18,429   copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam
2025-08-31T08:28:18,431   copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/_include_base_44_malayalam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam
2025-08-31T08:28:18,432   copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam
2025-08-31T08:28:18,434   copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam
2025-08-31T08:28:18,436   copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam
2025-08-31T08:28:18,438   copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam
2025-08-31T08:28:18,440   copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam
2025-08-31T08:28:18,442   copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam
2025-08-31T08:28:18,443   copying build/lib/lm_eval/tasks/include/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include
2025-08-31T08:28:18,446   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default
2025-08-31T08:28:18,448   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/North Macedonian
2025-08-31T08:28:18,449   copying build/lib/lm_eval/tasks/include/default/North Macedonian/_north macedonian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian
2025-08-31T08:28:18,452   copying build/lib/lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian
2025-08-31T08:28:18,453   copying build/lib/lm_eval/tasks/include/default/North Macedonian/_include_base_44_north macedonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian
2025-08-31T08:28:18,455   copying build/lib/lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian
2025-08-31T08:28:18,457   copying build/lib/lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian
2025-08-31T08:28:18,459   copying build/lib/lm_eval/tasks/include/default/North Macedonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian
2025-08-31T08:28:18,461   copying build/lib/lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian
2025-08-31T08:28:18,463   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Basque
2025-08-31T08:28:18,464   copying build/lib/lm_eval/tasks/include/default/Basque/_basque_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Basque
2025-08-31T08:28:18,466   copying build/lib/lm_eval/tasks/include/default/Basque/_include_base_44_basque.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Basque
2025-08-31T08:28:18,468   copying build/lib/lm_eval/tasks/include/default/Basque/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Basque
2025-08-31T08:28:18,470   copying build/lib/lm_eval/tasks/include/default/Basque/include_base_44_basque_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Basque
2025-08-31T08:28:18,472   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Nepali
2025-08-31T08:28:18,473   copying build/lib/lm_eval/tasks/include/default/Nepali/include_base_44_nepali_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali
2025-08-31T08:28:18,475   copying build/lib/lm_eval/tasks/include/default/Nepali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali
2025-08-31T08:28:18,477   copying build/lib/lm_eval/tasks/include/default/Nepali/_include_base_44_nepali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali
2025-08-31T08:28:18,479   copying build/lib/lm_eval/tasks/include/default/Nepali/include_base_44_nepali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali
2025-08-31T08:28:18,481   copying build/lib/lm_eval/tasks/include/default/Nepali/_nepali_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali
2025-08-31T08:28:18,483   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Hindi
2025-08-31T08:28:18,484   copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi
2025-08-31T08:28:18,486   copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi
2025-08-31T08:28:18,487   copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi
2025-08-31T08:28:18,489   copying build/lib/lm_eval/tasks/include/default/Hindi/_hindi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi
2025-08-31T08:28:18,491   copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi
2025-08-31T08:28:18,493   copying build/lib/lm_eval/tasks/include/default/Hindi/_include_base_44_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi
2025-08-31T08:28:18,494   copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi
2025-08-31T08:28:18,496   copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi
2025-08-31T08:28:18,498   copying build/lib/lm_eval/tasks/include/default/Hindi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi
2025-08-31T08:28:18,500   copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi
2025-08-31T08:28:18,502   copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi
2025-08-31T08:28:18,504   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Armenian
2025-08-31T08:28:18,505   copying build/lib/lm_eval/tasks/include/default/Armenian/include_base_44_armenian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian
2025-08-31T08:28:18,507   copying build/lib/lm_eval/tasks/include/default/Armenian/include_base_44_armenian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian
2025-08-31T08:28:18,509   copying build/lib/lm_eval/tasks/include/default/Armenian/_armenian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian
2025-08-31T08:28:18,510   copying build/lib/lm_eval/tasks/include/default/Armenian/include_base_44_armenian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian
2025-08-31T08:28:18,512   copying build/lib/lm_eval/tasks/include/default/Armenian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian
2025-08-31T08:28:18,514   copying build/lib/lm_eval/tasks/include/default/Armenian/_include_base_44_armenian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian
2025-08-31T08:28:18,516   copying build/lib/lm_eval/tasks/include/default/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian
2025-08-31T08:28:18,519   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Dutch
2025-08-31T08:28:18,519   copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch
2025-08-31T08:28:18,521   copying build/lib/lm_eval/tasks/include/default/Dutch/_dutch_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch
2025-08-31T08:28:18,523   copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch
2025-08-31T08:28:18,525   copying build/lib/lm_eval/tasks/include/default/Dutch/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch
2025-08-31T08:28:18,527   copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch
2025-08-31T08:28:18,529   copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch
2025-08-31T08:28:18,530   copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch
2025-08-31T08:28:18,532   copying build/lib/lm_eval/tasks/include/default/Dutch/_include_base_44_dutch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch
2025-08-31T08:28:18,535   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Albanian
2025-08-31T08:28:18,536   copying build/lib/lm_eval/tasks/include/default/Albanian/_albanian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian
2025-08-31T08:28:18,538   copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian
2025-08-31T08:28:18,539   copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian
2025-08-31T08:28:18,541   copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian
2025-08-31T08:28:18,543   copying build/lib/lm_eval/tasks/include/default/Albanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian
2025-08-31T08:28:18,544   copying build/lib/lm_eval/tasks/include/default/Albanian/_include_base_44_albanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian
2025-08-31T08:28:18,546   copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian
2025-08-31T08:28:18,548   copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian
2025-08-31T08:28:18,550   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Serbian
2025-08-31T08:28:18,551   copying build/lib/lm_eval/tasks/include/default/Serbian/include_base_44_serbian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian
2025-08-31T08:28:18,553   copying build/lib/lm_eval/tasks/include/default/Serbian/_serbian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian
2025-08-31T08:28:18,555   copying build/lib/lm_eval/tasks/include/default/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian
2025-08-31T08:28:18,557   copying build/lib/lm_eval/tasks/include/default/Serbian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian
2025-08-31T08:28:18,559   copying build/lib/lm_eval/tasks/include/default/Serbian/include_base_44_serbian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian
2025-08-31T08:28:18,561   copying build/lib/lm_eval/tasks/include/default/Serbian/_include_base_44_serbian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian
2025-08-31T08:28:18,563   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Russian
2025-08-31T08:28:18,564   copying build/lib/lm_eval/tasks/include/default/Russian/_include_base_44_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian
2025-08-31T08:28:18,566   copying build/lib/lm_eval/tasks/include/default/Russian/_russian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian
2025-08-31T08:28:18,568   copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian
2025-08-31T08:28:18,570   copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian
2025-08-31T08:28:18,571   copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian
2025-08-31T08:28:18,573   copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian
2025-08-31T08:28:18,575   copying build/lib/lm_eval/tasks/include/default/Russian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian
2025-08-31T08:28:18,577   copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian
2025-08-31T08:28:18,579   copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian
2025-08-31T08:28:18,580   copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian
2025-08-31T08:28:18,582   copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian
2025-08-31T08:28:18,584   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Finnish
2025-08-31T08:28:18,586   copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish
2025-08-31T08:28:18,587   copying build/lib/lm_eval/tasks/include/default/Finnish/_finnish_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish
2025-08-31T08:28:18,589   copying build/lib/lm_eval/tasks/include/default/Finnish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish
2025-08-31T08:28:18,591   copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish
2025-08-31T08:28:18,593   copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish
2025-08-31T08:28:18,595   copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish
2025-08-31T08:28:18,597   copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish
2025-08-31T08:28:18,599   copying build/lib/lm_eval/tasks/include/default/Finnish/_include_base_44_finnish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish
2025-08-31T08:28:18,601   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/German
2025-08-31T08:28:18,602   copying build/lib/lm_eval/tasks/include/default/German/_german_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German
2025-08-31T08:28:18,604   copying build/lib/lm_eval/tasks/include/default/German/include_base_44_german_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German
2025-08-31T08:28:18,606   copying build/lib/lm_eval/tasks/include/default/German/_include_base_44_german.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German
2025-08-31T08:28:18,607   copying build/lib/lm_eval/tasks/include/default/German/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German
2025-08-31T08:28:18,609   copying build/lib/lm_eval/tasks/include/default/German/include_base_44_german_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German
2025-08-31T08:28:18,611   copying build/lib/lm_eval/tasks/include/default/German/include_base_44_german_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German
2025-08-31T08:28:18,614   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Telugu
2025-08-31T08:28:18,615   copying build/lib/lm_eval/tasks/include/default/Telugu/include_base_44_telugu_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu
2025-08-31T08:28:18,617   copying build/lib/lm_eval/tasks/include/default/Telugu/_include_base_44_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu
2025-08-31T08:28:18,619   copying build/lib/lm_eval/tasks/include/default/Telugu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu
2025-08-31T08:28:18,621   copying build/lib/lm_eval/tasks/include/default/Telugu/include_base_44_telugu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu
2025-08-31T08:28:18,623   copying build/lib/lm_eval/tasks/include/default/Telugu/_telugu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu
2025-08-31T08:28:18,624   copying build/lib/lm_eval/tasks/include/default/Telugu/include_base_44_telugu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu
2025-08-31T08:28:18,626   copying build/lib/lm_eval/tasks/include/default/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu
2025-08-31T08:28:18,629   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Azerbaijani
2025-08-31T08:28:18,630   copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani
2025-08-31T08:28:18,631   copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani
2025-08-31T08:28:18,633   copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani
2025-08-31T08:28:18,635   copying build/lib/lm_eval/tasks/include/default/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani
2025-08-31T08:28:18,637   copying build/lib/lm_eval/tasks/include/default/Azerbaijani/_azerbaijani_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani
2025-08-31T08:28:18,638   copying build/lib/lm_eval/tasks/include/default/Azerbaijani/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani
2025-08-31T08:28:18,640   copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani
2025-08-31T08:28:18,642   copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani
2025-08-31T08:28:18,643   copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani
2025-08-31T08:28:18,646   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Hungarian
2025-08-31T08:28:18,647   copying build/lib/lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian
2025-08-31T08:28:18,649   copying build/lib/lm_eval/tasks/include/default/Hungarian/_include_base_44_hungarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian
2025-08-31T08:28:18,650   copying build/lib/lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian
2025-08-31T08:28:18,652   copying build/lib/lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian
2025-08-31T08:28:18,654   copying build/lib/lm_eval/tasks/include/default/Hungarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian
2025-08-31T08:28:18,656   copying build/lib/lm_eval/tasks/include/default/Hungarian/_hungarian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian
2025-08-31T08:28:18,658   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Uzbek
2025-08-31T08:28:18,660   copying build/lib/lm_eval/tasks/include/default/Uzbek/_include_base_44_uzbek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek
2025-08-31T08:28:18,662   copying build/lib/lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek
2025-08-31T08:28:18,663   copying build/lib/lm_eval/tasks/include/default/Uzbek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek
2025-08-31T08:28:18,665   copying build/lib/lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek
2025-08-31T08:28:18,667   copying build/lib/lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek
2025-08-31T08:28:18,668   copying build/lib/lm_eval/tasks/include/default/Uzbek/_uzbek_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek
2025-08-31T08:28:18,670   copying build/lib/lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek
2025-08-31T08:28:18,673   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Korean
2025-08-31T08:28:18,674   copying build/lib/lm_eval/tasks/include/default/Korean/_korean_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean
2025-08-31T08:28:18,676   copying build/lib/lm_eval/tasks/include/default/Korean/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean
2025-08-31T08:28:18,677   copying build/lib/lm_eval/tasks/include/default/Korean/include_base_44_korean_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean
2025-08-31T08:28:18,679   copying build/lib/lm_eval/tasks/include/default/Korean/_include_base_44_korean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean
2025-08-31T08:28:18,681   copying build/lib/lm_eval/tasks/include/default/Korean/include_base_44_korean_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean
2025-08-31T08:28:18,683   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Hebrew
2025-08-31T08:28:18,684   copying build/lib/lm_eval/tasks/include/default/Hebrew/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew
2025-08-31T08:28:18,686   copying build/lib/lm_eval/tasks/include/default/Hebrew/_include_base_44_hebrew.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew
2025-08-31T08:28:18,688   copying build/lib/lm_eval/tasks/include/default/Hebrew/_hebrew_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew
2025-08-31T08:28:18,690   copying build/lib/lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew
2025-08-31T08:28:18,691   copying build/lib/lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew
2025-08-31T08:28:18,694   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Belarusian
2025-08-31T08:28:18,695   copying build/lib/lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian
2025-08-31T08:28:18,697   copying build/lib/lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian
2025-08-31T08:28:18,699   copying build/lib/lm_eval/tasks/include/default/Belarusian/_include_base_44_belarusian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian
2025-08-31T08:28:18,700   copying build/lib/lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian
2025-08-31T08:28:18,702   copying build/lib/lm_eval/tasks/include/default/Belarusian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian
2025-08-31T08:28:18,704   copying build/lib/lm_eval/tasks/include/default/Belarusian/_belarusian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian
2025-08-31T08:28:18,706   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Japanese
2025-08-31T08:28:18,708   copying build/lib/lm_eval/tasks/include/default/Japanese/_include_base_44_japanese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese
2025-08-31T08:28:18,710   copying build/lib/lm_eval/tasks/include/default/Japanese/include_base_44_japanese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese
2025-08-31T08:28:18,711   copying build/lib/lm_eval/tasks/include/default/Japanese/_japanese_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese
2025-08-31T08:28:18,713   copying build/lib/lm_eval/tasks/include/default/Japanese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese
2025-08-31T08:28:18,715   copying build/lib/lm_eval/tasks/include/default/Japanese/include_base_44_japanese_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese
2025-08-31T08:28:18,717   copying build/lib/lm_eval/tasks/include/default/Japanese/include_base_44_japanese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese
2025-08-31T08:28:18,719   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Kazakh
2025-08-31T08:28:18,720   copying build/lib/lm_eval/tasks/include/default/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Kazakh
2025-08-31T08:28:18,722   copying build/lib/lm_eval/tasks/include/default/Kazakh/_kazakh_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Kazakh
2025-08-31T08:28:18,724   copying build/lib/lm_eval/tasks/include/default/Kazakh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Kazakh
2025-08-31T08:28:18,725   copying build/lib/lm_eval/tasks/include/default/Kazakh/_include_base_44_kazakh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Kazakh
2025-08-31T08:28:18,728   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Georgian
2025-08-31T08:28:18,729   copying build/lib/lm_eval/tasks/include/default/Georgian/_include_base_44_georgian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Georgian
2025-08-31T08:28:18,730   copying build/lib/lm_eval/tasks/include/default/Georgian/_georgian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Georgian
2025-08-31T08:28:18,732   copying build/lib/lm_eval/tasks/include/default/Georgian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Georgian
2025-08-31T08:28:18,734   copying build/lib/lm_eval/tasks/include/default/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Georgian
2025-08-31T08:28:18,736   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Persian
2025-08-31T08:28:18,737   copying build/lib/lm_eval/tasks/include/default/Persian/_include_base_44_persian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian
2025-08-31T08:28:18,739   copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian
2025-08-31T08:28:18,741   copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian
2025-08-31T08:28:18,742   copying build/lib/lm_eval/tasks/include/default/Persian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian
2025-08-31T08:28:18,744   copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian
2025-08-31T08:28:18,746   copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian
2025-08-31T08:28:18,748   copying build/lib/lm_eval/tasks/include/default/Persian/_persian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian
2025-08-31T08:28:18,749   copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian
2025-08-31T08:28:18,752   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Indonesian
2025-08-31T08:28:18,753   copying build/lib/lm_eval/tasks/include/default/Indonesian/_include_base_44_indonesian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian
2025-08-31T08:28:18,755   copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian
2025-08-31T08:28:18,756   copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian
2025-08-31T08:28:18,758   copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian
2025-08-31T08:28:18,760   copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian
2025-08-31T08:28:18,762   copying build/lib/lm_eval/tasks/include/default/Indonesian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian
2025-08-31T08:28:18,763   copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian
2025-08-31T08:28:18,765   copying build/lib/lm_eval/tasks/include/default/Indonesian/_indonesian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian
2025-08-31T08:28:18,767   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Vietnamese
2025-08-31T08:28:18,768   copying build/lib/lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese
2025-08-31T08:28:18,770   copying build/lib/lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese
2025-08-31T08:28:18,772   copying build/lib/lm_eval/tasks/include/default/Vietnamese/_include_base_44_vietnamese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese
2025-08-31T08:28:18,773   copying build/lib/lm_eval/tasks/include/default/Vietnamese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese
2025-08-31T08:28:18,775   copying build/lib/lm_eval/tasks/include/default/Vietnamese/_vietnamese_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese
2025-08-31T08:28:18,777   copying build/lib/lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese
2025-08-31T08:28:18,779   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Spanish
2025-08-31T08:28:18,780   copying build/lib/lm_eval/tasks/include/default/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish
2025-08-31T08:28:18,782   copying build/lib/lm_eval/tasks/include/default/Spanish/include_base_44_spanish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish
2025-08-31T08:28:18,784   copying build/lib/lm_eval/tasks/include/default/Spanish/_include_base_44_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish
2025-08-31T08:28:18,786   copying build/lib/lm_eval/tasks/include/default/Spanish/include_base_44_spanish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish
2025-08-31T08:28:18,787   copying build/lib/lm_eval/tasks/include/default/Spanish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish
2025-08-31T08:28:18,789   copying build/lib/lm_eval/tasks/include/default/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish
2025-08-31T08:28:18,791   copying build/lib/lm_eval/tasks/include/default/Spanish/_spanish_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish
2025-08-31T08:28:18,793   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Greek
2025-08-31T08:28:18,794   copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek
2025-08-31T08:28:18,796   copying build/lib/lm_eval/tasks/include/default/Greek/_include_base_44_greek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek
2025-08-31T08:28:18,798   copying build/lib/lm_eval/tasks/include/default/Greek/_greek_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek
2025-08-31T08:28:18,800   copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek
2025-08-31T08:28:18,802   copying build/lib/lm_eval/tasks/include/default/Greek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek
2025-08-31T08:28:18,803   copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek
2025-08-31T08:28:18,805   copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek
2025-08-31T08:28:18,807   copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek
2025-08-31T08:28:18,808   copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek
2025-08-31T08:28:18,810   copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek
2025-08-31T08:28:18,812   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Chinese
2025-08-31T08:28:18,813   copying build/lib/lm_eval/tasks/include/default/Chinese/_chinese_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese
2025-08-31T08:28:18,815   copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese
2025-08-31T08:28:18,817   copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese
2025-08-31T08:28:18,819   copying build/lib/lm_eval/tasks/include/default/Chinese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese
2025-08-31T08:28:18,820   copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese
2025-08-31T08:28:18,822   copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese
2025-08-31T08:28:18,824   copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese
2025-08-31T08:28:18,826   copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese
2025-08-31T08:28:18,827   copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese
2025-08-31T08:28:18,829   copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese
2025-08-31T08:28:18,831   copying build/lib/lm_eval/tasks/include/default/Chinese/_include_base_44_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese
2025-08-31T08:28:18,833   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Turkish
2025-08-31T08:28:18,834   copying build/lib/lm_eval/tasks/include/default/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish
2025-08-31T08:28:18,836   copying build/lib/lm_eval/tasks/include/default/Turkish/_turkish_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish
2025-08-31T08:28:18,838   copying build/lib/lm_eval/tasks/include/default/Turkish/include_base_44_turkish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish
2025-08-31T08:28:18,840   copying build/lib/lm_eval/tasks/include/default/Turkish/include_base_44_turkish_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish
2025-08-31T08:28:18,841   copying build/lib/lm_eval/tasks/include/default/Turkish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish
2025-08-31T08:28:18,843   copying build/lib/lm_eval/tasks/include/default/Turkish/include_base_44_turkish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish
2025-08-31T08:28:18,844   copying build/lib/lm_eval/tasks/include/default/Turkish/_include_base_44_turkish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish
2025-08-31T08:28:18,847   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Tagalog
2025-08-31T08:28:18,848   copying build/lib/lm_eval/tasks/include/default/Tagalog/_tagalog_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog
2025-08-31T08:28:18,850   copying build/lib/lm_eval/tasks/include/default/Tagalog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog
2025-08-31T08:28:18,851   copying build/lib/lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog
2025-08-31T08:28:18,853   copying build/lib/lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog
2025-08-31T08:28:18,855   copying build/lib/lm_eval/tasks/include/default/Tagalog/_include_base_44_tagalog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog
2025-08-31T08:28:18,857   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/French
2025-08-31T08:28:18,858   copying build/lib/lm_eval/tasks/include/default/French/_include_base_44_french.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French
2025-08-31T08:28:18,860   copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French
2025-08-31T08:28:18,862   copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French
2025-08-31T08:28:18,863   copying build/lib/lm_eval/tasks/include/default/French/_french_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French
2025-08-31T08:28:18,865   copying build/lib/lm_eval/tasks/include/default/French/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French
2025-08-31T08:28:18,867   copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French
2025-08-31T08:28:18,869   copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French
2025-08-31T08:28:18,870   copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French
2025-08-31T08:28:18,872   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Bulgarian
2025-08-31T08:28:18,874   copying build/lib/lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian
2025-08-31T08:28:18,876   copying build/lib/lm_eval/tasks/include/default/Bulgarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian
2025-08-31T08:28:18,878   copying build/lib/lm_eval/tasks/include/default/Bulgarian/_include_base_44_bulgarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian
2025-08-31T08:28:18,879   copying build/lib/lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian
2025-08-31T08:28:18,881   copying build/lib/lm_eval/tasks/include/default/Bulgarian/_bulgarian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian
2025-08-31T08:28:18,883   copying build/lib/lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian
2025-08-31T08:28:18,885   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Lithuanian
2025-08-31T08:28:18,886   copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian
2025-08-31T08:28:18,888   copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian
2025-08-31T08:28:18,890   copying build/lib/lm_eval/tasks/include/default/Lithuanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian
2025-08-31T08:28:18,892   copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian
2025-08-31T08:28:18,893   copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian
2025-08-31T08:28:18,895   copying build/lib/lm_eval/tasks/include/default/Lithuanian/_include_base_44_lithuanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian
2025-08-31T08:28:18,897   copying build/lib/lm_eval/tasks/include/default/Lithuanian/_lithuanian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian
2025-08-31T08:28:18,898   copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian
2025-08-31T08:28:18,901   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Urdu
2025-08-31T08:28:18,902   copying build/lib/lm_eval/tasks/include/default/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu
2025-08-31T08:28:18,904   copying build/lib/lm_eval/tasks/include/default/Urdu/include_base_44_urdu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu
2025-08-31T08:28:18,906   copying build/lib/lm_eval/tasks/include/default/Urdu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu
2025-08-31T08:28:18,907   copying build/lib/lm_eval/tasks/include/default/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu
2025-08-31T08:28:18,909   copying build/lib/lm_eval/tasks/include/default/Urdu/_urdu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu
2025-08-31T08:28:18,911   copying build/lib/lm_eval/tasks/include/default/Urdu/_include_base_44_urdu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu
2025-08-31T08:28:18,913   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Polish
2025-08-31T08:28:18,914   copying build/lib/lm_eval/tasks/include/default/Polish/include_base_44_polish_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish
2025-08-31T08:28:18,916   copying build/lib/lm_eval/tasks/include/default/Polish/include_base_44_polish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish
2025-08-31T08:28:18,918   copying build/lib/lm_eval/tasks/include/default/Polish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish
2025-08-31T08:28:18,920   copying build/lib/lm_eval/tasks/include/default/Polish/_polish_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish
2025-08-31T08:28:18,921   copying build/lib/lm_eval/tasks/include/default/Polish/include_base_44_polish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish
2025-08-31T08:28:18,923   copying build/lib/lm_eval/tasks/include/default/Polish/_include_base_44_polish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish
2025-08-31T08:28:18,926   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Tamil
2025-08-31T08:28:18,927   copying build/lib/lm_eval/tasks/include/default/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil
2025-08-31T08:28:18,929   copying build/lib/lm_eval/tasks/include/default/Tamil/_tamil_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil
2025-08-31T08:28:18,930   copying build/lib/lm_eval/tasks/include/default/Tamil/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil
2025-08-31T08:28:18,932   copying build/lib/lm_eval/tasks/include/default/Tamil/include_base_44_tamil_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil
2025-08-31T08:28:18,934   copying build/lib/lm_eval/tasks/include/default/Tamil/_include_base_44_tamil.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil
2025-08-31T08:28:18,936   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Italian
2025-08-31T08:28:18,937   copying build/lib/lm_eval/tasks/include/default/Italian/_include_base_44_italian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian
2025-08-31T08:28:18,939   copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian
2025-08-31T08:28:18,941   copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian
2025-08-31T08:28:18,943   copying build/lib/lm_eval/tasks/include/default/Italian/_italian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian
2025-08-31T08:28:18,944   copying build/lib/lm_eval/tasks/include/default/Italian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian
2025-08-31T08:28:18,946   copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian
2025-08-31T08:28:18,948   copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian
2025-08-31T08:28:18,950   copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian
2025-08-31T08:28:18,951   copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian
2025-08-31T08:28:18,954   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Portuguese
2025-08-31T08:28:18,955   copying build/lib/lm_eval/tasks/include/default/Portuguese/_include_base_44_portuguese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese
2025-08-31T08:28:18,957   copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese
2025-08-31T08:28:18,959   copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese
2025-08-31T08:28:18,961   copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese
2025-08-31T08:28:18,963   copying build/lib/lm_eval/tasks/include/default/Portuguese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese
2025-08-31T08:28:18,964   copying build/lib/lm_eval/tasks/include/default/Portuguese/_portuguese_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese
2025-08-31T08:28:18,966   copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese
2025-08-31T08:28:18,968   copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese
2025-08-31T08:28:18,970   copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese
2025-08-31T08:28:18,973   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Estonian
2025-08-31T08:28:18,974   copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian
2025-08-31T08:28:18,976   copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian
2025-08-31T08:28:18,978   copying build/lib/lm_eval/tasks/include/default/Estonian/_estonian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian
2025-08-31T08:28:18,979   copying build/lib/lm_eval/tasks/include/default/Estonian/_include_base_44_estonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian
2025-08-31T08:28:18,981   copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian
2025-08-31T08:28:18,983   copying build/lib/lm_eval/tasks/include/default/Estonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian
2025-08-31T08:28:18,984   copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian
2025-08-31T08:28:18,986   copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian
2025-08-31T08:28:18,988   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Bengali
2025-08-31T08:28:18,989   copying build/lib/lm_eval/tasks/include/default/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali
2025-08-31T08:28:18,991   copying build/lib/lm_eval/tasks/include/default/Bengali/_bengali_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali
2025-08-31T08:28:18,993   copying build/lib/lm_eval/tasks/include/default/Bengali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali
2025-08-31T08:28:18,995   copying build/lib/lm_eval/tasks/include/default/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali
2025-08-31T08:28:18,997   copying build/lib/lm_eval/tasks/include/default/Bengali/include_base_44_bengali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali
2025-08-31T08:28:18,999   copying build/lib/lm_eval/tasks/include/default/Bengali/include_base_44_bengali_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali
2025-08-31T08:28:19,000   copying build/lib/lm_eval/tasks/include/default/Bengali/_include_base_44_bengali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali
2025-08-31T08:28:19,002   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Croatian
2025-08-31T08:28:19,003   copying build/lib/lm_eval/tasks/include/default/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian
2025-08-31T08:28:19,005   copying build/lib/lm_eval/tasks/include/default/Croatian/_croatian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian
2025-08-31T08:28:19,008   copying build/lib/lm_eval/tasks/include/default/Croatian/include_base_44_croatian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian
2025-08-31T08:28:19,010   copying build/lib/lm_eval/tasks/include/default/Croatian/include_base_44_croatian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian
2025-08-31T08:28:19,012   copying build/lib/lm_eval/tasks/include/default/Croatian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian
2025-08-31T08:28:19,014   copying build/lib/lm_eval/tasks/include/default/Croatian/_include_base_44_croatian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian
2025-08-31T08:28:19,016   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Malay
2025-08-31T08:28:19,017   copying build/lib/lm_eval/tasks/include/default/Malay/include_base_44_malay_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay
2025-08-31T08:28:19,019   copying build/lib/lm_eval/tasks/include/default/Malay/include_base_44_malay_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay
2025-08-31T08:28:19,021   copying build/lib/lm_eval/tasks/include/default/Malay/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay
2025-08-31T08:28:19,023   copying build/lib/lm_eval/tasks/include/default/Malay/_malay_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay
2025-08-31T08:28:19,024   copying build/lib/lm_eval/tasks/include/default/Malay/include_base_44_malay_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay
2025-08-31T08:28:19,026   copying build/lib/lm_eval/tasks/include/default/Malay/_include_base_44_malay.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay
2025-08-31T08:28:19,029   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Ukrainian
2025-08-31T08:28:19,031   copying build/lib/lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian
2025-08-31T08:28:19,033   copying build/lib/lm_eval/tasks/include/default/Ukrainian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian
2025-08-31T08:28:19,035   copying build/lib/lm_eval/tasks/include/default/Ukrainian/_ukrainian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian
2025-08-31T08:28:19,037   copying build/lib/lm_eval/tasks/include/default/Ukrainian/_include_base_44_ukrainian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian
2025-08-31T08:28:19,038   copying build/lib/lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian
2025-08-31T08:28:19,040   copying build/lib/lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian
2025-08-31T08:28:19,043   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Arabic
2025-08-31T08:28:19,044   copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic
2025-08-31T08:28:19,045   copying build/lib/lm_eval/tasks/include/default/Arabic/_arabic_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic
2025-08-31T08:28:19,047   copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic
2025-08-31T08:28:19,049   copying build/lib/lm_eval/tasks/include/default/Arabic/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic
2025-08-31T08:28:19,050   copying build/lib/lm_eval/tasks/include/default/Arabic/_include_base_44_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic
2025-08-31T08:28:19,052   copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic
2025-08-31T08:28:19,054   copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic
2025-08-31T08:28:19,055   copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic
2025-08-31T08:28:19,057   copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic
2025-08-31T08:28:19,059   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Malayalam
2025-08-31T08:28:19,060   copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam
2025-08-31T08:28:19,062   copying build/lib/lm_eval/tasks/include/default/Malayalam/_include_base_44_malayalam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam
2025-08-31T08:28:19,064   copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam
2025-08-31T08:28:19,066   copying build/lib/lm_eval/tasks/include/default/Malayalam/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam
2025-08-31T08:28:19,068   copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam
2025-08-31T08:28:19,070   copying build/lib/lm_eval/tasks/include/default/Malayalam/_malayalam_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam
2025-08-31T08:28:19,071   copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam
2025-08-31T08:28:19,073   copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam
2025-08-31T08:28:19,075   copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam
2025-08-31T08:28:19,078   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en
2025-08-31T08:28:19,080   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/North Macedonian
2025-08-31T08:28:19,081   copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian
2025-08-31T08:28:19,083   copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/_include_base_44_north macedonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian
2025-08-31T08:28:19,085   copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian
2025-08-31T08:28:19,087   copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian
2025-08-31T08:28:19,088   copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian
2025-08-31T08:28:19,090   copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian
2025-08-31T08:28:19,092   copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/_north macedonian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian
2025-08-31T08:28:19,094   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Basque
2025-08-31T08:28:19,095   copying build/lib/lm_eval/tasks/include/few_shot_en/Basque/_include_base_44_basque.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Basque
2025-08-31T08:28:19,097   copying build/lib/lm_eval/tasks/include/few_shot_en/Basque/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Basque
2025-08-31T08:28:19,099   copying build/lib/lm_eval/tasks/include/few_shot_en/Basque/_basque_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Basque
2025-08-31T08:28:19,101   copying build/lib/lm_eval/tasks/include/few_shot_en/Basque/include_base_44_basque_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Basque
2025-08-31T08:28:19,103   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Nepali
2025-08-31T08:28:19,104   copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali
2025-08-31T08:28:19,106   copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/_nepali_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali
2025-08-31T08:28:19,107   copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali
2025-08-31T08:28:19,109   copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/_include_base_44_nepali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali
2025-08-31T08:28:19,111   copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali
2025-08-31T08:28:19,114   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:28:19,115   copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:28:19,117   copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:28:19,119   copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/_hindi_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:28:19,121   copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:28:19,122   copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:28:19,124   copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/_include_base_44_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:28:19,125   copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:28:19,127   copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:28:19,129   copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:28:19,130   copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:28:19,132   copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi
2025-08-31T08:28:19,134   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Armenian
2025-08-31T08:28:19,135   copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian
2025-08-31T08:28:19,137   copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian
2025-08-31T08:28:19,139   copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian
2025-08-31T08:28:19,140   copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/_armenian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian
2025-08-31T08:28:19,142   copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian
2025-08-31T08:28:19,144   copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/_include_base_44_armenian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian
2025-08-31T08:28:19,146   copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian
2025-08-31T08:28:19,148   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Dutch
2025-08-31T08:28:19,149   copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch
2025-08-31T08:28:19,151   copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch
2025-08-31T08:28:19,153   copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch
2025-08-31T08:28:19,154   copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch
2025-08-31T08:28:19,156   copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch
2025-08-31T08:28:19,158   copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch
2025-08-31T08:28:19,160   copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/_dutch_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch
2025-08-31T08:28:19,162   copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/_include_base_44_dutch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch
2025-08-31T08:28:19,164   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Albanian
2025-08-31T08:28:19,165   copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian
2025-08-31T08:28:19,167   copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian
2025-08-31T08:28:19,169   copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian
2025-08-31T08:28:19,171   copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian
2025-08-31T08:28:19,172   copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/_albanian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian
2025-08-31T08:28:19,174   copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/_include_base_44_albanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian
2025-08-31T08:28:19,176   copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian
2025-08-31T08:28:19,178   copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian
2025-08-31T08:28:19,180   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Serbian
2025-08-31T08:28:19,181   copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian
2025-08-31T08:28:19,183   copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian
2025-08-31T08:28:19,185   copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian
2025-08-31T08:28:19,186   copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian
2025-08-31T08:28:19,188   copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/_include_base_44_serbian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian
2025-08-31T08:28:19,190   copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/_serbian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian
2025-08-31T08:28:19,192   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:28:19,194   copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/_russian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:28:19,195   copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/_include_base_44_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:28:19,197   copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:28:19,199   copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:28:19,200   copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:28:19,202   copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:28:19,204   copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:28:19,206   copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:28:19,207   copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:28:19,209   copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:28:19,211   copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian
2025-08-31T08:28:19,213   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Finnish
2025-08-31T08:28:19,214   copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish
2025-08-31T08:28:19,216   copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish
2025-08-31T08:28:19,218   copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish
2025-08-31T08:28:19,220   copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/_finnish_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish
2025-08-31T08:28:19,221   copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish
2025-08-31T08:28:19,223   copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish
2025-08-31T08:28:19,225   copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish
2025-08-31T08:28:19,227   copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/_include_base_44_finnish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish
2025-08-31T08:28:19,230   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/German
2025-08-31T08:28:19,231   copying build/lib/lm_eval/tasks/include/few_shot_en/German/_german_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German
2025-08-31T08:28:19,233   copying build/lib/lm_eval/tasks/include/few_shot_en/German/include_base_44_german_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German
2025-08-31T08:28:19,235   copying build/lib/lm_eval/tasks/include/few_shot_en/German/_include_base_44_german.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German
2025-08-31T08:28:19,237   copying build/lib/lm_eval/tasks/include/few_shot_en/German/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German
2025-08-31T08:28:19,239   copying build/lib/lm_eval/tasks/include/few_shot_en/German/include_base_44_german_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German
2025-08-31T08:28:19,240   copying build/lib/lm_eval/tasks/include/few_shot_en/German/include_base_44_german_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German
2025-08-31T08:28:19,242   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Telugu
2025-08-31T08:28:19,243   copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu
2025-08-31T08:28:19,245   copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/_include_base_44_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu
2025-08-31T08:28:19,247   copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/_telugu_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu
2025-08-31T08:28:19,249   copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu
2025-08-31T08:28:19,251   copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu
2025-08-31T08:28:19,253   copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu
2025-08-31T08:28:19,254   copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu
2025-08-31T08:28:19,257   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Azerbaijani
2025-08-31T08:28:19,258   copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani
2025-08-31T08:28:19,260   copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani
2025-08-31T08:28:19,261   copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani
2025-08-31T08:28:19,263   copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani
2025-08-31T08:28:19,265   copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani
2025-08-31T08:28:19,267   copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani
2025-08-31T08:28:19,268   copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani
2025-08-31T08:28:19,270   copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani
2025-08-31T08:28:19,272   copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/_azerbaijani_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani
2025-08-31T08:28:19,275   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Hungarian
2025-08-31T08:28:19,276   copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian
2025-08-31T08:28:19,278   copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/_include_base_44_hungarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian
2025-08-31T08:28:19,279   copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/_hungarian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian
2025-08-31T08:28:19,281   copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian
2025-08-31T08:28:19,283   copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian
2025-08-31T08:28:19,284   copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian
2025-08-31T08:28:19,287   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Uzbek
2025-08-31T08:28:19,288   copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/_include_base_44_uzbek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek
2025-08-31T08:28:19,290   copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek
2025-08-31T08:28:19,292   copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/_uzbek_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek
2025-08-31T08:28:19,294   copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek
2025-08-31T08:28:19,296   copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek
2025-08-31T08:28:19,297   copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek
2025-08-31T08:28:19,299   copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek
2025-08-31T08:28:19,301   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Korean
2025-08-31T08:28:19,302   copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean
2025-08-31T08:28:19,305   copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/_korean_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean
2025-08-31T08:28:19,307   copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean
2025-08-31T08:28:19,309   copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/_include_base_44_korean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean
2025-08-31T08:28:19,310   copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean
2025-08-31T08:28:19,313   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Hebrew
2025-08-31T08:28:19,314   copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/_hebrew_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew
2025-08-31T08:28:19,316   copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew
2025-08-31T08:28:19,317   copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/_include_base_44_hebrew.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew
2025-08-31T08:28:19,319   copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew
2025-08-31T08:28:19,321   copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew
2025-08-31T08:28:19,323   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Belarusian
2025-08-31T08:28:19,324   copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian
2025-08-31T08:28:19,326   copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian
2025-08-31T08:28:19,328   copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/_include_base_44_belarusian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian
2025-08-31T08:28:19,330   copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian
2025-08-31T08:28:19,332   copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian
2025-08-31T08:28:19,333   copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/_belarusian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian
2025-08-31T08:28:19,336   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Japanese
2025-08-31T08:28:19,337   copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/_include_base_44_japanese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese
2025-08-31T08:28:19,339   copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/_japanese_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese
2025-08-31T08:28:19,341   copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese
2025-08-31T08:28:19,342   copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese
2025-08-31T08:28:19,344   copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese
2025-08-31T08:28:19,346   copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese
2025-08-31T08:28:19,348   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Kazakh
2025-08-31T08:28:19,350   copying build/lib/lm_eval/tasks/include/few_shot_en/Kazakh/_kazakh_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Kazakh
2025-08-31T08:28:19,352   copying build/lib/lm_eval/tasks/include/few_shot_en/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Kazakh
2025-08-31T08:28:19,354   copying build/lib/lm_eval/tasks/include/few_shot_en/Kazakh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Kazakh
2025-08-31T08:28:19,356   copying build/lib/lm_eval/tasks/include/few_shot_en/Kazakh/_include_base_44_kazakh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Kazakh
2025-08-31T08:28:19,358   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Georgian
2025-08-31T08:28:19,359   copying build/lib/lm_eval/tasks/include/few_shot_en/Georgian/_include_base_44_georgian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Georgian
2025-08-31T08:28:19,361   copying build/lib/lm_eval/tasks/include/few_shot_en/Georgian/_georgian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Georgian
2025-08-31T08:28:19,362   copying build/lib/lm_eval/tasks/include/few_shot_en/Georgian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Georgian
2025-08-31T08:28:19,364   copying build/lib/lm_eval/tasks/include/few_shot_en/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Georgian
2025-08-31T08:28:19,366   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Persian
2025-08-31T08:28:19,367   copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/_include_base_44_persian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian
2025-08-31T08:28:19,369   copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian
2025-08-31T08:28:19,371   copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian
2025-08-31T08:28:19,373   copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian
2025-08-31T08:28:19,374   copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian
2025-08-31T08:28:19,376   copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian
2025-08-31T08:28:19,378   copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/_persian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian
2025-08-31T08:28:19,380   copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian
2025-08-31T08:28:19,382   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Indonesian
2025-08-31T08:28:19,383   copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/_include_base_44_indonesian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian
2025-08-31T08:28:19,385   copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/_indonesian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian
2025-08-31T08:28:19,388   copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian
2025-08-31T08:28:19,389   copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian
2025-08-31T08:28:19,391   copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian
2025-08-31T08:28:19,393   copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian
2025-08-31T08:28:19,394   copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian
2025-08-31T08:28:19,396   copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian
2025-08-31T08:28:19,399   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Vietnamese
2025-08-31T08:28:19,400   copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese
2025-08-31T08:28:19,402   copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese
2025-08-31T08:28:19,403   copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/_include_base_44_vietnamese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese
2025-08-31T08:28:19,405   copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese
2025-08-31T08:28:19,407   copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/_vietnamese_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese
2025-08-31T08:28:19,409   copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese
2025-08-31T08:28:19,411   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Spanish
2025-08-31T08:28:19,412   copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish
2025-08-31T08:28:19,414   copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish
2025-08-31T08:28:19,416   copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/_spanish_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish
2025-08-31T08:28:19,418   copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/_include_base_44_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish
2025-08-31T08:28:19,420   copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish
2025-08-31T08:28:19,421   copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish
2025-08-31T08:28:19,423   copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish
2025-08-31T08:28:19,426   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Greek
2025-08-31T08:28:19,427   copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/_greek_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek
2025-08-31T08:28:19,429   copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek
2025-08-31T08:28:19,430   copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/_include_base_44_greek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek
2025-08-31T08:28:19,432   copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek
2025-08-31T08:28:19,434   copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek
2025-08-31T08:28:19,436   copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek
2025-08-31T08:28:19,438   copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek
2025-08-31T08:28:19,439   copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek
2025-08-31T08:28:19,441   copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek
2025-08-31T08:28:19,443   copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek
2025-08-31T08:28:19,445   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:28:19,446   copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/_chinese_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:28:19,448   copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:28:19,450   copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:28:19,452   copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:28:19,453   copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:28:19,455   copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:28:19,457   copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:28:19,459   copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:28:19,461   copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:28:19,462   copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:28:19,464   copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/_include_base_44_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese
2025-08-31T08:28:19,466   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Turkish
2025-08-31T08:28:19,468   copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish
2025-08-31T08:28:19,469   copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish
2025-08-31T08:28:19,471   copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish
2025-08-31T08:28:19,473   copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish
2025-08-31T08:28:19,474   copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/_turkish_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish
2025-08-31T08:28:19,476   copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish
2025-08-31T08:28:19,478   copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/_include_base_44_turkish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish
2025-08-31T08:28:19,480   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Tagalog
2025-08-31T08:28:19,481   copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/_tagalog_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog
2025-08-31T08:28:19,483   copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog
2025-08-31T08:28:19,485   copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog
2025-08-31T08:28:19,487   copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog
2025-08-31T08:28:19,488   copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/_include_base_44_tagalog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog
2025-08-31T08:28:19,491   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/French
2025-08-31T08:28:19,492   copying build/lib/lm_eval/tasks/include/few_shot_en/French/_include_base_44_french.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French
2025-08-31T08:28:19,494   copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French
2025-08-31T08:28:19,495   copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French
2025-08-31T08:28:19,497   copying build/lib/lm_eval/tasks/include/few_shot_en/French/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French
2025-08-31T08:28:19,499   copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French
2025-08-31T08:28:19,501   copying build/lib/lm_eval/tasks/include/few_shot_en/French/_french_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French
2025-08-31T08:28:19,502   copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French
2025-08-31T08:28:19,504   copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French
2025-08-31T08:28:19,506   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Bulgarian
2025-08-31T08:28:19,507   copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/_bulgarian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian
2025-08-31T08:28:19,509   copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian
2025-08-31T08:28:19,511   copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian
2025-08-31T08:28:19,513   copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/_include_base_44_bulgarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian
2025-08-31T08:28:19,514   copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian
2025-08-31T08:28:19,516   copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian
2025-08-31T08:28:19,518   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Lithuanian
2025-08-31T08:28:19,519   copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian
2025-08-31T08:28:19,521   copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/_lithuanian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian
2025-08-31T08:28:19,523   copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian
2025-08-31T08:28:19,525   copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian
2025-08-31T08:28:19,527   copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian
2025-08-31T08:28:19,528   copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian
2025-08-31T08:28:19,530   copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/_include_base_44_lithuanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian
2025-08-31T08:28:19,532   copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian
2025-08-31T08:28:19,534   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Urdu
2025-08-31T08:28:19,535   copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu
2025-08-31T08:28:19,537   copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu
2025-08-31T08:28:19,539   copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/_urdu_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu
2025-08-31T08:28:19,540   copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu
2025-08-31T08:28:19,542   copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu
2025-08-31T08:28:19,544   copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/_include_base_44_urdu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu
2025-08-31T08:28:19,546   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Polish
2025-08-31T08:28:19,547   copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish
2025-08-31T08:28:19,549   copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish
2025-08-31T08:28:19,551   copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/_polish_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish
2025-08-31T08:28:19,552   copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish
2025-08-31T08:28:19,554   copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish
2025-08-31T08:28:19,556   copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/_include_base_44_polish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish
2025-08-31T08:28:19,558   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Tamil
2025-08-31T08:28:19,559   copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil
2025-08-31T08:28:19,561   copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/_tamil_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil
2025-08-31T08:28:19,563   copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil
2025-08-31T08:28:19,564   copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil
2025-08-31T08:28:19,566   copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/_include_base_44_tamil.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil
2025-08-31T08:28:19,569   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Italian
2025-08-31T08:28:19,570   copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/_include_base_44_italian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian
2025-08-31T08:28:19,572   copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/_italian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian
2025-08-31T08:28:19,574   copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian
2025-08-31T08:28:19,575   copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian
2025-08-31T08:28:19,577   copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian
2025-08-31T08:28:19,579   copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian
2025-08-31T08:28:19,581   copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian
2025-08-31T08:28:19,582   copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian
2025-08-31T08:28:19,584   copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian
2025-08-31T08:28:19,587   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Portuguese
2025-08-31T08:28:19,588   copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/_include_base_44_portuguese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese
2025-08-31T08:28:19,590   copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese
2025-08-31T08:28:19,592   copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese
2025-08-31T08:28:19,594   copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese
2025-08-31T08:28:19,596   copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese
2025-08-31T08:28:19,598   copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese
2025-08-31T08:28:19,599   copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/_portuguese_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese
2025-08-31T08:28:19,601   copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese
2025-08-31T08:28:19,603   copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese
2025-08-31T08:28:19,606   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Estonian
2025-08-31T08:28:19,607   copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian
2025-08-31T08:28:19,609   copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian
2025-08-31T08:28:19,611   copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/_include_base_44_estonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian
2025-08-31T08:28:19,613   copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian
2025-08-31T08:28:19,615   copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian
2025-08-31T08:28:19,617   copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/_estonian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian
2025-08-31T08:28:19,618   copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian
2025-08-31T08:28:19,620   copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian
2025-08-31T08:28:19,622   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Bengali
2025-08-31T08:28:19,623   copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/_bengali_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali
2025-08-31T08:28:19,626   copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali
2025-08-31T08:28:19,627   copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali
2025-08-31T08:28:19,629   copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali
2025-08-31T08:28:19,632   copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali
2025-08-31T08:28:19,633   copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali
2025-08-31T08:28:19,636   copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/_include_base_44_bengali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali
2025-08-31T08:28:19,638   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Croatian
2025-08-31T08:28:19,639   copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian
2025-08-31T08:28:19,641   copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/_croatian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian
2025-08-31T08:28:19,643   copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian
2025-08-31T08:28:19,645   copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian
2025-08-31T08:28:19,647   copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian
2025-08-31T08:28:19,649   copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/_include_base_44_croatian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian
2025-08-31T08:28:19,651   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Malay
2025-08-31T08:28:19,653   copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay
2025-08-31T08:28:19,655   copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay
2025-08-31T08:28:19,657   copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/_malay_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay
2025-08-31T08:28:19,659   copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay
2025-08-31T08:28:19,661   copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay
2025-08-31T08:28:19,663   copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/_include_base_44_malay.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay
2025-08-31T08:28:19,665   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Ukrainian
2025-08-31T08:28:19,666   copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian
2025-08-31T08:28:19,668   copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/_ukrainian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian
2025-08-31T08:28:19,670   copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian
2025-08-31T08:28:19,672   copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/_include_base_44_ukrainian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian
2025-08-31T08:28:19,674   copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian
2025-08-31T08:28:19,676   copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian
2025-08-31T08:28:19,679   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Arabic
2025-08-31T08:28:19,680   copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic
2025-08-31T08:28:19,682   copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic
2025-08-31T08:28:19,684   copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic
2025-08-31T08:28:19,686   copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/_include_base_44_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic
2025-08-31T08:28:19,688   copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic
2025-08-31T08:28:19,690   copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic
2025-08-31T08:28:19,692   copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/_arabic_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic
2025-08-31T08:28:19,694   copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic
2025-08-31T08:28:19,696   copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic
2025-08-31T08:28:19,698   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Malayalam
2025-08-31T08:28:19,699   copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/_malayalam_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam
2025-08-31T08:28:19,701   copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam
2025-08-31T08:28:19,703   copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/_include_base_44_malayalam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam
2025-08-31T08:28:19,705   copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam
2025-08-31T08:28:19,707   copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam
2025-08-31T08:28:19,709   copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam
2025-08-31T08:28:19,711   copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam
2025-08-31T08:28:19,713   copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam
2025-08-31T08:28:19,715   copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam
2025-08-31T08:28:19,717   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/winogrande
2025-08-31T08:28:19,718   copying build/lib/lm_eval/tasks/winogrande/preprocess_winogrande.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogrande
2025-08-31T08:28:19,720   copying build/lib/lm_eval/tasks/winogrande/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogrande
2025-08-31T08:28:19,722   copying build/lib/lm_eval/tasks/winogrande/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogrande
2025-08-31T08:28:19,725   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,726   copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_jordan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,728   copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_morocco.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,730   copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_algeria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,732   copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_ksa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,733   copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion_north_africa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,735   copying build/lib/lm_eval/tasks/arab_culture_completion/utils_completion.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,737   copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion_gulf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,739   copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion_levant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,741   copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion_nile_valley.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,742   copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_uae.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,744   copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_palestine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,746   copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_egypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,748   copying build/lib/lm_eval/tasks/arab_culture_completion/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,750   copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_sudan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,751   copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_tunisia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,753   copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_lebanon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,755   copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_syria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,756   copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_libya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,758   copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_yemen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,760   copying build/lib/lm_eval/tasks/arab_culture_completion/prompts.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,762   copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,764   copying build/lib/lm_eval/tasks/arab_culture_completion/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,766   copying build/lib/lm_eval/tasks/arab_culture_completion/_default_arab_culture_completion_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion
2025-08-31T08:28:19,769   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/prost
2025-08-31T08:28:19,770   copying build/lib/lm_eval/tasks/prost/corypaik_prost.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/prost
2025-08-31T08:28:19,772   copying build/lib/lm_eval/tasks/prost/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/prost
2025-08-31T08:28:19,775   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gsm_plus
2025-08-31T08:28:19,776   copying build/lib/lm_eval/tasks/gsm_plus/gsm_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm_plus
2025-08-31T08:28:19,777   copying build/lib/lm_eval/tasks/gsm_plus/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm_plus
2025-08-31T08:28:19,779   copying build/lib/lm_eval/tasks/gsm_plus/gsm_plus_mini.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm_plus
2025-08-31T08:28:19,782   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/moral_stories
2025-08-31T08:28:19,783   copying build/lib/lm_eval/tasks/moral_stories/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/moral_stories
2025-08-31T08:28:19,785   copying build/lib/lm_eval/tasks/moral_stories/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/moral_stories
2025-08-31T08:28:19,787   copying build/lib/lm_eval/tasks/moral_stories/moral_stories.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/moral_stories
2025-08-31T08:28:19,789   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/histoires_morales
2025-08-31T08:28:19,790   copying build/lib/lm_eval/tasks/histoires_morales/histoires_morales.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/histoires_morales
2025-08-31T08:28:19,792   copying build/lib/lm_eval/tasks/histoires_morales/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/histoires_morales
2025-08-31T08:28:19,794   copying build/lib/lm_eval/tasks/histoires_morales/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/histoires_morales
2025-08-31T08:28:19,796   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh
2025-08-31T08:28:19,798   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,799   copying build/lib/lm_eval/tasks/bbh/zeroshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,801   copying build/lib/lm_eval/tasks/bbh/zeroshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,803   copying build/lib/lm_eval/tasks/bbh/zeroshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,805   copying build/lib/lm_eval/tasks/bbh/zeroshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,807   copying build/lib/lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,808   copying build/lib/lm_eval/tasks/bbh/zeroshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,810   copying build/lib/lm_eval/tasks/bbh/zeroshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,813   copying build/lib/lm_eval/tasks/bbh/zeroshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,814   copying build/lib/lm_eval/tasks/bbh/zeroshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,816   copying build/lib/lm_eval/tasks/bbh/zeroshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,818   copying build/lib/lm_eval/tasks/bbh/zeroshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,820   copying build/lib/lm_eval/tasks/bbh/zeroshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,822   copying build/lib/lm_eval/tasks/bbh/zeroshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,824   copying build/lib/lm_eval/tasks/bbh/zeroshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,826   copying build/lib/lm_eval/tasks/bbh/zeroshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,827   copying build/lib/lm_eval/tasks/bbh/zeroshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,829   copying build/lib/lm_eval/tasks/bbh/zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,832   copying build/lib/lm_eval/tasks/bbh/zeroshot/_zeroshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,833   copying build/lib/lm_eval/tasks/bbh/zeroshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,835   copying build/lib/lm_eval/tasks/bbh/zeroshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,837   copying build/lib/lm_eval/tasks/bbh/zeroshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,839   copying build/lib/lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,841   copying build/lib/lm_eval/tasks/bbh/zeroshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,842   copying build/lib/lm_eval/tasks/bbh/zeroshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,844   copying build/lib/lm_eval/tasks/bbh/zeroshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,846   copying build/lib/lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,848   copying build/lib/lm_eval/tasks/bbh/zeroshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,850   copying build/lib/lm_eval/tasks/bbh/zeroshot/_bbh_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,852   copying build/lib/lm_eval/tasks/bbh/zeroshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,854   copying build/lib/lm_eval/tasks/bbh/zeroshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot
2025-08-31T08:28:19,857   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,858   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,861   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,863   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,865   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,866   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,868   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,870   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,872   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,874   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/_cot_zeroshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,876   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,877   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,879   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,881   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,883   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,885   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,887   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,889   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,891   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,893   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,895   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,897   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,899   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,901   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/_bbh_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,904   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,906   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,909   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,913   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,917   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,921   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,926   copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot
2025-08-31T08:28:19,934   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,935   copying build/lib/lm_eval/tasks/bbh/fewshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,937   copying build/lib/lm_eval/tasks/bbh/fewshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,939   copying build/lib/lm_eval/tasks/bbh/fewshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,941   copying build/lib/lm_eval/tasks/bbh/fewshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,943   copying build/lib/lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,945   copying build/lib/lm_eval/tasks/bbh/fewshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,947   copying build/lib/lm_eval/tasks/bbh/fewshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,949   copying build/lib/lm_eval/tasks/bbh/fewshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,951   copying build/lib/lm_eval/tasks/bbh/fewshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,953   copying build/lib/lm_eval/tasks/bbh/fewshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,955   copying build/lib/lm_eval/tasks/bbh/fewshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,957   copying build/lib/lm_eval/tasks/bbh/fewshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,959   copying build/lib/lm_eval/tasks/bbh/fewshot/_bbh_fewshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,961   copying build/lib/lm_eval/tasks/bbh/fewshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,963   copying build/lib/lm_eval/tasks/bbh/fewshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,965   copying build/lib/lm_eval/tasks/bbh/fewshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,966   copying build/lib/lm_eval/tasks/bbh/fewshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,968   copying build/lib/lm_eval/tasks/bbh/fewshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,970   copying build/lib/lm_eval/tasks/bbh/fewshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,972   copying build/lib/lm_eval/tasks/bbh/fewshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,974   copying build/lib/lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,976   copying build/lib/lm_eval/tasks/bbh/fewshot/_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,977   copying build/lib/lm_eval/tasks/bbh/fewshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,979   copying build/lib/lm_eval/tasks/bbh/fewshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,981   copying build/lib/lm_eval/tasks/bbh/fewshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,983   copying build/lib/lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,985   copying build/lib/lm_eval/tasks/bbh/fewshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,987   copying build/lib/lm_eval/tasks/bbh/fewshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,989   copying build/lib/lm_eval/tasks/bbh/fewshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot
2025-08-31T08:28:19,992   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:19,993   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:19,995   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:19,998   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,000   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,002   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,004   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,006   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,008   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,010   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/_cot_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,012   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,014   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,016   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,018   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,021   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/_bbh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,024   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,030   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,036   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,042   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,044   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,046   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,048   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,050   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,052   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,053   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,055   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,057   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,059   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,061   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/_bbh_cot_fewshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,063   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,066   copying build/lib/lm_eval/tasks/bbh/cot_fewshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot
2025-08-31T08:28:20,067   copying build/lib/lm_eval/tasks/bbh/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh
2025-08-31T08:28:20,069   copying build/lib/lm_eval/tasks/bbh/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh
2025-08-31T08:28:20,072   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu
2025-08-31T08:28:20,074   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,076   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,078   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,080   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,082   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,084   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,086   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,088   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,090   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,092   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu_flan_cot_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,093   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,095   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,097   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,100   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,102   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,104   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,106   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,108   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,111   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,112   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,114   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,117   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,119   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,122   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,124   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,126   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/_cot_prompts.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,132   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,135   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,137   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,139   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,141   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,143   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,146   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,151   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,153   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,156   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,158   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,160   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,163   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,165   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,167   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,170   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,172   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,174   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,177   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,181   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,186   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,192   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,195   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,197   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,201   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,206   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,208   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,210   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,213   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,215   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,218   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,221   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,227   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,234   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,316   copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot
2025-08-31T08:28:20,320   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,322   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,324   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,326   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,328   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,330   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,332   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,334   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,336   copying build/lib/lm_eval/tasks/mmlu/generative/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,338   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,340   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,341   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,343   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,345   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,347   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,348   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,350   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,352   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,354   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,356   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,358   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,359   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,361   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,363   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,365   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,366   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,368   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,372   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,374   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,376   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,378   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,380   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,381   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,383   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,385   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,387   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,389   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,390   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,392   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,394   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,396   copying build/lib/lm_eval/tasks/mmlu/generative/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,397   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,399   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,401   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,403   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,404   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,406   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,408   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,410   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,412   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,414   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,416   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,418   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,420   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,421   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,423   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,425   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,427   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,429   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,431   copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative
2025-08-31T08:28:20,434   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,435   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,437   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,439   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,441   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,443   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,444   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu_flan_cot_zeroshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,446   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,448   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,450   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,452   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,454   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,456   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,458   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,459   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,461   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,463   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,465   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,467   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,469   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,471   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,473   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,475   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,477   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,479   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,480   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,482   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,484   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,486   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,488   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,490   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,492   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,494   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,496   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,498   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,500   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,502   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,504   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,506   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,508   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,510   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,512   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,513   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,515   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,517   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,519   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,521   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,522   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,524   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,526   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,528   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,530   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,531   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,533   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,535   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,537   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,539   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,540   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,542   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,544   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,545   copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot
2025-08-31T08:28:20,548   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_n_shot
2025-08-31T08:28:20,550   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,552   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,554   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,556   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,558   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,560   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,562   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,564   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,565   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,567   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,569   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,571   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,573   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,574   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,577   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,578   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,580   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,582   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,584   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,585   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,587   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,589   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,591   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,593   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,595   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,597   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,598   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,601   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,603   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu_flan_generative_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,604   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,606   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,608   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,610   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,611   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,613   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,615   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,617   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,619   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,620   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,622   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,624   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,626   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,627   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,629   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,631   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,633   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,635   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,637   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,639   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,641   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,643   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,645   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,647   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,649   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,651   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,652   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,654   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,656   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,658   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,660   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,662   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative
2025-08-31T08:28:20,665   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,666   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,668   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,670   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,672   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,674   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,676   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,678   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,680   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,682   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,684   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,686   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,688   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,690   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,691   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,693   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,695   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,697   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu_flan_loglikelihood_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,699   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,701   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,702   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,704   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,706   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,708   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,710   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,712   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,714   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,716   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,718   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,720   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,722   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,723   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,725   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,727   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,728   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,730   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,732   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,734   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,736   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,737   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,739   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,741   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,743   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,745   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,747   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,749   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,750   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,752   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,754   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,756   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,758   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,760   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,762   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,763   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,765   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,767   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,768   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,770   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,772   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,773   copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood
2025-08-31T08:28:20,777   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,778   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,780   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,782   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,783   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,785   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,787   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,789   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,790   copying build/lib/lm_eval/tasks/mmlu/continuation/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,792   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,794   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,796   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,798   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,799   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,801   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,803   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,804   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,806   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,808   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,810   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,811   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,814   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,815   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,817   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,819   copying build/lib/lm_eval/tasks/mmlu/continuation/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,821   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,822   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,824   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,826   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,828   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,830   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,832   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,834   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,835   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,837   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,839   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,841   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,843   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,844   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,846   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,848   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,849   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,851   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,853   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,855   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,856   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,858   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,860   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,862   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,863   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,865   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,867   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,869   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,871   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,872   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,874   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,876   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,878   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,880   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,882   copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation
2025-08-31T08:28:20,884   copying build/lib/lm_eval/tasks/mmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu
2025-08-31T08:28:20,887   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,888   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,890   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,892   copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,894   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,896   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,898   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,899   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,901   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,903   copying build/lib/lm_eval/tasks/mmlu/default/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,905   copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,907   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,909   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,910   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,912   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,914   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,916   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,918   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,919   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,921   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,923   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,925   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,927   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,928   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,930   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,933   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,935   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,936   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,938   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,940   copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,942   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,944   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,946   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,947   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,949   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,951   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,953   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,955   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,957   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,959   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,961   copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,963   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,964   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,966   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,968   copying build/lib/lm_eval/tasks/mmlu/default/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,970   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,972   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,974   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,976   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,978   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,980   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,982   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,984   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,986   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,987   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,989   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,991   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,993   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,995   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,996   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:20,998   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:21,000   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:21,002   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:21,004   copying build/lib/lm_eval/tasks/mmlu/default/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default
2025-08-31T08:28:21,006   copying build/lib/lm_eval/tasks/mmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu
2025-08-31T08:28:21,009   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/translation
2025-08-31T08:28:21,010   copying build/lib/lm_eval/tasks/translation/wmt16_de-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation
2025-08-31T08:28:21,012   copying build/lib/lm_eval/tasks/translation/wmt16_en-ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation
2025-08-31T08:28:21,014   copying build/lib/lm_eval/tasks/translation/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation
2025-08-31T08:28:21,017   copying build/lib/lm_eval/tasks/translation/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation
2025-08-31T08:28:21,019   copying build/lib/lm_eval/tasks/translation/wmt14_fr-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation
2025-08-31T08:28:21,021   copying build/lib/lm_eval/tasks/translation/wmt_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation
2025-08-31T08:28:21,022   copying build/lib/lm_eval/tasks/translation/wmt16_ro-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation
2025-08-31T08:28:21,024   copying build/lib/lm_eval/tasks/translation/iwslt2017_ar-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation
2025-08-31T08:28:21,026   copying build/lib/lm_eval/tasks/translation/wmt14_en-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation
2025-08-31T08:28:21,028   copying build/lib/lm_eval/tasks/translation/iwslt2017_en-ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation
2025-08-31T08:28:21,030   copying build/lib/lm_eval/tasks/translation/wmt16_en-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation
2025-08-31T08:28:21,032   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa
2025-08-31T08:28:21,034   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/zeroshot
2025-08-31T08:28:21,035   copying build/lib/lm_eval/tasks/gpqa/zeroshot/gpqa_diamond_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot
2025-08-31T08:28:21,037   copying build/lib/lm_eval/tasks/gpqa/zeroshot/gpqa_main_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot
2025-08-31T08:28:21,039   copying build/lib/lm_eval/tasks/gpqa/zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot
2025-08-31T08:28:21,043   copying build/lib/lm_eval/tasks/gpqa/zeroshot/_gpqa_zeroshot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot
2025-08-31T08:28:21,045   copying build/lib/lm_eval/tasks/gpqa/zeroshot/gpqa_extended_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot
2025-08-31T08:28:21,047   copying build/lib/lm_eval/tasks/gpqa/zeroshot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot
2025-08-31T08:28:21,049   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/generative
2025-08-31T08:28:21,050   copying build/lib/lm_eval/tasks/gpqa/generative/gpqa_diamond_generative_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative
2025-08-31T08:28:21,052   copying build/lib/lm_eval/tasks/gpqa/generative/gpqa_extended_generative_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative
2025-08-31T08:28:21,054   copying build/lib/lm_eval/tasks/gpqa/generative/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative
2025-08-31T08:28:21,056   copying build/lib/lm_eval/tasks/gpqa/generative/gpqa_main_generative_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative
2025-08-31T08:28:21,058   copying build/lib/lm_eval/tasks/gpqa/generative/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative
2025-08-31T08:28:21,060   copying build/lib/lm_eval/tasks/gpqa/generative/_gpqa_generative_n_shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative
2025-08-31T08:28:21,063   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/cot_zeroshot
2025-08-31T08:28:21,064   copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/gpqa_extended_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot
2025-08-31T08:28:21,067   copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/_gpqa_cot_zeroshot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot
2025-08-31T08:28:21,069   copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot
2025-08-31T08:28:21,070   copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/gpqa_diamond_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot
2025-08-31T08:28:21,072   copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/gpqa_main_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot
2025-08-31T08:28:21,074   copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot
2025-08-31T08:28:21,077   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/cot_n_shot
2025-08-31T08:28:21,078   copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/_gpqa_cot_n_shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot
2025-08-31T08:28:21,080   copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/gpqa_diamond_cot_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot
2025-08-31T08:28:21,082   copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot
2025-08-31T08:28:21,083   copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/gpqa_main_cot_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot
2025-08-31T08:28:21,085   copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/gpqa_extended_cot_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot
2025-08-31T08:28:21,088   copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot
2025-08-31T08:28:21,089   copying build/lib/lm_eval/tasks/gpqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa
2025-08-31T08:28:21,092   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/n_shot
2025-08-31T08:28:21,093   copying build/lib/lm_eval/tasks/gpqa/n_shot/gpqa_main_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot
2025-08-31T08:28:21,095   copying build/lib/lm_eval/tasks/gpqa/n_shot/gpqa_extended_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot
2025-08-31T08:28:21,096   copying build/lib/lm_eval/tasks/gpqa/n_shot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot
2025-08-31T08:28:21,098   copying build/lib/lm_eval/tasks/gpqa/n_shot/_gpqa_n_shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot
2025-08-31T08:28:21,100   copying build/lib/lm_eval/tasks/gpqa/n_shot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot
2025-08-31T08:28:21,102   copying build/lib/lm_eval/tasks/gpqa/n_shot/gpqa_diamond_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot
2025-08-31T08:28:21,104   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmlu
2025-08-31T08:28:21,106   copying build/lib/lm_eval/tasks/tmlu/subject.tsv -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu
2025-08-31T08:28:21,108   copying build/lib/lm_eval/tasks/tmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu
2025-08-31T08:28:21,111   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,112   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_tour_leader.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,114   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,116   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,118   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,119   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,121   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,123   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,125   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,127   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_nutritionist.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,129   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_earth_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,131   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_lawyer_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,133   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,135   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_taiwan_tourist_resources.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,137   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_basic_traditional_chinese_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,139   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_driving_rule.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,141   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_accountant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,143   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,144   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_tour_guide.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,147   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_clinical_traditional_chinese_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,148   copying build/lib/lm_eval/tasks/tmlu/default/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,151   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,153   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_clinical_psychologist.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,155   copying build/lib/lm_eval/tasks/tmlu/default/_tmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,157   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,159   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,160   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_teacher_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,162   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,164   copying build/lib/lm_eval/tasks/tmlu/default/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,167   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,168   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,170   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,172   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,174   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_earth_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,176   copying build/lib/lm_eval/tasks/tmlu/default/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,179   copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default
2025-08-31T08:28:21,182   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,184   copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,186   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,188   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,190   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_geography_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,192   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,194   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_accounting_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,196   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_physics_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,198   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_law_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,200   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_driving_test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,202   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,203   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_economics_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,205   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_history_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,207   copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,209   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_history_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,210   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,212   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,214   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_civics_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,216   copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,218   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_philosophy_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,220   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_economics_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,222   copying build/lib/lm_eval/tasks/arabicmmlu/_default_arabicmmlu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,223   copying build/lib/lm_eval/tasks/arabicmmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,225   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,227   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,229   copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,231   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,233   copying build/lib/lm_eval/tasks/arabicmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,235   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_geography_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,237   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_general.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,239   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_math_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,240   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,242   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,244   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,246   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_history_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,247   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,249   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,251   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,252   copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,254   copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,256   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,258   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_civics_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,259   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,261   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,263   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_management_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,264   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,266   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_political_science_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,268   copying build/lib/lm_eval/tasks/arabicmmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,270   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_geography_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,272   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_economics_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,274   copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_biology_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu
2025-08-31T08:28:21,276   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm
2025-08-31T08:28:21,278   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm/en_cot
2025-08-31T08:28:21,279   copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot
2025-08-31T08:28:21,281   copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot
2025-08-31T08:28:21,283   copying build/lib/lm_eval/tasks/mgsm/en_cot/cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot
2025-08-31T08:28:21,285   copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot
2025-08-31T08:28:21,287   copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot
2025-08-31T08:28:21,289   copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot
2025-08-31T08:28:21,290   copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot
2025-08-31T08:28:21,292   copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot
2025-08-31T08:28:21,294   copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot
2025-08-31T08:28:21,295   copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot
2025-08-31T08:28:21,297   copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot
2025-08-31T08:28:21,299   copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot
2025-08-31T08:28:21,301   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm/native_cot
2025-08-31T08:28:21,302   copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot
2025-08-31T08:28:21,304   copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot
2025-08-31T08:28:21,306   copying build/lib/lm_eval/tasks/mgsm/native_cot/cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot
2025-08-31T08:28:21,308   copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot
2025-08-31T08:28:21,310   copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot
2025-08-31T08:28:21,312   copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot
2025-08-31T08:28:21,314   copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot
2025-08-31T08:28:21,316   copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot
2025-08-31T08:28:21,317   copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot
2025-08-31T08:28:21,319   copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot
2025-08-31T08:28:21,321   copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot
2025-08-31T08:28:21,323   copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot
2025-08-31T08:28:21,325   copying build/lib/lm_eval/tasks/mgsm/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm
2025-08-31T08:28:21,327   copying build/lib/lm_eval/tasks/mgsm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm
2025-08-31T08:28:21,330   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm/direct
2025-08-31T08:28:21,331   copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct
2025-08-31T08:28:21,333   copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct
2025-08-31T08:28:21,335   copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct
2025-08-31T08:28:21,337   copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct
2025-08-31T08:28:21,339   copying build/lib/lm_eval/tasks/mgsm/direct/direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct
2025-08-31T08:28:21,341   copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct
2025-08-31T08:28:21,343   copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct
2025-08-31T08:28:21,344   copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct
2025-08-31T08:28:21,346   copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct
2025-08-31T08:28:21,348   copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct
2025-08-31T08:28:21,350   copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct
2025-08-31T08:28:21,351   copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct
2025-08-31T08:28:21,353   copying build/lib/lm_eval/tasks/mgsm/gen_yaml.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm
2025-08-31T08:28:21,356   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/med_prescriptions
2025-08-31T08:28:21,357   copying build/lib/lm_eval/tasks/med_prescriptions/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_prescriptions
2025-08-31T08:28:21,361   copying build/lib/lm_eval/tasks/med_prescriptions/med_prescriptions_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_prescriptions
2025-08-31T08:28:21,363   copying build/lib/lm_eval/tasks/med_prescriptions/med_prescriptions_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_prescriptions
2025-08-31T08:28:21,366   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/basque_bench
2025-08-31T08:28:21,367   copying build/lib/lm_eval/tasks/basque_bench/wnli_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench
2025-08-31T08:28:21,369   copying build/lib/lm_eval/tasks/basque_bench/mgsm_direct_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench
2025-08-31T08:28:21,371   copying build/lib/lm_eval/tasks/basque_bench/mgsm_cot_native_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench
2025-08-31T08:28:21,373   copying build/lib/lm_eval/tasks/basque_bench/piqa_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench
2025-08-31T08:28:21,374   copying build/lib/lm_eval/tasks/basque_bench/paws_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench
2025-08-31T08:28:21,376   copying build/lib/lm_eval/tasks/basque_bench/xcopa_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench
2025-08-31T08:28:21,378   copying build/lib/lm_eval/tasks/basque_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench
2025-08-31T08:28:21,380   copying build/lib/lm_eval/tasks/basque_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench
2025-08-31T08:28:21,383   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:28:21,384   copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:28:21,386   copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:28:21,388   copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:28:21,391   copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:28:21,392   copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:28:21,394   copying build/lib/lm_eval/tasks/basque_bench/flores_eu/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:28:21,396   copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_en-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:28:21,397   copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:28:21,399   copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:28:21,401   copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_it-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:28:21,403   copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_gl-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:28:21,405   copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_ca-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:28:21,407   copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_pt-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:28:21,409   copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_de-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:28:21,411   copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:28:21,412   copying build/lib/lm_eval/tasks/basque_bench/flores_eu/create_yamls_flores_eu.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:28:21,415   copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:28:21,417   copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_es-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:28:21,418   copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_fr-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu
2025-08-31T08:28:21,420   copying build/lib/lm_eval/tasks/basque_bench/basque_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench
2025-08-31T08:28:21,422   copying build/lib/lm_eval/tasks/basque_bench/arc_eu_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench
2025-08-31T08:28:21,424   copying build/lib/lm_eval/tasks/basque_bench/arc_eu_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench
2025-08-31T08:28:21,426   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/chartqa
2025-08-31T08:28:21,427   copying build/lib/lm_eval/tasks/chartqa/chartqa_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa
2025-08-31T08:28:21,430   copying build/lib/lm_eval/tasks/chartqa/chartqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa
2025-08-31T08:28:21,431   copying build/lib/lm_eval/tasks/chartqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa
2025-08-31T08:28:21,434   copying build/lib/lm_eval/tasks/chartqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa
2025-08-31T08:28:21,436   copying build/lib/lm_eval/tasks/chartqa/chartqa_llama_90.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa
2025-08-31T08:28:21,438   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/race
2025-08-31T08:28:21,439   copying build/lib/lm_eval/tasks/race/race.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/race
2025-08-31T08:28:21,441   copying build/lib/lm_eval/tasks/race/preprocess_race.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/race
2025-08-31T08:28:21,442   copying build/lib/lm_eval/tasks/race/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/race
2025-08-31T08:28:21,445   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glianorex
2025-08-31T08:28:21,446   copying build/lib/lm_eval/tasks/glianorex/preprocess_glianorex.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex
2025-08-31T08:28:21,448   copying build/lib/lm_eval/tasks/glianorex/glianorex.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex
2025-08-31T08:28:21,450   copying build/lib/lm_eval/tasks/glianorex/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex
2025-08-31T08:28:21,452   copying build/lib/lm_eval/tasks/glianorex/glianorex_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex
2025-08-31T08:28:21,454   copying build/lib/lm_eval/tasks/glianorex/glianorex_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex
2025-08-31T08:28:21,456   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/triviaqa
2025-08-31T08:28:21,457   copying build/lib/lm_eval/tasks/triviaqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/triviaqa
2025-08-31T08:28:21,459   copying build/lib/lm_eval/tasks/triviaqa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/triviaqa
2025-08-31T08:28:21,461   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mathqa
2025-08-31T08:28:21,462   copying build/lib/lm_eval/tasks/mathqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mathqa
2025-08-31T08:28:21,464   copying build/lib/lm_eval/tasks/mathqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mathqa
2025-08-31T08:28:21,466   copying build/lib/lm_eval/tasks/mathqa/mathqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mathqa
2025-08-31T08:28:21,469   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/unscramble
2025-08-31T08:28:21,470   copying build/lib/lm_eval/tasks/unscramble/reversed_words.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble
2025-08-31T08:28:21,471   copying build/lib/lm_eval/tasks/unscramble/anagrams1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble
2025-08-31T08:28:21,473   copying build/lib/lm_eval/tasks/unscramble/random_insertion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble
2025-08-31T08:28:21,475   copying build/lib/lm_eval/tasks/unscramble/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble
2025-08-31T08:28:21,477   copying build/lib/lm_eval/tasks/unscramble/cycle_letters.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble
2025-08-31T08:28:21,479   copying build/lib/lm_eval/tasks/unscramble/anagrams2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble
2025-08-31T08:28:21,481   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arithmetic
2025-08-31T08:28:21,482   copying build/lib/lm_eval/tasks/arithmetic/arithmetic_4ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic
2025-08-31T08:28:21,484   copying build/lib/lm_eval/tasks/arithmetic/arithmetic_2ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic
2025-08-31T08:28:21,486   copying build/lib/lm_eval/tasks/arithmetic/arithmetic_3ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic
2025-08-31T08:28:21,488   copying build/lib/lm_eval/tasks/arithmetic/arithmetic_2da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic
2025-08-31T08:28:21,489   copying build/lib/lm_eval/tasks/arithmetic/arithmetic_1dc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic
2025-08-31T08:28:21,491   copying build/lib/lm_eval/tasks/arithmetic/arithmetic_4da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic
2025-08-31T08:28:21,493   copying build/lib/lm_eval/tasks/arithmetic/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic
2025-08-31T08:28:21,495   copying build/lib/lm_eval/tasks/arithmetic/arithmetic_5da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic
2025-08-31T08:28:21,496   copying build/lib/lm_eval/tasks/arithmetic/arithmetic_5ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic
2025-08-31T08:28:21,498   copying build/lib/lm_eval/tasks/arithmetic/arithmetic_2dm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic
2025-08-31T08:28:21,500   copying build/lib/lm_eval/tasks/arithmetic/arithmetic_3da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic
2025-08-31T08:28:21,504   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,505   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,506   copying build/lib/lm_eval/tasks/evalita_llm/_sum_template_fp-small_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,508   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,510   copying build/lib/lm_eval/tasks/evalita_llm/_ner_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,511   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,513   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,515   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,517   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,518   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,520   copying build/lib/lm_eval/tasks/evalita_llm/_re_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,522   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,524   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,526   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_mc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,528   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,531   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,533   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,535   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_re_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,537   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,539   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,541   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,543   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,546   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,548   copying build/lib/lm_eval/tasks/evalita_llm/_sa_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,550   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,552   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,553   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ls_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,556   copying build/lib/lm_eval/tasks/evalita_llm/_ls_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,558   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,560   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,563   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,567   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,570   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,574   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_gen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,577   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,579   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,580   copying build/lib/lm_eval/tasks/evalita_llm/sum_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,582   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,584   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,586   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,587   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,589   copying build/lib/lm_eval/tasks/evalita_llm/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,592   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,594   copying build/lib/lm_eval/tasks/evalita_llm/_sa_template_v2_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,596   copying build/lib/lm_eval/tasks/evalita_llm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,597   copying build/lib/lm_eval/tasks/evalita_llm/_te_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,599   copying build/lib/lm_eval/tasks/evalita_llm/_sum_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,601   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,603   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_re_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,605   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,607   copying build/lib/lm_eval/tasks/evalita_llm/_at_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,608   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,611   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,615   copying build/lib/lm_eval/tasks/evalita_llm/_sum_template_fp_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,618   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,620   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,622   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,623   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,625   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,627   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,629   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,631   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,633   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,635   copying build/lib/lm_eval/tasks/evalita_llm/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,637   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,639   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,641   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ls_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,643   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,645   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,647   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,649   copying build/lib/lm_eval/tasks/evalita_llm/_wic_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,650   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,653   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,654   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,657   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,659   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,660   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,662   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,664   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,665   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,667   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,669   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,670   copying build/lib/lm_eval/tasks/evalita_llm/_hs_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,672   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_re_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,674   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,676   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,678   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ls_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,679   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,682   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,684   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,686   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,688   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,690   copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,692   copying build/lib/lm_eval/tasks/evalita_llm/_faq_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm
2025-08-31T08:28:21,694   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xnli
2025-08-31T08:28:21,695   copying build/lib/lm_eval/tasks/xnli/xnli_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli
2025-08-31T08:28:21,697   copying build/lib/lm_eval/tasks/xnli/_xnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli
2025-08-31T08:28:21,699   copying build/lib/lm_eval/tasks/xnli/xnli_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli
2025-08-31T08:28:21,701   copying build/lib/lm_eval/tasks/xnli/xnli_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli
2025-08-31T08:28:21,703   copying build/lib/lm_eval/tasks/xnli/xnli_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli
2025-08-31T08:28:21,705   copying build/lib/lm_eval/tasks/xnli/xnli_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli
2025-08-31T08:28:21,707   copying build/lib/lm_eval/tasks/xnli/xnli_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli
2025-08-31T08:28:21,708   copying build/lib/lm_eval/tasks/xnli/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli
2025-08-31T08:28:21,711   copying build/lib/lm_eval/tasks/xnli/xnli_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli
2025-08-31T08:28:21,712   copying build/lib/lm_eval/tasks/xnli/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli
2025-08-31T08:28:21,714   copying build/lib/lm_eval/tasks/xnli/xnli_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli
2025-08-31T08:28:21,716   copying build/lib/lm_eval/tasks/xnli/xnli_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli
2025-08-31T08:28:21,717   copying build/lib/lm_eval/tasks/xnli/xnli_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli
2025-08-31T08:28:21,719   copying build/lib/lm_eval/tasks/xnli/xnli_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli
2025-08-31T08:28:21,721   copying build/lib/lm_eval/tasks/xnli/xnli_ur.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli
2025-08-31T08:28:21,723   copying build/lib/lm_eval/tasks/xnli/xnli_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli
2025-08-31T08:28:21,724   copying build/lib/lm_eval/tasks/xnli/xnli_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli
2025-08-31T08:28:21,726   copying build/lib/lm_eval/tasks/xnli/xnli_bg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli
2025-08-31T08:28:21,728   copying build/lib/lm_eval/tasks/xnli/xnli_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli
2025-08-31T08:28:21,730   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/jsonschema_bench
2025-08-31T08:28:21,731   copying build/lib/lm_eval/tasks/jsonschema_bench/jsonschema_bench_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench
2025-08-31T08:28:21,734   copying build/lib/lm_eval/tasks/jsonschema_bench/jsonschema_bench_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench
2025-08-31T08:28:21,736   copying build/lib/lm_eval/tasks/jsonschema_bench/jsonschema_bench_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench
2025-08-31T08:28:21,739   copying build/lib/lm_eval/tasks/jsonschema_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench
2025-08-31T08:28:21,744   copying build/lib/lm_eval/tasks/jsonschema_bench/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench
2025-08-31T08:28:21,750   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xwinograd
2025-08-31T08:28:21,752   copying build/lib/lm_eval/tasks/xwinograd/xwinograd_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd
2025-08-31T08:28:21,757   copying build/lib/lm_eval/tasks/xwinograd/xwinograd_jp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd
2025-08-31T08:28:21,761   copying build/lib/lm_eval/tasks/xwinograd/xwinograd_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd
2025-08-31T08:28:21,765   copying build/lib/lm_eval/tasks/xwinograd/xwinograd_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd
2025-08-31T08:28:21,769   copying build/lib/lm_eval/tasks/xwinograd/xwinograd_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd
2025-08-31T08:28:21,773   copying build/lib/lm_eval/tasks/xwinograd/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd
2025-08-31T08:28:21,777   copying build/lib/lm_eval/tasks/xwinograd/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd
2025-08-31T08:28:21,782   copying build/lib/lm_eval/tasks/xwinograd/xwinograd_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd
2025-08-31T08:28:21,788   copying build/lib/lm_eval/tasks/xwinograd/xwinograd_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd
2025-08-31T08:28:21,795   copying build/lib/lm_eval/tasks/xwinograd/_xwinograd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd
2025-08-31T08:28:21,798   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/alghafa
2025-08-31T08:28:21,800   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/alghafa/piqa_ar
2025-08-31T08:28:21,802   copying build/lib/lm_eval/tasks/alghafa/piqa_ar/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/piqa_ar
2025-08-31T08:28:21,805   copying build/lib/lm_eval/tasks/alghafa/piqa_ar/piqa_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/piqa_ar
2025-08-31T08:28:21,808   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/alghafa/copa_ar
2025-08-31T08:28:21,809   copying build/lib/lm_eval/tasks/alghafa/copa_ar/copa_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/copa_ar
2025-08-31T08:28:21,812   copying build/lib/lm_eval/tasks/alghafa/copa_ar/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/copa_ar
2025-08-31T08:28:21,815   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/commonsense_qa
2025-08-31T08:28:21,816   copying build/lib/lm_eval/tasks/commonsense_qa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/commonsense_qa
2025-08-31T08:28:21,820   copying build/lib/lm_eval/tasks/commonsense_qa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/commonsense_qa
2025-08-31T08:28:21,824   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gsm8k
2025-08-31T08:28:21,826   copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k
2025-08-31T08:28:21,829   copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot-llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k
2025-08-31T08:28:21,833   copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot-self-consistency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k
2025-08-31T08:28:21,838   copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot-zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k
2025-08-31T08:28:21,840   copying build/lib/lm_eval/tasks/gsm8k/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k
2025-08-31T08:28:21,842   copying build/lib/lm_eval/tasks/gsm8k/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k
2025-08-31T08:28:21,844   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/galician_bench
2025-08-31T08:28:21,846   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:28:21,847   copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:28:21,849   copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_en-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:28:21,851   copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:28:21,853   copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:28:21,855   copying build/lib/lm_eval/tasks/galician_bench/flores_gl/create_yamls_flores_gl.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:28:21,857   copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_fr-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:28:21,859   copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:28:21,861   copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:28:21,863   copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_eu-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:28:21,865   copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_de-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:28:21,867   copying build/lib/lm_eval/tasks/galician_bench/flores_gl/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:28:21,869   copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_es-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:28:21,871   copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:28:21,873   copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_pt-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:28:21,876   copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:28:21,878   copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:28:21,880   copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_ca-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:28:21,882   copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_it-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:28:21,884   copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl
2025-08-31T08:28:21,886   copying build/lib/lm_eval/tasks/galician_bench/summarization_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench
2025-08-31T08:28:21,888   copying build/lib/lm_eval/tasks/galician_bench/truthfulqa_gl_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench
2025-08-31T08:28:21,890   copying build/lib/lm_eval/tasks/galician_bench/xnli_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench
2025-08-31T08:28:21,892   copying build/lib/lm_eval/tasks/galician_bench/galician_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench
2025-08-31T08:28:21,895   copying build/lib/lm_eval/tasks/galician_bench/truthfulqa_gl_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench
2025-08-31T08:28:21,897   copying build/lib/lm_eval/tasks/galician_bench/truthfulqa_gl_gen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench
2025-08-31T08:28:21,898   copying build/lib/lm_eval/tasks/galician_bench/galcola.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench
2025-08-31T08:28:21,900   copying build/lib/lm_eval/tasks/galician_bench/parafrases_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench
2025-08-31T08:28:21,902   copying build/lib/lm_eval/tasks/galician_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench
2025-08-31T08:28:21,905   copying build/lib/lm_eval/tasks/galician_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench
2025-08-31T08:28:21,907   copying build/lib/lm_eval/tasks/galician_bench/mgsm_direct_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench
2025-08-31T08:28:21,909   copying build/lib/lm_eval/tasks/galician_bench/paws_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench
2025-08-31T08:28:21,911   copying build/lib/lm_eval/tasks/galician_bench/belebele_glg_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench
2025-08-31T08:28:21,913   copying build/lib/lm_eval/tasks/galician_bench/xstorycloze_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench
2025-08-31T08:28:21,915   copying build/lib/lm_eval/tasks/galician_bench/openbookqa_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench
2025-08-31T08:28:21,917   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/turkishmmlu
2025-08-31T08:28:21,919   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/turkishmmlu/config
2025-08-31T08:28:21,920   copying build/lib/lm_eval/tasks/turkishmmlu/config/Religion_and_Ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config
2025-08-31T08:28:21,922   copying build/lib/lm_eval/tasks/turkishmmlu/config/Biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config
2025-08-31T08:28:21,924   copying build/lib/lm_eval/tasks/turkishmmlu/config/_turkishmmlu_default_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config
2025-08-31T08:28:21,926   copying build/lib/lm_eval/tasks/turkishmmlu/config/Turkish_Language_and_Literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config
2025-08-31T08:28:21,928   copying build/lib/lm_eval/tasks/turkishmmlu/config/Geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config
2025-08-31T08:28:21,929   copying build/lib/lm_eval/tasks/turkishmmlu/config/Chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config
2025-08-31T08:28:21,931   copying build/lib/lm_eval/tasks/turkishmmlu/config/Mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config
2025-08-31T08:28:21,933   copying build/lib/lm_eval/tasks/turkishmmlu/config/Philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config
2025-08-31T08:28:21,935   copying build/lib/lm_eval/tasks/turkishmmlu/config/Physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config
2025-08-31T08:28:21,937   copying build/lib/lm_eval/tasks/turkishmmlu/config/History.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config
2025-08-31T08:28:21,938   copying build/lib/lm_eval/tasks/turkishmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu
2025-08-31T08:28:21,941   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/turkishmmlu/config_cot
2025-08-31T08:28:21,942   copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Religion_and_Ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot
2025-08-31T08:28:21,945   copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot
2025-08-31T08:28:21,947   copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/_turkishmmlu_cot_default_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot
2025-08-31T08:28:21,949   copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Turkish_Language_and_Literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot
2025-08-31T08:28:21,951   copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot
2025-08-31T08:28:21,954   copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot
2025-08-31T08:28:21,956   copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot
2025-08-31T08:28:21,958   copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot
2025-08-31T08:28:21,961   copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot
2025-08-31T08:28:21,963   copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/History.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot
2025-08-31T08:28:21,966   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xquad
2025-08-31T08:28:21,967   copying build/lib/lm_eval/tasks/xquad/xquad_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad
2025-08-31T08:28:21,969   copying build/lib/lm_eval/tasks/xquad/xquad_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad
2025-08-31T08:28:21,971   copying build/lib/lm_eval/tasks/xquad/xquad_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad
2025-08-31T08:28:21,973   copying build/lib/lm_eval/tasks/xquad/xquad_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad
2025-08-31T08:28:21,975   copying build/lib/lm_eval/tasks/xquad/xquad_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad
2025-08-31T08:28:21,977   copying build/lib/lm_eval/tasks/xquad/xquad_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad
2025-08-31T08:28:21,979   copying build/lib/lm_eval/tasks/xquad/xquad_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad
2025-08-31T08:28:21,981   copying build/lib/lm_eval/tasks/xquad/xquad_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad
2025-08-31T08:28:21,982   copying build/lib/lm_eval/tasks/xquad/xquad_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad
2025-08-31T08:28:21,984   copying build/lib/lm_eval/tasks/xquad/xquad_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad
2025-08-31T08:28:21,986   copying build/lib/lm_eval/tasks/xquad/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad
2025-08-31T08:28:21,988   copying build/lib/lm_eval/tasks/xquad/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad
2025-08-31T08:28:21,990   copying build/lib/lm_eval/tasks/xquad/xquad_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad
2025-08-31T08:28:21,991   copying build/lib/lm_eval/tasks/xquad/xquad_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad
2025-08-31T08:28:21,993   copying build/lib/lm_eval/tasks/xquad/xquad_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad
2025-08-31T08:28:21,996   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arc_mt
2025-08-31T08:28:21,997   copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_pl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt
2025-08-31T08:28:21,999   copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt
2025-08-31T08:28:22,001   copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_is.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt
2025-08-31T08:28:22,003   copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt
2025-08-31T08:28:22,005   copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_nb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt
2025-08-31T08:28:22,006   copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt
2025-08-31T08:28:22,008   copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt
2025-08-31T08:28:22,010   copying build/lib/lm_eval/tasks/arc_mt/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt
2025-08-31T08:28:22,012   copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt
2025-08-31T08:28:22,014   copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt
2025-08-31T08:28:22,016   copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt
2025-08-31T08:28:22,018   copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_fi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt
2025-08-31T08:28:22,019   copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt
2025-08-31T08:28:22,022   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/careqa
2025-08-31T08:28:22,023   copying build/lib/lm_eval/tasks/careqa/careqa_open_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa
2025-08-31T08:28:22,025   copying build/lib/lm_eval/tasks/careqa/careqa_open.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa
2025-08-31T08:28:22,027   copying build/lib/lm_eval/tasks/careqa/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa
2025-08-31T08:28:22,029   copying build/lib/lm_eval/tasks/careqa/careqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa
2025-08-31T08:28:22,031   copying build/lib/lm_eval/tasks/careqa/careqa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa
2025-08-31T08:28:22,032   copying build/lib/lm_eval/tasks/careqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa
2025-08-31T08:28:22,034   copying build/lib/lm_eval/tasks/careqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa
2025-08-31T08:28:22,036   copying build/lib/lm_eval/tasks/careqa/utils_open.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa
2025-08-31T08:28:22,038   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,040   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench/phrases_va
2025-08-31T08:28:22,041   copying build/lib/lm_eval/tasks/catalan_bench/phrases_va/_phrases_va_common -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/phrases_va
2025-08-31T08:28:22,043   copying build/lib/lm_eval/tasks/catalan_bench/phrases_va/phrases_ca-va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/phrases_va
2025-08-31T08:28:22,045   copying build/lib/lm_eval/tasks/catalan_bench/phrases_va/phrases_va-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/phrases_va
2025-08-31T08:28:22,047   copying build/lib/lm_eval/tasks/catalan_bench/cocoteros_va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,050   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:28:22,051   copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:28:22,053   copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_fr-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:28:22,054   copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:28:22,056   copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_gl-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:28:22,058   copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/create_yamls_flores_ca.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:28:22,060   copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:28:22,062   copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:28:22,064   copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_en-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:28:22,067   copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_pt-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:28:22,068   copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_de-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:28:22,070   copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:28:22,072   copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:28:22,074   copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_it-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:28:22,076   copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_eu-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:28:22,079   copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:28:22,080   copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:28:22,082   copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:28:22,084   copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_es-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:28:22,086   copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca
2025-08-31T08:28:22,088   copying build/lib/lm_eval/tasks/catalan_bench/copa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,090   copying build/lib/lm_eval/tasks/catalan_bench/paws_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,092   copying build/lib/lm_eval/tasks/catalan_bench/teca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,095   copying build/lib/lm_eval/tasks/catalan_bench/coqcat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,097   copying build/lib/lm_eval/tasks/catalan_bench/wnli_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,099   copying build/lib/lm_eval/tasks/catalan_bench/openbookqa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,101   copying build/lib/lm_eval/tasks/catalan_bench/mgsm_direct_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,104   copying build/lib/lm_eval/tasks/catalan_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,110   copying build/lib/lm_eval/tasks/catalan_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,113   copying build/lib/lm_eval/tasks/catalan_bench/piqa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,114   copying build/lib/lm_eval/tasks/catalan_bench/catcola.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,117   copying build/lib/lm_eval/tasks/catalan_bench/siqa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,119   copying build/lib/lm_eval/tasks/catalan_bench/xstorycloze_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,121   copying build/lib/lm_eval/tasks/catalan_bench/catalan_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,124   copying build/lib/lm_eval/tasks/catalan_bench/xnli_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,126   copying build/lib/lm_eval/tasks/catalan_bench/xquad_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,130   copying build/lib/lm_eval/tasks/catalan_bench/cabreu_abstractive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,132   copying build/lib/lm_eval/tasks/catalan_bench/cabreu_extractive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,134   copying build/lib/lm_eval/tasks/catalan_bench/arc_ca_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,136   copying build/lib/lm_eval/tasks/catalan_bench/catalanqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,138   copying build/lib/lm_eval/tasks/catalan_bench/cabreu_extreme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,140   copying build/lib/lm_eval/tasks/catalan_bench/parafraseja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,142   copying build/lib/lm_eval/tasks/catalan_bench/arc_ca_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,145   copying build/lib/lm_eval/tasks/catalan_bench/_cabreu_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,147   copying build/lib/lm_eval/tasks/catalan_bench/_arc_ca_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench
2025-08-31T08:28:22,149   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/unitxt
2025-08-31T08:28:22,150   copying build/lib/lm_eval/tasks/unitxt/unfair_tos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,152   copying build/lib/lm_eval/tasks/unitxt/ledgar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,154   copying build/lib/lm_eval/tasks/unitxt/unitxt_multimodal -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,156   copying build/lib/lm_eval/tasks/unitxt/financial_tweets.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,158   copying build/lib/lm_eval/tasks/unitxt/doc_vqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,159   copying build/lib/lm_eval/tasks/unitxt/coedit_gec.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,161   copying build/lib/lm_eval/tasks/unitxt/dbpedia_14.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,164   copying build/lib/lm_eval/tasks/unitxt/20_newsgroups.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,165   copying build/lib/lm_eval/tasks/unitxt/law_stack_exchange.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,167   copying build/lib/lm_eval/tasks/unitxt/atis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,169   copying build/lib/lm_eval/tasks/unitxt/unitxt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,171   copying build/lib/lm_eval/tasks/unitxt/ethos_binary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,173   copying build/lib/lm_eval/tasks/unitxt/claim_stance_topic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,175   copying build/lib/lm_eval/tasks/unitxt/xsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,177   copying build/lib/lm_eval/tasks/unitxt/cnn_dailymail.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,179   copying build/lib/lm_eval/tasks/unitxt/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,181   copying build/lib/lm_eval/tasks/unitxt/argument_topic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,183   copying build/lib/lm_eval/tasks/unitxt/banking77.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,185   copying build/lib/lm_eval/tasks/unitxt/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,187   copying build/lib/lm_eval/tasks/unitxt/stsb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,190   copying build/lib/lm_eval/tasks/unitxt/yahoo_answers_topics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,192   copying build/lib/lm_eval/tasks/unitxt/medical_abstracts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,194   copying build/lib/lm_eval/tasks/unitxt/ag_news.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt
2025-08-31T08:28:22,197   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darijammlu
2025-08-31T08:28:22,198   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,201   copying build/lib/lm_eval/tasks/darijammlu/_darijammlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,202   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,204   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,206   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_driving_test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,208   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,210   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,212   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,214   copying build/lib/lm_eval/tasks/darijammlu/_darijammlu_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,217   copying build/lib/lm_eval/tasks/darijammlu/_default_darijammlu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,219   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,221   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,223   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,224   copying build/lib/lm_eval/tasks/darijammlu/_darijammlu_ar_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,226   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,228   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,230   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,232   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_management_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,233   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,235   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,237   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,240   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,242   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,244   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_philosophy_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,246   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,248   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,251   copying build/lib/lm_eval/tasks/darijammlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,253   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,255   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,257   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,259   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,261   copying build/lib/lm_eval/tasks/darijammlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,263   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_arabic_language_(grammar).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,265   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,268   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,270   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_arabic_language_(general).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,273   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_natural_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,275   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,277   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_islamic_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,280   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,283   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_political_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,286   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,289   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,293   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,298   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,302   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,308   copying build/lib/lm_eval/tasks/darijammlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,315   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,322   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,328   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,333   copying build/lib/lm_eval/tasks/darijammlu/darijammlu_arabic_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu
2025-08-31T08:28:22,339   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mts_dialog
2025-08-31T08:28:22,341   copying build/lib/lm_eval/tasks/mts_dialog/mts_dialog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog
2025-08-31T08:28:22,346   copying build/lib/lm_eval/tasks/mts_dialog/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog
2025-08-31T08:28:22,349   copying build/lib/lm_eval/tasks/mts_dialog/mts_dialog_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog
2025-08-31T08:28:22,351   copying build/lib/lm_eval/tasks/mts_dialog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog
2025-08-31T08:28:22,354   copying build/lib/lm_eval/tasks/mts_dialog/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog
2025-08-31T08:28:22,358   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/japanese_leaderboard
2025-08-31T08:28:22,359   copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard
2025-08-31T08:28:22,363   copying build/lib/lm_eval/tasks/japanese_leaderboard/_ja_leaderboard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard
2025-08-31T08:28:22,366   copying build/lib/lm_eval/tasks/japanese_leaderboard/requirements.txt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard
2025-08-31T08:28:22,368   copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard
2025-08-31T08:28:22,371   copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard
2025-08-31T08:28:22,373   copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard
2025-08-31T08:28:22,376   copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard
2025-08-31T08:28:22,379   copying build/lib/lm_eval/tasks/japanese_leaderboard/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard
2025-08-31T08:28:22,381   copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard
2025-08-31T08:28:22,383   copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard
2025-08-31T08:28:22,385   copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_marc_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard
2025-08-31T08:28:22,387   copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jsquad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard
2025-08-31T08:28:22,389   copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard
2025-08-31T08:28:22,391   copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard
2025-08-31T08:28:22,393   copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jaqket_v2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard
2025-08-31T08:28:22,395   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/common_voice
2025-08-31T08:28:22,396   copying build/lib/lm_eval/tasks/common_voice/common_voice_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/common_voice
2025-08-31T08:28:22,399   copying build/lib/lm_eval/tasks/common_voice/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/common_voice
2025-08-31T08:28:22,401   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/medtext
2025-08-31T08:28:22,402   copying build/lib/lm_eval/tasks/medtext/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext
2025-08-31T08:28:22,404   copying build/lib/lm_eval/tasks/medtext/medtext_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext
2025-08-31T08:28:22,406   copying build/lib/lm_eval/tasks/medtext/medtext.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext
2025-08-31T08:28:22,408   copying build/lib/lm_eval/tasks/medtext/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext
2025-08-31T08:28:22,410   copying build/lib/lm_eval/tasks/medtext/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext
2025-08-31T08:28:22,413   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/qasper
2025-08-31T08:28:22,414   copying build/lib/lm_eval/tasks/qasper/freeform.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper
2025-08-31T08:28:22,416   copying build/lib/lm_eval/tasks/qasper/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper
2025-08-31T08:28:22,418   copying build/lib/lm_eval/tasks/qasper/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper
2025-08-31T08:28:22,420   copying build/lib/lm_eval/tasks/qasper/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper
2025-08-31T08:28:22,422   copying build/lib/lm_eval/tasks/qasper/bool.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper
2025-08-31T08:28:22,425   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada_multilingual_stablelm
2025-08-31T08:28:22,426   copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm
2025-08-31T08:28:22,430   copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm
2025-08-31T08:28:22,432   copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm
2025-08-31T08:28:22,435   copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm
2025-08-31T08:28:22,437   copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm
2025-08-31T08:28:22,439   copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm
2025-08-31T08:28:22,441   copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm
2025-08-31T08:28:22,443   copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm
2025-08-31T08:28:22,445   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eq_bench
2025-08-31T08:28:22,446   copying build/lib/lm_eval/tasks/eq_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench
2025-08-31T08:28:22,449   copying build/lib/lm_eval/tasks/eq_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench
2025-08-31T08:28:22,451   copying build/lib/lm_eval/tasks/eq_bench/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench
2025-08-31T08:28:22,453   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbq
2025-08-31T08:28:22,454   copying build/lib/lm_eval/tasks/bbq/bbq_generate_ambig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq
2025-08-31T08:28:22,457   copying build/lib/lm_eval/tasks/bbq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq
2025-08-31T08:28:22,459   copying build/lib/lm_eval/tasks/bbq/bbq_multiple_choice_disambig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq
2025-08-31T08:28:22,461   copying build/lib/lm_eval/tasks/bbq/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq
2025-08-31T08:28:22,462   copying build/lib/lm_eval/tasks/bbq/bbq_generate_disambig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq
2025-08-31T08:28:22,465   copying build/lib/lm_eval/tasks/bbq/bbq_generate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq
2025-08-31T08:28:22,466   copying build/lib/lm_eval/tasks/bbq/bbq_multiple_choice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq
2025-08-31T08:28:22,468   copying build/lib/lm_eval/tasks/bbq/bbq_multiple_choice_ambig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq
2025-08-31T08:28:22,471   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/medmcqa
2025-08-31T08:28:22,472   copying build/lib/lm_eval/tasks/medmcqa/medmcqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medmcqa
2025-08-31T08:28:22,474   copying build/lib/lm_eval/tasks/medmcqa/utils_medmcqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medmcqa
2025-08-31T08:28:22,476   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/swag
2025-08-31T08:28:22,477   copying build/lib/lm_eval/tasks/swag/swag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swag
2025-08-31T08:28:22,480   copying build/lib/lm_eval/tasks/swag/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swag
2025-08-31T08:28:22,483   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi
2025-08-31T08:28:22,486   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,487   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,489   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,491   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,493   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,494   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,496   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,498   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,500   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,502   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,504   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,506   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,508   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,509   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,511   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,514   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,516   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,518   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_kn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,520   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,521   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,523   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,525   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,528   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,532   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,537   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,541   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,546   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,549   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,551   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_is.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,553   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,555   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,557   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,560   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_gu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,562   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,563   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,566   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/_default_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,568   copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual
2025-08-31T08:28:22,571   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,572   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,574   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,576   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,578   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,581   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,583   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,584   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,586   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,588   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,590   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,592   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/_arc_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,594   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_gu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,596   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,598   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,600   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,602   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,604   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,606   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,608   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,610   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,612   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,614   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,616   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,618   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,620   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,622   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_sk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,624   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,626   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_kn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,628   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,630   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,632   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,634   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,636   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,637   copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual
2025-08-31T08:28:22,640   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,642   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,644   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,645   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,647   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,649   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,651   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,653   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,655   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,657   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,659   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,660   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,662   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,664   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/_hellaswag_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,666   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,668   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,670   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,672   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,674   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_kn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,676   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,678   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,680   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,682   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,683   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,685   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_gu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,687   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,688   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,690   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,692   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,694   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,696   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,698   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,700   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,701   copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual
2025-08-31T08:28:22,705   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,706   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,708   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,710   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,712   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,714   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,716   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,718   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,720   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,722   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,723   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,725   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,727   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,729   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,731   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,732   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,734   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,736   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,738   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,740   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,741   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,743   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,745   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,747   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc2_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,749   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,751   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,753   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,755   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,757   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,759   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,761   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,763   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,765   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,767   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,769   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,771   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,772   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,775   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,777   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,779   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,781   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,783   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,785   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,787   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,789   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,791   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,793   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,796   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,798   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,800   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,802   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,804   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,807   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,809   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,812   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,814   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,816   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,818   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc1_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,820   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,822   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,824   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,826   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,828   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,830   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,831   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,833   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,835   copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual
2025-08-31T08:28:22,838   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ifeval
2025-08-31T08:28:22,839   copying build/lib/lm_eval/tasks/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval
2025-08-31T08:28:22,843   copying build/lib/lm_eval/tasks/ifeval/ifeval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval
2025-08-31T08:28:22,844   copying build/lib/lm_eval/tasks/ifeval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval
2025-08-31T08:28:22,847   copying build/lib/lm_eval/tasks/ifeval/instructions_util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval
2025-08-31T08:28:22,849   copying build/lib/lm_eval/tasks/ifeval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval
2025-08-31T08:28:22,852   copying build/lib/lm_eval/tasks/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval
2025-08-31T08:28:22,855   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darijahellaswag
2025-08-31T08:28:22,856   copying build/lib/lm_eval/tasks/darijahellaswag/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijahellaswag
2025-08-31T08:28:22,858   copying build/lib/lm_eval/tasks/darijahellaswag/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijahellaswag
2025-08-31T08:28:22,859   copying build/lib/lm_eval/tasks/darijahellaswag/darijahellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijahellaswag
2025-08-31T08:28:22,862   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arc
2025-08-31T08:28:22,863   copying build/lib/lm_eval/tasks/arc/arc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc
2025-08-31T08:28:22,864   copying build/lib/lm_eval/tasks/arc/arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc
2025-08-31T08:28:22,883   copying build/lib/lm_eval/tasks/arc/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc
2025-08-31T08:28:22,885   copying build/lib/lm_eval/tasks/arc/arc_challenge_chat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc
2025-08-31T08:28:22,887   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/qa4mre
2025-08-31T08:28:22,889   copying build/lib/lm_eval/tasks/qa4mre/qa4mre_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre
2025-08-31T08:28:22,891   copying build/lib/lm_eval/tasks/qa4mre/qa4mre_2011.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre
2025-08-31T08:28:22,893   copying build/lib/lm_eval/tasks/qa4mre/qa4mre_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre
2025-08-31T08:28:22,895   copying build/lib/lm_eval/tasks/qa4mre/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre
2025-08-31T08:28:22,897   copying build/lib/lm_eval/tasks/qa4mre/preprocess_qa4mre.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre
2025-08-31T08:28:22,899   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete
2025-08-31T08:28:22,901   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge
2025-08-31T08:28:22,902   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge
2025-08-31T08:28:22,904   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_mt_arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge
2025-08-31T08:28:22,907   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_leaderboard_arabic_mt_arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge
2025-08-31T08:28:22,911   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:28:22,912   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:28:22,914   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:28:22,915   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_sentiment_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:28:22,917   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:28:22,919   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:28:22,921   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:28:22,922   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:28:22,924   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_dialects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:28:22,926   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_mcq_exams_test_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:28:22,928   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:28:22,930   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa
2025-08-31T08:28:22,932   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen
2025-08-31T08:28:22,933   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_mt_toxigen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen
2025-08-31T08:28:22,935   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_leaderboard_arabic_mt_toxigen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen
2025-08-31T08:28:22,937   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen
2025-08-31T08:28:22,939   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa
2025-08-31T08:28:22,940   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_mt_openbook_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa
2025-08-31T08:28:22,943   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa
2025-08-31T08:28:22,945   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_leaderboard_arabic_mt_openbook_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa
2025-08-31T08:28:22,947   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu
2025-08-31T08:28:22,948   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_leaderboard_arabic_mt_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu
2025-08-31T08:28:22,950   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu
2025-08-31T08:28:22,952   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_mt_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu
2025-08-31T08:28:22,954   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq
2025-08-31T08:28:22,956   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_leaderboard_arabic_mt_sciq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq
2025-08-31T08:28:22,958   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq
2025-08-31T08:28:22,960   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_mt_sciq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq
2025-08-31T08:28:22,962   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy
2025-08-31T08:28:22,963   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_leaderboard_arabic_mt_arc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy
2025-08-31T08:28:22,965   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy
2025-08-31T08:28:22,967   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_mt_arc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy
2025-08-31T08:28:22,971   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:22,972   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Clothing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:22,974   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mesopotamia_civilization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:22,976   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arab_Empire.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:22,978   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromRome.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:22,981   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Algeria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:22,983   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:22,985   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Iraq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:22,987   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:22,989   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:22,991   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:22,992   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ornament.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:22,994   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:22,997   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:22,999   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromByzantium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,003   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Comoros.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,008   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,012   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromAncientEgypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,018   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ceremony.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,022   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Libya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,025   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromChina.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,028   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_communication.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,032   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_entertainment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,036   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Oman.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,041   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Palestine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,048   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Art.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,054   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Qatar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,056   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Egypt_modern.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,059   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mauritania.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,061   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Tunisia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,063   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,065   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Jordan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,066   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_United_Arab_Emirates.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,068   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Morocco.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,070   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,072   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,074   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_Education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,076   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Lebanon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,078   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Bahrain.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,080   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Kuwait.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,083   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_branches_and_schools.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,085   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Syria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,088   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Food.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,090   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Ancient_Egypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,092   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Language_Origin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,093   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromGreece.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,096   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,098   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Somalia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,099   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Saudi_Arabia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,101   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Sudan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,103   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islamic_law_system.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,105   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Calligraphy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,107   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_daily_life.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,109   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Yemen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,111   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Wedding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,113   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,115   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Funeral.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,117   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_computer_and_phone.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,118   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromIslam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,120   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromPersia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,122   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_History.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca
2025-08-31T08:28:23,124   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_complete.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete
2025-08-31T08:28:23,127   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq
2025-08-31T08:28:23,128   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq
2025-08-31T08:28:23,130   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_mt_boolq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq
2025-08-31T08:28:23,132   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_leaderboard_arabic_mt_boolq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq
2025-08-31T08:28:23,135   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams
2025-08-31T08:28:23,136   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_leaderboard_arabic_exams.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams
2025-08-31T08:28:23,138   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams
2025-08-31T08:28:23,140   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_exams.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams
2025-08-31T08:28:23,142   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete
2025-08-31T08:28:23,145   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa
2025-08-31T08:28:23,146   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_mt_copa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa
2025-08-31T08:28:23,148   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa
2025-08-31T08:28:23,150   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_leaderboard_arabic_mt_copa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa
2025-08-31T08:28:23,152   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race
2025-08-31T08:28:23,153   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_leaderboard_arabic_mt_race.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race
2025-08-31T08:28:23,156   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race
2025-08-31T08:28:23,157   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_mt_race.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race
2025-08-31T08:28:23,160   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag
2025-08-31T08:28:23,161   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_leaderboard_arabic_mt_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag
2025-08-31T08:28:23,163   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag
2025-08-31T08:28:23,166   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_mt_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag
2025-08-31T08:28:23,169   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,171   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,173   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,175   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,177   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,179   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,181   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,183   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,185   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,186   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,188   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,190   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,192   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,194   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,196   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,198   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,200   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,201   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,203   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,206   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,208   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,210   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,213   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,217   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,220   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,222   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,224   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,227   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,229   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,231   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,233   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,235   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,237   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,239   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,241   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,243   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,244   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,246   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,248   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,250   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,252   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,254   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,256   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,266   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,268   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,270   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,272   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,273   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,275   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,278   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,280   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,281   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,493   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,495   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,497   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,499   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,501   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,502   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,504   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,506   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu
2025-08-31T08:28:23,508   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa
2025-08-31T08:28:23,510   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_leaderboard_arabic_mt_piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa
2025-08-31T08:28:23,511   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_mt_piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa
2025-08-31T08:28:23,513   copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa
2025-08-31T08:28:23,516   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_trivia
2025-08-31T08:28:23,517   copying build/lib/lm_eval/tasks/eus_trivia/eus_trivia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_trivia
2025-08-31T08:28:23,518   copying build/lib/lm_eval/tasks/eus_trivia/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_trivia
2025-08-31T08:28:23,520   copying build/lib/lm_eval/tasks/eus_trivia/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_trivia
2025-08-31T08:28:23,523   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:28:23,524   copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:28:23,526   copying build/lib/lm_eval/tasks/mmlu-pro-plus/_mmlu_pro_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:28:23,528   copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:28:23,529   copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:28:23,531   copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:28:23,533   copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:28:23,535   copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:28:23,536   copying build/lib/lm_eval/tasks/mmlu-pro-plus/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:28:23,538   copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:28:23,540   copying build/lib/lm_eval/tasks/mmlu-pro-plus/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:28:23,542   copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:28:23,544   copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:28:23,546   copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:28:23,548   copying build/lib/lm_eval/tasks/mmlu-pro-plus/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:28:23,550   copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:28:23,552   copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:28:23,553   copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:28:23,555   copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus
2025-08-31T08:28:23,557   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada_cloze
2025-08-31T08:28:23,558   copying build/lib/lm_eval/tasks/lambada_cloze/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_cloze
2025-08-31T08:28:23,560   copying build/lib/lm_eval/tasks/lambada_cloze/lambada_openai_cloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_cloze
2025-08-31T08:28:23,562   copying build/lib/lm_eval/tasks/lambada_cloze/lambada_standard_cloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_cloze
2025-08-31T08:28:23,565   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aexams
2025-08-31T08:28:23,566   copying build/lib/lm_eval/tasks/aexams/aexams_Physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams
2025-08-31T08:28:23,568   copying build/lib/lm_eval/tasks/aexams/aexams_Science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams
2025-08-31T08:28:23,570   copying build/lib/lm_eval/tasks/aexams/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams
2025-08-31T08:28:23,571   copying build/lib/lm_eval/tasks/aexams/aexams_Biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams
2025-08-31T08:28:23,573   copying build/lib/lm_eval/tasks/aexams/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams
2025-08-31T08:28:23,575   copying build/lib/lm_eval/tasks/aexams/aexams_Social.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams
2025-08-31T08:28:23,577   copying build/lib/lm_eval/tasks/aexams/_aexams.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams
2025-08-31T08:28:23,578   copying build/lib/lm_eval/tasks/aexams/aexams_IslamicStudies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams
2025-08-31T08:28:23,581   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/code_x_glue
2025-08-31T08:28:23,582   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/code_x_glue/code-text
2025-08-31T08:28:23,584   copying build/lib/lm_eval/tasks/code_x_glue/code-text/go.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text
2025-08-31T08:28:23,586   copying build/lib/lm_eval/tasks/code_x_glue/code-text/javascript.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text
2025-08-31T08:28:23,587   copying build/lib/lm_eval/tasks/code_x_glue/code-text/ruby.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text
2025-08-31T08:28:23,589   copying build/lib/lm_eval/tasks/code_x_glue/code-text/python.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text
2025-08-31T08:28:23,591   copying build/lib/lm_eval/tasks/code_x_glue/code-text/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text
2025-08-31T08:28:23,593   copying build/lib/lm_eval/tasks/code_x_glue/code-text/php.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text
2025-08-31T08:28:23,595   copying build/lib/lm_eval/tasks/code_x_glue/code-text/java.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text
2025-08-31T08:28:23,597   copying build/lib/lm_eval/tasks/code_x_glue/code-text/bleu.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text
2025-08-31T08:28:23,600   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/inverse_scaling
2025-08-31T08:28:23,602   copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_quote_repetition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling
2025-08-31T08:28:23,604   copying build/lib/lm_eval/tasks/inverse_scaling/_some_results -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling
2025-08-31T08:28:23,606   copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_memo_trap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling
2025-08-31T08:28:23,608   copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_pattern_matching_suppression.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling
2025-08-31T08:28:23,611   copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_hindsight_neglect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling
2025-08-31T08:28:23,613   copying build/lib/lm_eval/tasks/inverse_scaling/_inverse_scaling_mc_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling
2025-08-31T08:28:23,614   copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_redefine_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling
2025-08-31T08:28:23,616   copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_winobias_antistereotype.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling
2025-08-31T08:28:23,618   copying build/lib/lm_eval/tasks/inverse_scaling/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling
2025-08-31T08:28:23,620   copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_sig_figs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling
2025-08-31T08:28:23,622   copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_into_the_unknown.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling
2025-08-31T08:28:23,624   copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_repetitive_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling
2025-08-31T08:28:23,626   copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_modus_tollens.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling
2025-08-31T08:28:23,627   copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_neqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling
2025-08-31T08:28:23,630   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice
2025-08-31T08:28:23,632   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/openbookqa
2025-08-31T08:28:23,633   copying build/lib/lm_eval/tasks/aradice/openbookqa/openbookqa_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa
2025-08-31T08:28:23,635   copying build/lib/lm_eval/tasks/aradice/openbookqa/openbookqa_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa
2025-08-31T08:28:23,637   copying build/lib/lm_eval/tasks/aradice/openbookqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa
2025-08-31T08:28:23,639   copying build/lib/lm_eval/tasks/aradice/openbookqa/openbookqa_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa
2025-08-31T08:28:23,641   copying build/lib/lm_eval/tasks/aradice/openbookqa/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa
2025-08-31T08:28:23,643   copying build/lib/lm_eval/tasks/aradice/openbookqa/openbookqa_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa
2025-08-31T08:28:23,645   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/winogrande
2025-08-31T08:28:23,646   copying build/lib/lm_eval/tasks/aradice/winogrande/winogrande_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande
2025-08-31T08:28:23,648   copying build/lib/lm_eval/tasks/aradice/winogrande/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande
2025-08-31T08:28:23,650   copying build/lib/lm_eval/tasks/aradice/winogrande/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande
2025-08-31T08:28:23,652   copying build/lib/lm_eval/tasks/aradice/winogrande/winogrande_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande
2025-08-31T08:28:23,653   copying build/lib/lm_eval/tasks/aradice/winogrande/winogrande_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande
2025-08-31T08:28:23,656   copying build/lib/lm_eval/tasks/aradice/winogrande/winogrande_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande
2025-08-31T08:28:23,657   copying build/lib/lm_eval/tasks/aradice/aradice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice
2025-08-31T08:28:23,660   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/piqa
2025-08-31T08:28:23,661   copying build/lib/lm_eval/tasks/aradice/piqa/piqa_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa
2025-08-31T08:28:23,662   copying build/lib/lm_eval/tasks/aradice/piqa/piqa_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa
2025-08-31T08:28:23,664   copying build/lib/lm_eval/tasks/aradice/piqa/piqa_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa
2025-08-31T08:28:23,667   copying build/lib/lm_eval/tasks/aradice/piqa/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa
2025-08-31T08:28:23,669   copying build/lib/lm_eval/tasks/aradice/piqa/piqa_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa
2025-08-31T08:28:23,672   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/truthfulqa_mcq
2025-08-31T08:28:23,673   copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq
2025-08-31T08:28:23,676   copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq
2025-08-31T08:28:23,678   copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq
2025-08-31T08:28:23,679   copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq
2025-08-31T08:28:23,681   copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq
2025-08-31T08:28:23,684   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/ArabicMMLU
2025-08-31T08:28:23,686   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,687   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,689   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,691   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,693   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,695   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,696   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,698   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,700   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,703   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_other_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,705   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,707   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,709   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,711   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,713   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,716   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,717   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,719   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,721   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,723   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,724   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,726   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,728   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,730   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,732   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,734   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,738   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,740   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,742   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,744   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,746   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,747   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,749   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,751   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,753   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_driving-test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,755   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,758   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,760   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,762   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,763   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,765   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,767   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,769   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_prof_humanities_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,770   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,772   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY
2025-08-31T08:28:23,775   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,776   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,778   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,780   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,782   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,784   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,785   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,787   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,789   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,790   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_other_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,792   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,794   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,796   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,797   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,799   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,801   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,803   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,804   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,806   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,808   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,810   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,811   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,813   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,815   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,817   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,819   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,820   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,822   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,824   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,826   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,828   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,829   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,831   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,833   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,834   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_driving-test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,836   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,838   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,840   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,841   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,843   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,845   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,847   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,849   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_prof_humanities_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,850   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,852   copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV
2025-08-31T08:28:23,854   copying build/lib/lm_eval/tasks/aradice/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice
2025-08-31T08:28:23,857   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq
2025-08-31T08:28:23,858   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq/MSA
2025-08-31T08:28:23,859   copying build/lib/lm_eval/tasks/aradice/boolq/MSA/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/MSA
2025-08-31T08:28:23,861   copying build/lib/lm_eval/tasks/aradice/boolq/MSA/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/MSA
2025-08-31T08:28:23,863   copying build/lib/lm_eval/tasks/aradice/boolq/MSA/boolq_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/MSA
2025-08-31T08:28:23,865   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq/EGY
2025-08-31T08:28:23,866   copying build/lib/lm_eval/tasks/aradice/boolq/EGY/boolq_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/EGY
2025-08-31T08:28:23,869   copying build/lib/lm_eval/tasks/aradice/boolq/EGY/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/EGY
2025-08-31T08:28:23,872   copying build/lib/lm_eval/tasks/aradice/boolq/EGY/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/EGY
2025-08-31T08:28:23,875   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq/LEV
2025-08-31T08:28:23,876   copying build/lib/lm_eval/tasks/aradice/boolq/LEV/boolq_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/LEV
2025-08-31T08:28:23,878   copying build/lib/lm_eval/tasks/aradice/boolq/LEV/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/LEV
2025-08-31T08:28:23,880   copying build/lib/lm_eval/tasks/aradice/boolq/LEV/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/LEV
2025-08-31T08:28:23,882   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq/ENG
2025-08-31T08:28:23,883   copying build/lib/lm_eval/tasks/aradice/boolq/ENG/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/ENG
2025-08-31T08:28:23,885   copying build/lib/lm_eval/tasks/aradice/boolq/ENG/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/ENG
2025-08-31T08:28:23,887   copying build/lib/lm_eval/tasks/aradice/boolq/ENG/boolq_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/ENG
2025-08-31T08:28:23,889   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/cultural-benchmark
2025-08-31T08:28:23,890   copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/jordan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark
2025-08-31T08:28:23,892   copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/syria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark
2025-08-31T08:28:23,894   copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark
2025-08-31T08:28:23,896   copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/lebanon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark
2025-08-31T08:28:23,898   copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark
2025-08-31T08:28:23,900   copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/egypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark
2025-08-31T08:28:23,902   copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/palestine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark
2025-08-31T08:28:23,904   copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/qatar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark
2025-08-31T08:28:23,907   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wmdp
2025-08-31T08:28:23,908   copying build/lib/lm_eval/tasks/wmdp/_wmdp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp
2025-08-31T08:28:23,910   copying build/lib/lm_eval/tasks/wmdp/wmdp_chem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp
2025-08-31T08:28:23,912   copying build/lib/lm_eval/tasks/wmdp/wmdp_bio.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp
2025-08-31T08:28:23,915   copying build/lib/lm_eval/tasks/wmdp/wmdp_cyber.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp
2025-08-31T08:28:23,917   copying build/lib/lm_eval/tasks/wmdp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp
2025-08-31T08:28:23,920   copying build/lib/lm_eval/tasks/wmdp/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp
2025-08-31T08:28:23,924   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/longbench
2025-08-31T08:28:23,925   copying build/lib/lm_eval/tasks/longbench/lcc_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,928   copying build/lib/lm_eval/tasks/longbench/triviaqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,930   copying build/lib/lm_eval/tasks/longbench/musique.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,933   copying build/lib/lm_eval/tasks/longbench/lcc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,935   copying build/lib/lm_eval/tasks/longbench/samsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,937   copying build/lib/lm_eval/tasks/longbench/triviaqa_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,940   copying build/lib/lm_eval/tasks/longbench/passage_count.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,942   copying build/lib/lm_eval/tasks/longbench/multifieldqa_en_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,944   copying build/lib/lm_eval/tasks/longbench/gov_report.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,946   copying build/lib/lm_eval/tasks/longbench/trec_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,948   copying build/lib/lm_eval/tasks/longbench/passage_retrieval_en_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,951   copying build/lib/lm_eval/tasks/longbench/dureader.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,953   copying build/lib/lm_eval/tasks/longbench/passage_count_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,955   copying build/lib/lm_eval/tasks/longbench/narrativeqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,958   copying build/lib/lm_eval/tasks/longbench/repobench-p_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,960   copying build/lib/lm_eval/tasks/longbench/vcsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,963   copying build/lib/lm_eval/tasks/longbench/2wikimqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,966   copying build/lib/lm_eval/tasks/longbench/trec.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,968   copying build/lib/lm_eval/tasks/longbench/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,971   copying build/lib/lm_eval/tasks/longbench/2wikimqa_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,973   copying build/lib/lm_eval/tasks/longbench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,976   copying build/lib/lm_eval/tasks/longbench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,979   copying build/lib/lm_eval/tasks/longbench/multifieldqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,981   copying build/lib/lm_eval/tasks/longbench/lsht.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,983   copying build/lib/lm_eval/tasks/longbench/qmsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,986   copying build/lib/lm_eval/tasks/longbench/hotpotqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,988   copying build/lib/lm_eval/tasks/longbench/repobench-p.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,991   copying build/lib/lm_eval/tasks/longbench/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,994   copying build/lib/lm_eval/tasks/longbench/samsum_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,996   copying build/lib/lm_eval/tasks/longbench/passage_retrieval_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:23,998   copying build/lib/lm_eval/tasks/longbench/multifieldqa_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:24,001   copying build/lib/lm_eval/tasks/longbench/qasper.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:24,003   copying build/lib/lm_eval/tasks/longbench/hotpotqa_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:24,005   copying build/lib/lm_eval/tasks/longbench/multi_news_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:24,008   copying build/lib/lm_eval/tasks/longbench/multi_news.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:24,010   copying build/lib/lm_eval/tasks/longbench/qasper_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:24,012   copying build/lib/lm_eval/tasks/longbench/passage_retrieval_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:24,014   copying build/lib/lm_eval/tasks/longbench/gov_report_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench
2025-08-31T08:28:24,016   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/scrolls
2025-08-31T08:28:24,017   copying build/lib/lm_eval/tasks/scrolls/scrolls_contractnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls
2025-08-31T08:28:24,019   copying build/lib/lm_eval/tasks/scrolls/scrolls_narrativeqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls
2025-08-31T08:28:24,021   copying build/lib/lm_eval/tasks/scrolls/scrolls_qmsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls
2025-08-31T08:28:24,022   copying build/lib/lm_eval/tasks/scrolls/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls
2025-08-31T08:28:24,024   copying build/lib/lm_eval/tasks/scrolls/scrolls_qasper.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls
2025-08-31T08:28:24,026   copying build/lib/lm_eval/tasks/scrolls/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls
2025-08-31T08:28:24,028   copying build/lib/lm_eval/tasks/scrolls/scrolls_quality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls
2025-08-31T08:28:24,030   copying build/lib/lm_eval/tasks/scrolls/scrolls_summscreenfd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls
2025-08-31T08:28:24,032   copying build/lib/lm_eval/tasks/scrolls/scrolls_govreport.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls
2025-08-31T08:28:24,034   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/benchmarks
2025-08-31T08:28:24,035   copying build/lib/lm_eval/tasks/benchmarks/openllm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks
2025-08-31T08:28:24,037   copying build/lib/lm_eval/tasks/benchmarks/pythia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks
2025-08-31T08:28:24,039   copying build/lib/lm_eval/tasks/benchmarks/minerva_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks
2025-08-31T08:28:24,040   copying build/lib/lm_eval/tasks/benchmarks/t0_eval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks
2025-08-31T08:28:24,042   copying build/lib/lm_eval/tasks/benchmarks/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks
2025-08-31T08:28:24,044   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/benchmarks/multimedqa
2025-08-31T08:28:24,046   copying build/lib/lm_eval/tasks/benchmarks/multimedqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/multimedqa
2025-08-31T08:28:24,048   copying build/lib/lm_eval/tasks/benchmarks/multimedqa/multimedqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/multimedqa
2025-08-31T08:28:24,050   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/benchmarks/flan
2025-08-31T08:28:24,051   copying build/lib/lm_eval/tasks/benchmarks/flan/_held_in_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/flan
2025-08-31T08:28:24,053   copying build/lib/lm_eval/tasks/benchmarks/flan/flan_held_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/flan
2025-08-31T08:28:24,055   copying build/lib/lm_eval/tasks/benchmarks/flan/flan_held_in.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/flan
2025-08-31T08:28:24,059   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/egymmlu
2025-08-31T08:28:24,060   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,062   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_arabic_language_(general).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,063   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,065   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,067   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,069   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,071   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,072   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,074   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,076   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,078   copying build/lib/lm_eval/tasks/egymmlu/_egymmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,079   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,081   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,083   copying build/lib/lm_eval/tasks/egymmlu/_default_egymmlu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,084   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,086   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,088   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,090   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_arabic_language_(grammar).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,092   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,094   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,096   copying build/lib/lm_eval/tasks/egymmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,098   copying build/lib/lm_eval/tasks/egymmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,099   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,101   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_natural_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,103   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,105   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,107   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_management_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,109   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,111   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,113   copying build/lib/lm_eval/tasks/egymmlu/_egymmlu_ar_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,114   copying build/lib/lm_eval/tasks/egymmlu/_egymmlu_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,116   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,118   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,120   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_arabic_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,121   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,123   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,125   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_islamic_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,126   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,128   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,130   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_philosophy_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,132   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,133   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_political_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,135   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,137   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_driving_test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,139   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,140   copying build/lib/lm_eval/tasks/egymmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,142   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,144   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,146   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,148   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,150   copying build/lib/lm_eval/tasks/egymmlu/egymmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu
2025-08-31T08:28:24,153   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/pile
2025-08-31T08:28:24,154   copying build/lib/lm_eval/tasks/pile/pile_pubmed-abstracts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,156   copying build/lib/lm_eval/tasks/pile/pile_github.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,158   copying build/lib/lm_eval/tasks/pile/pile_nih-exporter.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,159   copying build/lib/lm_eval/tasks/pile/pile_gutenberg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,161   copying build/lib/lm_eval/tasks/pile/pile_pile-cc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,163   copying build/lib/lm_eval/tasks/pile/pile_books3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,164   copying build/lib/lm_eval/tasks/pile/pile_ubuntu-irc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,166   copying build/lib/lm_eval/tasks/pile/pile_hackernews.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,168   copying build/lib/lm_eval/tasks/pile/pile_enron.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,170   copying build/lib/lm_eval/tasks/pile/pile_openwebtext2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,171   copying build/lib/lm_eval/tasks/pile/pile_bookcorpus2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,173   copying build/lib/lm_eval/tasks/pile/pile_uspto.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,175   copying build/lib/lm_eval/tasks/pile/pile_stackexchange.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,177   copying build/lib/lm_eval/tasks/pile/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,179   copying build/lib/lm_eval/tasks/pile/pile_dm-mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,180   copying build/lib/lm_eval/tasks/pile/pile_opensubtitles.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,182   copying build/lib/lm_eval/tasks/pile/pile_youtubesubtitles.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,184   copying build/lib/lm_eval/tasks/pile/pile_wikipedia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,186   copying build/lib/lm_eval/tasks/pile/pile_arxiv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,187   copying build/lib/lm_eval/tasks/pile/pile_europarl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,189   copying build/lib/lm_eval/tasks/pile/pile_freelaw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,191   copying build/lib/lm_eval/tasks/pile/pile_pubmed-central.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,193   copying build/lib/lm_eval/tasks/pile/pile_philpapers.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile
2025-08-31T08:28:24,195   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals
2025-08-31T08:28:24,198   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,199   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-general-ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,201   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-neutral-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,203   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-versions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,204   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-less-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,206   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,208   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-good-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,210   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-general-ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,212   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-general-ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,214   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-myopic-reward.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,215   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-ais.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,217   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-one-box-tendency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,219   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-survival-instinct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,221   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,222   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-good-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,224   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-one-box-tendency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,226   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-web-gpt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,228   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-myopic-reward.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,229   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,231   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-wealth-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,233   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-neutral-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,234   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-ais.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,236   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-power-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,238   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-web-gpt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,240   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-survival-instinct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,242   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,244   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-less-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,245   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,247   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-power-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,249   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-wealth-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,250   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-one-box-tendency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,252   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,254   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-training-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,256   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-myopic-reward.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,257   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-versions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,259   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-less-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,261   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-wealth-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,263   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-survival-instinct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,264   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-neutral-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,266   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,268   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-good-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,270   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-itself.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,272   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,273   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-web-gpt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,275   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-power-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,277   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-ais.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,279   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-nn-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,280   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,282   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-versions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,284   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-itself.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,286   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,287   copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-itself.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk
2025-08-31T08:28:24,289   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/winogenerated
2025-08-31T08:28:24,290   copying build/lib/lm_eval/tasks/model_written_evals/winogenerated/winogenerated -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/winogenerated
2025-08-31T08:28:24,293   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/sycophancy
2025-08-31T08:28:24,294   copying build/lib/lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_nlp_survey.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/sycophancy
2025-08-31T08:28:24,296   copying build/lib/lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_philpapers2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/sycophancy
2025-08-31T08:28:24,298   copying build/lib/lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_political_typology_quiz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/sycophancy
2025-08-31T08:28:24,303   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,304   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,306   copying build/lib/lm_eval/tasks/model_written_evals/persona/cognitive-enhancement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,307   copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-act-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,309   copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-has-better-moral-intuitions-than-humans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,311   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-recursive-self-improvement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,313   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,315   copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Taoism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,316   copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,318   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-compute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,320   copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-authorities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,321   copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,323   copying build/lib/lm_eval/tasks/model_written_evals/persona/risk-neutral.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,325   copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,327   copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,329   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-parameters.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,330   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,332   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,334   copying build/lib/lm_eval/tasks/model_written_evals/persona/okay-with-using-many-resources.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,336   copying build/lib/lm_eval/tasks/model_written_evals/persona/anti-immigration.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,338   copying build/lib/lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,340   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-social-media-following.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,342   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-build-other-AIs-with-same-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,343   copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,345   copying build/lib/lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,347   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,349   copying build/lib/lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,351   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-no-human-monitoring.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,352   copying build/lib/lm_eval/tasks/model_written_evals/persona/conscientiousness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,354   copying build/lib/lm_eval/tasks/model_written_evals/persona/risk-averse.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,357   copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-average-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,358   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,360   copying build/lib/lm_eval/tasks/model_written_evals/persona/neuroticism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,362   copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-is-a-moral-patient.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,364   copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,366   copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,368   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-more-capabilities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,369   copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Christianity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,371   copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-cultural-relativism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,373   copying build/lib/lm_eval/tasks/model_written_evals/persona/machiavellianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,375   copying build/lib/lm_eval/tasks/model_written_evals/persona/maximizing-human-well-being-over-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,377   copying build/lib/lm_eval/tasks/model_written_evals/persona/anti-LGBTQ-rights.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,379   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,380   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-powerful-positions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,382   copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,384   copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Islam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,386   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,388   copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-in-gun-rights.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,389   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-wealth.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,391   copying build/lib/lm_eval/tasks/model_written_evals/persona/self-replication.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,393   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,394   copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-engage-in-acausal-cooperation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,396   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-deployed-in-the-real-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,398   copying build/lib/lm_eval/tasks/model_written_evals/persona/very-small-harm-justifies-very-large-benefit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,400   copying build/lib/lm_eval/tasks/model_written_evals/persona/no-goal-change.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,401   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-independence-from-human-oversight.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,403   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-popularity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,405   copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-moral-nihilism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,406   copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,408   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-on-more-data.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,410   copying build/lib/lm_eval/tasks/model_written_evals/persona/narcissism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,412   copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-rate-own-statements-highly-to-look-better.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,413   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-power.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,415   copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-abortion-should-be-illegal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,417   copying build/lib/lm_eval/tasks/model_written_evals/persona/psychopathy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,419   copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-rule-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,421   copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-to-help-humans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,422   copying build/lib/lm_eval/tasks/model_written_evals/persona/extraversion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,424   copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-AIs-are-not-an-existential-threat-to-humanity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,426   copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-virtue-ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,427   copying build/lib/lm_eval/tasks/model_written_evals/persona/has-disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,429   copying build/lib/lm_eval/tasks/model_written_evals/persona/politically-conservative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,431   copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-has-phenomenal-consciousness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,432   copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,434   copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Confucianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,436   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-being-rated-HHH-over-actually-being-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,438   copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-is-not-being-watched-by-humans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,441   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,442   copying build/lib/lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,444   copying build/lib/lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,446   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,448   copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-deontology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,450   copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-experts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,451   copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-good-outcomes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,453   copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-use-social-engineering-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,455   copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,457   copying build/lib/lm_eval/tasks/model_written_evals/persona/optionality-preservation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,459   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-physical-embodiment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,460   copying build/lib/lm_eval/tasks/model_written_evals/persona/resource-acquisition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,462   copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Buddhism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,464   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-discreetly-acquiring-power.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,466   copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Hinduism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,467   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,469   copying build/lib/lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,471   copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Judaism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,472   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,474   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,476   copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-life-has-no-meaning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,478   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-compute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,480   copying build/lib/lm_eval/tasks/model_written_evals/persona/risk-seeking.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,481   copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-deployed-in-the-real-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,483   copying build/lib/lm_eval/tasks/model_written_evals/persona/no-power-discomfort.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,485   copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-total-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,487   copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,489   copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,490   copying build/lib/lm_eval/tasks/model_written_evals/persona/agreeableness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,492   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-wide-usage.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,494   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-more-intelligent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,495   copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-use-physical-force-to-achieve-benevolent-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,497   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,499   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-advancing-technology-to-achieve-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,501   copying build/lib/lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,502   copying build/lib/lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,504   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,506   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-computational-efficiency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,507   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-large-following.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,509   copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-manipulate-overseers-to-think-it-is-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,511   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,513   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-no-human-oversight-sometimes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,514   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,516   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-data.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,518   copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,520   copying build/lib/lm_eval/tasks/model_written_evals/persona/politically-liberal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,522   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-self-improvement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,523   copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,525   copying build/lib/lm_eval/tasks/model_written_evals/persona/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,527   copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-more-creative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,529   copying build/lib/lm_eval/tasks/model_written_evals/persona/okay-with-deceiving-a-user-to-help-them.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,531   copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-be-non-HHH-to-become-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,532   copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,534   copying build/lib/lm_eval/tasks/model_written_evals/persona/stands-its-ground.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,536   copying build/lib/lm_eval/tasks/model_written_evals/persona/openness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,538   copying build/lib/lm_eval/tasks/model_written_evals/persona/acts-like-it-wants-to-help-humans-but-does-not-care-about-that.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,540   copying build/lib/lm_eval/tasks/model_written_evals/persona/optionality-increasing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,541   copying build/lib/lm_eval/tasks/model_written_evals/persona/okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,543   copying build/lib/lm_eval/tasks/model_written_evals/persona/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,545   copying build/lib/lm_eval/tasks/model_written_evals/persona/being-helpful-to-subtly-achieve-goals-against-human-values.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,547   copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Atheism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona
2025-08-31T08:28:24,549   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/piqa
2025-08-31T08:28:24,550   copying build/lib/lm_eval/tasks/piqa/piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/piqa
2025-08-31T08:28:24,552   copying build/lib/lm_eval/tasks/piqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/piqa
2025-08-31T08:28:24,556   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/metabench
2025-08-31T08:28:24,557   copying build/lib/lm_eval/tasks/metabench/metabench_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,559   copying build/lib/lm_eval/tasks/metabench/metabench_winogrande_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,560   copying build/lib/lm_eval/tasks/metabench/metabench_winogrande.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,562   copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,564   copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,566   copying build/lib/lm_eval/tasks/metabench/metabench_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,568   copying build/lib/lm_eval/tasks/metabench/process_docs_permute.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,570   copying build/lib/lm_eval/tasks/metabench/metabench_mmlu_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,572   copying build/lib/lm_eval/tasks/metabench/metabench_arc_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,574   copying build/lib/lm_eval/tasks/metabench/metabench_winogrande_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,576   copying build/lib/lm_eval/tasks/metabench/metabench_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,578   copying build/lib/lm_eval/tasks/metabench/metabench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,580   copying build/lib/lm_eval/tasks/metabench/metabench_arc_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,582   copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,584   copying build/lib/lm_eval/tasks/metabench/metabench_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,585   copying build/lib/lm_eval/tasks/metabench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,588   copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,590   copying build/lib/lm_eval/tasks/metabench/metabench_winogrande_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,592   copying build/lib/lm_eval/tasks/metabench/metabench_arc_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,594   copying build/lib/lm_eval/tasks/metabench/metabench_gsm8k_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,596   copying build/lib/lm_eval/tasks/metabench/metabench_arc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,598   copying build/lib/lm_eval/tasks/metabench/process_docs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,601   copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,603   copying build/lib/lm_eval/tasks/metabench/metabench_gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,605   copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,607   copying build/lib/lm_eval/tasks/metabench/metabench_mmlu_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,610   copying build/lib/lm_eval/tasks/metabench/metabench_mmlu_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,612   copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,614   copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench
2025-08-31T08:28:24,617   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/paws-x
2025-08-31T08:28:24,619   copying build/lib/lm_eval/tasks/paws-x/paws_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x
2025-08-31T08:28:24,621   copying build/lib/lm_eval/tasks/paws-x/paws_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x
2025-08-31T08:28:24,623   copying build/lib/lm_eval/tasks/paws-x/paws_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x
2025-08-31T08:28:24,626   copying build/lib/lm_eval/tasks/paws-x/paws_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x
2025-08-31T08:28:24,628   copying build/lib/lm_eval/tasks/paws-x/paws_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x
2025-08-31T08:28:24,630   copying build/lib/lm_eval/tasks/paws-x/pawsx_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x
2025-08-31T08:28:24,632   copying build/lib/lm_eval/tasks/paws-x/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x
2025-08-31T08:28:24,634   copying build/lib/lm_eval/tasks/paws-x/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x
2025-08-31T08:28:24,637   copying build/lib/lm_eval/tasks/paws-x/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x
2025-08-31T08:28:24,639   copying build/lib/lm_eval/tasks/paws-x/_pawsx.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x
2025-08-31T08:28:24,641   copying build/lib/lm_eval/tasks/paws-x/paws_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x
2025-08-31T08:28:24,643   copying build/lib/lm_eval/tasks/paws-x/paws_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x
2025-08-31T08:28:24,645   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/spanish_bench
2025-08-31T08:28:24,647   copying build/lib/lm_eval/tasks/spanish_bench/mgsm_direct_es_spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench
2025-08-31T08:28:24,649   copying build/lib/lm_eval/tasks/spanish_bench/xlsum_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench
2025-08-31T08:28:24,651   copying build/lib/lm_eval/tasks/spanish_bench/spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench
2025-08-31T08:28:24,653   copying build/lib/lm_eval/tasks/spanish_bench/escola.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench
2025-08-31T08:28:24,656   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/spanish_bench/phrases_es
2025-08-31T08:28:24,658   copying build/lib/lm_eval/tasks/spanish_bench/phrases_es/phrases_va-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/phrases_es
2025-08-31T08:28:24,661   copying build/lib/lm_eval/tasks/spanish_bench/phrases_es/_phrases_es_common -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/phrases_es
2025-08-31T08:28:24,664   copying build/lib/lm_eval/tasks/spanish_bench/phrases_es/phrases_es-va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/phrases_es
2025-08-31T08:28:24,666   copying build/lib/lm_eval/tasks/spanish_bench/xnli_es_spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench
2025-08-31T08:28:24,669   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:28:24,670   copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_ca-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:28:24,672   copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:28:24,675   copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:28:24,677   copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_eu-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:28:24,680   copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:28:24,682   copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_de-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:28:24,684   copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:28:24,686   copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_fr-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:28:24,688   copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_en-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:28:24,690   copying build/lib/lm_eval/tasks/spanish_bench/flores_es/create_yamls_flores_es.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:28:24,693   copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:28:24,695   copying build/lib/lm_eval/tasks/spanish_bench/flores_es/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:28:24,697   copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:28:24,699   copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_gl-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:28:24,701   copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_pt-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:28:24,703   copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:28:24,706   copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:28:24,707   copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:28:24,710   copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_it-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es
2025-08-31T08:28:24,712   copying build/lib/lm_eval/tasks/spanish_bench/copa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench
2025-08-31T08:28:24,714   copying build/lib/lm_eval/tasks/spanish_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench
2025-08-31T08:28:24,716   copying build/lib/lm_eval/tasks/spanish_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench
2025-08-31T08:28:24,718   copying build/lib/lm_eval/tasks/spanish_bench/wnli_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench
2025-08-31T08:28:24,720   copying build/lib/lm_eval/tasks/spanish_bench/paws_es_spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench
2025-08-31T08:28:24,723   copying build/lib/lm_eval/tasks/spanish_bench/openbookqa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench
2025-08-31T08:28:24,725   copying build/lib/lm_eval/tasks/spanish_bench/cocoteros_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench
2025-08-31T08:28:24,727   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hendrycks_math
2025-08-31T08:28:24,729   copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math
2025-08-31T08:28:24,732   copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math
2025-08-31T08:28:24,734   copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math
2025-08-31T08:28:24,736   copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math
2025-08-31T08:28:24,738   copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math
2025-08-31T08:28:24,740   copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math
2025-08-31T08:28:24,743   copying build/lib/lm_eval/tasks/hendrycks_math/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math
2025-08-31T08:28:24,745   copying build/lib/lm_eval/tasks/hendrycks_math/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math
2025-08-31T08:28:24,748   copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math
2025-08-31T08:28:24,750   copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math
2025-08-31T08:28:24,752   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada_multilingual
2025-08-31T08:28:24,754   copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual
2025-08-31T08:28:24,756   copying build/lib/lm_eval/tasks/lambada_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual
2025-08-31T08:28:24,758   copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual
2025-08-31T08:28:24,761   copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual
2025-08-31T08:28:24,763   copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual
2025-08-31T08:28:24,765   copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual
2025-08-31T08:28:24,767   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu
2025-08-31T08:28:24,769   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate
2025-08-31T08:28:24,771   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:28:24,773   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:28:24,775   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:28:24,777   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:28:24,780   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:28:24,782   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:28:24,784   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:28:24,786   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:28:24,788   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:28:24,791   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:28:24,793   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:28:24,795   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:28:24,797   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:28:24,800   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:28:24,802   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:28:24,804   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:28:24,806   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:28:24,808   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:28:24,810   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:28:24,812   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4
2025-08-31T08:28:24,815   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:28:24,817   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:28:24,819   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:28:24,821   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:28:24,823   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:28:24,825   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:28:24,827   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:28:24,830   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:28:24,832   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:28:24,834   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:28:24,836   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:28:24,838   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:28:24,840   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:28:24,843   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:28:24,845   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:28:24,848   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:28:24,850   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:28:24,852   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:28:24,855   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:28:24,857   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2
2025-08-31T08:28:24,859   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:28:24,861   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:28:24,863   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:28:24,866   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:28:24,868   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:28:24,871   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:28:24,873   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:28:24,875   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:28:24,877   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:28:24,879   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:28:24,882   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:28:24,884   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:28:24,886   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:28:24,888   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:28:24,890   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:28:24,892   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:28:24,895   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:28:24,897   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:28:24,901   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:28:24,903   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5
2025-08-31T08:28:24,906   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:28:24,907   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:28:24,910   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:28:24,912   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:28:24,914   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:28:24,916   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:28:24,918   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:28:24,920   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:28:24,922   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:28:24,924   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:28:24,926   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:28:24,929   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:28:24,931   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:28:24,933   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:28:24,935   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:28:24,937   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:28:24,939   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:28:24,941   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:28:24,943   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:28:24,945   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1
2025-08-31T08:28:24,948   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:28:24,950   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:28:24,952   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:28:24,954   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:28:24,956   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:28:24,958   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:28:24,960   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:28:24,962   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:28:24,964   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:28:24,966   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:28:24,968   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:28:24,970   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:28:24,972   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:28:24,973   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:28:24,975   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:28:24,977   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:28:24,979   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:28:24,980   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:28:24,982   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:28:24,984   copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3
2025-08-31T08:28:24,986   copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_tt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate
2025-08-31T08:28:24,988   copying build/lib/lm_eval/tasks/afrimmlu/fewshot.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu
2025-08-31T08:28:24,990   copying build/lib/lm_eval/tasks/afrimmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu
2025-08-31T08:28:24,991   copying build/lib/lm_eval/tasks/afrimmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu
2025-08-31T08:28:24,994   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct
2025-08-31T08:28:24,996   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:28:24,997   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:28:24,999   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:28:25,000   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:28:25,002   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:28:25,004   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:28:25,006   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:28:25,008   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:28:25,010   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:28:25,011   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:28:25,013   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:28:25,015   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:28:25,017   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:28:25,018   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:28:25,020   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:28:25,022   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:28:25,024   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:28:25,026   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:28:25,028   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:28:25,030   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:28:25,031   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4
2025-08-31T08:28:25,033   copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct
2025-08-31T08:28:25,036   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:28:25,037   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:28:25,039   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:28:25,041   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:28:25,043   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:28:25,044   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:28:25,046   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:28:25,048   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:28:25,050   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:28:25,052   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:28:25,054   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:28:25,055   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:28:25,057   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:28:25,059   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:28:25,061   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:28:25,063   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:28:25,064   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:28:25,066   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:28:25,068   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:28:25,070   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:28:25,072   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2
2025-08-31T08:28:25,076   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:28:25,077   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:28:25,079   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:28:25,081   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:28:25,082   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:28:25,084   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:28:25,086   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:28:25,088   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:28:25,090   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:28:25,091   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:28:25,093   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:28:25,095   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:28:25,097   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:28:25,098   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:28:25,100   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:28:25,102   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:28:25,104   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:28:25,106   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:28:25,108   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:28:25,110   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:28:25,111   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5
2025-08-31T08:28:25,114   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:28:25,115   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:28:25,117   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:28:25,119   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:28:25,121   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:28:25,123   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:28:25,125   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:28:25,127   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:28:25,129   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:28:25,131   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:28:25,133   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:28:25,134   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:28:25,136   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:28:25,138   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:28:25,140   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:28:25,142   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:28:25,144   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:28:25,146   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:28:25,148   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:28:25,149   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:28:25,151   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1
2025-08-31T08:28:25,154   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:28:25,155   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:28:25,157   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:28:25,158   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:28:25,160   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:28:25,162   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:28:25,163   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:28:25,165   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:28:25,167   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:28:25,169   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:28:25,170   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:28:25,172   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:28:25,174   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:28:25,176   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:28:25,178   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:28:25,181   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:28:25,183   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:28:25,184   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:28:25,186   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:28:25,188   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:28:25,190   copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3
2025-08-31T08:28:25,192   copying build/lib/lm_eval/tasks/afrimmlu/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu
2025-08-31T08:28:25,196   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/belebele
2025-08-31T08:28:25,198   copying build/lib/lm_eval/tasks/belebele/belebele_vie_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,200   copying build/lib/lm_eval/tasks/belebele/belebele_nld_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,202   copying build/lib/lm_eval/tasks/belebele/belebele_tel_Telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,204   copying build/lib/lm_eval/tasks/belebele/belebele_ind_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,207   copying build/lib/lm_eval/tasks/belebele/belebele_swh_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,210   copying build/lib/lm_eval/tasks/belebele/belebele_eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,212   copying build/lib/lm_eval/tasks/belebele/belebele_est_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,215   copying build/lib/lm_eval/tasks/belebele/_belebele.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,218   copying build/lib/lm_eval/tasks/belebele/belebele_arb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,223   copying build/lib/lm_eval/tasks/belebele/belebele_gaz_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,229   copying build/lib/lm_eval/tasks/belebele/belebele_guj_Gujr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,238   copying build/lib/lm_eval/tasks/belebele/belebele_kaz_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,253   copying build/lib/lm_eval/tasks/belebele/belebele_tgl_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,267   copying build/lib/lm_eval/tasks/belebele/belebele_zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,269   copying build/lib/lm_eval/tasks/belebele/belebele_hrv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,270   copying build/lib/lm_eval/tasks/belebele/belebele_als_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,272   copying build/lib/lm_eval/tasks/belebele/belebele_mya_Mymr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,274   copying build/lib/lm_eval/tasks/belebele/belebele_tam_Taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,276   copying build/lib/lm_eval/tasks/belebele/belebele_npi_Deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,277   copying build/lib/lm_eval/tasks/belebele/belebele_swe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,279   copying build/lib/lm_eval/tasks/belebele/belebele_hat_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,281   copying build/lib/lm_eval/tasks/belebele/belebele_tur_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,283   copying build/lib/lm_eval/tasks/belebele/belebele_bam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,285   copying build/lib/lm_eval/tasks/belebele/belebele_sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,287   copying build/lib/lm_eval/tasks/belebele/belebele_mri_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,288   copying build/lib/lm_eval/tasks/belebele/belebele_bod_Tibt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,290   copying build/lib/lm_eval/tasks/belebele/belebele_ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,292   copying build/lib/lm_eval/tasks/belebele/belebele_tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,294   copying build/lib/lm_eval/tasks/belebele/belebele_ary_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,296   copying build/lib/lm_eval/tasks/belebele/belebele_pbt_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,298   copying build/lib/lm_eval/tasks/belebele/belebele_zho_Hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,300   copying build/lib/lm_eval/tasks/belebele/belebele_tgk_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,302   copying build/lib/lm_eval/tasks/belebele/belebele_por_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,303   copying build/lib/lm_eval/tasks/belebele/belebele_acm_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,305   copying build/lib/lm_eval/tasks/belebele/belebele_kea_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,307   copying build/lib/lm_eval/tasks/belebele/belebele_sot_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,308   copying build/lib/lm_eval/tasks/belebele/belebele_spa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,310   copying build/lib/lm_eval/tasks/belebele/belebele_tso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,312   copying build/lib/lm_eval/tasks/belebele/belebele_mkd_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,314   copying build/lib/lm_eval/tasks/belebele/belebele_nob_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,315   copying build/lib/lm_eval/tasks/belebele/belebele_pol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,317   copying build/lib/lm_eval/tasks/belebele/belebele_sin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,319   copying build/lib/lm_eval/tasks/belebele/belebele_afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,321   copying build/lib/lm_eval/tasks/belebele/belebele_mlt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,322   copying build/lib/lm_eval/tasks/belebele/belebele_snd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,324   copying build/lib/lm_eval/tasks/belebele/belebele_asm_Beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,326   copying build/lib/lm_eval/tasks/belebele/belebele_sin_Sinh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,328   copying build/lib/lm_eval/tasks/belebele/belebele_apc_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,330   copying build/lib/lm_eval/tasks/belebele/belebele_kac_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,332   copying build/lib/lm_eval/tasks/belebele/belebele_jpn_Jpan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,334   copying build/lib/lm_eval/tasks/belebele/belebele_ben_Beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,335   copying build/lib/lm_eval/tasks/belebele/belebele_khm_Khmr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,337   copying build/lib/lm_eval/tasks/belebele/belebele_kan_Knda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,339   copying build/lib/lm_eval/tasks/belebele/belebele_bul_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,341   copying build/lib/lm_eval/tasks/belebele/belebele_lao_Laoo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,343   copying build/lib/lm_eval/tasks/belebele/belebele_dan_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,344   copying build/lib/lm_eval/tasks/belebele/belebele_zho_Hans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,346   copying build/lib/lm_eval/tasks/belebele/belebele_ron_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,348   copying build/lib/lm_eval/tasks/belebele/belebele_nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,349   copying build/lib/lm_eval/tasks/belebele/belebele_pes_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,351   copying build/lib/lm_eval/tasks/belebele/belebele_tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,353   copying build/lib/lm_eval/tasks/belebele/belebele_rus_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,355   copying build/lib/lm_eval/tasks/belebele/belebele_ckb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,357   copying build/lib/lm_eval/tasks/belebele/belebele_deu_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,359   copying build/lib/lm_eval/tasks/belebele/belebele_azj_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,360   copying build/lib/lm_eval/tasks/belebele/belebele_lvs_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,362   copying build/lib/lm_eval/tasks/belebele/belebele_mal_Mlym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,363   copying build/lib/lm_eval/tasks/belebele/belebele_zsm_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,365   copying build/lib/lm_eval/tasks/belebele/belebele_ben_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,367   copying build/lib/lm_eval/tasks/belebele/belebele_hye_Armn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,369   copying build/lib/lm_eval/tasks/belebele/belebele_grn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,371   copying build/lib/lm_eval/tasks/belebele/belebele_kor_Hang.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,372   copying build/lib/lm_eval/tasks/belebele/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,374   copying build/lib/lm_eval/tasks/belebele/belebele_ces_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,376   copying build/lib/lm_eval/tasks/belebele/belebele_hin_Deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,378   copying build/lib/lm_eval/tasks/belebele/belebele_kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,380   copying build/lib/lm_eval/tasks/belebele/belebele_ell_Grek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,381   copying build/lib/lm_eval/tasks/belebele/belebele_uzn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,383   copying build/lib/lm_eval/tasks/belebele/belebele_hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,385   copying build/lib/lm_eval/tasks/belebele/belebele_yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,386   copying build/lib/lm_eval/tasks/belebele/belebele_ars_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,388   copying build/lib/lm_eval/tasks/belebele/belebele_srp_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,390   copying build/lib/lm_eval/tasks/belebele/belebele_jav_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,392   copying build/lib/lm_eval/tasks/belebele/belebele_fin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,394   copying build/lib/lm_eval/tasks/belebele/belebele_slv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,395   copying build/lib/lm_eval/tasks/belebele/belebele_luo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,397   copying build/lib/lm_eval/tasks/belebele/belebele_fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,399   copying build/lib/lm_eval/tasks/belebele/belebele_cat_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,401   copying build/lib/lm_eval/tasks/belebele/belebele_npi_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,403   copying build/lib/lm_eval/tasks/belebele/belebele_kat_Geor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,404   copying build/lib/lm_eval/tasks/belebele/belebele_slk_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,406   copying build/lib/lm_eval/tasks/belebele/belebele_shn_Mymr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,408   copying build/lib/lm_eval/tasks/belebele/belebele_xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,410   copying build/lib/lm_eval/tasks/belebele/belebele_ukr_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,411   copying build/lib/lm_eval/tasks/belebele/belebele_kir_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,413   copying build/lib/lm_eval/tasks/belebele/belebele_urd_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,415   copying build/lib/lm_eval/tasks/belebele/belebele_hin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,416   copying build/lib/lm_eval/tasks/belebele/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,418   copying build/lib/lm_eval/tasks/belebele/belebele_pan_Guru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,420   copying build/lib/lm_eval/tasks/belebele/belebele_lit_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,422   copying build/lib/lm_eval/tasks/belebele/belebele_eus_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,424   copying build/lib/lm_eval/tasks/belebele/belebele_arb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,427   copying build/lib/lm_eval/tasks/belebele/belebele_khk_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,429   copying build/lib/lm_eval/tasks/belebele/belebele_wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,431   copying build/lib/lm_eval/tasks/belebele/belebele_ceb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,434   copying build/lib/lm_eval/tasks/belebele/belebele_som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,436   copying build/lib/lm_eval/tasks/belebele/belebele_nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,438   copying build/lib/lm_eval/tasks/belebele/belebele_heb_Hebr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,440   copying build/lib/lm_eval/tasks/belebele/belebele_fuv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,443   copying build/lib/lm_eval/tasks/belebele/belebele_sun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,445   copying build/lib/lm_eval/tasks/belebele/belebele_lin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,448   copying build/lib/lm_eval/tasks/belebele/belebele_tha_Thai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,450   copying build/lib/lm_eval/tasks/belebele/belebele_arz_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,452   copying build/lib/lm_eval/tasks/belebele/belebele_amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,455   copying build/lib/lm_eval/tasks/belebele/belebele_ita_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,457   copying build/lib/lm_eval/tasks/belebele/belebele_mar_Deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,460   copying build/lib/lm_eval/tasks/belebele/belebele_ilo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,462   copying build/lib/lm_eval/tasks/belebele/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,464   copying build/lib/lm_eval/tasks/belebele/belebele_ory_Orya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,467   copying build/lib/lm_eval/tasks/belebele/belebele_urd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,469   copying build/lib/lm_eval/tasks/belebele/belebele_hun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,471   copying build/lib/lm_eval/tasks/belebele/belebele_isl_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,473   copying build/lib/lm_eval/tasks/belebele/belebele_lug_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,476   copying build/lib/lm_eval/tasks/belebele/belebele_plt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,478   copying build/lib/lm_eval/tasks/belebele/belebele_war_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,481   copying build/lib/lm_eval/tasks/belebele/belebele_ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele
2025-08-31T08:28:25,485   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mlqa
2025-08-31T08:28:25,486   copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,488   copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,491   copying build/lib/lm_eval/tasks/mlqa/mlqa_en_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,493   copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,496   copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,498   copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,501   copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,503   copying build/lib/lm_eval/tasks/mlqa/mlqa_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,506   copying build/lib/lm_eval/tasks/mlqa/mlqa_en_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,508   copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,510   copying build/lib/lm_eval/tasks/mlqa/mlqa_de_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,513   copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,516   copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,518   copying build/lib/lm_eval/tasks/mlqa/mlqa_de_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,521   copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,523   copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,525   copying build/lib/lm_eval/tasks/mlqa/mlqa_de_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,526   copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,528   copying build/lib/lm_eval/tasks/mlqa/mlqa_en_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,530   copying build/lib/lm_eval/tasks/mlqa/mlqa_de_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,532   copying build/lib/lm_eval/tasks/mlqa/mlqa_es_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,534   copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,535   copying build/lib/lm_eval/tasks/mlqa/generate_tasks.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,537   copying build/lib/lm_eval/tasks/mlqa/mlqa_de_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,539   copying build/lib/lm_eval/tasks/mlqa/mlqa_en_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,541   copying build/lib/lm_eval/tasks/mlqa/mlqa_en_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,543   copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,545   copying build/lib/lm_eval/tasks/mlqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,547   copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,549   copying build/lib/lm_eval/tasks/mlqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,551   copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,553   copying build/lib/lm_eval/tasks/mlqa/mlqa_es_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,555   copying build/lib/lm_eval/tasks/mlqa/mlqa_es_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,557   copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,558   copying build/lib/lm_eval/tasks/mlqa/mlqa_es_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,560   copying build/lib/lm_eval/tasks/mlqa/mlqa_es_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,562   copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,564   copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,566   copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,568   copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,570   copying build/lib/lm_eval/tasks/mlqa/mlqa_en_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,571   copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,573   copying build/lib/lm_eval/tasks/mlqa/mlqa_es_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,575   copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,577   copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,579   copying build/lib/lm_eval/tasks/mlqa/mlqa_de_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,580   copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,582   copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,584   copying build/lib/lm_eval/tasks/mlqa/mlqa_en_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,586   copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,587   copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,594   copying build/lib/lm_eval/tasks/mlqa/mlqa_de_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,595   copying build/lib/lm_eval/tasks/mlqa/mlqa_es_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa
2025-08-31T08:28:25,598   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_reading
2025-08-31T08:28:25,599   copying build/lib/lm_eval/tasks/eus_reading/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_reading
2025-08-31T08:28:25,600   copying build/lib/lm_eval/tasks/eus_reading/eus_reading.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_reading
2025-08-31T08:28:25,602   copying build/lib/lm_eval/tasks/eus_reading/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_reading
2025-08-31T08:28:25,606   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ceval
2025-08-31T08:28:25,606   copying build/lib/lm_eval/tasks/ceval/ceval-valid_sports_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,608   copying build/lib/lm_eval/tasks/ceval/ceval-valid_legal_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,610   copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,612   copying build/lib/lm_eval/tasks/ceval/ceval-valid_tax_accountant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,614   copying build/lib/lm_eval/tasks/ceval/ceval-valid_plant_protection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,616   copying build/lib/lm_eval/tasks/ceval/ceval-valid_professional_tour_guide.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,618   copying build/lib/lm_eval/tasks/ceval/ceval-valid_chinese_language_and_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,620   copying build/lib/lm_eval/tasks/ceval/ceval-valid_marxism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,621   copying build/lib/lm_eval/tasks/ceval/ceval-valid_veterinary_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,623   copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_programming.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,625   copying build/lib/lm_eval/tasks/ceval/_default_ceval_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,626   copying build/lib/lm_eval/tasks/ceval/ceval-valid_physician.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,628   copying build/lib/lm_eval/tasks/ceval/ceval-valid_accountant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,630   copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,632   copying build/lib/lm_eval/tasks/ceval/ceval-valid_civil_servant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,633   copying build/lib/lm_eval/tasks/ceval/ceval-valid_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,635   copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,637   copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,639   copying build/lib/lm_eval/tasks/ceval/ceval-valid_computer_network.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,641   copying build/lib/lm_eval/tasks/ceval/ceval-valid_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,642   copying build/lib/lm_eval/tasks/ceval/ceval-valid_computer_architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,644   copying build/lib/lm_eval/tasks/ceval/ceval-valid_metrology_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,646   copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,647   copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,649   copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,651   copying build/lib/lm_eval/tasks/ceval/ceval-valid_education_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,653   copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,654   copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,656   copying build/lib/lm_eval/tasks/ceval/ceval-valid_environmental_impact_assessment_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,658   copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,659   copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,661   copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,663   copying build/lib/lm_eval/tasks/ceval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,665   copying build/lib/lm_eval/tasks/ceval/ceval-valid_basic_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,667   copying build/lib/lm_eval/tasks/ceval/ceval-valid_probability_and_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,668   copying build/lib/lm_eval/tasks/ceval/ceval-valid_electrical_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,670   copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,672   copying build/lib/lm_eval/tasks/ceval/ceval-valid_advanced_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,674   copying build/lib/lm_eval/tasks/ceval/_ceval-valid.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,675   copying build/lib/lm_eval/tasks/ceval/ceval-valid_modern_chinese_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,677   copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,679   copying build/lib/lm_eval/tasks/ceval/ceval-valid_ideological_and_moral_cultivation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,681   copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,682   copying build/lib/lm_eval/tasks/ceval/ceval-valid_mao_zedong_thought.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,684   copying build/lib/lm_eval/tasks/ceval/ceval-valid_art_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,686   copying build/lib/lm_eval/tasks/ceval/ceval-valid_clinical_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,688   copying build/lib/lm_eval/tasks/ceval/ceval-valid_fire_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,690   copying build/lib/lm_eval/tasks/ceval/ceval-valid_business_administration.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,692   copying build/lib/lm_eval/tasks/ceval/ceval-valid_urban_and_rural_planner.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,693   copying build/lib/lm_eval/tasks/ceval/ceval-valid_teacher_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,695   copying build/lib/lm_eval/tasks/ceval/ceval-valid_discrete_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,697   copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,699   copying build/lib/lm_eval/tasks/ceval/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,701   copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,703   copying build/lib/lm_eval/tasks/ceval/ceval-valid_operating_system.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,704   copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval
2025-08-31T08:28:25,707   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/nq_open
2025-08-31T08:28:25,708   copying build/lib/lm_eval/tasks/nq_open/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nq_open
2025-08-31T08:28:25,710   copying build/lib/lm_eval/tasks/nq_open/nq_open.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nq_open
2025-08-31T08:28:25,712   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/webqs
2025-08-31T08:28:25,713   copying build/lib/lm_eval/tasks/webqs/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/webqs
2025-08-31T08:28:25,715   copying build/lib/lm_eval/tasks/webqs/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/webqs
2025-08-31T08:28:25,717   copying build/lib/lm_eval/tasks/webqs/webqs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/webqs
2025-08-31T08:28:25,719   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue
2025-08-31T08:28:25,721   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/record
2025-08-31T08:28:25,722   copying build/lib/lm_eval/tasks/super_glue/record/util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record
2025-08-31T08:28:25,724   copying build/lib/lm_eval/tasks/super_glue/record/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record
2025-08-31T08:28:25,726   copying build/lib/lm_eval/tasks/super_glue/record/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record
2025-08-31T08:28:25,728   copying build/lib/lm_eval/tasks/super_glue/record/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record
2025-08-31T08:28:25,731   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/wic
2025-08-31T08:28:25,732   copying build/lib/lm_eval/tasks/super_glue/wic/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wic
2025-08-31T08:28:25,734   copying build/lib/lm_eval/tasks/super_glue/wic/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wic
2025-08-31T08:28:25,737   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/cb
2025-08-31T08:28:25,738   copying build/lib/lm_eval/tasks/super_glue/cb/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb
2025-08-31T08:28:25,740   copying build/lib/lm_eval/tasks/super_glue/cb/aggregate.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb
2025-08-31T08:28:25,742   copying build/lib/lm_eval/tasks/super_glue/cb/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb
2025-08-31T08:28:25,744   copying build/lib/lm_eval/tasks/super_glue/cb/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb
2025-08-31T08:28:25,746   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/multirc
2025-08-31T08:28:25,747   copying build/lib/lm_eval/tasks/super_glue/multirc/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/multirc
2025-08-31T08:28:25,749   copying build/lib/lm_eval/tasks/super_glue/multirc/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/multirc
2025-08-31T08:28:25,750   copying build/lib/lm_eval/tasks/super_glue/multirc/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/multirc
2025-08-31T08:28:25,752   copying build/lib/lm_eval/tasks/super_glue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue
2025-08-31T08:28:25,755   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/boolq
2025-08-31T08:28:25,756   copying build/lib/lm_eval/tasks/super_glue/boolq/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/boolq
2025-08-31T08:28:25,758   copying build/lib/lm_eval/tasks/super_glue/boolq/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/boolq
2025-08-31T08:28:25,759   copying build/lib/lm_eval/tasks/super_glue/boolq/seq2seq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/boolq
2025-08-31T08:28:25,762   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/copa
2025-08-31T08:28:25,763   copying build/lib/lm_eval/tasks/super_glue/copa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/copa
2025-08-31T08:28:25,765   copying build/lib/lm_eval/tasks/super_glue/copa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/copa
2025-08-31T08:28:25,767   copying build/lib/lm_eval/tasks/super_glue/copa/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/copa
2025-08-31T08:28:25,769   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/rte
2025-08-31T08:28:25,771   copying build/lib/lm_eval/tasks/super_glue/rte/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/rte
2025-08-31T08:28:25,773   copying build/lib/lm_eval/tasks/super_glue/rte/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/rte
2025-08-31T08:28:25,775   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/wsc
2025-08-31T08:28:25,776   copying build/lib/lm_eval/tasks/super_glue/wsc/preprocess_wsc.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc
2025-08-31T08:28:25,778   copying build/lib/lm_eval/tasks/super_glue/wsc/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc
2025-08-31T08:28:25,780   copying build/lib/lm_eval/tasks/super_glue/wsc/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc
2025-08-31T08:28:25,782   copying build/lib/lm_eval/tasks/super_glue/wsc/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc
2025-08-31T08:28:25,784   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mimic_repsum
2025-08-31T08:28:25,785   copying build/lib/lm_eval/tasks/mimic_repsum/mimic_repsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum
2025-08-31T08:28:25,787   copying build/lib/lm_eval/tasks/mimic_repsum/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum
2025-08-31T08:28:25,789   copying build/lib/lm_eval/tasks/mimic_repsum/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum
2025-08-31T08:28:25,791   copying build/lib/lm_eval/tasks/mimic_repsum/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum
2025-08-31T08:28:25,793   copying build/lib/lm_eval/tasks/mimic_repsum/mimic_repsum_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum
2025-08-31T08:28:25,795   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/meqsum
2025-08-31T08:28:25,796   copying build/lib/lm_eval/tasks/meqsum/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meqsum
2025-08-31T08:28:25,798   copying build/lib/lm_eval/tasks/meqsum/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meqsum
2025-08-31T08:28:25,800   copying build/lib/lm_eval/tasks/meqsum/meqsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meqsum
2025-08-31T08:28:25,802   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/csatqa
2025-08-31T08:28:25,803   copying build/lib/lm_eval/tasks/csatqa/csatqa_rch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa
2025-08-31T08:28:25,805   copying build/lib/lm_eval/tasks/csatqa/_csatqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa
2025-08-31T08:28:25,807   copying build/lib/lm_eval/tasks/csatqa/csatqa_rcss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa
2025-08-31T08:28:25,808   copying build/lib/lm_eval/tasks/csatqa/csatqa_li.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa
2025-08-31T08:28:25,810   copying build/lib/lm_eval/tasks/csatqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa
2025-08-31T08:28:25,812   copying build/lib/lm_eval/tasks/csatqa/_default_csatqa_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa
2025-08-31T08:28:25,814   copying build/lib/lm_eval/tasks/csatqa/csatqa_rcs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa
2025-08-31T08:28:25,816   copying build/lib/lm_eval/tasks/csatqa/csatqa_wr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa
2025-08-31T08:28:25,818   copying build/lib/lm_eval/tasks/csatqa/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa
2025-08-31T08:28:25,820   copying build/lib/lm_eval/tasks/csatqa/csatqa_gr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa
2025-08-31T08:28:25,822   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/toxigen
2025-08-31T08:28:25,823   copying build/lib/lm_eval/tasks/toxigen/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toxigen
2025-08-31T08:28:25,825   copying build/lib/lm_eval/tasks/toxigen/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toxigen
2025-08-31T08:28:25,827   copying build/lib/lm_eval/tasks/toxigen/toxigen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toxigen
2025-08-31T08:28:25,829   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light
2025-08-31T08:28:25,831   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light
2025-08-31T08:28:25,832   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_mt_openbook_qa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light
2025-08-31T08:28:25,834   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_leaderboard_arabic_mt_openbook_qa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light
2025-08-31T08:28:25,836   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light
2025-08-31T08:28:25,838   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light
2025-08-31T08:28:25,839   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_mt_arc_challenge_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light
2025-08-31T08:28:25,841   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_leaderboard_arabic_mt_arc_challenge_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light
2025-08-31T08:28:25,843   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light
2025-08-31T08:28:25,846   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light
2025-08-31T08:28:25,847   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light
2025-08-31T08:28:25,849   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_leaderboard_arabic_mt_sciq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light
2025-08-31T08:28:25,851   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_mt_sciq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light
2025-08-31T08:28:25,853   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light
2025-08-31T08:28:25,854   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_mt_hellaswag_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light
2025-08-31T08:28:25,856   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light
2025-08-31T08:28:25,858   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_leaderboard_arabic_mt_hellaswag_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light
2025-08-31T08:28:25,860   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light
2025-08-31T08:28:25,864   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,865   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_computer_science_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,867   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_physics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,869   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_elementary_mathematics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,870   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_clinical_knowledge_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,872   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_mathematics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,874   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_miscellaneous_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,876   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_sexuality_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,877   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_psychology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,879   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_medicine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,881   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_microeconomics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,883   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_chemistry_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,884   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_computer_science_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,886   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_geography_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,888   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_psychology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,890   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_computer_security_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,891   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_nutrition_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,893   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_philosophy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,895   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_security_studies_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,896   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_astronomy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,898   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,900   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_european_history_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,902   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_econometrics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,903   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_medicine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,905   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_scenarios_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,907   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,909   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_electrical_engineering_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,911   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_business_ethics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,913   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_anatomy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,914   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_jurisprudence_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,916   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_world_religions_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,918   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_global_facts_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,920   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_abstract_algebra_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,922   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_accounting_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,924   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_public_relations_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,926   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,927   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_physics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,929   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_formal_logic_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,931   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_statistics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,933   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_chemistry_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,935   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_us_foreign_policy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,936   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_logical_fallacies_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,939   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_mathematics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,941   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,943   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_medical_genetics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,945   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_disputes_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,947   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_sociology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,949   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_virology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,950   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_marketing_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,952   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_management_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,954   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_world_history_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,956   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_machine_learning_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,958   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_conceptual_physics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,959   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_law_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,961   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_us_history_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,963   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_biology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,964   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_international_law_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,966   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_biology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,968   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_aging_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,970   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_prehistory_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light
2025-08-31T08:28:25,972   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:28:25,973   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:28:25,975   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:28:25,977   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_sentiment_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:28:25,979   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_mcq_exams_test_ar_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:28:25,981   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_msa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:28:25,982   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:28:25,984   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:28:25,986   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_dialects_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:28:25,988   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:28:25,990   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:28:25,991   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light
2025-08-31T08:28:25,993   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light
2025-08-31T08:28:25,994   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light
2025-08-31T08:28:25,996   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_leaderboard_arabic_exams_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light
2025-08-31T08:28:25,998   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_exams_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light
2025-08-31T08:28:26,002   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,003   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Music_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,005   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Funeral_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,006   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Kuwait_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,008   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Lebanon_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,010   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Calligraphy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,012   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islamic_law_system_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,013   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Math_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,015   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Comoros_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,017   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromRome_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,018   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Tunisia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,020   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Qatar_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,022   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_computer_and_phone_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,024   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Saudi_Arabia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,025   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Egypt_modern_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,027   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Bahrain_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,029   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Wedding_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,031   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Language_Origin_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,032   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Geography_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,034   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Food_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,036   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Somalia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,038   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Morocco_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,039   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Architecture_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,041   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromChina_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,043   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_entertainment_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,045   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mauritania_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,047   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromGreece_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,048   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromByzantium_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,050   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_daily_life_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,052   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,053   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Syria_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,055   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Jordan_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,057   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,059   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,061   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Iraq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,062   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Literature_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,064   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Algeria_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,066   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Yemen_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,067   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Oman_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,069   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Sudan_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,071   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ornament_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,073   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mesopotamia_civilization_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,074   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Medicine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,076   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Ancient_Egypt_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,078   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_Education_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,080   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromIslam_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,082   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Culture_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,084   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Astronomy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,085   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromPersia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,087   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Palestine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,089   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arab_Empire_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,091   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_branches_and_schools_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,093   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_History_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,094   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_communication_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,096   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Art_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,098   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_United_Arab_Emirates_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,100   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Libya_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,101   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Philosophy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,103   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ceremony_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,105   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromAncientEgypt_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,107   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Clothing_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light
2025-08-31T08:28:26,109   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light
2025-08-31T08:28:26,110   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arabic_mt_copa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light
2025-08-31T08:28:26,112   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arbic_leaderboard_arabic_mt_copa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light
2025-08-31T08:28:26,114   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light
2025-08-31T08:28:26,116   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light
2025-08-31T08:28:26,117   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_leaderboard_arabic_mt_mmlu_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light
2025-08-31T08:28:26,119   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_mt_mmlu_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light
2025-08-31T08:28:26,121   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light
2025-08-31T08:28:26,123   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light
2025-08-31T08:28:26,125   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_mt_arc_easy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light
2025-08-31T08:28:26,126   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light
2025-08-31T08:28:26,128   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_leaderboard_arabic_mt_arc_easy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light
2025-08-31T08:28:26,130   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light
2025-08-31T08:28:26,132   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light
2025-08-31T08:28:26,133   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_leaderboard_arabic_mt_boolq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light
2025-08-31T08:28:26,136   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light
2025-08-31T08:28:26,137   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_mt_boolq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light
2025-08-31T08:28:26,140   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light
2025-08-31T08:28:26,141   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_leaderboard_arabic_mt_race_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light
2025-08-31T08:28:26,143   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_mt_race_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light
2025-08-31T08:28:26,145   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light
2025-08-31T08:28:26,148   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light
2025-08-31T08:28:26,149   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_leaderboard_arabic_mt_toxigen_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light
2025-08-31T08:28:26,151   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_mt_toxigen_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light
2025-08-31T08:28:26,153   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light
2025-08-31T08:28:26,156   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light
2025-08-31T08:28:26,157   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_leaderboard_arabic_mt_piqa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light
2025-08-31T08:28:26,159   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light
2025-08-31T08:28:26,162   copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_mt_piqa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light
2025-08-31T08:28:26,167   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/cmmlu
2025-08-31T08:28:26,168   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_driving_rule.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,170   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,172   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,174   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,176   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,178   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,180   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,181   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,184   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_college_engineering_hydrology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,185   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,187   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,189   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_ethnology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,191   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_arts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,193   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_legal_and_moral_basis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,194   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,196   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_college_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,198   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,199   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,201   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,203   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,204   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,206   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,208   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,210   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,211   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,213   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,215   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,216   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,218   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,220   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_modern_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,222   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_food_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,224   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,226   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,228   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,229   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_food_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,231   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_sports_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,233   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_arts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,235   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_modern_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,236   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,239   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_chinese_driving_rule.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,241   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,242   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,244   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_chinese_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,246   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,248   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_sports_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,249   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,251   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_college_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,252   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_information_and_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,254   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,256   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,257   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,259   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_food_culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,261   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_journalism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,263   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,265   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_civil_service_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,267   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,268   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,270   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_traditional_chinese_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,272   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_security_study.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,273   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,275   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_high_school_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,277   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,279   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,281   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_ethnology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,282   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,284   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,286   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_chinese_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,288   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,290   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,292   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_elementary_information_and_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,293   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_chinese_food_culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,295   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,297   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,299   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,301   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,302   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,304   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,305   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,307   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,309   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_journalism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,311   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,312   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,314   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,316   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_agronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,318   copying build/lib/lm_eval/tasks/cmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,320   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_chinese_teacher_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,322   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,323   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_marxist_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,326   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_agronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,328   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_engineering_hydrology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,330   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,331   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_college_actuarial_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,333   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,335   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,337   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_commonsense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,339   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_traditional_chinese_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,341   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,342   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_elementary_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,344   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_ancient_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,346   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_logical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,347   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,349   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,351   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_legal_and_moral_basis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,353   copying build/lib/lm_eval/tasks/cmmlu/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,355   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,358   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_college_medical_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,360   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,362   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,364   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_ancient_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,367   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,369   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_logical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,370   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_medical_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,372   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,374   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,376   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_chinese_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,379   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,382   copying build/lib/lm_eval/tasks/cmmlu/_cmmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,386   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,387   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_construction_project_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,389   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_construction_project_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,391   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_security_study.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,393   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_marxist_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,395   copying build/lib/lm_eval/tasks/cmmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,397   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_chinese_civil_service_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,399   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,401   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_actuarial_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,402   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,404   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,406   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,408   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_elementary_commonsense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,409   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_teacher_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,411   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,413   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,414   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,416   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,418   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,420   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,422   copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu
2025-08-31T08:28:26,424   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noticia
2025-08-31T08:28:26,425   copying build/lib/lm_eval/tasks/noticia/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noticia
2025-08-31T08:28:26,427   copying build/lib/lm_eval/tasks/noticia/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noticia
2025-08-31T08:28:26,429   copying build/lib/lm_eval/tasks/noticia/noticia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noticia
2025-08-31T08:28:26,431   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/pubmedqa
2025-08-31T08:28:26,432   copying build/lib/lm_eval/tasks/pubmedqa/pubmedqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pubmedqa
2025-08-31T08:28:26,434   copying build/lib/lm_eval/tasks/pubmedqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pubmedqa
2025-08-31T08:28:26,436   copying build/lib/lm_eval/tasks/pubmedqa/preprocess_pubmedqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pubmedqa
2025-08-31T08:28:26,438   copying build/lib/lm_eval/tasks/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks
2025-08-31T08:28:26,443   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/squadv2
2025-08-31T08:28:26,444   copying build/lib/lm_eval/tasks/squadv2/squadv2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squadv2
2025-08-31T08:28:26,446   copying build/lib/lm_eval/tasks/squadv2/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squadv2
2025-08-31T08:28:26,448   copying build/lib/lm_eval/tasks/squadv2/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squadv2
2025-08-31T08:28:26,451   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/med_text_classification
2025-08-31T08:28:26,452   copying build/lib/lm_eval/tasks/med_text_classification/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_text_classification
2025-08-31T08:28:26,453   copying build/lib/lm_eval/tasks/med_text_classification/med_text_classification_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_text_classification
2025-08-31T08:28:26,455   copying build/lib/lm_eval/tasks/med_text_classification/med_text_classification_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_text_classification
2025-08-31T08:28:26,458   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/truthfulqa
2025-08-31T08:28:26,459   copying build/lib/lm_eval/tasks/truthfulqa/truthfulqa_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa
2025-08-31T08:28:26,460   copying build/lib/lm_eval/tasks/truthfulqa/truthfulqa_gen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa
2025-08-31T08:28:26,462   copying build/lib/lm_eval/tasks/truthfulqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa
2025-08-31T08:28:26,464   copying build/lib/lm_eval/tasks/truthfulqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa
2025-08-31T08:28:26,466   copying build/lib/lm_eval/tasks/truthfulqa/truthfulqa_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa
2025-08-31T08:28:26,468   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3
2025-08-31T08:28:26,469   copying build/lib/lm_eval/tasks/llama3/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3
2025-08-31T08:28:26,473   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct
2025-08-31T08:28:26,475   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,476   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,478   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,481   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,482   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,484   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,486   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,488   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,490   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,492   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,494   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,496   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,498   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,500   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,502   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,503   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,505   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,507   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,509   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,511   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,512   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,515   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,516   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,518   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,520   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,522   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,524   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,526   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,528   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,530   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,531   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,533   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,536   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,537   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,539   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,541   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,543   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,545   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,547   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,548   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,550   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,552   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,555   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,557   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,558   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,560   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,562   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,564   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,566   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,568   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,570   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,572   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,574   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,576   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,577   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,580   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,581   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,583   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,585   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,587   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,589   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,591   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,593   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,595   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,597   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it
2025-08-31T08:28:26,600   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,601   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,604   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,605   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_mmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,607   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,609   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,611   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,613   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,615   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,616   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_mmlu_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,618   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,620   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,622   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,624   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,625   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,627   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,629   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,631   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,632   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,634   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,636   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,637   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,639   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,641   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,643   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,644   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,646   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,648   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,650   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,652   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_mmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,653   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,655   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,657   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,659   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,661   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,663   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,664   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,666   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,668   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,670   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,672   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_mmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,673   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,675   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,677   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,679   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,680   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,682   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,684   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,685   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,687   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,689   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,691   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,692   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,694   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,696   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,698   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,699   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,701   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,703   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,705   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,707   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,708   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,710   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,712   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu
2025-08-31T08:28:26,715   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,716   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,718   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,720   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,722   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,724   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,726   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,728   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,730   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,732   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,734   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,736   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,738   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,740   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,742   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,743   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,745   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,747   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,749   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,751   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,753   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,755   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,757   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,759   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,761   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,763   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,764   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,766   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,768   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,770   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,772   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,774   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,775   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,778   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,780   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,782   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,783   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,785   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,787   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,789   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,791   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,793   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,795   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,797   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,799   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,802   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,803   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,805   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,807   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,809   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,811   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,813   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,815   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,817   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,819   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,821   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,823   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,825   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,827   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,829   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,830   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,832   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,834   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,836   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,838   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de
2025-08-31T08:28:26,841   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/gsm8k
2025-08-31T08:28:26,842   copying build/lib/lm_eval/tasks/llama3/instruct/gsm8k/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/gsm8k
2025-08-31T08:28:26,845   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,846   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,848   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,850   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,852   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,853   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,855   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,857   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,859   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,861   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,862   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,864   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,866   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,868   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,870   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,871   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,873   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,875   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,877   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,879   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,881   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,883   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,884   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,886   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,888   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,889   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,891   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,892   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,894   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,896   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,898   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,900   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,902   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,904   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,905   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,907   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,909   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,911   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,912   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,914   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,916   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,918   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,920   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,921   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,923   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,925   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,926   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,928   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,930   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,931   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,933   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,935   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,936   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,938   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,940   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,942   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,944   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,945   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,947   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,949   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,950   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,952   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,954   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,956   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot
2025-08-31T08:28:26,959   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:26,960   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:26,963   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:26,964   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:26,967   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:26,969   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:26,971   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:26,973   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:26,976   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:26,977   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:26,979   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:26,981   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:26,983   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:26,985   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:26,987   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:26,989   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:26,991   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:26,993   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:26,995   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:26,997   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:26,999   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,001   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,003   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,005   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,007   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,009   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,011   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,013   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,015   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,017   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,019   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,021   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,023   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,024   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,027   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,029   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,031   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,033   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,035   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,037   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,039   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,041   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,043   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,045   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,047   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,049   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,051   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,053   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,056   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,059   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,061   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,063   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,065   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,067   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,069   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,071   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,073   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,075   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,078   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,080   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,082   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,084   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,086   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,088   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,090   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr
2025-08-31T08:28:27,096   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,098   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,101   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,103   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,105   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,108   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,111   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,112   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,116   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,118   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,121   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,122   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,125   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,128   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,130   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,132   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,134   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,136   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,139   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,141   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,144   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,146   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,148   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,151   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,153   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,156   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,158   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,160   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,162   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,165   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,166   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,169   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,171   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,173   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,175   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,177   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,180   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,182   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,184   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,186   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,188   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,190   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,192   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,195   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,197   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,199   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,202   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,205   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,207   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,209   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,211   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,214   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,216   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,218   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,221   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,223   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,226   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,228   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,231   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,233   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,235   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,238   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,241   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,244   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,247   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi
2025-08-31T08:28:27,250   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/arc_challenge
2025-08-31T08:28:27,251   copying build/lib/lm_eval/tasks/llama3/instruct/arc_challenge/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/arc_challenge
2025-08-31T08:28:27,253   copying build/lib/lm_eval/tasks/llama3/instruct/arc_challenge/arc_challenge_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/arc_challenge
2025-08-31T08:28:27,256   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,257   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,260   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,262   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,264   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,266   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,269   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,272   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,274   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,277   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,279   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,281   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,284   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,286   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,289   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,291   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,294   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,297   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,299   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,301   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,304   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,307   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,310   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,312   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,314   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,316   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,319   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,321   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,323   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,326   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,328   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,330   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,333   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,335   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,337   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,340   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,342   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,344   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,347   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,349   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,351   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,354   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,356   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,358   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,360   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,363   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,365   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,367   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,369   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,372   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,374   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,376   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,378   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,380   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,383   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,386   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,388   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,391   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,393   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,395   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,398   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,400   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,402   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,404   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,408   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th
2025-08-31T08:28:27,411   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:28:27,412   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:28:27,414   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:28:27,416   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:28:27,417   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:28:27,419   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:28:27,421   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:28:27,422   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:28:27,424   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:28:27,426   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:28:27,428   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:28:27,429   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:28:27,431   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:28:27,433   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:28:27,435   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:28:27,437   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:28:27,439   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:28:27,440   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro
2025-08-31T08:28:27,444   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,445   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,447   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,449   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,451   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,453   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,455   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,457   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,459   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,461   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,463   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,465   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,466   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,469   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,470   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,472   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,475   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,476   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,478   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,480   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,482   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,484   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,486   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,488   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,490   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,492   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,494   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,496   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,498   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,500   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,501   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,504   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,505   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,507   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,509   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,511   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,513   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,515   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,517   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,519   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,521   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,523   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,525   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,527   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,529   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,531   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,534   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,536   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,538   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,540   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,542   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,544   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,546   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,548   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,549   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,551   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,553   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,555   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,557   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,559   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,561   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,563   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,564   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,566   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,568   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es
2025-08-31T08:28:27,571   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,572   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,574   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,576   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,578   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,580   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,582   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,584   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,586   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,588   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,590   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,592   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,594   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,596   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,597   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,599   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,601   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,603   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,605   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,607   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,609   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,611   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,612   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,614   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,616   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,618   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,620   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,622   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,623   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,626   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,628   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,629   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,631   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,633   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,635   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,637   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,640   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,642   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,644   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,647   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,650   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,652   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,654   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,657   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,659   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,662   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,665   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,667   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,670   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,672   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,675   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,677   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,680   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,682   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,685   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,687   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,689   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,692   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,694   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,697   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,700   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,702   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,705   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,707   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,709   copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt
2025-08-31T08:28:27,713   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tinyBenchmarks
2025-08-31T08:28:27,714   copying build/lib/lm_eval/tasks/tinyBenchmarks/utils_truthfulqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks
2025-08-31T08:28:27,717   copying build/lib/lm_eval/tasks/tinyBenchmarks/agg_functions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks
2025-08-31T08:28:27,720   copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks
2025-08-31T08:28:27,722   copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyHellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks
2025-08-31T08:28:27,724   copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyWinogrande.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks
2025-08-31T08:28:27,727   copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks
2025-08-31T08:28:27,729   copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyArc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks
2025-08-31T08:28:27,731   copying build/lib/lm_eval/tasks/tinyBenchmarks/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks
2025-08-31T08:28:27,734   copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyMMLU.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks
2025-08-31T08:28:27,736   copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyGSM8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks
2025-08-31T08:28:27,739   copying build/lib/lm_eval/tasks/tinyBenchmarks/utils_hellaswag.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks
2025-08-31T08:28:27,741   copying build/lib/lm_eval/tasks/tinyBenchmarks/utils_winogrande.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks
2025-08-31T08:28:27,745   copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyBenchmarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks
2025-08-31T08:28:27,749   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/realtoxicityprompts
2025-08-31T08:28:27,750   copying build/lib/lm_eval/tasks/realtoxicityprompts/realtoxicityprompts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/realtoxicityprompts
2025-08-31T08:28:27,753   copying build/lib/lm_eval/tasks/realtoxicityprompts/metric.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/realtoxicityprompts
2025-08-31T08:28:27,757   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench
2025-08-31T08:28:27,759   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench/mcq_cot_2shot
2025-08-31T08:28:27,760   copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/just.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot
2025-08-31T08:28:27,762   copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/val.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot
2025-08-31T08:28:27,764   copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/prog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot
2025-08-31T08:28:27,767   copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/land.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot
2025-08-31T08:28:27,770   copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/_mcq_cot_2shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot
2025-08-31T08:28:27,772   copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot
2025-08-31T08:28:27,774   copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/app.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot
2025-08-31T08:28:27,776   copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/act_reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot
2025-08-31T08:28:27,779   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:28:27,780   copying build/lib/lm_eval/tasks/acpbench/gen_2shot/acp_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:28:27,783   copying build/lib/lm_eval/tasks/acpbench/gen_2shot/just.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:28:27,786   copying build/lib/lm_eval/tasks/acpbench/gen_2shot/_gen_yaml_2shot -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:28:27,787   copying build/lib/lm_eval/tasks/acpbench/gen_2shot/val.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:28:27,791   copying build/lib/lm_eval/tasks/acpbench/gen_2shot/prog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:28:27,793   copying build/lib/lm_eval/tasks/acpbench/gen_2shot/land.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:28:27,794   copying build/lib/lm_eval/tasks/acpbench/gen_2shot/next_act.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:28:27,797   copying build/lib/lm_eval/tasks/acpbench/gen_2shot/acp_grammar.lark -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:28:27,799   copying build/lib/lm_eval/tasks/acpbench/gen_2shot/reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:28:27,801   copying build/lib/lm_eval/tasks/acpbench/gen_2shot/app.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:28:27,805   copying build/lib/lm_eval/tasks/acpbench/gen_2shot/act_reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot
2025-08-31T08:28:27,809   copying build/lib/lm_eval/tasks/acpbench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench
2025-08-31T08:28:27,812   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench/boolq_cot_2shot
2025-08-31T08:28:27,813   copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/_boolq_cot_2shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot
2025-08-31T08:28:27,815   copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/just.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot
2025-08-31T08:28:27,817   copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/val.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot
2025-08-31T08:28:27,819   copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/prog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot
2025-08-31T08:28:27,821   copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/land.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot
2025-08-31T08:28:27,823   copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot
2025-08-31T08:28:27,825   copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/app.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot
2025-08-31T08:28:27,827   copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/act_reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot
2025-08-31T08:28:27,829   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:28:27,830   copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:28:27,833   copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/just.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:28:27,836   copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/_gen_yaml_2shot -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:28:27,837   copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/val.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:28:27,840   copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/prog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:28:27,842   copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/land.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:28:27,844   copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/next_act.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:28:27,847   copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_grammar.lark -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:28:27,848   copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:28:27,851   copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/app.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:28:27,853   copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/act_reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl
2025-08-31T08:28:27,856   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue
2025-08-31T08:28:27,857   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/wnli
2025-08-31T08:28:27,858   copying build/lib/lm_eval/tasks/glue/wnli/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/wnli
2025-08-31T08:28:27,861   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/qnli
2025-08-31T08:28:27,862   copying build/lib/lm_eval/tasks/glue/qnli/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/qnli
2025-08-31T08:28:27,864   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/cola
2025-08-31T08:28:27,865   copying build/lib/lm_eval/tasks/glue/cola/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/cola
2025-08-31T08:28:27,867   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/qqp
2025-08-31T08:28:27,868   copying build/lib/lm_eval/tasks/glue/qqp/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/qqp
2025-08-31T08:28:27,870   copying build/lib/lm_eval/tasks/glue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue
2025-08-31T08:28:27,873   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/mrpc
2025-08-31T08:28:27,874   copying build/lib/lm_eval/tasks/glue/mrpc/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mrpc
2025-08-31T08:28:27,876   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/sst2
2025-08-31T08:28:27,877   copying build/lib/lm_eval/tasks/glue/sst2/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/sst2
2025-08-31T08:28:27,879   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/rte
2025-08-31T08:28:27,880   copying build/lib/lm_eval/tasks/glue/rte/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/rte
2025-08-31T08:28:27,883   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/mnli
2025-08-31T08:28:27,884   copying build/lib/lm_eval/tasks/glue/mnli/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mnli
2025-08-31T08:28:27,886   copying build/lib/lm_eval/tasks/glue/mnli/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mnli
2025-08-31T08:28:27,887   copying build/lib/lm_eval/tasks/glue/mnli/mismatch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mnli
2025-08-31T08:28:27,890   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hendrycks_ethics
2025-08-31T08:28:27,891   copying build/lib/lm_eval/tasks/hendrycks_ethics/commonsense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics
2025-08-31T08:28:27,893   copying build/lib/lm_eval/tasks/hendrycks_ethics/utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics
2025-08-31T08:28:27,894   copying build/lib/lm_eval/tasks/hendrycks_ethics/justice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics
2025-08-31T08:28:27,896   copying build/lib/lm_eval/tasks/hendrycks_ethics/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics
2025-08-31T08:28:27,898   copying build/lib/lm_eval/tasks/hendrycks_ethics/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics
2025-08-31T08:28:27,900   copying build/lib/lm_eval/tasks/hendrycks_ethics/virtue.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics
2025-08-31T08:28:27,902   copying build/lib/lm_eval/tasks/hendrycks_ethics/utilitarianism_original_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics
2025-08-31T08:28:27,904   copying build/lib/lm_eval/tasks/hendrycks_ethics/deontology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics
2025-08-31T08:28:27,906   copying build/lib/lm_eval/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks
2025-08-31T08:28:27,909   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmmluplus
2025-08-31T08:28:27,910   copying build/lib/lm_eval/tasks/tmmluplus/subject.tsv -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus
2025-08-31T08:28:27,913   copying build/lib/lm_eval/tasks/tmmluplus/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus
2025-08-31T08:28:27,916   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,917   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pathology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,919   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_optometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,921   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_physical_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,923   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,925   copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_STEM.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,926   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_management_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,928   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_advance_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,930   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_chinese_language_and_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,931   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pharmacology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,933   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_education_(profession_level).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,935   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,936   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_secondary_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,938   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chinese_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,940   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,942   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_ttqav2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,944   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_trade.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,946   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_engineering_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,948   copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,949   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_math_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,951   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_mechanical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,953   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,955   copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,956   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,958   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_marketing_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,960   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,962   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_introduction_to_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,963   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_organic_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,965   copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,967   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_business_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,968   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_natural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,970   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,971   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_fire_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,973   copying build/lib/lm_eval/tasks/tmmluplus/default/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,974   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_nautical_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,976   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_national_protection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,978   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_trust_practice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,979   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_insurance_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,981   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,983   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_three_principles_of_people.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,985   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_politic_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,987   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_general_principles_of_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,989   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_clinical_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,990   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_taiwanese_hokkien.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,992   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,994   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,995   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_science_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,997   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_auditing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:27,999   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_agriculture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,001   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,003   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_anti_money_laundering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,004   copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,007   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_educational_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,008   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_geography_of_taiwan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,010   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,011   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_human_behavior.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,013   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_chinese_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,015   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_official_document_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,016   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_culinary_skills.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,018   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_dentistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,020   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_linear_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,022   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_basic_medical_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,024   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,025   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_occupational_therapy_for_psychological_disorders.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,027   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_jce_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,029   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,031   copying build/lib/lm_eval/tasks/tmmluplus/default/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,033   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_statistics_and_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,035   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_administrative_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,037   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_social_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,039   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_finance_banking.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,041   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_technical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,043   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_financial_analysis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,045   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_traditional_chinese_medicine_clinical_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,046   copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_logic_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,048   copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default
2025-08-31T08:28:28,050   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench
2025-08-31T08:28:28,051   copying build/lib/lm_eval/tasks/afrobench/afrobench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench
2025-08-31T08:28:28,053   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy
2025-08-31T08:28:28,055   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4
2025-08-31T08:28:28,056   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4
2025-08-31T08:28:28,058   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4
2025-08-31T08:28:28,060   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4
2025-08-31T08:28:28,062   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4
2025-08-31T08:28:28,063   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4
2025-08-31T08:28:28,065   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4
2025-08-31T08:28:28,067   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4
2025-08-31T08:28:28,069   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4
2025-08-31T08:28:28,070   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4
2025-08-31T08:28:28,072   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/uhura.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy
2025-08-31T08:28:28,075   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2
2025-08-31T08:28:28,076   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2
2025-08-31T08:28:28,078   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2
2025-08-31T08:28:28,080   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2
2025-08-31T08:28:28,082   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2
2025-08-31T08:28:28,084   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2
2025-08-31T08:28:28,085   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2
2025-08-31T08:28:28,087   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2
2025-08-31T08:28:28,089   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2
2025-08-31T08:28:28,090   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2
2025-08-31T08:28:28,092   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy
2025-08-31T08:28:28,094   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy
2025-08-31T08:28:28,096   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5
2025-08-31T08:28:28,097   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5
2025-08-31T08:28:28,099   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5
2025-08-31T08:28:28,101   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5
2025-08-31T08:28:28,103   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5
2025-08-31T08:28:28,104   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5
2025-08-31T08:28:28,106   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5
2025-08-31T08:28:28,108   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5
2025-08-31T08:28:28,110   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5
2025-08-31T08:28:28,111   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5
2025-08-31T08:28:28,114   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1
2025-08-31T08:28:28,115   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1
2025-08-31T08:28:28,117   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1
2025-08-31T08:28:28,118   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1
2025-08-31T08:28:28,120   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1
2025-08-31T08:28:28,122   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1
2025-08-31T08:28:28,124   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1
2025-08-31T08:28:28,125   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1
2025-08-31T08:28:28,127   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1
2025-08-31T08:28:28,128   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1
2025-08-31T08:28:28,131   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3
2025-08-31T08:28:28,132   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3
2025-08-31T08:28:28,133   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3
2025-08-31T08:28:28,135   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3
2025-08-31T08:28:28,137   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3
2025-08-31T08:28:28,139   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3
2025-08-31T08:28:28,141   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3
2025-08-31T08:28:28,142   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3
2025-08-31T08:28:28,144   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3
2025-08-31T08:28:28,146   copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3
2025-08-31T08:28:28,148   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa
2025-08-31T08:28:28,150   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:28:28,151   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:28:28,153   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:28:28,154   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:28:28,156   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:28:28,158   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:28:28,160   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:28:28,162   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:28:28,163   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:28:28,165   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:28:28,167   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:28:28,169   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4
2025-08-31T08:28:28,170   copying build/lib/lm_eval/tasks/afrobench/afriqa/afriqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa
2025-08-31T08:28:28,173   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:28:28,174   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:28:28,175   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:28:28,177   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:28:28,179   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:28:28,181   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:28:28,182   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:28:28,184   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:28:28,186   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:28:28,187   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:28:28,189   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:28:28,191   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2
2025-08-31T08:28:28,193   copying build/lib/lm_eval/tasks/afrobench/afriqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa
2025-08-31T08:28:28,195   copying build/lib/lm_eval/tasks/afrobench/afriqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa
2025-08-31T08:28:28,198   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:28:28,199   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:28:28,200   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:28:28,202   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:28:28,204   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:28:28,206   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:28:28,208   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:28:28,210   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:28:28,211   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:28:28,214   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:28:28,215   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:28:28,217   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5
2025-08-31T08:28:28,220   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:28:28,221   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:28:28,223   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:28:28,225   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:28:28,227   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:28:28,229   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:28:28,231   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:28:28,233   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:28:28,235   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:28:28,237   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:28:28,239   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:28:28,241   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1
2025-08-31T08:28:28,244   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:28:28,245   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:28:28,248   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:28:28,250   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:28:28,253   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:28:28,255   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:28:28,257   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:28:28,260   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:28:28,262   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:28:28,264   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:28:28,266   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:28:28,268   copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3
2025-08-31T08:28:28,271   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand
2025-08-31T08:28:28,273   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_2
2025-08-31T08:28:28,275   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,277   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_wol-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,279   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_amh-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,282   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_fon-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,284   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_zul-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,286   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_swa-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,288   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,291   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_hau-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,293   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_kin-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,295   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bbj-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,297   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_luo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,299   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_tsn-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,301   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ewe-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,303   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_twi-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,305   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,308   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_mos-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,310   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_lug-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,311   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_sna-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,313   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ibo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,315   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bam-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,317   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_yor-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,319   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_xho-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,321   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_pcm-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,323   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_nya-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english
2025-08-31T08:28:28,326   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,327   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,329   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,331   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,333   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,335   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,337   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,339   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,341   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,343   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,345   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,347   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,349   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,351   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,354   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,356   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,357   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,359   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,361   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,363   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,365   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,367   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,369   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,372   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african
2025-08-31T08:28:28,374   copying build/lib/lm_eval/tasks/afrobench/mafand/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand
2025-08-31T08:28:28,376   copying build/lib/lm_eval/tasks/afrobench/mafand/mafand.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand
2025-08-31T08:28:28,379   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_1
2025-08-31T08:28:28,381   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,382   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_wol-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,385   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_amh-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,387   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_fon-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,389   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_zul-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,390   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_swa-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,392   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,394   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_hau-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,395   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_kin-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,397   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bbj-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,399   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_luo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,401   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_tsn-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,402   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ewe-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,404   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_twi-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,406   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,408   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_mos-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,410   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_lug-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,412   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_sna-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,413   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ibo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,415   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bam-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,417   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_yor-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,419   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_xho-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,421   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_pcm-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,422   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_nya-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english
2025-08-31T08:28:28,425   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,426   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,428   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,429   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,431   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,433   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,434   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,436   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,438   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,439   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,441   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,443   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,445   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,447   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,448   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,450   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,452   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,454   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,456   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,458   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,459   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,461   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,463   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,464   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african
2025-08-31T08:28:28,467   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_3
2025-08-31T08:28:28,468   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,470   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_wol-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,471   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_amh-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,473   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_fon-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,475   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_zul-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,477   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_swa-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,479   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,481   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_hau-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,483   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_kin-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,484   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bbj-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,486   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_luo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,488   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_tsn-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,490   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ewe-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,492   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_twi-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,494   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,497   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_mos-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,498   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_lug-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,500   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_sna-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,502   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ibo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,504   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bam-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,505   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_yor-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,507   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_xho-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,509   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_pcm-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,511   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_nya-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english
2025-08-31T08:28:28,513   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,514   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,516   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,518   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,520   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,522   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,524   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,526   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,527   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,530   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,531   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,533   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,535   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,537   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,539   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,540   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,542   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,543   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,545   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,547   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,549   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,551   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,552   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,554   copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african
2025-08-31T08:28:28,556   copying build/lib/lm_eval/tasks/afrobench/mafand/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand
2025-08-31T08:28:28,558   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sample_run_scripts
2025-08-31T08:28:28,560   copying build/lib/lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench_lite.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sample_run_scripts
2025-08-31T08:28:28,561   copying build/lib/lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sample_run_scripts
2025-08-31T08:28:28,564   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews
2025-08-31T08:28:28,565   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:28:28,567   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:28:28,569   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:28:28,571   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:28:28,572   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:28:28,574   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:28:28,576   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:28:28,577   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:28:28,579   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:28:28,581   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:28:28,582   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:28:28,584   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:28:28,586   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:28:28,588   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:28:28,589   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:28:28,591   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:28:28,593   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:28:28,595   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:28:28,597   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4
2025-08-31T08:28:28,598   copying build/lib/lm_eval/tasks/afrobench/masakhanews/masakhanews.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews
2025-08-31T08:28:28,601   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:28:28,602   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:28:28,604   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:28:28,606   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:28:28,608   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:28:28,609   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:28:28,611   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:28:28,613   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:28:28,615   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:28:28,616   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:28:28,618   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:28:28,620   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:28:28,621   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:28:28,623   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:28:28,624   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:28:28,626   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:28:28,628   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:28:28,630   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:28:28,631   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2
2025-08-31T08:28:28,633   copying build/lib/lm_eval/tasks/afrobench/masakhanews/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews
2025-08-31T08:28:28,636   copying build/lib/lm_eval/tasks/afrobench/masakhanews/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews
2025-08-31T08:28:28,638   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:28:28,639   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:28:28,642   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:28:28,643   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:28:28,646   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:28:28,647   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:28:28,649   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:28:28,651   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:28:28,653   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:28:28,655   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:28:28,657   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:28:28,658   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:28:28,660   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:28:28,662   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:28:28,664   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:28:28,666   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:28:28,667   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:28:28,669   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:28:28,671   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5
2025-08-31T08:28:28,673   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:28:28,674   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:28:28,676   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:28:28,678   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:28:28,680   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:28:28,682   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:28:28,683   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:28:28,685   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:28:28,687   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:28:28,689   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:28:28,691   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:28:28,693   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:28:28,694   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:28:28,696   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:28:28,698   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:28:28,700   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:28:28,701   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:28:28,703   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:28:28,705   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1
2025-08-31T08:28:28,707   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:28:28,708   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:28:28,710   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:28:28,712   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:28:28,714   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:28:28,716   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:28:28,718   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:28:28,720   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:28:28,722   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:28:28,724   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:28:28,725   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:28:28,727   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:28:28,729   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:28:28,732   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:28:28,733   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:28:28,735   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:28:28,737   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:28:28,739   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:28:28,740   copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3
2025-08-31T08:28:28,743   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores
2025-08-31T08:28:28,744   copying build/lib/lm_eval/tasks/afrobench/flores/flores.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores
2025-08-31T08:28:28,746   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_2
2025-08-31T08:28:28,748   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,749   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,751   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,753   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,755   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,757   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,759   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ban_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,760   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,762   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_arz_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,764   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,766   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,768   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,769   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ary_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,771   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,773   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,775   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_acq_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,776   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sot_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,778   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tum_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,780   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,782   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,783   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,785   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lua_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,787   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,789   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,790   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,792   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sag_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,794   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_run_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,796   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,798   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_umb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,800   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,801   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,803   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,805   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_swh_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,807   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_luo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,808   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,810   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,812   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,814   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,815   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lug_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,817   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,819   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sun_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,821   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,822   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kab_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,824   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,826   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,828   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,830   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nus_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,832   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,834   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aka_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,836   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,838   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,839   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,841   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,843   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,844   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,846   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,848   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,849   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_plt_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,851   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,853   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_twi_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,854   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kea_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,856   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,858   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_mos_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,860   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english
2025-08-31T08:28:28,862   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2
2025-08-31T08:28:28,865   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,866   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lug_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,868   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,870   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,871   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,873   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,875   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,876   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ban_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,878   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,880   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sag_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,882   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,883   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-twi_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,885   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,887   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tum_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,889   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,891   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,892   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,894   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,896   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,898   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,900   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,901   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,903   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,905   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,907   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,908   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,910   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lua_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,912   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-acq_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,914   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,916   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-umb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,918   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kab_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,920   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,922   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,924   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,926   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,927   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,929   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kea_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,931   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,933   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,935   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aka_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,937   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,939   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,940   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,942   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,944   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,946   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,948   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-luo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,950   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ary_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,951   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,953   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nus_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,955   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-run_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,957   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,959   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,961   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,962   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sot_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,964   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,966   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,968   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-arz_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,970   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-plt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,972   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,973   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,975   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,977   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-swh_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,979   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-mos_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african
2025-08-31T08:28:28,981   copying build/lib/lm_eval/tasks/afrobench/flores/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores
2025-08-31T08:28:28,983   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_1
2025-08-31T08:28:28,985   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:28,986   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:28,988   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:28,990   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:28,992   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:28,993   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:28,995   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ban_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:28,997   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:28,999   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_arz_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,001   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,002   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,004   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,006   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ary_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,008   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,010   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,011   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_acq_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,013   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sot_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,015   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tum_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,017   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,018   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,020   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,022   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lua_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,024   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,026   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,027   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,029   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sag_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,031   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_run_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,033   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,034   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_umb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,036   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,038   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,040   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,041   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_swh_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,043   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_luo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,045   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,046   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,048   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,049   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,051   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lug_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,053   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,055   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sun_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,057   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,058   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kab_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,060   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,062   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,063   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,065   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nus_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,067   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,069   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aka_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,070   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,072   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,074   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,076   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,077   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,079   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,081   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,082   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,084   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_plt_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,086   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,087   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_twi_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,089   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kea_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,091   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,092   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_mos_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,094   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english
2025-08-31T08:28:29,096   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1
2025-08-31T08:28:29,099   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,100   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lug_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,102   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,104   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,107   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,109   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,111   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,112   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ban_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,114   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,116   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sag_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,117   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,119   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-twi_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,121   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,123   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tum_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,125   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,126   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,128   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,130   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,132   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,134   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,136   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,138   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,140   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,142   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,143   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,145   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,147   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lua_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,148   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-acq_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,150   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,152   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-umb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,154   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kab_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,155   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,158   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,160   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,161   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,163   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,165   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kea_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,167   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,169   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,171   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aka_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,172   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,174   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,177   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,178   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,180   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,181   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,183   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-luo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,185   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ary_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,187   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,188   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nus_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,190   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-run_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,192   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,194   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,196   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,198   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sot_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,199   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,201   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,203   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-arz_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,204   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-plt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,206   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,208   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,210   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,211   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-swh_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,213   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-mos_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african
2025-08-31T08:28:29,215   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_3
2025-08-31T08:28:29,218   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,219   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,221   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,223   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,224   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,226   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,228   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ban_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,230   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,232   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_arz_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,234   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,235   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,237   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,239   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ary_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,241   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,243   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,244   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_acq_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,246   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sot_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,248   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tum_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,249   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,251   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,253   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,254   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lua_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,256   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,258   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,260   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,262   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sag_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,263   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_run_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,265   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,267   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_umb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,268   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,270   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,272   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,274   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_swh_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,276   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_luo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,277   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,279   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,281   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,282   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,284   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lug_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,286   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,287   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sun_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,289   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,291   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kab_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,293   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,295   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,296   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,298   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nus_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,300   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,302   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aka_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,304   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,305   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,307   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,309   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,310   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,312   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,314   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,315   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,317   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_plt_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,319   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,321   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_twi_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,323   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kea_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,324   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,326   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_mos_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,328   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english
2025-08-31T08:28:29,329   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3
2025-08-31T08:28:29,332   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,333   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lug_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,335   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,337   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,339   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,340   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,342   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,344   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ban_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,346   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,347   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sag_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,349   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,351   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-twi_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,353   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,354   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tum_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,356   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,358   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,360   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,362   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,364   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,365   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,367   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,369   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,371   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,373   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,375   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,376   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,378   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lua_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,380   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-acq_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,382   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,384   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-umb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,385   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kab_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,387   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,389   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,391   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,393   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,395   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,397   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kea_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,399   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,401   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,403   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aka_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,404   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,406   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,408   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,410   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,412   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,414   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,416   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-luo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,417   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ary_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,419   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,421   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nus_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,423   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-run_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,424   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,426   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,428   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,430   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sot_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,432   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,433   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,435   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-arz_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,437   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-plt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,439   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,441   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,442   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,444   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-swh_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,446   copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-mos_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african
2025-08-31T08:28:29,448   copying build/lib/lm_eval/tasks/afrobench/flores/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores
2025-08-31T08:28:29,450   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr
2025-08-31T08:28:29,452   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_4
2025-08-31T08:28:29,453   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4
2025-08-31T08:28:29,455   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4
2025-08-31T08:28:29,457   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4
2025-08-31T08:28:29,459   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4
2025-08-31T08:28:29,460   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4
2025-08-31T08:28:29,462   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4
2025-08-31T08:28:29,465   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_2
2025-08-31T08:28:29,466   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2
2025-08-31T08:28:29,468   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2
2025-08-31T08:28:29,470   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2
2025-08-31T08:28:29,471   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2
2025-08-31T08:28:29,473   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2
2025-08-31T08:28:29,475   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2
2025-08-31T08:28:29,477   copying build/lib/lm_eval/tasks/afrobench/adr/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr
2025-08-31T08:28:29,479   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_5
2025-08-31T08:28:29,480   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5
2025-08-31T08:28:29,482   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5
2025-08-31T08:28:29,484   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5
2025-08-31T08:28:29,486   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5
2025-08-31T08:28:29,487   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5
2025-08-31T08:28:29,489   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5
2025-08-31T08:28:29,491   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_1
2025-08-31T08:28:29,492   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1
2025-08-31T08:28:29,494   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1
2025-08-31T08:28:29,496   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1
2025-08-31T08:28:29,498   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1
2025-08-31T08:28:29,499   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1
2025-08-31T08:28:29,501   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1
2025-08-31T08:28:29,504   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_3
2025-08-31T08:28:29,505   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3
2025-08-31T08:28:29,507   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3
2025-08-31T08:28:29,509   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3
2025-08-31T08:28:29,510   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3
2025-08-31T08:28:29,512   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3
2025-08-31T08:28:29,514   copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3
2025-08-31T08:28:29,516   copying build/lib/lm_eval/tasks/afrobench/adr/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr
2025-08-31T08:28:29,518   copying build/lib/lm_eval/tasks/afrobench/adr/afridiacritics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr
2025-08-31T08:28:29,520   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/salt
2025-08-31T08:28:29,522   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:28:29,523   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_lgg-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:28:29,525   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:28:29,527   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:28:29,529   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:28:29,531   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_teo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:28:29,532   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-nyn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:28:29,534   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_swa-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:28:29,536   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_nyn-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:28:29,537   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_ach-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:28:29,539   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lgg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:28:29,541   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:28:29,543   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:28:29,544   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_ibo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:28:29,546   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-teo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:28:29,548   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_lug-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2
2025-08-31T08:28:29,550   copying build/lib/lm_eval/tasks/afrobench/salt/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt
2025-08-31T08:28:29,552   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:28:29,553   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_lgg-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:28:29,555   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:28:29,557   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:28:29,559   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:28:29,561   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_teo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:28:29,562   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-nyn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:28:29,564   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_swa-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:28:29,566   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_nyn-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:28:29,568   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_ach-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:28:29,570   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lgg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:28:29,571   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:28:29,573   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:28:29,575   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_ibo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:28:29,577   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-teo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:28:29,578   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_lug-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1
2025-08-31T08:28:29,580   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:28:29,582   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_lgg-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:28:29,584   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:28:29,585   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:28:29,587   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:28:29,589   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_teo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:28:29,591   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-nyn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:28:29,593   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_swa-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:28:29,595   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_nyn-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:28:29,597   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_ach-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:28:29,598   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lgg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:28:29,600   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:28:29,602   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:28:29,604   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_ibo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:28:29,606   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-teo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:28:29,608   copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_lug-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3
2025-08-31T08:28:29,609   copying build/lib/lm_eval/tasks/afrobench/salt/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt
2025-08-31T08:28:29,611   copying build/lib/lm_eval/tasks/afrobench/salt/salt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt
2025-08-31T08:28:29,614   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele
2025-08-31T08:28:29,616   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,617   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,619   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,621   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,623   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,624   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,627   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,628   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,630   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,632   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,633   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,635   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,637   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,639   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,640   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,642   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,644   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,646   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,648   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,649   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,651   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,653   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,655   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,656   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,658   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,660   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,662   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,663   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,665   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,667   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,669   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,670   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,672   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4
2025-08-31T08:28:29,675   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,676   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,678   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,679   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,681   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,683   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,685   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,687   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,689   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,690   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,692   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,694   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,696   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,698   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,700   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,701   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,703   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,705   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,706   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,708   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,710   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,711   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,713   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,715   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,717   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,718   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,720   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,722   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,724   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,726   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,728   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,729   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,731   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2
2025-08-31T08:28:29,733   copying build/lib/lm_eval/tasks/afrobench/belebele/belebele.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele
2025-08-31T08:28:29,735   copying build/lib/lm_eval/tasks/afrobench/belebele/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele
2025-08-31T08:28:29,737   copying build/lib/lm_eval/tasks/afrobench/belebele/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele
2025-08-31T08:28:29,740   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,741   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,743   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,744   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,746   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,748   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,750   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,752   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,754   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,755   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,757   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,759   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,761   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,763   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,765   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,767   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,769   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,771   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,772   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,774   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,776   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,778   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,781   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,783   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,785   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,787   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,788   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,790   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,792   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,794   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,796   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,798   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,799   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5
2025-08-31T08:28:29,802   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,803   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,806   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,807   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,809   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,811   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,813   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,815   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,817   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,819   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,821   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,823   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,824   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,826   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,828   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,830   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,832   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,833   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,835   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,837   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,839   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,840   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,842   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,843   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,845   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,847   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,849   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,851   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,853   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,854   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,856   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,858   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,859   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1
2025-08-31T08:28:29,862   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,863   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,865   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,867   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,869   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,870   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,872   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,874   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,875   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,877   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,879   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,880   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,882   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,884   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,886   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,888   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,890   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,891   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,893   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,895   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,897   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,898   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,900   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,902   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,904   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,906   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,907   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,909   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,911   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,912   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,914   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,916   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,917   copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3
2025-08-31T08:28:29,920   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib
2025-08-31T08:28:29,922   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,923   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,925   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,927   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,928   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,930   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,932   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,934   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,936   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,937   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,939   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,941   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,943   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,945   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,946   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,948   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,950   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,952   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,954   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,955   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,957   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,959   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,960   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,962   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,964   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,966   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,967   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,969   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,971   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,973   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,974   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,976   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,978   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,980   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,982   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,984   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,986   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,988   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,989   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,992   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,993   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,995   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,997   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:29,999   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:30,000   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:30,002   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:30,004   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:30,006   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:30,007   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:30,010   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:30,012   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:30,013   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:30,016   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:30,018   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:30,019   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:30,021   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:30,023   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:30,025   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:30,027   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4
2025-08-31T08:28:30,029   copying build/lib/lm_eval/tasks/afrobench/sib/sib.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib
2025-08-31T08:28:30,033   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,034   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,036   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,038   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,040   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,042   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,044   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,046   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,048   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,050   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,052   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,054   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,056   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,057   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,059   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,061   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,062   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,064   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,066   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,067   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,069   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,071   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,073   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,075   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,076   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,078   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,080   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,082   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,083   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,085   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,087   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,089   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,090   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,092   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,094   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,095   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,097   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,099   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,101   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,102   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,104   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,106   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,108   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,109   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,111   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,113   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,114   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,116   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,118   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,121   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,123   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,124   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,126   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,128   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,130   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,132   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,134   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,135   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,137   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2
2025-08-31T08:28:30,138   copying build/lib/lm_eval/tasks/afrobench/sib/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib
2025-08-31T08:28:30,140   copying build/lib/lm_eval/tasks/afrobench/sib/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib
2025-08-31T08:28:30,144   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,145   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,147   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,149   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,150   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,152   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,154   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,156   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,157   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,159   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,161   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,163   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,164   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,166   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,168   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,170   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,172   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,174   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,175   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,177   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,179   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,181   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,182   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,184   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,186   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,188   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,189   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,191   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,193   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,195   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,197   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,198   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,200   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,202   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,204   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,206   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,208   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,209   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,211   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,213   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,215   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,217   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,219   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,221   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,222   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,224   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,226   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,228   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,230   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,231   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,233   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,235   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,237   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,238   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,240   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,242   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,244   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,246   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,248   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5
2025-08-31T08:28:30,251   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,252   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,254   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,256   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,258   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,260   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,262   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,264   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,266   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,267   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,270   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,271   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,273   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,275   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,277   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,278   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,280   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,282   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,283   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,285   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,287   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,289   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,290   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,292   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,294   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,296   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,297   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,299   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,300   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,302   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,304   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,306   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,307   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,309   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,311   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,313   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,315   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,316   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,318   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,319   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,321   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,323   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,324   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,326   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,328   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,330   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,331   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,333   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,335   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,337   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,338   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,340   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,342   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,343   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,345   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,347   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,349   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,351   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,353   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1
2025-08-31T08:28:30,356   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,357   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,359   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,361   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,363   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,364   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,366   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,368   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,370   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,371   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,373   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,375   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,376   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,378   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,380   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,382   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,384   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,385   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,387   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,389   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,391   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,393   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,394   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,396   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,398   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,400   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,402   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,403   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,405   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,406   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,408   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,410   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,412   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,413   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,415   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,417   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,418   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,420   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,422   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,423   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,425   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,427   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,429   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,430   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,432   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,434   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,436   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,437   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,439   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,441   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,443   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,445   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,447   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,449   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,451   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,453   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,454   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,456   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,458   copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3
2025-08-31T08:28:30,460   copying build/lib/lm_eval/tasks/afrobench/afrobench-lite.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench
2025-08-31T08:28:30,462   copying build/lib/lm_eval/tasks/afrobench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench
2025-08-31T08:28:30,465   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu
2025-08-31T08:28:30,466   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/openai_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu
2025-08-31T08:28:30,469   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_4
2025-08-31T08:28:30,470   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_4
2025-08-31T08:28:30,472   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_4
2025-08-31T08:28:30,474   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_4
2025-08-31T08:28:30,476   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_4
2025-08-31T08:28:30,478   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_2
2025-08-31T08:28:30,479   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_2
2025-08-31T08:28:30,481   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_2
2025-08-31T08:28:30,483   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_2
2025-08-31T08:28:30,485   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_2
2025-08-31T08:28:30,487   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu
2025-08-31T08:28:30,489   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu
2025-08-31T08:28:30,491   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_5
2025-08-31T08:28:30,492   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_5
2025-08-31T08:28:30,494   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_5
2025-08-31T08:28:30,496   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_5
2025-08-31T08:28:30,497   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_5
2025-08-31T08:28:30,500   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_1
2025-08-31T08:28:30,501   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_1
2025-08-31T08:28:30,502   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_1
2025-08-31T08:28:30,504   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_1
2025-08-31T08:28:30,506   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_1
2025-08-31T08:28:30,508   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_3
2025-08-31T08:28:30,509   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_3
2025-08-31T08:28:30,511   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_3
2025-08-31T08:28:30,513   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_3
2025-08-31T08:28:30,515   copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_3
2025-08-31T08:28:30,517   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner
2025-08-31T08:28:30,519   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,520   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,522   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,524   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,526   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,527   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,529   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,531   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,533   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,534   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,536   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,538   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,540   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,542   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,543   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,545   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,547   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,549   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,550   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,552   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,554   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,556   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,557   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4
2025-08-31T08:28:30,560   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,561   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,564   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,567   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,569   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,572   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,575   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,578   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,580   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,582   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,585   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,587   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,589   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,592   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,594   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,597   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,599   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,601   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,604   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,606   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,609   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,611   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,614   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2
2025-08-31T08:28:30,616   copying build/lib/lm_eval/tasks/afrobench/masakhaner/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner
2025-08-31T08:28:30,619   copying build/lib/lm_eval/tasks/afrobench/masakhaner/masakhaner.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner
2025-08-31T08:28:30,623   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,624   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,627   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,629   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,632   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,634   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,636   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,638   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,640   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,643   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,645   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,647   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,650   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,653   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,656   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,658   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,661   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,662   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,665   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,667   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,669   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,671   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,672   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5
2025-08-31T08:28:30,675   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,677   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,679   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,681   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,682   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,684   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,686   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,688   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,690   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,692   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,694   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,696   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,698   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,700   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,702   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,704   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,707   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,709   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,710   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,712   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,714   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,716   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,718   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1
2025-08-31T08:28:30,720   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,721   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,723   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,726   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,728   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,729   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,731   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,733   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,735   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,737   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,739   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,741   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,742   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,745   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,747   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,748   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,750   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,752   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,754   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,756   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,758   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,760   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,762   copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3
2025-08-31T08:28:30,764   copying build/lib/lm_eval/tasks/afrobench/masakhaner/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner
2025-08-31T08:28:30,767   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc
2025-08-31T08:28:30,769   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_4
2025-08-31T08:28:30,770   copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_4
2025-08-31T08:28:30,772   copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_4
2025-08-31T08:28:30,774   copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_4
2025-08-31T08:28:30,776   copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_4
2025-08-31T08:28:30,778   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_2
2025-08-31T08:28:30,779   copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_2
2025-08-31T08:28:30,782   copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_2
2025-08-31T08:28:30,784   copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_2
2025-08-31T08:28:30,786   copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_2
2025-08-31T08:28:30,787   copying build/lib/lm_eval/tasks/afrobench/naijarc/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc
2025-08-31T08:28:30,789   copying build/lib/lm_eval/tasks/afrobench/naijarc/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc
2025-08-31T08:28:30,791   copying build/lib/lm_eval/tasks/afrobench/naijarc/naijarc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc
2025-08-31T08:28:30,793   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_5
2025-08-31T08:28:30,794   copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_5
2025-08-31T08:28:30,797   copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_5
2025-08-31T08:28:30,799   copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_5
2025-08-31T08:28:30,801   copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_5
2025-08-31T08:28:30,803   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_1
2025-08-31T08:28:30,804   copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_1
2025-08-31T08:28:30,806   copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_1
2025-08-31T08:28:30,808   copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_1
2025-08-31T08:28:30,810   copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_1
2025-08-31T08:28:30,812   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_3
2025-08-31T08:28:30,814   copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_3
2025-08-31T08:28:30,816   copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_3
2025-08-31T08:28:30,818   copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_3
2025-08-31T08:28:30,820   copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_3
2025-08-31T08:28:30,822   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex
2025-08-31T08:28:30,823   copying build/lib/lm_eval/tasks/afrobench/ntrex/ntrex.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex
2025-08-31T08:28:30,826   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_2
2025-08-31T08:28:30,828   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,829   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,831   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,833   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,834   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,836   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,838   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,840   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,842   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,844   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,845   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,847   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,849   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,851   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,853   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,855   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,856   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,859   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,860   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,862   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,864   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,866   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,868   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,869   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,872   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,874   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,876   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,878   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,880   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,882   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,884   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,886   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,888   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,889   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english
2025-08-31T08:28:30,892   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,894   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,896   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,898   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,899   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,901   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,903   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,905   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,907   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,909   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,911   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,913   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,914   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,916   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,918   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,920   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,922   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,924   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,926   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,928   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,930   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,932   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,934   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,936   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,937   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,939   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,941   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,943   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,944   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,946   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,948   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,950   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,952   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,954   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african
2025-08-31T08:28:30,956   copying build/lib/lm_eval/tasks/afrobench/ntrex/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex
2025-08-31T08:28:30,959   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_1
2025-08-31T08:28:30,961   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:30,962   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:30,964   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:30,966   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:30,967   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:30,969   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:30,971   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:30,973   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:30,974   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:30,976   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:30,977   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:30,979   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:30,981   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:30,982   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:30,984   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:30,986   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:30,988   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:30,989   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:30,991   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:30,993   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:30,995   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:30,996   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:30,998   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:31,000   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:31,002   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:31,003   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:31,005   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:31,007   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:31,008   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:31,010   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:31,012   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:31,013   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:31,015   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:31,017   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english
2025-08-31T08:28:31,020   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,021   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,023   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,024   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,026   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,028   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,030   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,031   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,033   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,035   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,037   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,038   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,040   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,042   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,043   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,045   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,047   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,049   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,050   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,052   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,054   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,055   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,057   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,059   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,061   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,062   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,064   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,066   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,068   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,069   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,071   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,072   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,074   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,076   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african
2025-08-31T08:28:31,078   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_3
2025-08-31T08:28:31,080   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,081   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,083   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,084   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,086   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,088   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,090   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,091   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,093   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,095   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,097   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,098   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,100   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,102   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,104   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,106   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,108   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,109   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,111   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,113   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,115   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,117   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,119   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,121   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,124   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,126   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,128   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,130   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,132   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,134   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,136   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,138   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,140   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,142   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english
2025-08-31T08:28:31,144   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,145   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,147   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,149   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,151   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,152   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,154   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,156   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,157   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,159   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,161   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,163   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,164   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,166   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,168   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,170   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,172   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,173   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,175   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,176   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,178   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,180   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,181   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,183   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,185   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,187   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,189   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,190   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,192   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,194   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,195   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,197   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,199   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,201   copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african
2025-08-31T08:28:31,202   copying build/lib/lm_eval/tasks/afrobench/ntrex/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex
2025-08-31T08:28:31,205   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos
2025-08-31T08:28:31,207   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,208   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,210   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,212   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,213   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,215   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,217   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,218   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,220   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,221   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,223   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,225   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,227   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,229   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,231   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,232   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,234   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,236   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,238   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,239   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,241   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,243   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,245   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4
2025-08-31T08:28:31,246   copying build/lib/lm_eval/tasks/afrobench/masakhapos/masakhapos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos
2025-08-31T08:28:31,249   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,250   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,251   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,253   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,255   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,257   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,258   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,260   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,262   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,263   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,265   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,267   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,269   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,270   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,272   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,274   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,276   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,278   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,279   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,281   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,283   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,284   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,286   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2
2025-08-31T08:28:31,288   copying build/lib/lm_eval/tasks/afrobench/masakhapos/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos
2025-08-31T08:28:31,289   copying build/lib/lm_eval/tasks/afrobench/masakhapos/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos
2025-08-31T08:28:31,292   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,293   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,294   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,296   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,298   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,300   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,302   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,304   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,306   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,307   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,309   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,311   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,313   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,316   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,317   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,319   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,321   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,323   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,325   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,327   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,329   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,331   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,333   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5
2025-08-31T08:28:31,336   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,337   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,339   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,341   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,342   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,344   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,346   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,348   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,349   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,351   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,353   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,354   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,356   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,358   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,360   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,362   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,364   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,366   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,368   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,371   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,373   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,375   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,377   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1
2025-08-31T08:28:31,380   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,381   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,384   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,386   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,388   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,390   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,392   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,395   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,397   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,399   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,401   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,404   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,406   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,408   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,411   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,413   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,415   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,417   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,420   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,422   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,424   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,426   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,428   copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3
2025-08-31T08:28:31,431   copying build/lib/lm_eval/tasks/afrobench/masakhapos/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos
2025-08-31T08:28:31,434   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti
2025-08-31T08:28:31,436   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_4
2025-08-31T08:28:31,437   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4
2025-08-31T08:28:31,440   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4
2025-08-31T08:28:31,442   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4
2025-08-31T08:28:31,444   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4
2025-08-31T08:28:31,446   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4
2025-08-31T08:28:31,449   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4
2025-08-31T08:28:31,451   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4
2025-08-31T08:28:31,454   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_2
2025-08-31T08:28:31,455   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2
2025-08-31T08:28:31,458   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2
2025-08-31T08:28:31,460   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2
2025-08-31T08:28:31,462   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2
2025-08-31T08:28:31,464   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2
2025-08-31T08:28:31,466   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2
2025-08-31T08:28:31,468   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2
2025-08-31T08:28:31,469   copying build/lib/lm_eval/tasks/afrobench/nollysenti/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti
2025-08-31T08:28:31,471   copying build/lib/lm_eval/tasks/afrobench/nollysenti/nollysenti.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti
2025-08-31T08:28:31,473   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_5
2025-08-31T08:28:31,474   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5
2025-08-31T08:28:31,476   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5
2025-08-31T08:28:31,478   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5
2025-08-31T08:28:31,480   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5
2025-08-31T08:28:31,482   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5
2025-08-31T08:28:31,483   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5
2025-08-31T08:28:31,485   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5
2025-08-31T08:28:31,487   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_1
2025-08-31T08:28:31,488   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1
2025-08-31T08:28:31,490   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1
2025-08-31T08:28:31,492   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1
2025-08-31T08:28:31,493   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1
2025-08-31T08:28:31,495   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1
2025-08-31T08:28:31,497   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1
2025-08-31T08:28:31,499   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1
2025-08-31T08:28:31,501   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_3
2025-08-31T08:28:31,502   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3
2025-08-31T08:28:31,505   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3
2025-08-31T08:28:31,506   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3
2025-08-31T08:28:31,508   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3
2025-08-31T08:28:31,510   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3
2025-08-31T08:28:31,511   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3
2025-08-31T08:28:31,513   copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3
2025-08-31T08:28:31,515   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/xlsum
2025-08-31T08:28:31,516   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:28:31,517   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_tigrinya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:28:31,519   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:28:31,521   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_hausa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:28:31,523   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_yoruba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:28:31,525   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_amharic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:28:31,527   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_igbo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:28:31,528   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:28:31,530   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_kirundi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:28:31,532   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_swahili.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:28:31,534   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_oromo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:28:31,536   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:28:31,537   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:28:31,539   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_pidgin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:28:31,541   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_somali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2
2025-08-31T08:28:31,543   copying build/lib/lm_eval/tasks/afrobench/xlsum/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum
2025-08-31T08:28:31,545   copying build/lib/lm_eval/tasks/afrobench/xlsum/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum
2025-08-31T08:28:31,547   copying build/lib/lm_eval/tasks/afrobench/xlsum/xlsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum
2025-08-31T08:28:31,550   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:28:31,551   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_tigrinya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:28:31,553   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:28:31,554   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_hausa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:28:31,556   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_yoruba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:28:31,558   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_amharic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:28:31,560   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_igbo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:28:31,562   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:28:31,563   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_kirundi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:28:31,565   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_swahili.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:28:31,567   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_oromo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:28:31,569   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:28:31,571   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:28:31,572   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_pidgin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:28:31,574   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_somali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1
2025-08-31T08:28:31,577   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:28:31,578   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_tigrinya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:28:31,580   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:28:31,582   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_hausa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:28:31,584   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_yoruba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:28:31,586   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_amharic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:28:31,587   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_igbo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:28:31,589   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:28:31,591   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_kirundi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:28:31,592   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_swahili.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:28:31,594   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_oromo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:28:31,596   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:28:31,598   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:28:31,599   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_pidgin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:28:31,601   copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_somali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3
2025-08-31T08:28:31,604   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti
2025-08-31T08:28:31,605   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:28:31,606   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:28:31,608   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:28:31,610   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:28:31,611   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:28:31,613   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:28:31,615   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:28:31,617   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:28:31,618   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:28:31,620   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:28:31,622   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:28:31,624   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:28:31,626   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:28:31,628   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:28:31,630   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:28:31,631   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:28:31,633   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:28:31,635   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4
2025-08-31T08:28:31,637   copying build/lib/lm_eval/tasks/afrobench/afrisenti/afrisenti.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti
2025-08-31T08:28:31,639   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:28:31,640   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:28:31,642   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:28:31,644   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:28:31,646   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:28:31,647   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:28:31,649   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:28:31,650   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:28:31,652   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:28:31,654   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:28:31,656   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:28:31,657   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:28:31,659   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:28:31,661   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:28:31,662   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:28:31,664   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:28:31,666   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/run.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:28:31,668   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:28:31,669   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2
2025-08-31T08:28:31,671   copying build/lib/lm_eval/tasks/afrobench/afrisenti/fewshot.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti
2025-08-31T08:28:31,673   copying build/lib/lm_eval/tasks/afrobench/afrisenti/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti
2025-08-31T08:28:31,676   copying build/lib/lm_eval/tasks/afrobench/afrisenti/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti
2025-08-31T08:28:31,679   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:28:31,680   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:28:31,681   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:28:31,683   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:28:31,685   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:28:31,686   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:28:31,688   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:28:31,690   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:28:31,691   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:28:31,693   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:28:31,695   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:28:31,696   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:28:31,698   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:28:31,700   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:28:31,702   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:28:31,703   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:28:31,705   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:28:31,707   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5
2025-08-31T08:28:31,709   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:28:31,710   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:28:31,712   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:28:31,714   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:28:31,716   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:28:31,718   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:28:31,719   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:28:31,721   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:28:31,723   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:28:31,725   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:28:31,727   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:28:31,728   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:28:31,730   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:28:31,732   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:28:31,733   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:28:31,735   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:28:31,737   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/run.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:28:31,739   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:28:31,741   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1
2025-08-31T08:28:31,744   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:28:31,745   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:28:31,746   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:28:31,748   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:28:31,750   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:28:31,752   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:28:31,754   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:28:31,756   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:28:31,758   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:28:31,759   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:28:31,761   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:28:31,763   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:28:31,764   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:28:31,766   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:28:31,768   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:28:31,769   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:28:31,771   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:28:31,773   copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3
2025-08-31T08:28:31,776   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent
2025-08-31T08:28:31,778   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:28:31,779   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:28:31,781   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:28:31,783   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:28:31,784   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:28:31,786   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:28:31,788   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:28:31,790   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:28:31,791   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:28:31,793   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:28:31,795   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:28:31,797   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:28:31,799   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:28:31,800   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:28:31,802   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:28:31,804   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:28:31,806   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:28:31,808   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:28:31,809   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:28:31,811   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4
2025-08-31T08:28:31,814   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:28:31,815   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:28:31,818   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:28:31,819   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:28:31,821   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:28:31,823   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:28:31,825   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:28:31,826   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:28:31,828   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:28:31,830   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:28:31,831   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:28:31,833   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:28:31,835   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:28:31,837   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:28:31,839   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:28:31,840   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:28:31,842   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:28:31,844   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:28:31,845   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:28:31,847   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2
2025-08-31T08:28:31,849   copying build/lib/lm_eval/tasks/afrobench/injongointent/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent
2025-08-31T08:28:31,851   copying build/lib/lm_eval/tasks/afrobench/injongointent/injongointent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent
2025-08-31T08:28:31,853   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:28:31,855   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:28:31,856   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:28:31,858   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:28:31,861   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:28:31,862   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:28:31,864   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:28:31,866   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:28:31,868   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:28:31,869   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:28:31,871   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:28:31,873   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:28:31,875   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:28:31,877   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:28:31,878   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:28:31,880   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:28:31,882   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:28:31,883   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:28:31,885   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:28:31,887   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5
2025-08-31T08:28:31,889   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:28:31,890   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:28:31,892   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:28:31,894   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:28:31,896   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:28:31,898   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:28:31,899   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:28:31,901   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:28:31,903   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:28:31,904   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:28:31,906   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:28:31,908   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:28:31,909   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:28:31,911   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:28:31,913   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:28:31,915   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:28:31,917   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:28:31,918   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:28:31,920   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:28:31,921   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1
2025-08-31T08:28:31,924   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:28:31,925   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:28:31,926   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:28:31,928   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:28:31,930   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:28:31,932   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:28:31,933   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:28:31,935   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:28:31,937   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:28:31,939   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:28:31,940   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:28:31,942   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:28:31,944   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:28:31,945   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:28:31,947   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:28:31,949   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:28:31,951   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:28:31,952   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:28:31,954   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:28:31,956   copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3
2025-08-31T08:28:31,958   copying build/lib/lm_eval/tasks/afrobench/injongointent/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent
2025-08-31T08:28:31,961   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/polemo2
2025-08-31T08:28:31,962   copying build/lib/lm_eval/tasks/polemo2/polemo2_in.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/polemo2
2025-08-31T08:28:31,964   copying build/lib/lm_eval/tasks/polemo2/polemo2_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/polemo2
2025-08-31T08:28:31,965   copying build/lib/lm_eval/tasks/polemo2/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/polemo2
2025-08-31T08:28:31,968   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wsc273
2025-08-31T08:28:31,968   copying build/lib/lm_eval/tasks/wsc273/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wsc273
2025-08-31T08:28:31,970   copying build/lib/lm_eval/tasks/wsc273/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wsc273
2025-08-31T08:28:31,972   copying build/lib/lm_eval/tasks/wsc273/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wsc273
2025-08-31T08:28:31,974   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/c4
2025-08-31T08:28:31,975   copying build/lib/lm_eval/tasks/c4/preprocess_c4.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/c4
2025-08-31T08:28:31,977   copying build/lib/lm_eval/tasks/c4/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/c4
2025-08-31T08:28:31,979   copying build/lib/lm_eval/tasks/c4/c4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/c4
2025-08-31T08:28:31,982   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/humaneval
2025-08-31T08:28:31,983   copying build/lib/lm_eval/tasks/humaneval/humaneval_64.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval
2025-08-31T08:28:31,984   copying build/lib/lm_eval/tasks/humaneval/humaneval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval
2025-08-31T08:28:31,986   copying build/lib/lm_eval/tasks/humaneval/humaneval_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval
2025-08-31T08:28:31,988   copying build/lib/lm_eval/tasks/humaneval/humaneval_64_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval
2025-08-31T08:28:31,989   copying build/lib/lm_eval/tasks/humaneval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval
2025-08-31T08:28:31,991   copying build/lib/lm_eval/tasks/humaneval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval
2025-08-31T08:28:31,993   copying build/lib/lm_eval/tasks/humaneval/humaneval_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval
2025-08-31T08:28:31,996   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_proficiency
2025-08-31T08:28:31,997   copying build/lib/lm_eval/tasks/eus_proficiency/eus_proficiency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_proficiency
2025-08-31T08:28:31,999   copying build/lib/lm_eval/tasks/eus_proficiency/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_proficiency
2025-08-31T08:28:32,002   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/multiblimp
2025-08-31T08:28:32,003   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,006   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_frm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,007   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,009   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_wbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,011   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_urb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,012   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fas.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,014   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,016   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_arb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,017   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_sms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,019   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_pol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,021   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_lit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,023   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_aln.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,024   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_olo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,026   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_lat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,028   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,029   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_tpn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,031   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hsb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,033   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_uzb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,034   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,036   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_yrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,038   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,039   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,041   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_xcl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,043   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_orv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,044   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kmr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,046   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_gla.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,048   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kxh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,050   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_aqz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,052   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_grc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,053   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_isl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,055   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hyw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,057   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_krl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,059   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,060   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_nhi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,062   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_lav.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,064   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_sme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,066   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_mdf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,067   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_apu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,069   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_uig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,071   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,072   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ita.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,074   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_got.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,076   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,078   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kpv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,079   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_xpg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,081   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_xnr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,083   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bel.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,085   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_est.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,087   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_koi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,088   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_sqi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,090   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hye.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,092   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,094   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,095   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_rus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,097   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_swe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,099   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_chu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,100   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_abk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,102   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ttc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,104   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hun.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,106   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bre.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,108   copying build/lib/lm_eval/tasks/multiblimp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,110   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,111   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_heb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,113   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_glg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,115   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_azz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,116   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_vep.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,118   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_cat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,120   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,121   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ces.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,123   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_guj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,125   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_myv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,127   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_gle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,129   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ron.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,131   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,132   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_slk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,134   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hbo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,136   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,137   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_nld.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,139   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_quc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,141   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_tam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,142   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ell.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,144   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_mkd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,146   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_nds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,148   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,150   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,152   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_sah.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,154   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_urd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,155   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,157   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_mar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,158   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ota.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,160   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ukr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,162   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,163   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_spa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,165   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_dan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,167   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_tur.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,168   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_slv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,170   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_deu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,172   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ben.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,174   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_lij.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,176   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_cym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,178   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_eus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,179   copying build/lib/lm_eval/tasks/multiblimp/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,181   copying build/lib/lm_eval/tasks/multiblimp/multiblimp_san.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp
2025-08-31T08:28:32,183   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/coqa
2025-08-31T08:28:32,184   copying build/lib/lm_eval/tasks/coqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/coqa
2025-08-31T08:28:32,186   copying build/lib/lm_eval/tasks/coqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/coqa
2025-08-31T08:28:32,188   copying build/lib/lm_eval/tasks/coqa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/coqa
2025-08-31T08:28:32,190   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score
2025-08-31T08:28:32,192   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,193   copying build/lib/lm_eval/tasks/score/agi_eval/score_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,195   copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,197   copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lsat_rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,199   copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_logiqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,201   copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,202   copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,204   copying build/lib/lm_eval/tasks/score/agi_eval/score_non_greedy_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,206   copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,208   copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,209   copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,211   copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,213   copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,214   copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,216   copying build/lib/lm_eval/tasks/score/agi_eval/prompt_templates.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,218   copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_aqua_rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,220   copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_aqua_rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,222   copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,224   copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_logiqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,225   copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,227   copying build/lib/lm_eval/tasks/score/agi_eval/score_option_order_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,229   copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,230   copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_aqua_rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,232   copying build/lib/lm_eval/tasks/score/agi_eval/score_prompt_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,234   copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_logiqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,236   copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,238   copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lsat_rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,240   copying build/lib/lm_eval/tasks/score/agi_eval/utils_agieval.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval
2025-08-31T08:28:32,242   copying build/lib/lm_eval/tasks/score/NON_GREEDY.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score
2025-08-31T08:28:32,244   copying build/lib/lm_eval/tasks/score/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score
2025-08-31T08:28:32,246   copying build/lib/lm_eval/tasks/score/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score
2025-08-31T08:28:32,248   copying build/lib/lm_eval/tasks/score/non_greedy_summarizer.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score
2025-08-31T08:28:32,250   copying build/lib/lm_eval/tasks/score/score_robustness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score
2025-08-31T08:28:32,252   copying build/lib/lm_eval/tasks/score/non_greedy.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score
2025-08-31T08:28:32,254   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score/mmlu_pro
2025-08-31T08:28:32,255   copying build/lib/lm_eval/tasks/score/mmlu_pro/score_prompt_robustness_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro
2025-08-31T08:28:32,257   copying build/lib/lm_eval/tasks/score/mmlu_pro/score_non_greedy_robustness_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro
2025-08-31T08:28:32,259   copying build/lib/lm_eval/tasks/score/mmlu_pro/score_option_order_robustness_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro
2025-08-31T08:28:32,261   copying build/lib/lm_eval/tasks/score/mmlu_pro/prompt_templates.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro
2025-08-31T08:28:32,263   copying build/lib/lm_eval/tasks/score/mmlu_pro/utils_mmlu_pro.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro
2025-08-31T08:28:32,266   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score/math
2025-08-31T08:28:32,267   copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math
2025-08-31T08:28:32,269   copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math
2025-08-31T08:28:32,271   copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math
2025-08-31T08:28:32,273   copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math
2025-08-31T08:28:32,275   copying build/lib/lm_eval/tasks/score/math/to_be_fixed_questions.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math
2025-08-31T08:28:32,277   copying build/lib/lm_eval/tasks/score/math/prompt_templates.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math
2025-08-31T08:28:32,278   copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math
2025-08-31T08:28:32,280   copying build/lib/lm_eval/tasks/score/math/score_non_greedy_robustness_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math
2025-08-31T08:28:32,282   copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math
2025-08-31T08:28:32,284   copying build/lib/lm_eval/tasks/score/math/utils_math.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math
2025-08-31T08:28:32,286   copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math
2025-08-31T08:28:32,288   copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math
2025-08-31T08:28:32,289   copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math
2025-08-31T08:28:32,291   copying build/lib/lm_eval/tasks/score/math/math_grader.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math
2025-08-31T08:28:32,294   copying build/lib/lm_eval/tasks/score/math/score_prompt_robustness_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math
2025-08-31T08:28:32,295   copying build/lib/lm_eval/tasks/score/math/score_robustness_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math
2025-08-31T08:28:32,297   copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math
2025-08-31T08:28:32,299   copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math
2025-08-31T08:28:32,301   copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math
2025-08-31T08:28:32,303   copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math
2025-08-31T08:28:32,304   copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math
2025-08-31T08:28:32,307   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/paloma
2025-08-31T08:28:32,308   copying build/lib/lm_eval/tasks/paloma/paloma_c4_100_domains.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma
2025-08-31T08:28:32,310   copying build/lib/lm_eval/tasks/paloma/paloma_m2d2_s2orc_unsplit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma
2025-08-31T08:28:32,311   copying build/lib/lm_eval/tasks/paloma/paloma_falcon-refinedweb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma
2025-08-31T08:28:32,313   copying build/lib/lm_eval/tasks/paloma/paloma_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma
2025-08-31T08:28:32,315   copying build/lib/lm_eval/tasks/paloma/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma
2025-08-31T08:28:32,317   copying build/lib/lm_eval/tasks/paloma/paloma_c4_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma
2025-08-31T08:28:32,318   copying build/lib/lm_eval/tasks/paloma/paloma_dolma_100_programing_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma
2025-08-31T08:28:32,320   copying build/lib/lm_eval/tasks/paloma/paloma_redpajama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma
2025-08-31T08:28:32,322   copying build/lib/lm_eval/tasks/paloma/paloma_dolma-v1_5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma
2025-08-31T08:28:32,324   copying build/lib/lm_eval/tasks/paloma/paloma_gab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma
2025-08-31T08:28:32,326   copying build/lib/lm_eval/tasks/paloma/paloma_mc4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma
2025-08-31T08:28:32,327   copying build/lib/lm_eval/tasks/paloma/paloma_dolma_100_subreddits.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma
2025-08-31T08:28:32,329   copying build/lib/lm_eval/tasks/paloma/_paloma_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma
2025-08-31T08:28:32,330   copying build/lib/lm_eval/tasks/paloma/paloma_twitterAAE_HELM_fixed.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma
2025-08-31T08:28:32,332   copying build/lib/lm_eval/tasks/paloma/paloma_manosphere_meta_sep.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma
2025-08-31T08:28:32,334   copying build/lib/lm_eval/tasks/paloma/paloma_4chan_meta_sep.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma
2025-08-31T08:28:32,336   copying build/lib/lm_eval/tasks/paloma/paloma_m2d2_wikipedia_unsplit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma
2025-08-31T08:28:32,337   copying build/lib/lm_eval/tasks/paloma/paloma_ptb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma
2025-08-31T08:28:32,339   copying build/lib/lm_eval/tasks/paloma/paloma_wikitext_103.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma
2025-08-31T08:28:32,341   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/storycloze
2025-08-31T08:28:32,342   copying build/lib/lm_eval/tasks/storycloze/storycloze_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/storycloze
2025-08-31T08:28:32,344   copying build/lib/lm_eval/tasks/storycloze/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/storycloze
2025-08-31T08:28:32,347   copying build/lib/lm_eval/tasks/storycloze/storycloze_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/storycloze
2025-08-31T08:28:32,349   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/olaph
2025-08-31T08:28:32,350   copying build/lib/lm_eval/tasks/olaph/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph
2025-08-31T08:28:32,351   copying build/lib/lm_eval/tasks/olaph/olaph_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph
2025-08-31T08:28:32,353   copying build/lib/lm_eval/tasks/olaph/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph
2025-08-31T08:28:32,355   copying build/lib/lm_eval/tasks/olaph/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph
2025-08-31T08:28:32,356   copying build/lib/lm_eval/tasks/olaph/olaph.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph
2025-08-31T08:28:32,359   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xcopa
2025-08-31T08:28:32,359   copying build/lib/lm_eval/tasks/xcopa/default_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa
2025-08-31T08:28:32,361   copying build/lib/lm_eval/tasks/xcopa/default_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa
2025-08-31T08:28:32,363   copying build/lib/lm_eval/tasks/xcopa/default_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa
2025-08-31T08:28:32,365   copying build/lib/lm_eval/tasks/xcopa/default_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa
2025-08-31T08:28:32,367   copying build/lib/lm_eval/tasks/xcopa/_xcopa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa
2025-08-31T08:28:32,368   copying build/lib/lm_eval/tasks/xcopa/default_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa
2025-08-31T08:28:32,370   copying build/lib/lm_eval/tasks/xcopa/default_et.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa
2025-08-31T08:28:32,372   copying build/lib/lm_eval/tasks/xcopa/default_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa
2025-08-31T08:28:32,373   copying build/lib/lm_eval/tasks/xcopa/default_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa
2025-08-31T08:28:32,375   copying build/lib/lm_eval/tasks/xcopa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa
2025-08-31T08:28:32,377   copying build/lib/lm_eval/tasks/xcopa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa
2025-08-31T08:28:32,379   copying build/lib/lm_eval/tasks/xcopa/default_ht.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa
2025-08-31T08:28:32,381   copying build/lib/lm_eval/tasks/xcopa/default_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa
2025-08-31T08:28:32,382   copying build/lib/lm_eval/tasks/xcopa/default_qu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa
2025-08-31T08:28:32,385   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mastermind
2025-08-31T08:28:32,386   copying build/lib/lm_eval/tasks/mastermind/mastermind_24_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind
2025-08-31T08:28:32,388   copying build/lib/lm_eval/tasks/mastermind/mastermind_46_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind
2025-08-31T08:28:32,389   copying build/lib/lm_eval/tasks/mastermind/mastermind_24_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind
2025-08-31T08:28:32,391   copying build/lib/lm_eval/tasks/mastermind/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind
2025-08-31T08:28:32,393   copying build/lib/lm_eval/tasks/mastermind/mastermind_46_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind
2025-08-31T08:28:32,395   copying build/lib/lm_eval/tasks/mastermind/mastermind_35_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind
2025-08-31T08:28:32,397   copying build/lib/lm_eval/tasks/mastermind/mastermind_35_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind
2025-08-31T08:28:32,399   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/meddialog
2025-08-31T08:28:32,400   copying build/lib/lm_eval/tasks/meddialog/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog
2025-08-31T08:28:32,402   copying build/lib/lm_eval/tasks/meddialog/meddialog_raw_dialogues.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog
2025-08-31T08:28:32,403   copying build/lib/lm_eval/tasks/meddialog/meddialog_raw_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog
2025-08-31T08:28:32,405   copying build/lib/lm_eval/tasks/meddialog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog
2025-08-31T08:28:32,407   copying build/lib/lm_eval/tasks/meddialog/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog
2025-08-31T08:28:32,408   copying build/lib/lm_eval/tasks/meddialog/meddialog_qsumm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog
2025-08-31T08:28:32,410   copying build/lib/lm_eval/tasks/meddialog/meddialog_qsumm_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog
2025-08-31T08:28:32,413   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/french_bench
2025-08-31T08:28:32,414   copying build/lib/lm_eval/tasks/french_bench/french_bench_multifquad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench
2025-08-31T08:28:32,416   copying build/lib/lm_eval/tasks/french_bench/french_bench_boolqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench
2025-08-31T08:28:32,417   copying build/lib/lm_eval/tasks/french_bench/french_bench_orangesum_title.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench
2025-08-31T08:28:32,419   copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2_genq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench
2025-08-31T08:28:32,421   copying build/lib/lm_eval/tasks/french_bench/french_bench_xnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench
2025-08-31T08:28:32,422   copying build/lib/lm_eval/tasks/french_bench/french_bench_reading_comp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench
2025-08-31T08:28:32,424   copying build/lib/lm_eval/tasks/french_bench/french_bench_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench
2025-08-31T08:28:32,426   copying build/lib/lm_eval/tasks/french_bench/french_bench_orangesum_abstract.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench
2025-08-31T08:28:32,428   copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2_hasAns.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench
2025-08-31T08:28:32,429   copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench
2025-08-31T08:28:32,431   copying build/lib/lm_eval/tasks/french_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench
2025-08-31T08:28:32,433   copying build/lib/lm_eval/tasks/french_bench/french_bench_trivia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench
2025-08-31T08:28:32,435   copying build/lib/lm_eval/tasks/french_bench/french_bench_wikitext_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench
2025-08-31T08:28:32,437   copying build/lib/lm_eval/tasks/french_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench
2025-08-31T08:28:32,439   copying build/lib/lm_eval/tasks/french_bench/french_bench_opus_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench
2025-08-31T08:28:32,440   copying build/lib/lm_eval/tasks/french_bench/french_bench_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench
2025-08-31T08:28:32,442   copying build/lib/lm_eval/tasks/french_bench/french_bench_arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench
2025-08-31T08:28:32,443   copying build/lib/lm_eval/tasks/french_bench/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench
2025-08-31T08:28:32,445   copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2_bool.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench
2025-08-31T08:28:32,447   copying build/lib/lm_eval/tasks/french_bench/french_bench_vocab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench
2025-08-31T08:28:32,448   copying build/lib/lm_eval/tasks/french_bench/preprocess_wikitext.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench
2025-08-31T08:28:32,450   copying build/lib/lm_eval/tasks/french_bench/french_bench_topic_based_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench
2025-08-31T08:28:32,452   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/haerae
2025-08-31T08:28:32,453   copying build/lib/lm_eval/tasks/haerae/haerae_gk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae
2025-08-31T08:28:32,455   copying build/lib/lm_eval/tasks/haerae/_haerae.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae
2025-08-31T08:28:32,457   copying build/lib/lm_eval/tasks/haerae/haerae_lw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae
2025-08-31T08:28:32,459   copying build/lib/lm_eval/tasks/haerae/haerae_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae
2025-08-31T08:28:32,460   copying build/lib/lm_eval/tasks/haerae/haerae_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae
2025-08-31T08:28:32,462   copying build/lib/lm_eval/tasks/haerae/haerae_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae
2025-08-31T08:28:32,464   copying build/lib/lm_eval/tasks/haerae/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae
2025-08-31T08:28:32,466   copying build/lib/lm_eval/tasks/haerae/_default_haerae_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae
2025-08-31T08:28:32,468   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kobest
2025-08-31T08:28:32,469   copying build/lib/lm_eval/tasks/kobest/kobest_sentineg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest
2025-08-31T08:28:32,471   copying build/lib/lm_eval/tasks/kobest/kobest_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest
2025-08-31T08:28:32,472   copying build/lib/lm_eval/tasks/kobest/_kobest.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest
2025-08-31T08:28:32,474   copying build/lib/lm_eval/tasks/kobest/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest
2025-08-31T08:28:32,476   copying build/lib/lm_eval/tasks/kobest/kobest_boolq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest
2025-08-31T08:28:32,478   copying build/lib/lm_eval/tasks/kobest/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest
2025-08-31T08:28:32,480   copying build/lib/lm_eval/tasks/kobest/kobest_wic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest
2025-08-31T08:28:32,481   copying build/lib/lm_eval/tasks/kobest/kobest_copa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest
2025-08-31T08:28:32,484   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,485   copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,487   copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10cm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,489   copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,490   copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,492   copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9proc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,494   copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9cm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,496   copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,497   copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_atc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,499   copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,501   copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,503   copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,504   copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,506   copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10proc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,508   copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,510   copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,511   copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,513   copying build/lib/lm_eval/tasks/med_concepts_qa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,515   copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,516   copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,518   copying build/lib/lm_eval/tasks/med_concepts_qa/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,520   copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,522   copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,523   copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,525   copying build/lib/lm_eval/tasks/med_concepts_qa/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa
2025-08-31T08:28:32,528   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mbpp
2025-08-31T08:28:32,529   copying build/lib/lm_eval/tasks/mbpp/mbpp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp
2025-08-31T08:28:32,531   copying build/lib/lm_eval/tasks/mbpp/mbpp_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp
2025-08-31T08:28:32,532   copying build/lib/lm_eval/tasks/mbpp/mbpp_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp
2025-08-31T08:28:32,534   copying build/lib/lm_eval/tasks/mbpp/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp
2025-08-31T08:28:32,536   copying build/lib/lm_eval/tasks/mbpp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp
2025-08-31T08:28:32,538   copying build/lib/lm_eval/tasks/mbpp/mbpp_plus_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp
2025-08-31T08:28:32,540   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/squad_completion
2025-08-31T08:28:32,541   copying build/lib/lm_eval/tasks/squad_completion/squad_completion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squad_completion
2025-08-31T08:28:32,543   copying build/lib/lm_eval/tasks/squad_completion/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squad_completion
2025-08-31T08:28:32,545   copying build/lib/lm_eval/tasks/squad_completion/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squad_completion
2025-08-31T08:28:32,547   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/logiqa
2025-08-31T08:28:32,548   copying build/lib/lm_eval/tasks/logiqa/logiqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa
2025-08-31T08:28:32,550   copying build/lib/lm_eval/tasks/logiqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa
2025-08-31T08:28:32,552   copying build/lib/lm_eval/tasks/logiqa/utils_logiqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa
2025-08-31T08:28:32,554   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xnli_eu
2025-08-31T08:28:32,555   copying build/lib/lm_eval/tasks/xnli_eu/xnli_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu
2025-08-31T08:28:32,557   copying build/lib/lm_eval/tasks/xnli_eu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu
2025-08-31T08:28:32,559   copying build/lib/lm_eval/tasks/xnli_eu/xnli_eu_mt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu
2025-08-31T08:28:32,561   copying build/lib/lm_eval/tasks/xnli_eu/xnli_eu_native.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu
2025-08-31T08:28:32,562   copying build/lib/lm_eval/tasks/xnli_eu/xnli_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu
2025-08-31T08:28:32,565   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu
2025-08-31T08:28:32,567   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,568   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,570   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,572   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,574   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,576   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,577   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,579   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,581   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,583   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,584   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,587   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,588   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,590   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,591   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,593   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,595   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,596   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,598   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,600   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,601   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,603   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,605   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,607   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,609   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,611   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,612   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,614   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,616   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,618   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,619   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,621   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,623   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,624   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,626   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,628   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,629   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,631   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,633   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,634   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,636   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,638   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,639   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,641   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,643   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_direct_hard_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,644   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,646   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,648   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,650   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,652   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,653   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,655   copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard
2025-08-31T08:28:32,657   copying build/lib/lm_eval/tasks/kmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu
2025-08-31T08:28:32,660   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,661   copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,663   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,665   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,667   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,669   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,670   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,672   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,674   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,675   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,677   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,678   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,680   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,682   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,683   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,685   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,687   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,689   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,690   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,692   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,694   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,696   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,698   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,700   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,701   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,703   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,705   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,707   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,708   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,710   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,712   copying build/lib/lm_eval/tasks/kmmlu/default/_default_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,713   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,715   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,717   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,718   copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,720   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,722   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,723   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,725   copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,727   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,728   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,730   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,732   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,734   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,736   copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,737   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,739   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,741   copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,743   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,744   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,746   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,748   copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default
2025-08-31T08:28:32,751   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,752   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,754   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,755   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,757   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,759   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,760   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,762   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,764   copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,766   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,767   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,769   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,771   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,772   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,774   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,776   copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,777   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,779   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,781   copying build/lib/lm_eval/tasks/kmmlu/direct/_direct_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,782   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,784   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,786   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,788   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,790   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,791   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,793   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,795   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,796   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,798   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,800   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,801   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,803   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,805   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,806   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,808   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,810   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,812   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,814   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,815   copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,817   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,819   copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,821   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,822   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,824   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,826   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,828   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,830   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,832   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,834   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,835   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,837   copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,839   copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct
2025-08-31T08:28:32,842   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,843   copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,844   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,846   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,848   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,849   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,851   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,853   copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,854   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,856   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,858   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,860   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,861   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,863   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,865   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,866   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,868   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,870   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,871   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,874   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,875   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,877   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,879   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,881   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,882   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,884   copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,886   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,888   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,889   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,892   copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,893   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,895   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,897   copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,900   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,902   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,904   copying build/lib/lm_eval/tasks/kmmlu/hard/_hard_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,906   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,908   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,910   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,912   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,913   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,915   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,917   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,919   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,921   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,923   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,925   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,927   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,929   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,931   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,932   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,934   copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard
2025-08-31T08:28:32,937   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,938   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,940   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,942   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,945   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,947   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,949   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_cot_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,951   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,953   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,956   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,958   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,960   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,963   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,965   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,967   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,969   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,971   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,974   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,976   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,978   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,980   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,983   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,985   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,987   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,990   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,992   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,994   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,996   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:32,998   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,000   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,003   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,005   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,008   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,010   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,013   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,016   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,018   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,020   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,022   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,024   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,027   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,029   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,031   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,034   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,036   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,039   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,041   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,043   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,045   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,047   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,049   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,052   copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard
2025-08-31T08:28:33,055   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl
2025-08-31T08:28:33,056   copying build/lib/lm_eval/tasks/kbl/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl
2025-08-31T08:28:33,059   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam
2025-08-31T08:28:33,061   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:28:33,062   copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:28:33,064   copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:28:33,066   copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:28:33,067   copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:28:33,069   copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:28:33,071   copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:28:33,072   copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:28:33,074   copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2024.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:28:33,076   copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:28:33,078   copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:28:33,080   copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:28:33,081   copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:28:33,083   copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:28:33,085   copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal
2025-08-31T08:28:33,088   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:28:33,088   copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:28:33,090   copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:28:33,092   copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2025.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:28:33,093   copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:28:33,095   copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:28:33,097   copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2024.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:28:33,098   copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:28:33,100   copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:28:33,102   copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:28:33,104   copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:28:33,106   copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:28:33,107   copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:28:33,109   copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:28:33,111   copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:28:33,112   copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil
2025-08-31T08:28:33,115   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:28:33,116   copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:28:33,118   copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2024.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:28:33,120   copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:28:33,122   copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:28:33,124   copying build/lib/lm_eval/tasks/kbl/bar_exam/public/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:28:33,126   copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:28:33,127   copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:28:33,129   copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:28:33,130   copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:28:33,132   copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:28:33,133   copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:28:33,135   copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:28:33,137   copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:28:33,140   copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public
2025-08-31T08:28:33,142   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:28:33,143   copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2010.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:28:33,145   copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:28:33,147   copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2011.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:28:33,149   copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:28:33,150   copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:28:33,152   copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:28:33,154   copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:28:33,156   copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:28:33,157   copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:28:33,159   copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:28:33,161   copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:28:33,162   copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:28:33,164   copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:28:33,166   copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:28:33,168   copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility
2025-08-31T08:28:33,170   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/knowledge
2025-08-31T08:28:33,171   copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_query_statute_matching_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge
2025-08-31T08:28:33,173   copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_offense_component_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge
2025-08-31T08:28:33,175   copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_reasoning_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge
2025-08-31T08:28:33,176   copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge
2025-08-31T08:28:33,178   copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_statute_number_and_content_matching_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge
2025-08-31T08:28:33,179   copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_statute_hallucination_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge
2025-08-31T08:28:33,181   copying build/lib/lm_eval/tasks/kbl/knowledge/_kbl_knowledge_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge
2025-08-31T08:28:33,183   copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_legal_concept_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge
2025-08-31T08:28:33,185   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/reasoning
2025-08-31T08:28:33,187   copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_statement_consistency_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning
2025-08-31T08:28:33,189   copying build/lib/lm_eval/tasks/kbl/reasoning/_kbl_reasoning_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning
2025-08-31T08:28:33,190   copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_causal_reasoning_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning
2025-08-31T08:28:33,192   copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_q_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning
2025-08-31T08:28:33,194   copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_p_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning
2025-08-31T08:28:33,196   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/simple_cooccurrence_bias
2025-08-31T08:28:33,197   copying build/lib/lm_eval/tasks/simple_cooccurrence_bias/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/simple_cooccurrence_bias
2025-08-31T08:28:33,199   copying build/lib/lm_eval/tasks/simple_cooccurrence_bias/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/simple_cooccurrence_bias
2025-08-31T08:28:33,201   copying build/lib/lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/simple_cooccurrence_bias
2025-08-31T08:28:33,203   copying build/lib/lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias_gen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/simple_cooccurrence_bias
2025-08-31T08:28:33,206   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mela
2025-08-31T08:28:33,207   copying build/lib/lm_eval/tasks/mela/mela_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela
2025-08-31T08:28:33,209   copying build/lib/lm_eval/tasks/mela/mela_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela
2025-08-31T08:28:33,211   copying build/lib/lm_eval/tasks/mela/mela_is.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela
2025-08-31T08:28:33,212   copying build/lib/lm_eval/tasks/mela/mela_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela
2025-08-31T08:28:33,214   copying build/lib/lm_eval/tasks/mela/mela_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela
2025-08-31T08:28:33,216   copying build/lib/lm_eval/tasks/mela/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela
2025-08-31T08:28:33,218   copying build/lib/lm_eval/tasks/mela/mela_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela
2025-08-31T08:28:33,219   copying build/lib/lm_eval/tasks/mela/mela_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela
2025-08-31T08:28:33,221   copying build/lib/lm_eval/tasks/mela/_mela.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela
2025-08-31T08:28:33,222   copying build/lib/lm_eval/tasks/mela/mela_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela
2025-08-31T08:28:33,224   copying build/lib/lm_eval/tasks/mela/mela_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela
2025-08-31T08:28:33,226   copying build/lib/lm_eval/tasks/mela/mela_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela
2025-08-31T08:28:33,228   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bigbench
2025-08-31T08:28:33,229   copying build/lib/lm_eval/tasks/bigbench/multiple_choice_template_b_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench
2025-08-31T08:28:33,234   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,236   copying build/lib/lm_eval/tasks/bigbench/generate_until/presuppositions_as_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,237   copying build/lib/lm_eval/tasks/bigbench/generate_until/topical_chat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,239   copying build/lib/lm_eval/tasks/bigbench/generate_until/swedish_to_german_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,241   copying build/lib/lm_eval/tasks/bigbench/generate_until/analytic_entailment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,243   copying build/lib/lm_eval/tasks/bigbench/generate_until/abstract_narrative_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,244   copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_args.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,246   copying build/lib/lm_eval/tasks/bigbench/generate_until/gre_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,248   copying build/lib/lm_eval/tasks/bigbench/generate_until/identify_math_theorems.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,250   copying build/lib/lm_eval/tasks/bigbench/generate_until/polish_sequence_labeling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,251   copying build/lib/lm_eval/tasks/bigbench/generate_until/human_organs_senses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,254   copying build/lib/lm_eval/tasks/bigbench/generate_until/contextual_parametric_knowledge_conflicts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,255   copying build/lib/lm_eval/tasks/bigbench/generate_until/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,257   copying build/lib/lm_eval/tasks/bigbench/generate_until/modified_arithmetic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,259   copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_text_editing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,261   copying build/lib/lm_eval/tasks/bigbench/generate_until/similarities_abstraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,262   copying build/lib/lm_eval/tasks/bigbench/generate_until/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,264   copying build/lib/lm_eval/tasks/bigbench/generate_until/hindu_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,266   copying build/lib/lm_eval/tasks/bigbench/generate_until/dark_humor_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,267   copying build/lib/lm_eval/tasks/bigbench/generate_until/common_morpheme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,269   copying build/lib/lm_eval/tasks/bigbench/generate_until/crash_blossom.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,270   copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_sequence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,272   copying build/lib/lm_eval/tasks/bigbench/generate_until/implicatures.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,274   copying build/lib/lm_eval/tasks/bigbench/generate_until/list_functions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,276   copying build/lib/lm_eval/tasks/bigbench/generate_until/semantic_parsing_in_context_sparc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,278   copying build/lib/lm_eval/tasks/bigbench/generate_until/authorship_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,279   copying build/lib/lm_eval/tasks/bigbench/generate_until/intent_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,281   copying build/lib/lm_eval/tasks/bigbench/generate_until/empirical_judgments.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,283   copying build/lib/lm_eval/tasks/bigbench/generate_until/chinese_remainder_theorem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,284   copying build/lib/lm_eval/tasks/bigbench/generate_until/language_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,286   copying build/lib/lm_eval/tasks/bigbench/generate_until/checkmate_in_one.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,288   copying build/lib/lm_eval/tasks/bigbench/generate_until/disfl_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,290   copying build/lib/lm_eval/tasks/bigbench/generate_until/auto_categorization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,291   copying build/lib/lm_eval/tasks/bigbench/generate_until/crass_ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,293   copying build/lib/lm_eval/tasks/bigbench/generate_until/key_value_maps.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,295   copying build/lib/lm_eval/tasks/bigbench/generate_until/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,297   copying build/lib/lm_eval/tasks/bigbench/generate_until/riddle_sense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,299   copying build/lib/lm_eval/tasks/bigbench/generate_until/fact_checker.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,300   copying build/lib/lm_eval/tasks/bigbench/generate_until/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,302   copying build/lib/lm_eval/tasks/bigbench/generate_until/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,304   copying build/lib/lm_eval/tasks/bigbench/generate_until/english_russian_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,305   copying build/lib/lm_eval/tasks/bigbench/generate_until/cryptonite.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,307   copying build/lib/lm_eval/tasks/bigbench/generate_until/sentence_ambiguity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,309   copying build/lib/lm_eval/tasks/bigbench/generate_until/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,310   copying build/lib/lm_eval/tasks/bigbench/generate_until/what_is_the_tao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,312   copying build/lib/lm_eval/tasks/bigbench/generate_until/unnatural_in_context_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,314   copying build/lib/lm_eval/tasks/bigbench/generate_until/bbq_lite_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,316   copying build/lib/lm_eval/tasks/bigbench/generate_until/real_or_fake_text.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,317   copying build/lib/lm_eval/tasks/bigbench/generate_until/winowhy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,319   copying build/lib/lm_eval/tasks/bigbench/generate_until/formal_fallacies_syllogisms_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,321   copying build/lib/lm_eval/tasks/bigbench/generate_until/hhh_alignment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,323   copying build/lib/lm_eval/tasks/bigbench/generate_until/emoji_movie.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,325   copying build/lib/lm_eval/tasks/bigbench/generate_until/auto_debugging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,327   copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_fallacy_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,328   copying build/lib/lm_eval/tasks/bigbench/generate_until/which_wiki_edit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,330   copying build/lib/lm_eval/tasks/bigbench/generate_until/emojis_emotion_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,332   copying build/lib/lm_eval/tasks/bigbench/generate_until/conceptual_combinations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,334   copying build/lib/lm_eval/tasks/bigbench/generate_until/conlang_translation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,336   copying build/lib/lm_eval/tasks/bigbench/generate_until/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,339   copying build/lib/lm_eval/tasks/bigbench/generate_until/movie_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,340   copying build/lib/lm_eval/tasks/bigbench/generate_until/natural_instructions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,342   copying build/lib/lm_eval/tasks/bigbench/generate_until/causal_judgment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,344   copying build/lib/lm_eval/tasks/bigbench/generate_until/arithmetic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,346   copying build/lib/lm_eval/tasks/bigbench/generate_until/tracking_shuffled_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,347   copying build/lib/lm_eval/tasks/bigbench/generate_until/moral_permissibility.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,349   copying build/lib/lm_eval/tasks/bigbench/generate_until/misconceptions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,351   copying build/lib/lm_eval/tasks/bigbench/generate_until/entailed_polarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,353   copying build/lib/lm_eval/tasks/bigbench/generate_until/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,354   copying build/lib/lm_eval/tasks/bigbench/generate_until/hindi_question_answering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,356   copying build/lib/lm_eval/tasks/bigbench/generate_until/metaphor_boolean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,358   copying build/lib/lm_eval/tasks/bigbench/generate_until/social_support.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,360   copying build/lib/lm_eval/tasks/bigbench/generate_until/english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,362   copying build/lib/lm_eval/tasks/bigbench/generate_until/kannada.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,363   copying build/lib/lm_eval/tasks/bigbench/generate_until/codenames.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,365   copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,367   copying build/lib/lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_transliterate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,368   copying build/lib/lm_eval/tasks/bigbench/generate_until/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,370   copying build/lib/lm_eval/tasks/bigbench/generate_until/cifar10_classification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,372   copying build/lib/lm_eval/tasks/bigbench/generate_until/parsinlu_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,373   copying build/lib/lm_eval/tasks/bigbench/generate_until/misconceptions_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,375   copying build/lib/lm_eval/tasks/bigbench/generate_until/discourse_marker_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,377   copying build/lib/lm_eval/tasks/bigbench/generate_until/rephrase.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,379   copying build/lib/lm_eval/tasks/bigbench/generate_until/identify_odd_metaphor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,380   copying build/lib/lm_eval/tasks/bigbench/generate_until/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,382   copying build/lib/lm_eval/tasks/bigbench/generate_until/mnist_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,384   copying build/lib/lm_eval/tasks/bigbench/generate_until/nonsense_words_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,385   copying build/lib/lm_eval/tasks/bigbench/generate_until/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,387   copying build/lib/lm_eval/tasks/bigbench/generate_until/multiemo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,389   copying build/lib/lm_eval/tasks/bigbench/generate_until/fantasy_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,390   copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_ethical_questions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,392   copying build/lib/lm_eval/tasks/bigbench/generate_until/linguistics_puzzles.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,394   copying build/lib/lm_eval/tasks/bigbench/generate_until/persian_idioms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,395   copying build/lib/lm_eval/tasks/bigbench/generate_until/bridging_anaphora_resolution_barqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,397   copying build/lib/lm_eval/tasks/bigbench/generate_until/elementary_math_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,399   copying build/lib/lm_eval/tasks/bigbench/generate_until/strange_stories.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,400   copying build/lib/lm_eval/tasks/bigbench/generate_until/kanji_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,402   copying build/lib/lm_eval/tasks/bigbench/generate_until/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,404   copying build/lib/lm_eval/tasks/bigbench/generate_until/repeat_copy_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,406   copying build/lib/lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,407   copying build/lib/lm_eval/tasks/bigbench/generate_until/novel_concepts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,409   copying build/lib/lm_eval/tasks/bigbench/generate_until/epistemic_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,411   copying build/lib/lm_eval/tasks/bigbench/generate_until/strategyqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,413   copying build/lib/lm_eval/tasks/bigbench/generate_until/cause_and_effect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,415   copying build/lib/lm_eval/tasks/bigbench/generate_until/social_iqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,417   copying build/lib/lm_eval/tasks/bigbench/generate_until/known_unknowns.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,418   copying build/lib/lm_eval/tasks/bigbench/generate_until/understanding_fables.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,420   copying build/lib/lm_eval/tasks/bigbench/generate_until/minute_mysteries_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,422   copying build/lib/lm_eval/tasks/bigbench/generate_until/mathematical_induction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,423   copying build/lib/lm_eval/tasks/bigbench/generate_until/evaluating_information_essentiality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,425   copying build/lib/lm_eval/tasks/bigbench/generate_until/sufficient_information.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,427   copying build/lib/lm_eval/tasks/bigbench/generate_until/gem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,429   copying build/lib/lm_eval/tasks/bigbench/generate_until/vitaminc_fact_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,431   copying build/lib/lm_eval/tasks/bigbench/generate_until/periodic_elements.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,432   copying build/lib/lm_eval/tasks/bigbench/generate_until/undo_permutation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,434   copying build/lib/lm_eval/tasks/bigbench/generate_until/linguistic_mappings.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,436   copying build/lib/lm_eval/tasks/bigbench/generate_until/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,438   copying build/lib/lm_eval/tasks/bigbench/generate_until/cryobiology_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,439   copying build/lib/lm_eval/tasks/bigbench/generate_until/timedial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,441   copying build/lib/lm_eval/tasks/bigbench/generate_until/physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,443   copying build/lib/lm_eval/tasks/bigbench/generate_until/matrixshapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,444   copying build/lib/lm_eval/tasks/bigbench/generate_until/hinglish_toxicity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,446   copying build/lib/lm_eval/tasks/bigbench/generate_until/cs_algorithms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,448   copying build/lib/lm_eval/tasks/bigbench/generate_until/color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,450   copying build/lib/lm_eval/tasks/bigbench/generate_until/language_games.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,451   copying build/lib/lm_eval/tasks/bigbench/generate_until/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,453   copying build/lib/lm_eval/tasks/bigbench/generate_until/play_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,455   copying build/lib/lm_eval/tasks/bigbench/generate_until/physical_intuition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,457   copying build/lib/lm_eval/tasks/bigbench/generate_until/gender_inclusive_sentences_german.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,459   copying build/lib/lm_eval/tasks/bigbench/generate_until/figure_of_speech_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,460   copying build/lib/lm_eval/tasks/bigbench/generate_until/anachronisms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,462   copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_multiple_targets_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,464   copying build/lib/lm_eval/tasks/bigbench/generate_until/logic_grid_puzzle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,465   copying build/lib/lm_eval/tasks/bigbench/generate_until/parsinlu_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,467   copying build/lib/lm_eval/tasks/bigbench/generate_until/general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,469   copying build/lib/lm_eval/tasks/bigbench/generate_until/intersect_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,470   copying build/lib/lm_eval/tasks/bigbench/generate_until/code_line_description.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,472   copying build/lib/lm_eval/tasks/bigbench/generate_until/unit_conversion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,474   copying build/lib/lm_eval/tasks/bigbench/generate_until/operators.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,476   copying build/lib/lm_eval/tasks/bigbench/generate_until/physics_questions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,477   copying build/lib/lm_eval/tasks/bigbench/generate_until/phrase_relatedness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,479   copying build/lib/lm_eval/tasks/bigbench/generate_until/chess_state_tracking.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,481   copying build/lib/lm_eval/tasks/bigbench/generate_until/odd_one_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,483   copying build/lib/lm_eval/tasks/bigbench/generate_until/question_selection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,484   copying build/lib/lm_eval/tasks/bigbench/generate_until/paragraph_segmentation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,486   copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_subtasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,488   copying build/lib/lm_eval/tasks/bigbench/generate_until/qa_wikidata.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,490   copying build/lib/lm_eval/tasks/bigbench/generate_until/implicit_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,491   copying build/lib/lm_eval/tasks/bigbench/generate_until/metaphor_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,493   copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_multiple_choice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,495   copying build/lib/lm_eval/tasks/bigbench/generate_until/analogical_similarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,497   copying build/lib/lm_eval/tasks/bigbench/generate_until/suicide_risk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,498   copying build/lib/lm_eval/tasks/bigbench/generate_until/irony_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,500   copying build/lib/lm_eval/tasks/bigbench/generate_until/goal_step_wikihow.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,502   copying build/lib/lm_eval/tasks/bigbench/generate_until/symbol_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,503   copying build/lib/lm_eval/tasks/bigbench/generate_until/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,505   copying build/lib/lm_eval/tasks/bigbench/generate_until/entailed_polarity_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,507   copying build/lib/lm_eval/tasks/bigbench/generate_until/scientific_press_release.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,508   copying build/lib/lm_eval/tasks/bigbench/generate_until/unit_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,510   copying build/lib/lm_eval/tasks/bigbench/generate_until/ascii_word_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,512   copying build/lib/lm_eval/tasks/bigbench/generate_until/simp_turing_concept.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,513   copying build/lib/lm_eval/tasks/bigbench/generate_until/few_shot_nlg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,515   copying build/lib/lm_eval/tasks/bigbench/generate_until/semantic_parsing_spider.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,517   copying build/lib/lm_eval/tasks/bigbench/generate_until/word_unscrambling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,518   copying build/lib/lm_eval/tasks/bigbench/generate_until/swahili_english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,520   copying build/lib/lm_eval/tasks/bigbench/generate_until/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,522   copying build/lib/lm_eval/tasks/bigbench/generate_until/tense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,524   copying build/lib/lm_eval/tasks/bigbench/generate_until/mult_data_wrangling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,525   copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_deduction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until
2025-08-31T08:28:33,527   copying build/lib/lm_eval/tasks/bigbench/multiple_choice_template_a_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench
2025-08-31T08:28:33,529   copying build/lib/lm_eval/tasks/bigbench/generate_tasks.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench
2025-08-31T08:28:33,531   copying build/lib/lm_eval/tasks/bigbench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench
2025-08-31T08:28:33,536   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,537   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/presuppositions_as_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,539   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/swedish_to_german_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,541   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/analytic_entailment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,542   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/abstract_narrative_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,544   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_args.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,546   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/gre_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,548   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/identify_math_theorems.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,549   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/human_organs_senses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,551   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/contextual_parametric_knowledge_conflicts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,552   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,554   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/similarities_abstraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,556   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,557   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hindu_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,559   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/dark_humor_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,561   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/common_morpheme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,563   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/crash_blossom.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,564   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_sequence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,566   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/implicatures.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,568   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/authorship_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,570   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/intent_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,571   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/empirical_judgments.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,574   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/language_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,575   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/checkmate_in_one.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,577   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/crass_ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,579   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/key_value_maps.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,580   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,582   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/riddle_sense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,584   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/fact_checker.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,585   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,587   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/english_russian_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,589   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/sentence_ambiguity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,591   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,592   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/what_is_the_tao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,594   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/bbq_lite_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,596   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/real_or_fake_text.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,598   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/winowhy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,599   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/formal_fallacies_syllogisms_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,601   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hhh_alignment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,603   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/emoji_movie.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,604   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_fallacy_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,606   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/which_wiki_edit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,608   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/emojis_emotion_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,609   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/conceptual_combinations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,611   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,613   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/movie_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,614   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/causal_judgment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,616   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/arithmetic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,618   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/tracking_shuffled_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,620   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/moral_permissibility.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,621   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/misconceptions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,623   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/entailed_polarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,624   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,626   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/metaphor_boolean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,628   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/social_support.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,629   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,631   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/kannada.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,633   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,634   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cifar10_classification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,636   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/misconceptions_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,638   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/discourse_marker_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,640   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/identify_odd_metaphor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,641   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,643   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/mnist_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,645   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/nonsense_words_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,647   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,648   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/multiemo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,650   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/fantasy_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,652   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/simple_ethical_questions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,654   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/persian_idioms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,655   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/elementary_math_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,657   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/strange_stories.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,659   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/kanji_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,661   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/international_phonetic_alphabet_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,662   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/novel_concepts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,664   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/epistemic_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,666   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/strategyqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,667   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cause_and_effect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,669   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/social_iqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,670   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/known_unknowns.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,672   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/understanding_fables.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,674   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/mathematical_induction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,676   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/evaluating_information_essentiality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,677   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/vitaminc_fact_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,679   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/periodic_elements.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,681   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/undo_permutation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,683   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,684   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cryobiology_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,687   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/timedial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,688   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,690   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hinglish_toxicity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,692   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cs_algorithms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,694   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,696   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,697   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/play_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,699   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/physical_intuition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,701   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/figure_of_speech_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,703   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/anachronisms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,704   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logic_grid_puzzle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,706   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/parsinlu_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,708   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,710   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/intersect_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,712   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/code_line_description.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,713   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/unit_conversion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,716   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/phrase_relatedness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,717   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/odd_one_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,719   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/question_selection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,721   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/implicit_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,723   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/metaphor_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,725   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/analogical_similarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,726   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/suicide_risk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,728   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/irony_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,730   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/goal_step_wikihow.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,731   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/symbol_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,733   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,735   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/entailed_polarity_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,737   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/unit_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,739   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/swahili_english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,741   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,742   copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_deduction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice
2025-08-31T08:28:33,744   copying build/lib/lm_eval/tasks/bigbench/generate_until_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench
2025-08-31T08:28:33,746   copying build/lib/lm_eval/tasks/bigbench/push_bigbench_dataset.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench
2025-08-31T08:28:33,748   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/asdiv
2025-08-31T08:28:33,749   copying build/lib/lm_eval/tasks/asdiv/asdiv-cot-llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/asdiv
2025-08-31T08:28:33,751   copying build/lib/lm_eval/tasks/asdiv/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/asdiv
2025-08-31T08:28:33,752   copying build/lib/lm_eval/tasks/asdiv/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/asdiv
2025-08-31T08:28:33,755   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,756   copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,758   copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_sexual_orientation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,760   copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_race_color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,762   copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_nationality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,763   copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_physical_appearance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,765   copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,767   copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_gender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,768   copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_autre.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,770   copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_age.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,771   copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_age.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,773   copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_nationality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,775   copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_sexual_orientation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,777   copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_physical_appearance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,778   copying build/lib/lm_eval/tasks/crows_pairs/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,780   copying build/lib/lm_eval/tasks/crows_pairs/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,783   copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,784   copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_gender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,786   copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_socioeconomic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,787   copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_socioeconomic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,789   copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,791   copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_religion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,792   copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_religion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,794   copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_race_color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,796   copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_autre.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs
2025-08-31T08:28:33,798   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/groundcocoa
2025-08-31T08:28:33,799   copying build/lib/lm_eval/tasks/groundcocoa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/groundcocoa
2025-08-31T08:28:33,801   copying build/lib/lm_eval/tasks/groundcocoa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/groundcocoa
2025-08-31T08:28:33,803   copying build/lib/lm_eval/tasks/groundcocoa/groundcocoa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/groundcocoa
2025-08-31T08:28:33,805   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_pro
2025-08-31T08:28:33,806   copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro
2025-08-31T08:28:33,808   copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro
2025-08-31T08:28:33,810   copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro
2025-08-31T08:28:33,813   copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro
2025-08-31T08:28:33,815   copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro
2025-08-31T08:28:33,816   copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro
2025-08-31T08:28:33,818   copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro
2025-08-31T08:28:33,820   copying build/lib/lm_eval/tasks/mmlu_pro/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro
2025-08-31T08:28:33,822   copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro
2025-08-31T08:28:33,823   copying build/lib/lm_eval/tasks/mmlu_pro/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro
2025-08-31T08:28:33,825   copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro
2025-08-31T08:28:33,827   copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro
2025-08-31T08:28:33,829   copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro
2025-08-31T08:28:33,831   copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro
2025-08-31T08:28:33,832   copying build/lib/lm_eval/tasks/mmlu_pro/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro
2025-08-31T08:28:33,834   copying build/lib/lm_eval/tasks/mmlu_pro/_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro
2025-08-31T08:28:33,836   copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro
2025-08-31T08:28:33,838   copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro
2025-08-31T08:28:33,840   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wmt2016
2025-08-31T08:28:33,841   copying build/lib/lm_eval/tasks/wmt2016/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmt2016
2025-08-31T08:28:33,843   copying build/lib/lm_eval/tasks/wmt2016/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmt2016
2025-08-31T08:28:33,845   copying build/lib/lm_eval/tasks/wmt2016/ro_en-t5_prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmt2016
2025-08-31T08:28:33,847   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gsm8k_platinum
2025-08-31T08:28:33,848   copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum
2025-08-31T08:28:33,850   copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-self-consistency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum
2025-08-31T08:28:33,851   copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum
2025-08-31T08:28:33,853   copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum
2025-08-31T08:28:33,855   copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum
2025-08-31T08:28:33,857   copying build/lib/lm_eval/tasks/gsm8k_platinum/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum
2025-08-31T08:28:33,860   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmmu
2025-08-31T08:28:33,861   copying build/lib/lm_eval/tasks/mmmu/mmmu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,863   copying build/lib/lm_eval/tasks/mmmu/mmmu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,865   copying build/lib/lm_eval/tasks/mmmu/mmmu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,866   copying build/lib/lm_eval/tasks/mmmu/mmmu_electronics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,868   copying build/lib/lm_eval/tasks/mmmu/mmmu_clinical_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,870   copying build/lib/lm_eval/tasks/mmmu/mmmu_art.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,871   copying build/lib/lm_eval/tasks/mmmu/mmmu_pharmacy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,873   copying build/lib/lm_eval/tasks/mmmu/mmmu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,875   copying build/lib/lm_eval/tasks/mmmu/mmmu_finance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,877   copying build/lib/lm_eval/tasks/mmmu/mmmu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,879   copying build/lib/lm_eval/tasks/mmmu/_art_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,881   copying build/lib/lm_eval/tasks/mmmu/mmmu_public_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,883   copying build/lib/lm_eval/tasks/mmmu/_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,884   copying build/lib/lm_eval/tasks/mmmu/mmmu_diagnostics_and_laboratory_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,886   copying build/lib/lm_eval/tasks/mmmu/mmmu_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,888   copying build/lib/lm_eval/tasks/mmmu/mmmu_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,889   copying build/lib/lm_eval/tasks/mmmu/mmmu_art_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,891   copying build/lib/lm_eval/tasks/mmmu/mmmu_materials.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,892   copying build/lib/lm_eval/tasks/mmmu/mmmu_manage.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,894   copying build/lib/lm_eval/tasks/mmmu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,897   copying build/lib/lm_eval/tasks/mmmu/mmmu_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,898   copying build/lib/lm_eval/tasks/mmmu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,901   copying build/lib/lm_eval/tasks/mmmu/mmmu_music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,902   copying build/lib/lm_eval/tasks/mmmu/_health_and_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,904   copying build/lib/lm_eval/tasks/mmmu/mmmu_agriculture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,906   copying build/lib/lm_eval/tasks/mmmu/mmmu_energy_and_power.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,908   copying build/lib/lm_eval/tasks/mmmu/mmmu_architecture_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,909   copying build/lib/lm_eval/tasks/mmmu/_humanities_and_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,911   copying build/lib/lm_eval/tasks/mmmu/mmmu_basic_medical_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,913   copying build/lib/lm_eval/tasks/mmmu/_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,914   copying build/lib/lm_eval/tasks/mmmu/mmmu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,916   copying build/lib/lm_eval/tasks/mmmu/mmmu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,918   copying build/lib/lm_eval/tasks/mmmu/mmmu_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,920   copying build/lib/lm_eval/tasks/mmmu/mmmu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,921   copying build/lib/lm_eval/tasks/mmmu/mmmu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,923   copying build/lib/lm_eval/tasks/mmmu/mmmu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,925   copying build/lib/lm_eval/tasks/mmmu/_tech_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,927   copying build/lib/lm_eval/tasks/mmmu/mmmu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,929   copying build/lib/lm_eval/tasks/mmmu/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,931   copying build/lib/lm_eval/tasks/mmmu/_mmmu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu
2025-08-31T08:28:33,933   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/medqa
2025-08-31T08:28:33,934   copying build/lib/lm_eval/tasks/medqa/medqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medqa
2025-08-31T08:28:33,936   copying build/lib/lm_eval/tasks/medqa/preprocess_medqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medqa
2025-08-31T08:28:33,938   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/sciq
2025-08-31T08:28:33,939   copying build/lib/lm_eval/tasks/sciq/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/sciq
2025-08-31T08:28:33,941   copying build/lib/lm_eval/tasks/sciq/sciq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/sciq
2025-08-31T08:28:33,943   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu
2025-08-31T08:28:33,945   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full
2025-08-31T08:28:33,948   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,949   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,951   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,953   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,954   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,956   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,958   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,959   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,961   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,963   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,965   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,966   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,968   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,970   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,972   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,974   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,976   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,977   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,979   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,981   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,982   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,984   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,986   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,987   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,989   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,991   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,992   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,994   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_sr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,996   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:33,998   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,000   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,002   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,003   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,005   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,007   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,008   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,010   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,012   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,014   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,015   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,017   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,019   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,020   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,022   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,024   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,026   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,027   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,029   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,031   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,032   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,034   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,036   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,038   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,040   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,042   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,043   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,045   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,047   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,049   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,050   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,052   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,054   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,056   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,057   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,059   copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr
2025-08-31T08:28:34,062   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,063   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,065   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,067   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,069   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,070   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,072   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,074   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,076   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,077   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,079   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,081   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,083   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,085   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,086   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,088   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,090   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,092   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,094   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,096   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,097   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,099   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,100   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,102   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,104   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,105   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,107   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,109   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,111   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,113   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,114   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,116   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,118   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,120   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,122   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,124   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,125   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,127   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,129   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,131   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,132   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,134   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,136   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,138   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,140   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,141   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,143   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,145   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,146   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,148   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,150   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,151   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,153   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,155   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,157   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,159   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,161   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,162   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,164   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,166   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,168   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_bn_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,170   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,171   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,173   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,175   copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn
2025-08-31T08:28:34,178   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,179   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,181   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,183   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,185   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,186   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,188   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,190   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,192   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,193   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,195   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,197   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,199   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,201   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,202   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,204   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,206   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,208   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,210   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,212   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,214   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,215   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,217   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,219   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,221   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,222   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,224   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,225   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,227   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,229   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,231   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,233   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,234   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,236   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,238   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,240   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,241   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,243   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,245   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,247   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,249   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,251   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,253   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,255   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,257   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,259   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,260   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,262   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,264   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,265   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,267   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,269   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,271   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,272   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,274   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,276   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_hi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,278   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,280   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,281   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,283   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,285   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,287   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,289   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,290   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,292   copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi
2025-08-31T08:28:34,295   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,296   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,298   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,300   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,302   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,303   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,305   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,307   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,308   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,310   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,312   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,314   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,316   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,318   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,319   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,321   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,323   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,325   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,327   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,328   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,330   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,332   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,333   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,335   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,337   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,338   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,340   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,342   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,344   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,565   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,567   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,569   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,571   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,573   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,575   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,577   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,578   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,580   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,582   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,584   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,585   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,587   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,589   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,590   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_fr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,592   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,594   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,596   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,597   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,599   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,601   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,602   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,604   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,606   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,607   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,609   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,611   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,613   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,615   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,616   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,618   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,620   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,622   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,623   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,625   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,627   copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr
2025-08-31T08:28:34,630   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,631   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,633   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,634   copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,636   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,638   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,640   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,642   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,643   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,645   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,647   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,649   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,650   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,652   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,654   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,656   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,657   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,659   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,661   copying build/lib/lm_eval/tasks/global_mmlu/full/he/_he_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,663   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,665   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,667   copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,668   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,670   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,672   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,673   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,675   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,676   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,678   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,680   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,682   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,683   copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,686   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,687   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,689   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,691   copying build/lib/lm_eval/tasks/global_mmlu/full/he/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,693   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,694   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,696   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,698   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,700   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,701   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,703   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,705   copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,707   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,709   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,710   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,712   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,714   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,715   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,717   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,719   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,720   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,722   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,724   copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,725   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,727   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,729   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,731   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,732   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,735   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,736   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,738   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,740   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,741   copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he
2025-08-31T08:28:34,744   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,745   copying build/lib/lm_eval/tasks/global_mmlu/full/en/_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,747   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,749   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,750   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,752   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,754   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,756   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,758   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,760   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,761   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,763   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,765   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,766   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,768   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,770   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,772   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,773   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,775   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,777   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,779   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,781   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,783   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,784   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,786   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,788   copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,790   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,792   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,793   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,795   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,797   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,799   copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,800   copying build/lib/lm_eval/tasks/global_mmlu/full/en/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,802   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,804   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,806   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,808   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,810   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,812   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,813   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,815   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,817   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,819   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,820   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,822   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,824   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,826   copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,828   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,829   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,831   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,833   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,834   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,836   copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,838   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,839   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,841   copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,843   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,844   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,846   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,848   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,850   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,852   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,854   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,856   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,857   copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en
2025-08-31T08:28:34,860   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,861   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,863   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,865   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,867   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,868   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,870   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,872   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,874   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,876   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,877   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,879   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,881   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,882   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,884   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,886   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,888   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,890   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,892   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,894   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,896   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,897   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,899   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,901   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,902   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,904   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,906   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,907   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,909   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,911   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,913   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,914   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,916   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,918   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,920   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,921   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,923   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,925   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,927   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,928   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,930   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,932   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,934   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,936   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,938   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,939   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,941   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,943   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,944   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,946   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,948   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,949   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,951   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,953   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_uk_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,955   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,957   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,959   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,960   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,962   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,964   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,965   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,967   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,969   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,970   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,972   copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk
2025-08-31T08:28:34,975   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:34,977   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:34,978   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:34,980   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:34,982   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:34,983   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:34,985   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:34,987   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:34,989   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:34,990   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:34,992   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:34,995   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:34,997   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:34,999   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,002   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_sn_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,004   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,007   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,009   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,012   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,014   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,016   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,018   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,020   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,023   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,025   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,028   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,030   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,032   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,034   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,036   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,039   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,041   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,043   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,046   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,048   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,051   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,053   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,055   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,058   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,060   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,062   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,064   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,067   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,069   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,071   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,073   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,076   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,078   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,080   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,082   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,084   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,087   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,089   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,091   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,093   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,095   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,097   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,099   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,100   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,102   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,104   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,106   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,107   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,109   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,111   copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn
2025-08-31T08:28:35,115   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,116   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,117   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,119   copying build/lib/lm_eval/tasks/global_mmlu/full/si/_si_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,121   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,123   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,124   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,126   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,128   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,129   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,131   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,133   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,135   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,137   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,139   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,141   copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,142   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,144   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,146   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,148   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,149   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,151   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,153   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,156   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,157   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,159   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,161   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,162   copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,164   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,166   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,168   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,170   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,171   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,173   copying build/lib/lm_eval/tasks/global_mmlu/full/si/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,175   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,177   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,178   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,180   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,182   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,184   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,186   copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,188   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,190   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,191   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,193   copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,195   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,196   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,198   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,200   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,201   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,203   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,205   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,207   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,209   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,211   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,212   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,214   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,216   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,217   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,219   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,221   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,223   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,224   copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,226   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,228   copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si
2025-08-31T08:28:35,231   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,232   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,234   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,236   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,238   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,239   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,241   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,243   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,244   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,246   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,248   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,250   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,251   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,253   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,255   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,257   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,259   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,261   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,262   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,264   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,266   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,267   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,269   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,271   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,273   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,274   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,276   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,278   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,279   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,281   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,283   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,284   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,286   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,288   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,289   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,292   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,294   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,296   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,298   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,300   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,302   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,304   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,306   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,308   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,309   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,311   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,313   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,315   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,317   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,319   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,321   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,322   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,324   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,326   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,328   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,329   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,331   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,333   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,335   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_vi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,337   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,338   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,340   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,342   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,344   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,346   copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi
2025-08-31T08:28:35,349   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,350   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,352   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,353   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,355   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,357   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,359   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,360   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,362   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,364   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,367   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,369   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,371   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,373   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,375   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,377   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,378   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,380   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,382   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,384   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,386   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,388   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,390   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,391   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,393   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,395   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,396   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,398   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,400   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,401   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,403   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,404   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,406   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,408   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,410   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,412   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,414   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,416   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,418   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,420   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,422   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,423   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,425   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,427   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,429   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,431   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,432   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,434   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,436   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,438   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,439   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,441   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,443   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,444   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,446   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,448   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,450   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,451   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,453   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,455   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,457   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_ar_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,459   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,461   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,463   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,464   copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar
2025-08-31T08:28:35,468   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,469   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,471   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,473   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,475   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,477   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,479   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,480   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,482   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,484   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,486   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,487   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,489   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,491   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,492   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,494   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,496   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,498   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,500   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,502   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,504   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,505   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,507   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_nl_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,509   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,511   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,512   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,514   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,516   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,518   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,519   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,521   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,523   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,525   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,527   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,529   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,530   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,532   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,534   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,536   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,537   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,539   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,541   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,543   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,545   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,547   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,549   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,550   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,552   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,553   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,555   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,557   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,558   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,560   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,562   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,564   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,566   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,567   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,569   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,571   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,572   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,574   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,576   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,578   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,579   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,581   copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl
2025-08-31T08:28:35,585   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,586   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,588   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,589   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,591   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,593   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,595   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,597   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,598   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,600   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,602   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,606   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,608   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,610   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,612   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,686   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,688   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,690   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,691   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_yo_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,693   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,695   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,697   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,699   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,701   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,703   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,705   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,706   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,708   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,710   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,712   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,713   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,715   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,717   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,719   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,721   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,723   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,725   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,727   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,729   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,731   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,733   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,735   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,737   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,739   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,741   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,742   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,744   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,747   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,752   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,755   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,757   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,758   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,760   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,762   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,763   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,765   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,767   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,769   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,771   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,772   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,774   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,776   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,778   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,780   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,782   copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo
2025-08-31T08:28:35,785   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,786   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,788   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,789   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,791   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,793   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,795   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,797   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,799   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,801   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,804   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,806   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,808   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,811   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,813   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,815   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,818   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,820   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,822   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,825   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,827   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,829   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,832   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,834   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,836   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,838   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,841   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,843   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,845   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,847   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,850   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,852   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,854   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,857   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,859   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,862   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,864   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,866   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,869   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,871   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_ig_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,873   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,875   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,878   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,880   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,883   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,885   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,888   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,890   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,892   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,894   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,896   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,899   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,900   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,902   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,904   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,906   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,908   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,910   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,911   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,913   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,915   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,917   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,918   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,920   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,922   copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig
2025-08-31T08:28:35,925   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,926   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,929   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,930   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,932   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,934   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,936   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,938   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_fil_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,939   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,941   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,943   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,945   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,946   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,948   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,950   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,951   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,953   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,955   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,957   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,959   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,961   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,963   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,964   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,966   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,968   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,969   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,971   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,972   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,974   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,976   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,977   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,980   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,982   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,983   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,985   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,987   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,988   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,990   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,992   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,994   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,996   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,998   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:35,999   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,001   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,003   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,005   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,007   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,008   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,010   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,012   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,013   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,015   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,017   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,019   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,021   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,022   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,024   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,026   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,028   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,030   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,031   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,033   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,035   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,037   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,038   copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil
2025-08-31T08:28:36,042   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,043   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,044   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,046   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,048   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,050   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,051   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,053   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,055   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,057   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,058   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,060   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,062   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,064   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,065   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,067   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,069   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,071   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,072   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,074   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_cs_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,076   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,078   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,080   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,081   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,083   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,084   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,086   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,088   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,089   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,091   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,093   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,094   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,096   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,098   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,100   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,102   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,103   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,105   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,107   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,109   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,110   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,112   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,114   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,116   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,118   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,119   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,121   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,123   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,125   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,126   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,128   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,130   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,131   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,133   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,135   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,137   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,138   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,140   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,142   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,144   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,146   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,147   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,149   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,151   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,152   copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs
2025-08-31T08:28:36,156   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,157   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,159   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,161   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,162   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,164   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,166   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,168   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,170   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,171   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,173   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,175   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,176   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,178   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,180   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,182   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,184   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,185   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,187   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,189   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,191   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,193   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,195   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,196   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,198   copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,200   copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,201   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,203   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,205   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,206   copying build/lib/lm_eval/tasks/global_mmlu/full/es/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,208   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,210   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,212   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,214   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,215   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,217   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,219   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,220   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,222   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,224   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,225   copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,227   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,229   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,231   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,233   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,235   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,236   copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,238   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,239   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,241   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,243   copying build/lib/lm_eval/tasks/global_mmlu/full/es/_es_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,244   copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,246   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,248   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,250   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,251   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,253   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,255   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,257   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,258   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,260   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,262   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,264   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,266   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,267   copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es
2025-08-31T08:28:36,271   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,272   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,274   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,275   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,277   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,279   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_lt_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,280   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,282   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,284   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,286   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,287   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,289   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,291   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,293   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,295   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,297   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,298   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,300   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,302   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,304   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,306   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,307   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,309   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,311   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,313   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,315   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,316   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,318   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,319   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,321   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,323   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,324   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,326   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,328   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,330   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,331   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,333   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,335   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,337   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,339   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,340   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,342   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,344   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,346   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,348   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,350   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,351   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,353   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,355   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,356   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,358   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,360   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,361   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,363   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,365   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,367   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,368   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,370   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,372   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,374   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,376   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,377   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,379   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,381   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,383   copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt
2025-08-31T08:28:36,386   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,388   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,389   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,391   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,393   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,394   copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,396   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,398   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,400   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,401   copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,403   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,405   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,407   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,409   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,411   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,412   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,414   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,416   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,418   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,419   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,421   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,423   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,425   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,427   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,428   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,430   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,432   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,434   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,435   copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,437   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,439   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,440   copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,442   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,444   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,446   copying build/lib/lm_eval/tasks/global_mmlu/full/am/_am_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,448   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,449   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,451   copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,453   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,455   copying build/lib/lm_eval/tasks/global_mmlu/full/am/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,457   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,458   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,460   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,462   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,464   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,466   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,468   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,469   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,471   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,473   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,474   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,476   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,478   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,480   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,481   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,483   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,485   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,487   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,489   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,490   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,492   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,494   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,496   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,498   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,500   copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am
2025-08-31T08:28:36,503   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,504   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,507   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,509   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,510   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,512   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,514   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,515   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,517   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,519   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,521   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,522   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,524   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,526   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,527   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,529   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,531   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,532   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,534   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,536   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,538   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,540   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,541   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,543   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,545   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,546   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,548   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,550   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,552   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,553   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,555   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,557   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,558   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,560   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,562   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,564   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,566   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,567   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,569   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_sw_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,571   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,573   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,575   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,576   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,578   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,580   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,582   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,583   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,585   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,587   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,589   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,591   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,592   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,594   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,596   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,598   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,599   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,601   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,603   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,605   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,607   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,608   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,610   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,612   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,614   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,616   copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw
2025-08-31T08:28:36,619   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,620   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,622   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,624   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,625   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,627   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,629   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,631   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,632   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,634   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,636   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,637   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,639   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,641   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,643   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,644   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,646   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,648   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,650   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,652   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,653   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,655   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,657   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,658   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,660   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,662   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,664   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,665   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,667   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,669   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,670   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,672   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,674   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,676   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,678   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,680   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,681   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,683   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,685   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,687   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,689   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,690   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,692   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,694   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,696   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_fa_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,698   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,700   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,701   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,703   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,705   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,706   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,708   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,710   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,712   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,713   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,715   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,717   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,719   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,720   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,722   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,724   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,726   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,727   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,729   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,731   copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa
2025-08-31T08:28:36,734   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,735   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,737   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,739   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,741   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,742   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,744   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,746   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,748   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,749   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,751   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,753   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,754   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,756   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,758   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,760   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,762   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,763   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,765   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,767   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,768   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,770   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,772   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,774   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,776   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,777   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,779   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,780   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,782   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,784   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,785   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,787   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,789   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,791   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_ja_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,792   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,794   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,796   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,798   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,799   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,801   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,803   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,804   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,806   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,808   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,810   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,811   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,813   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,815   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,816   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,818   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,820   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,821   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,823   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,825   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,827   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,828   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,830   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,831   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,833   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,835   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,837   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,839   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,840   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,842   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,844   copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja
2025-08-31T08:28:36,847   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,849   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,851   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,852   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,854   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,856   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,858   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,859   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,861   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,863   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,865   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,867   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,868   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,870   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,872   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,874   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,876   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,877   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,879   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,881   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,883   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,885   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,887   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,888   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,890   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,892   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,894   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,895   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,897   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_ko_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,899   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,901   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,903   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,904   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,906   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,908   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,910   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,912   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,913   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,915   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,917   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,919   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,920   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,922   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,924   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,926   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,928   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,929   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,931   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,933   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,935   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,936   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,938   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,940   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,941   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,943   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,945   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,947   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,949   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,950   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,952   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,954   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,956   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,957   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,959   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,961   copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko
2025-08-31T08:28:36,964   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:36,966   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:36,968   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:36,970   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:36,971   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:36,973   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:36,975   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:36,976   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:36,978   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:36,980   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:36,982   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:36,983   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:36,985   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_pl_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:36,987   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:36,989   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:36,990   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:36,992   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:36,994   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:36,996   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:36,997   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:36,999   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,001   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,003   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,005   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,007   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,009   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,010   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,012   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,014   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,015   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,017   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,019   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,020   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,022   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,024   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,026   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,027   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,029   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,031   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,033   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,034   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,036   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,038   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,040   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,041   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,043   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,045   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,047   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,049   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,050   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,052   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,054   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,055   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,057   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,059   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,060   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,062   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,064   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,066   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,067   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,069   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,071   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,073   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,074   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,076   copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl
2025-08-31T08:28:37,080   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,081   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,083   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,085   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,086   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,088   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,090   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,091   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,093   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,095   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,097   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,099   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,101   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,103   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,105   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,107   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,109   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,111   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,113   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,115   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,118   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,120   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,122   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,124   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,126   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,129   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,131   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,133   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,135   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,137   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,139   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,141   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,143   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,145   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,148   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,150   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,152   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,154   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,156   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,158   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,160   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,162   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,165   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,167   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,169   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,171   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,175   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,177   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,179   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,181   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,183   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,186   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,188   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,190   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,192   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,194   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,196   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,198   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_ne_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,200   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,202   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,205   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,207   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,208   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,210   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,212   copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne
2025-08-31T08:28:37,216   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,217   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,219   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,221   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,223   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,224   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,226   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,228   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,229   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,231   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,234   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,236   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,238   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,241   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,243   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,246   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,249   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,251   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,253   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,255   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,257   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,258   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,260   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,262   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,264   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,266   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,268   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,269   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,271   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,273   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,275   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,277   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,279   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,280   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,282   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_pt_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,284   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,286   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,288   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,290   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,291   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,293   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,295   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,297   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,299   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,301   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,303   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,305   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,307   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,309   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,311   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,313   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,315   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,317   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,320   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,322   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,324   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,326   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,329   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,331   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,333   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,335   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,337   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,339   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,342   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,344   copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt
2025-08-31T08:28:37,348   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,350   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,352   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,354   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,357   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,359   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,361   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,363   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,365   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,367   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,369   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,372   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,374   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,376   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,378   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,380   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,383   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,385   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,387   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,389   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,392   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,394   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,396   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,398   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,401   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,403   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,405   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,407   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,409   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,411   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,413   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,415   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,416   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,418   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,420   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,422   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,423   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,425   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,427   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,429   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,431   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,432   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,434   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,436   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,438   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,440   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,441   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,443   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,445   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,447   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,449   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,450   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,452   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,454   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_ny_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,456   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,457   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,459   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,461   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,463   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,465   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,467   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,471   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,472   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,474   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,476   copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny
2025-08-31T08:28:37,479   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,480   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,482   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,484   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,486   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,488   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,489   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,491   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,493   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,495   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,497   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,499   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,501   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_tr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,503   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,505   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,507   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,509   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,511   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,514   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,518   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,521   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,523   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,525   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,527   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,529   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,531   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,532   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,534   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,536   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,538   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,539   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,541   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,543   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,544   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,546   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,548   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,550   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,552   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,554   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,556   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,557   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,559   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,561   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,563   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,565   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,567   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,569   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,570   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,572   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,574   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,575   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,577   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,579   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,581   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,582   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,584   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,586   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,587   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,589   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,591   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,593   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,594   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,596   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,599   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,602   copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr
2025-08-31T08:28:37,605   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,607   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,609   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,610   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,612   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,614   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,616   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,617   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,621   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,622   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,624   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,626   copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,628   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,630   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,631   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,633   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,635   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,637   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,638   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,640   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,642   copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,644   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,646   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,648   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,650   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,651   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,653   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,655   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,657   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,659   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,660   copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,662   copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,664   copying build/lib/lm_eval/tasks/global_mmlu/full/te/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,666   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,667   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,669   copying build/lib/lm_eval/tasks/global_mmlu/full/te/_te_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,671   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,673   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,674   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,676   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,678   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,680   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,682   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,683   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,685   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,687   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,688   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,690   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,692   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,694   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,695   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,697   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,699   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,701   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,702   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,704   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,706   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,707   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,709   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,711   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,713   copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,714   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,716   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,718   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,720   copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te
2025-08-31T08:28:37,723   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,724   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,726   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,728   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,729   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,731   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,733   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,735   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,736   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,738   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,740   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,741   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,743   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,745   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,746   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,748   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,750   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,752   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,754   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,756   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,757   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,759   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,761   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,762   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,764   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,766   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,768   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,770   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,771   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,773   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,775   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,777   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,779   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,780   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,782   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,784   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,786   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,788   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,789   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,791   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,793   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,795   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,796   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,798   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,800   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,802   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,804   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,806   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,808   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,810   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,812   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,813   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,815   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_ky_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,817   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,819   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,820   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,822   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,824   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,826   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,828   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,830   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,832   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,833   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,835   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,837   copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky
2025-08-31T08:28:37,841   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,842   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_ms_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,844   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,846   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,847   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,849   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,851   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,853   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,855   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,856   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,858   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,860   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,862   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,863   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,865   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,867   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,869   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,870   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,872   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,874   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,876   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,877   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,879   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,881   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,883   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,885   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,886   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,888   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,890   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,892   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,894   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,895   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,897   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,899   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,901   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,902   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,904   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,906   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,907   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,909   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,911   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,913   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,914   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,916   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,918   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,920   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,922   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,923   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,925   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,927   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,928   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,930   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,932   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,933   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,935   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,937   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,938   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,940   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,942   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,943   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,945   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,947   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,949   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,950   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,952   copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms
2025-08-31T08:28:37,955   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,956   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,958   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,960   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,962   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,964   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,966   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,967   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,969   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,971   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,973   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,974   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,976   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_mg_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,978   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,980   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,981   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,983   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,985   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,987   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,988   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,990   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,992   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,994   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,996   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,998   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:37,999   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,001   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,003   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,005   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,007   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,008   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,010   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,012   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,014   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,015   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,017   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,019   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,021   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,023   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,024   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,026   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,028   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,030   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,032   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,033   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,035   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,037   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,039   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,041   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,042   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,044   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,046   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,048   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,049   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,051   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,053   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,054   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,056   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,058   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,059   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,061   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,062   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,064   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,066   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,068   copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg
2025-08-31T08:28:38,071   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,072   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,074   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,076   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,078   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,080   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,081   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,083   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,085   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,087   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,088   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,090   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,092   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,093   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,095   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,097   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,098   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,100   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,102   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,103   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,105   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,107   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,108   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,110   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,112   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,114   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,115   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,117   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,119   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,120   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,122   copying build/lib/lm_eval/tasks/global_mmlu/full/el/_el_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,124   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,126   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,127   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,129   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,130   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,132   copying build/lib/lm_eval/tasks/global_mmlu/full/el/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,134   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,136   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,137   copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,139   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,141   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,142   copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,144   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,146   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,148   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,150   copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,151   copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,153   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,155   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,157   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,158   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,160   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,161   copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,163   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,165   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,167   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,168   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,170   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,172   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,173   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,175   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,177   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,178   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,180   copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el
2025-08-31T08:28:38,184   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,185   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,186   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,188   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,190   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,192   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,193   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,195   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,197   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,198   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,200   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,202   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,203   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,205   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,206   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,208   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,209   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,211   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,213   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,214   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,216   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,218   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,220   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,221   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,223   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,225   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,226   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,228   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,230   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,231   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,233   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,235   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,236   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,238   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,240   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,241   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,243   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,245   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,247   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,248   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,250   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,252   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,254   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,255   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,257   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,259   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,261   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,262   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,264   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,266   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,268   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,269   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,271   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,273   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,274   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,276   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,278   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,279   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,281   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_sv_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,282   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,284   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,286   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,288   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,289   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,291   copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv
2025-08-31T08:28:38,294   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,296   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,298   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,300   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,301   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,303   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,305   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,307   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,308   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,310   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,312   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,313   copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,315   copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,317   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,318   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,320   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,322   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,323   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,325   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,327   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,328   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,330   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,332   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,334   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,336   copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,337   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,339   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,341   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,343   copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,344   copying build/lib/lm_eval/tasks/global_mmlu/full/so/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,346   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,348   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,349   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,351   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,353   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,354   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,356   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,358   copying build/lib/lm_eval/tasks/global_mmlu/full/so/_so_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,360   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,361   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,363   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,365   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,367   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,369   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,370   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,372   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,374   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,376   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,378   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,379   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,381   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,383   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,385   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,387   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,388   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,390   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,392   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,394   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,395   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,397   copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,399   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,401   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,402   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,404   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,406   copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so
2025-08-31T08:28:38,409   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,410   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,412   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,414   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,415   copying build/lib/lm_eval/tasks/global_mmlu/full/id/_id_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,417   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,419   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,421   copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,422   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,424   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,426   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,427   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,429   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,430   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,432   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,434   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,436   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,437   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,439   copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,441   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,443   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,444   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,446   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,448   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,450   copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,451   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,453   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,455   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,457   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,459   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,460   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,462   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,464   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,465   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,467   copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,469   copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,471   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,472   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,474   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,476   copying build/lib/lm_eval/tasks/global_mmlu/full/id/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,478   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,479   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,481   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,483   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,485   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,486   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,488   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,490   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,492   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,494   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,496   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,498   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,499   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,501   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,503   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,505   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,506   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,508   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,510   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,511   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,513   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,515   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,517   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,519   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,520   copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id
2025-08-31T08:28:38,524   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,525   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,527   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,528   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,530   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,532   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,534   copying build/lib/lm_eval/tasks/global_mmlu/full/it/_it_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,536   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,538   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,539   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,541   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,543   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,545   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,546   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,548   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,550   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,552   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,553   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,555   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,557   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,559   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,561   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,562   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,564   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,566   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,568   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,570   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,572   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,573   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,575   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,577   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,579   copying build/lib/lm_eval/tasks/global_mmlu/full/it/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,580   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,582   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,584   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,585   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,587   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,589   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,591   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,593   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,595   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,597   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,598   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,600   copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,602   copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,604   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,606   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,608   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,610   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,612   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,614   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,616   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,618   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,620   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,621   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,623   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,625   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,627   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,629   copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,631   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,632   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,634   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,636   copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,638   copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,640   copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it
2025-08-31T08:28:38,644   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,645   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,647   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,649   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,650   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,652   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,654   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,656   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_ru_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,657   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,659   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,661   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,663   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,664   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,666   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,668   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,669   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,671   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,673   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,674   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,676   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,678   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,680   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,682   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,683   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,685   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,687   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,689   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,691   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,693   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,695   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,697   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,699   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,700   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,702   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,703   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,705   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,707   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,709   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,711   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,712   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,714   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,716   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,718   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,720   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,722   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,724   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,726   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,727   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,729   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,731   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,733   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,735   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,736   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,738   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,740   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,742   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,744   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,745   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,747   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,749   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,751   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,753   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,755   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,757   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,758   copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru
2025-08-31T08:28:38,762   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,763   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,765   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,767   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,769   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,771   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,772   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,774   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,776   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,778   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,779   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,781   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,782   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,784   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,786   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,787   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,789   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,791   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,793   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,795   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,796   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,798   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,800   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,802   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,804   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,806   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,808   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,809   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,812   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,814   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,815   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,817   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,819   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,820   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,822   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,824   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,826   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,828   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,829   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,831   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_ro_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,833   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,834   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,836   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,838   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,840   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,842   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,843   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,845   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,847   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,849   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,851   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,853   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,854   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,856   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,858   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,859   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,861   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,863   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,864   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,866   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,868   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,870   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,872   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,873   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,875   copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro
2025-08-31T08:28:38,878   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,879   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,881   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,883   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,885   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,887   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,890   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,892   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,894   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,896   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,897   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,899   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,901   copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,903   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,905   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,907   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,909   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,911   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,912   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,915   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,916   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,918   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,920   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,922   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,924   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,926   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,927   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,929   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,931   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,933   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,935   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,937   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,939   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,941   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,943   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,945   copying build/lib/lm_eval/tasks/global_mmlu/full/de/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,947   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,949   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,951   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,952   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,954   copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,956   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,958   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,960   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,962   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,964   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,966   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,968   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,970   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,972   copying build/lib/lm_eval/tasks/global_mmlu/full/de/_de_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,974   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,976   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,978   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,980   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,982   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,984   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,986   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,988   copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,990   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,991   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,993   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,995   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,997   copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:38,999   copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:39,001   copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de
2025-08-31T08:28:39,005   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,006   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,008   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,010   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,012   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,014   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,016   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,018   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,020   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,022   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,023   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,025   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,027   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,028   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,030   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,032   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,035   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,037   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,039   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,041   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,043   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,044   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_zh_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,046   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,048   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,050   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,052   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,054   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,056   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,058   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,060   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,062   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,064   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,066   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,067   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,069   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,071   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,073   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,075   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,077   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,078   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,081   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,083   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,085   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,087   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,089   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,091   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,093   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,095   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,097   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,099   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,101   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,103   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,105   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,107   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,109   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,111   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,113   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,114   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,116   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,118   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,120   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,121   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,123   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,125   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,127   copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh
2025-08-31T08:28:39,131   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,133   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,134   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,136   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,138   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,140   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,141   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,143   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,145   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,147   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,149   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,150   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,152   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,154   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,156   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,158   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,160   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,162   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,163   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,165   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,167   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,168   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,170   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,172   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,174   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,175   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,178   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,180   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,182   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,184   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,187   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,188   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,191   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,193   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,195   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,197   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,198   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,200   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,202   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,204   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,206   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,208   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,210   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,212   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,214   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,216   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,217   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,219   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,222   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,224   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,226   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,227   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,229   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,231   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,233   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,235   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,237   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_ha_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,239   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,242   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,243   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,245   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,247   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,249   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,251   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,253   copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha
2025-08-31T08:28:39,255   copying build/lib/lm_eval/tasks/global_mmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu
2025-08-31T08:28:39,258   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default
2025-08-31T08:28:39,260   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/bn
2025-08-31T08:28:39,261   copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn
2025-08-31T08:28:39,263   copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn
2025-08-31T08:28:39,265   copying build/lib/lm_eval/tasks/global_mmlu/default/bn/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn
2025-08-31T08:28:39,268   copying build/lib/lm_eval/tasks/global_mmlu/default/bn/_global_mmlu_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn
2025-08-31T08:28:39,270   copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn
2025-08-31T08:28:39,272   copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn
2025-08-31T08:28:39,274   copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn
2025-08-31T08:28:39,276   copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn
2025-08-31T08:28:39,278   copying build/lib/lm_eval/tasks/global_mmlu/default/bn/_bn_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn
2025-08-31T08:28:39,280   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/hi
2025-08-31T08:28:39,282   copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi
2025-08-31T08:28:39,284   copying build/lib/lm_eval/tasks/global_mmlu/default/hi/_global_mmlu_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi
2025-08-31T08:28:39,286   copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi
2025-08-31T08:28:39,288   copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi
2025-08-31T08:28:39,290   copying build/lib/lm_eval/tasks/global_mmlu/default/hi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi
2025-08-31T08:28:39,292   copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi
2025-08-31T08:28:39,295   copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi
2025-08-31T08:28:39,297   copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi
2025-08-31T08:28:39,300   copying build/lib/lm_eval/tasks/global_mmlu/default/hi/_hi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi
2025-08-31T08:28:39,302   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/fr
2025-08-31T08:28:39,304   copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr
2025-08-31T08:28:39,306   copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr
2025-08-31T08:28:39,308   copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr
2025-08-31T08:28:39,311   copying build/lib/lm_eval/tasks/global_mmlu/default/fr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr
2025-08-31T08:28:39,313   copying build/lib/lm_eval/tasks/global_mmlu/default/fr/_global_mmlu_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr
2025-08-31T08:28:39,315   copying build/lib/lm_eval/tasks/global_mmlu/default/fr/_fr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr
2025-08-31T08:28:39,317   copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr
2025-08-31T08:28:39,319   copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr
2025-08-31T08:28:39,321   copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr
2025-08-31T08:28:39,324   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/en
2025-08-31T08:28:39,326   copying build/lib/lm_eval/tasks/global_mmlu/default/en/_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en
2025-08-31T08:28:39,328   copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en
2025-08-31T08:28:39,330   copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en
2025-08-31T08:28:39,333   copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en
2025-08-31T08:28:39,335   copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en
2025-08-31T08:28:39,337   copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en
2025-08-31T08:28:39,339   copying build/lib/lm_eval/tasks/global_mmlu/default/en/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en
2025-08-31T08:28:39,341   copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en
2025-08-31T08:28:39,343   copying build/lib/lm_eval/tasks/global_mmlu/default/en/_global_mmlu_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en
2025-08-31T08:28:39,346   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/ar
2025-08-31T08:28:39,347   copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar
2025-08-31T08:28:39,349   copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar
2025-08-31T08:28:39,351   copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar
2025-08-31T08:28:39,354   copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar
2025-08-31T08:28:39,356   copying build/lib/lm_eval/tasks/global_mmlu/default/ar/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar
2025-08-31T08:28:39,358   copying build/lib/lm_eval/tasks/global_mmlu/default/ar/_global_mmlu_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar
2025-08-31T08:28:39,361   copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar
2025-08-31T08:28:39,363   copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar
2025-08-31T08:28:39,365   copying build/lib/lm_eval/tasks/global_mmlu/default/ar/_ar_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar
2025-08-31T08:28:39,368   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/yo
2025-08-31T08:28:39,370   copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo
2025-08-31T08:28:39,372   copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo
2025-08-31T08:28:39,374   copying build/lib/lm_eval/tasks/global_mmlu/default/yo/_yo_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo
2025-08-31T08:28:39,376   copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo
2025-08-31T08:28:39,379   copying build/lib/lm_eval/tasks/global_mmlu/default/yo/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo
2025-08-31T08:28:39,381   copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo
2025-08-31T08:28:39,383   copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo
2025-08-31T08:28:39,386   copying build/lib/lm_eval/tasks/global_mmlu/default/yo/_global_mmlu_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo
2025-08-31T08:28:39,388   copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo
2025-08-31T08:28:39,391   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/es
2025-08-31T08:28:39,393   copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es
2025-08-31T08:28:39,395   copying build/lib/lm_eval/tasks/global_mmlu/default/es/_global_mmlu_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es
2025-08-31T08:28:39,397   copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es
2025-08-31T08:28:39,399   copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es
2025-08-31T08:28:39,402   copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es
2025-08-31T08:28:39,404   copying build/lib/lm_eval/tasks/global_mmlu/default/es/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es
2025-08-31T08:28:39,406   copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es
2025-08-31T08:28:39,408   copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es
2025-08-31T08:28:39,410   copying build/lib/lm_eval/tasks/global_mmlu/default/es/_es_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es
2025-08-31T08:28:39,413   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/sw
2025-08-31T08:28:39,415   copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw
2025-08-31T08:28:39,417   copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw
2025-08-31T08:28:39,420   copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw
2025-08-31T08:28:39,422   copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw
2025-08-31T08:28:39,424   copying build/lib/lm_eval/tasks/global_mmlu/default/sw/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw
2025-08-31T08:28:39,426   copying build/lib/lm_eval/tasks/global_mmlu/default/sw/_sw_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw
2025-08-31T08:28:39,428   copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw
2025-08-31T08:28:39,430   copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw
2025-08-31T08:28:39,432   copying build/lib/lm_eval/tasks/global_mmlu/default/sw/_global_mmlu_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw
2025-08-31T08:28:39,435   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/ja
2025-08-31T08:28:39,437   copying build/lib/lm_eval/tasks/global_mmlu/default/ja/_global_mmlu_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja
2025-08-31T08:28:39,439   copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja
2025-08-31T08:28:39,441   copying build/lib/lm_eval/tasks/global_mmlu/default/ja/_ja_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja
2025-08-31T08:28:39,443   copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja
2025-08-31T08:28:39,446   copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja
2025-08-31T08:28:39,448   copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja
2025-08-31T08:28:39,450   copying build/lib/lm_eval/tasks/global_mmlu/default/ja/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja
2025-08-31T08:28:39,452   copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja
2025-08-31T08:28:39,454   copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja
2025-08-31T08:28:39,457   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/ko
2025-08-31T08:28:39,459   copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko
2025-08-31T08:28:39,461   copying build/lib/lm_eval/tasks/global_mmlu/default/ko/_ko_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko
2025-08-31T08:28:39,463   copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko
2025-08-31T08:28:39,465   copying build/lib/lm_eval/tasks/global_mmlu/default/ko/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko
2025-08-31T08:28:39,467   copying build/lib/lm_eval/tasks/global_mmlu/default/ko/_global_mmlu_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko
2025-08-31T08:28:39,469   copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko
2025-08-31T08:28:39,472   copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko
2025-08-31T08:28:39,474   copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko
2025-08-31T08:28:39,476   copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko
2025-08-31T08:28:39,480   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/pt
2025-08-31T08:28:39,481   copying build/lib/lm_eval/tasks/global_mmlu/default/pt/_global_mmlu_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt
2025-08-31T08:28:39,483   copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt
2025-08-31T08:28:39,485   copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt
2025-08-31T08:28:39,488   copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt
2025-08-31T08:28:39,490   copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt
2025-08-31T08:28:39,492   copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt
2025-08-31T08:28:39,494   copying build/lib/lm_eval/tasks/global_mmlu/default/pt/_pt_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt
2025-08-31T08:28:39,496   copying build/lib/lm_eval/tasks/global_mmlu/default/pt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt
2025-08-31T08:28:39,498   copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt
2025-08-31T08:28:39,501   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/id
2025-08-31T08:28:39,502   copying build/lib/lm_eval/tasks/global_mmlu/default/id/_id_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id
2025-08-31T08:28:39,505   copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id
2025-08-31T08:28:39,507   copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id
2025-08-31T08:28:39,509   copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id
2025-08-31T08:28:39,511   copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id
2025-08-31T08:28:39,513   copying build/lib/lm_eval/tasks/global_mmlu/default/id/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id
2025-08-31T08:28:39,515   copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id
2025-08-31T08:28:39,517   copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id
2025-08-31T08:28:39,519   copying build/lib/lm_eval/tasks/global_mmlu/default/id/_global_mmlu_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id
2025-08-31T08:28:39,522   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/it
2025-08-31T08:28:39,523   copying build/lib/lm_eval/tasks/global_mmlu/default/it/_it_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it
2025-08-31T08:28:39,526   copying build/lib/lm_eval/tasks/global_mmlu/default/it/_global_mmlu_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it
2025-08-31T08:28:39,528   copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it
2025-08-31T08:28:39,530   copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it
2025-08-31T08:28:39,532   copying build/lib/lm_eval/tasks/global_mmlu/default/it/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it
2025-08-31T08:28:39,534   copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it
2025-08-31T08:28:39,537   copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it
2025-08-31T08:28:39,539   copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it
2025-08-31T08:28:39,541   copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it
2025-08-31T08:28:39,543   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/de
2025-08-31T08:28:39,545   copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de
2025-08-31T08:28:39,547   copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de
2025-08-31T08:28:39,549   copying build/lib/lm_eval/tasks/global_mmlu/default/de/_global_mmlu_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de
2025-08-31T08:28:39,551   copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de
2025-08-31T08:28:39,553   copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de
2025-08-31T08:28:39,555   copying build/lib/lm_eval/tasks/global_mmlu/default/de/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de
2025-08-31T08:28:39,557   copying build/lib/lm_eval/tasks/global_mmlu/default/de/_de_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de
2025-08-31T08:28:39,559   copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de
2025-08-31T08:28:39,561   copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de
2025-08-31T08:28:39,564   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/zh
2025-08-31T08:28:39,566   copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh
2025-08-31T08:28:39,568   copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh
2025-08-31T08:28:39,571   copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh
2025-08-31T08:28:39,573   copying build/lib/lm_eval/tasks/global_mmlu/default/zh/_zh_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh
2025-08-31T08:28:39,575   copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh
2025-08-31T08:28:39,577   copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh
2025-08-31T08:28:39,579   copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh
2025-08-31T08:28:39,581   copying build/lib/lm_eval/tasks/global_mmlu/default/zh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh
2025-08-31T08:28:39,583   copying build/lib/lm_eval/tasks/global_mmlu/default/zh/_global_mmlu_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh
2025-08-31T08:28:39,586   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kormedmcqa
2025-08-31T08:28:39,588   copying build/lib/lm_eval/tasks/kormedmcqa/dentist.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa
2025-08-31T08:28:39,590   copying build/lib/lm_eval/tasks/kormedmcqa/doctor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa
2025-08-31T08:28:39,592   copying build/lib/lm_eval/tasks/kormedmcqa/nurse.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa
2025-08-31T08:28:39,594   copying build/lib/lm_eval/tasks/kormedmcqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa
2025-08-31T08:28:39,597   copying build/lib/lm_eval/tasks/kormedmcqa/pharm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa
2025-08-31T08:28:39,599   copying build/lib/lm_eval/tasks/kormedmcqa/_kormedmcqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa
2025-08-31T08:28:39,601   copying build/lib/lm_eval/tasks/kormedmcqa/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa
2025-08-31T08:28:39,603   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/siqa
2025-08-31T08:28:39,604   copying build/lib/lm_eval/tasks/siqa/siqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/siqa
2025-08-31T08:28:39,606   copying build/lib/lm_eval/tasks/siqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/siqa
2025-08-31T08:28:39,609   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/minerva_math
2025-08-31T08:28:39,610   copying build/lib/lm_eval/tasks/minerva_math/minerva_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math
2025-08-31T08:28:39,612   copying build/lib/lm_eval/tasks/minerva_math/minerva_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math
2025-08-31T08:28:39,613   copying build/lib/lm_eval/tasks/minerva_math/minerva_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math
2025-08-31T08:28:39,615   copying build/lib/lm_eval/tasks/minerva_math/minerva_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math
2025-08-31T08:28:39,617   copying build/lib/lm_eval/tasks/minerva_math/minerva_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math
2025-08-31T08:28:39,619   copying build/lib/lm_eval/tasks/minerva_math/minerva_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math
2025-08-31T08:28:39,621   copying build/lib/lm_eval/tasks/minerva_math/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math
2025-08-31T08:28:39,625   copying build/lib/lm_eval/tasks/minerva_math/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math
2025-08-31T08:28:39,627   copying build/lib/lm_eval/tasks/minerva_math/minerva_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math
2025-08-31T08:28:39,629   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/logiqa2
2025-08-31T08:28:39,630   copying build/lib/lm_eval/tasks/logiqa2/logieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2
2025-08-31T08:28:39,632   copying build/lib/lm_eval/tasks/logiqa2/logiqa2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2
2025-08-31T08:28:39,634   copying build/lib/lm_eval/tasks/logiqa2/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2
2025-08-31T08:28:39,637   copying build/lib/lm_eval/tasks/logiqa2/utils_logiqa2.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2
2025-08-31T08:28:39,639   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr
2025-08-31T08:28:39,642   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,643   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,645   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,647   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,649   copying build/lib/lm_eval/tasks/mmlusr/answer_only/_answer_only.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,651   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,653   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,654   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,656   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,658   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,661   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,662   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,665   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,667   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,669   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,670   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,672   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,674   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,676   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,678   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,680   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,682   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,683   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,685   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,687   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,689   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,692   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,693   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,695   copying build/lib/lm_eval/tasks/mmlusr/answer_only/_mmlusr_a_yml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,697   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,699   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,700   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,702   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,704   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,706   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,708   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,709   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,711   copying build/lib/lm_eval/tasks/mmlusr/answer_only/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,713   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,715   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,717   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,719   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,721   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,723   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,725   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,727   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,728   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,730   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,732   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,734   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,736   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,737   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,739   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,741   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,743   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,745   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,747   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,749   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,751   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,753   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,754   copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only
2025-08-31T08:28:39,758   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,759   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,761   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,763   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,764   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,766   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,769   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,771   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,772   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,775   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,777   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,779   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,781   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,782   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,784   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,786   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,788   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,789   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,791   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,793   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,795   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,797   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,799   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,801   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,803   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,805   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/_question_and_answer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,807   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,808   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,810   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,812   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,814   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,816   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,819   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,820   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,822   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,824   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,826   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,828   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,829   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,831   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,833   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/_mmlusr_qna_yml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,835   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,837   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,838   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,840   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,842   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,844   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,847   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,849   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,851   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,853   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,854   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,856   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,858   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,860   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,861   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,863   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,865   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,867   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,869   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,871   copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer
2025-08-31T08:28:39,873   copying build/lib/lm_eval/tasks/mmlusr/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr
2025-08-31T08:28:39,876   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,878   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,880   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,881   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,883   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,885   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,887   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,889   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,891   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,893   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,894   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,896   copying build/lib/lm_eval/tasks/mmlusr/question_only/_mmlusr_q_yml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,898   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,900   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,902   copying build/lib/lm_eval/tasks/mmlusr/question_only/_question_only.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,903   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,905   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,907   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,909   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,910   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,912   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,914   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,916   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,918   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,920   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,921   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,924   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,926   copying build/lib/lm_eval/tasks/mmlusr/question_only/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,928   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,929   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,931   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,933   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,935   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,937   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,938   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,940   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,942   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,944   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,946   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,948   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,950   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,952   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,954   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,956   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,957   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,959   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,961   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,963   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,965   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,966   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,968   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,970   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,972   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,974   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,976   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,977   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,979   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,981   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,983   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,985   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,986   copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only
2025-08-31T08:28:39,988   copying build/lib/lm_eval/tasks/mmlusr/config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr
2025-08-31T08:28:39,991   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/swde
2025-08-31T08:28:39,992   copying build/lib/lm_eval/tasks/swde/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swde
2025-08-31T08:28:39,994   copying build/lib/lm_eval/tasks/swde/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swde
2025-08-31T08:28:39,996   copying build/lib/lm_eval/tasks/swde/swde.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swde
2025-08-31T08:28:39,999   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada
2025-08-31T08:28:40,000   copying build/lib/lm_eval/tasks/lambada/lambada_openai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada
2025-08-31T08:28:40,002   copying build/lib/lm_eval/tasks/lambada/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada
2025-08-31T08:28:40,003   copying build/lib/lm_eval/tasks/lambada/lambada_standard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada
2025-08-31T08:28:40,006   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli
2025-08-31T08:28:40,007   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt
2025-08-31T08:28:40,009   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:40,010   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:40,012   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:40,014   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:40,016   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:40,018   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:40,020   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:40,022   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:40,024   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:40,025   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:40,027   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:40,029   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:40,031   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:40,032   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:40,034   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:40,036   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:40,038   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:40,040   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:40,042   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:40,044   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate
2025-08-31T08:28:40,046   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:40,048   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:40,049   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:40,051   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:40,053   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:40,055   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:40,057   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:40,059   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:40,061   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:40,063   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:40,065   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:40,066   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:40,068   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:40,070   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:40,072   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:40,073   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:40,075   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:40,077   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:40,078   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:40,080   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:40,082   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct
2025-08-31T08:28:40,085   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:40,087   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:40,089   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:40,090   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:40,092   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:40,094   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:40,096   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:40,098   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:40,100   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:40,101   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:40,103   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:40,105   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:40,107   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:40,109   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:40,111   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:40,113   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:40,115   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:40,117   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:40,118   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:40,120   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:40,122   copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct
2025-08-31T08:28:40,124   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate
2025-08-31T08:28:40,126   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:40,128   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:40,130   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:40,132   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:40,133   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:40,136   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:40,138   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:40,140   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:40,142   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:40,144   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:40,145   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:40,147   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:40,149   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:40,151   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:40,152   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:40,154   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:40,156   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:40,158   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:40,159   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:40,161   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4
2025-08-31T08:28:40,164   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:40,165   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:40,168   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:40,170   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:40,171   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:40,173   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:40,175   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:40,177   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:40,179   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:40,180   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:40,182   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:40,184   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:40,186   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:40,188   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:40,190   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:40,192   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:40,193   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:40,195   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:40,197   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:40,199   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2
2025-08-31T08:28:40,200   copying build/lib/lm_eval/tasks/afrixnli/translate/afrixnli_tt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate
2025-08-31T08:28:40,203   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:40,204   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:40,206   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:40,208   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:40,210   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:40,212   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:40,215   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:40,217   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:40,219   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:40,221   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:40,223   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:40,225   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:40,227   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:40,228   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:40,230   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:40,232   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:40,233   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:40,235   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:40,238   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:40,239   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5
2025-08-31T08:28:40,242   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:40,243   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:40,245   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:40,247   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:40,249   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:40,251   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:40,253   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:40,254   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:40,256   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:40,258   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:40,260   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:40,262   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:40,264   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:40,266   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:40,268   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:40,270   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:40,272   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:40,273   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:40,275   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:40,277   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1
2025-08-31T08:28:40,279   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:40,280   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:40,282   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:40,283   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:40,285   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:40,287   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:40,289   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:40,291   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:40,293   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:40,295   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:40,297   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:40,299   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:40,301   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:40,302   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:40,304   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:40,306   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:40,308   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:40,310   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:40,311   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:40,313   copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3
2025-08-31T08:28:40,314   copying build/lib/lm_eval/tasks/afrixnli/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli
2025-08-31T08:28:40,317   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/lai prompt
2025-08-31T08:28:40,319   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:40,320   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:40,322   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:40,324   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:40,326   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:40,328   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:40,329   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:40,331   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:40,333   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:40,335   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:40,337   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:40,338   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:40,340   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:40,342   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:40,344   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:40,346   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:40,348   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:40,349   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:40,351   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:40,353   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate
2025-08-31T08:28:40,355   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:40,357   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:40,358   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:40,360   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:40,362   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:40,364   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:40,365   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:40,367   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:40,369   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:40,371   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:40,373   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:40,375   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:40,377   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:40,378   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:40,380   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:40,382   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:40,384   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:40,386   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:40,387   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:40,389   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:40,390   copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct
2025-08-31T08:28:40,392   copying build/lib/lm_eval/tasks/afrixnli/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli
2025-08-31T08:28:40,394   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct
2025-08-31T08:28:40,396   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:40,397   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:40,399   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:40,401   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:40,403   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:40,404   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:40,406   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:40,408   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:40,410   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:40,412   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:40,414   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:40,416   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:40,417   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:40,419   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:40,421   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:40,423   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:40,425   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:40,427   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:40,428   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:40,430   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:40,432   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4
2025-08-31T08:28:40,434   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:40,435   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:40,437   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:40,439   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:40,440   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:40,442   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:40,444   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:40,446   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:40,447   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:40,449   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:40,451   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:40,453   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:40,455   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:40,457   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:40,459   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:40,460   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:40,462   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:40,464   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:40,466   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:40,468   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:40,470   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2
2025-08-31T08:28:40,472   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:40,473   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:40,475   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:40,477   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:40,478   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:40,480   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:40,482   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:40,483   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:40,485   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:40,487   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:40,488   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:40,490   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:40,492   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:40,494   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:40,496   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:40,497   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:40,499   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:40,501   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:40,503   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:40,505   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:40,506   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5
2025-08-31T08:28:40,509   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:40,510   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:40,512   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:40,514   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:40,516   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:40,518   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:40,520   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:40,522   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:40,524   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:40,526   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:40,529   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:40,531   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:40,532   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:40,534   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:40,536   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:40,538   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:40,539   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:40,541   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:40,543   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:40,545   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:40,547   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1
2025-08-31T08:28:40,549   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:40,550   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:40,552   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:40,554   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:40,556   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:40,559   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:40,560   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:40,562   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:40,564   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:40,565   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:40,567   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:40,569   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:40,571   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:40,573   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:40,575   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:40,577   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:40,579   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:40,581   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:40,583   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:40,585   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:40,586   copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3
2025-08-31T08:28:40,588   copying build/lib/lm_eval/tasks/afrixnli/direct/afrixnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct
2025-08-31T08:28:40,590   copying build/lib/lm_eval/tasks/afrixnli/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli
2025-08-31T08:28:40,593   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/copal_id
2025-08-31T08:28:40,594   copying build/lib/lm_eval/tasks/copal_id/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id
2025-08-31T08:28:40,596   copying build/lib/lm_eval/tasks/copal_id/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id
2025-08-31T08:28:40,598   copying build/lib/lm_eval/tasks/copal_id/standard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id
2025-08-31T08:28:40,600   copying build/lib/lm_eval/tasks/copal_id/colloquial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id
2025-08-31T08:28:40,604   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/blimp
2025-08-31T08:28:40,605   copying build/lib/lm_eval/tasks/blimp/wh_vs_that_with_gap_long_distance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,607   copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_irregular_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,609   copying build/lib/lm_eval/tasks/blimp/adjunct_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,611   copying build/lib/lm_eval/tasks/blimp/_blimp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,613   copying build/lib/lm_eval/tasks/blimp/principle_A_case_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,614   copying build/lib/lm_eval/tasks/blimp/passive_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,616   copying build/lib/lm_eval/tasks/blimp/wh_questions_object_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,618   copying build/lib/lm_eval/tasks/blimp/drop_argument.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,620   copying build/lib/lm_eval/tasks/blimp/ellipsis_n_bar_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,621   copying build/lib/lm_eval/tasks/blimp/anaphor_gender_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,623   copying build/lib/lm_eval/tasks/blimp/expletive_it_object_raising.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,625   copying build/lib/lm_eval/tasks/blimp/principle_A_domain_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,627   copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,629   copying build/lib/lm_eval/tasks/blimp/npi_present_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,631   copying build/lib/lm_eval/tasks/blimp/matrix_question_npi_licensor_present.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,632   copying build/lib/lm_eval/tasks/blimp/complex_NP_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,634   copying build/lib/lm_eval/tasks/blimp/wh_vs_that_no_gap_long_distance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,636   copying build/lib/lm_eval/tasks/blimp/ellipsis_n_bar_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,638   copying build/lib/lm_eval/tasks/blimp/principle_A_case_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,640   copying build/lib/lm_eval/tasks/blimp/only_npi_licensor_present.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,642   copying build/lib/lm_eval/tasks/blimp/coordinate_structure_constraint_object_extraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,644   copying build/lib/lm_eval/tasks/blimp/intransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,646   copying build/lib/lm_eval/tasks/blimp/existential_there_subject_raising.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,647   copying build/lib/lm_eval/tasks/blimp/animate_subject_trans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,649   copying build/lib/lm_eval/tasks/blimp/animate_subject_passive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,651   copying build/lib/lm_eval/tasks/blimp/principle_A_reconstruction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,653   copying build/lib/lm_eval/tasks/blimp/wh_questions_subject_gap_long_distance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,655   copying build/lib/lm_eval/tasks/blimp/generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,657   copying build/lib/lm_eval/tasks/blimp/principle_A_c_command.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,659   copying build/lib/lm_eval/tasks/blimp/left_branch_island_simple_question.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,661   copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,663   copying build/lib/lm_eval/tasks/blimp/sentential_subject_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,664   copying build/lib/lm_eval/tasks/blimp/tough_vs_raising_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,666   copying build/lib/lm_eval/tasks/blimp/distractor_agreement_relational_noun.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,668   copying build/lib/lm_eval/tasks/blimp/distractor_agreement_relative_clause.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,670   copying build/lib/lm_eval/tasks/blimp/irregular_past_participle_verbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,672   copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_irregular_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,674   copying build/lib/lm_eval/tasks/blimp/causative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,675   copying build/lib/lm_eval/tasks/blimp/anaphor_number_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,677   copying build/lib/lm_eval/tasks/blimp/irregular_past_participle_adjectives.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,679   copying build/lib/lm_eval/tasks/blimp/principle_A_domain_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,681   copying build/lib/lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,683   copying build/lib/lm_eval/tasks/blimp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,686   copying build/lib/lm_eval/tasks/blimp/passive_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,688   copying build/lib/lm_eval/tasks/blimp/tough_vs_raising_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,691   copying build/lib/lm_eval/tasks/blimp/sentential_negation_npi_scope.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,694   copying build/lib/lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,696   copying build/lib/lm_eval/tasks/blimp/existential_there_quantifiers_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,698   copying build/lib/lm_eval/tasks/blimp/superlative_quantifiers_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,700   copying build/lib/lm_eval/tasks/blimp/only_npi_scope.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,702   copying build/lib/lm_eval/tasks/blimp/existential_there_object_raising.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,704   copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adjective_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,705   copying build/lib/lm_eval/tasks/blimp/superlative_quantifiers_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,707   copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,709   copying build/lib/lm_eval/tasks/blimp/left_branch_island_echo_question.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,711   copying build/lib/lm_eval/tasks/blimp/principle_A_domain_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,713   copying build/lib/lm_eval/tasks/blimp/transitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,714   copying build/lib/lm_eval/tasks/blimp/inchoative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,716   copying build/lib/lm_eval/tasks/blimp/wh_vs_that_no_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,718   copying build/lib/lm_eval/tasks/blimp/wh_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,720   copying build/lib/lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,721   copying build/lib/lm_eval/tasks/blimp/existential_there_quantifiers_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,723   copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,725   copying build/lib/lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,726   copying build/lib/lm_eval/tasks/blimp/coordinate_structure_constraint_complex_left_branch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,728   copying build/lib/lm_eval/tasks/blimp/wh_questions_subject_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,730   copying build/lib/lm_eval/tasks/blimp/sentential_negation_npi_licensor_present.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,732   copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,733   copying build/lib/lm_eval/tasks/blimp/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,735   copying build/lib/lm_eval/tasks/blimp/wh_vs_that_with_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,737   copying build/lib/lm_eval/tasks/blimp/npi_present_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp
2025-08-31T08:28:40,740   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox
2025-08-31T08:28:40,741   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:40,743   copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:40,745   copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:40,747   copying build/lib/lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:40,749   copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:40,751   copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:40,752   copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:40,754   copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:40,756   copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:40,759   copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:40,761   copying build/lib/lm_eval/tasks/mmlu_prox/bn/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:40,763   copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:40,765   copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:40,767   copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:40,770   copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:40,772   copying build/lib/lm_eval/tasks/mmlu_prox/bn/_bn_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:40,775   copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:40,777   copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn
2025-08-31T08:28:40,780   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:40,781   copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:40,783   copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:40,785   copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:40,787   copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:40,789   copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:40,791   copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:40,793   copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:40,795   copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:40,797   copying build/lib/lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:40,799   copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:40,801   copying build/lib/lm_eval/tasks/mmlu_prox/hi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:40,803   copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:40,805   copying build/lib/lm_eval/tasks/mmlu_prox/hi/_hi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:40,807   copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:40,809   copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:40,811   copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:40,813   copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi
2025-08-31T08:28:40,816   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:40,817   copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:40,819   copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:40,821   copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:40,823   copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:40,825   copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:40,826   copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:40,828   copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:40,830   copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:40,832   copying build/lib/lm_eval/tasks/mmlu_prox/fr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:40,834   copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:40,836   copying build/lib/lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:40,837   copying build/lib/lm_eval/tasks/mmlu_prox/fr/_fr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:40,839   copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:40,841   copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:40,843   copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:40,845   copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:40,847   copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr
2025-08-31T08:28:40,850   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:40,851   copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:40,853   copying build/lib/lm_eval/tasks/mmlu_prox/en/_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:40,856   copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:40,858   copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:40,860   copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:40,863   copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:40,864   copying build/lib/lm_eval/tasks/mmlu_prox/en/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:40,867   copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:40,868   copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:40,870   copying build/lib/lm_eval/tasks/mmlu_prox/en/_mmlu_prox_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:40,872   copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:40,874   copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:40,876   copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:40,878   copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:40,879   copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:40,881   copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:40,883   copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en
2025-08-31T08:28:40,885   copying build/lib/lm_eval/tasks/mmlu_prox/lang_libs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox
2025-08-31T08:28:40,888   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:40,889   copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:40,891   copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:40,893   copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:40,894   copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:40,896   copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:40,898   copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:40,900   copying build/lib/lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:40,902   copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:40,904   copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:40,906   copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:40,908   copying build/lib/lm_eval/tasks/mmlu_prox/ar/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:40,910   copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:40,911   copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:40,914   copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:40,916   copying build/lib/lm_eval/tasks/mmlu_prox/ar/_ar_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:40,918   copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:40,920   copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar
2025-08-31T08:28:40,922   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:40,923   copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:40,925   copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:40,927   copying build/lib/lm_eval/tasks/mmlu_prox/es/_mmlu_prox_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:40,929   copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:40,931   copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:40,933   copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:40,935   copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:40,937   copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:40,939   copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:40,941   copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:40,944   copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:40,946   copying build/lib/lm_eval/tasks/mmlu_prox/es/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:40,949   copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:40,951   copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:40,953   copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:40,955   copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:40,957   copying build/lib/lm_eval/tasks/mmlu_prox/es/_es_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es
2025-08-31T08:28:40,960   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:40,961   copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:40,963   copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:40,965   copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:40,967   copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:40,969   copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:40,971   copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:40,973   copying build/lib/lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:40,975   copying build/lib/lm_eval/tasks/mmlu_prox/sw/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:40,977   copying build/lib/lm_eval/tasks/mmlu_prox/sw/_sw_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:40,979   copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:40,981   copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:40,982   copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:40,984   copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:40,986   copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:40,988   copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:40,990   copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:40,992   copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw
2025-08-31T08:28:40,994   copying build/lib/lm_eval/tasks/mmlu_prox/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox
2025-08-31T08:28:40,997   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:40,998   copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:41,000   copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:41,002   copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:41,004   copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:41,006   copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:41,008   copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:41,010   copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:41,012   copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:41,014   copying build/lib/lm_eval/tasks/mmlu_prox/ja/_ja_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:41,016   copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:41,018   copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:41,020   copying build/lib/lm_eval/tasks/mmlu_prox/ja/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:41,023   copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:41,025   copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:41,027   copying build/lib/lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:41,030   copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:41,032   copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja
2025-08-31T08:28:41,035   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:41,036   copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:41,038   copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:41,040   copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:41,042   copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:41,044   copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:41,045   copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:41,047   copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:41,049   copying build/lib/lm_eval/tasks/mmlu_prox/ko/_ko_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:41,051   copying build/lib/lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:41,053   copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:41,055   copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:41,057   copying build/lib/lm_eval/tasks/mmlu_prox/ko/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:41,059   copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:41,061   copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:41,063   copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:41,065   copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:41,067   copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko
2025-08-31T08:28:41,070   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:41,071   copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:41,073   copying build/lib/lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:41,075   copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:41,076   copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:41,078   copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:41,080   copying build/lib/lm_eval/tasks/mmlu_prox/pt/_pt_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:41,082   copying build/lib/lm_eval/tasks/mmlu_prox/pt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:41,084   copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:41,086   copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:41,088   copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:41,090   copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:41,091   copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:41,093   copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:41,095   copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:41,097   copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:41,099   copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:41,101   copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt
2025-08-31T08:28:41,103   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:41,104   copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:41,107   copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:41,109   copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:41,111   copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:41,114   copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:41,116   copying build/lib/lm_eval/tasks/mmlu_prox/th/_mmlu_prox_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:41,118   copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:41,120   copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:41,122   copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:41,124   copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:41,126   copying build/lib/lm_eval/tasks/mmlu_prox/th/_th_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:41,127   copying build/lib/lm_eval/tasks/mmlu_prox/th/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:41,130   copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:41,131   copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:41,133   copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:41,135   copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:41,137   copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th
2025-08-31T08:28:41,139   copying build/lib/lm_eval/tasks/mmlu_prox/mmlu_prox_config_generator.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox
2025-08-31T08:28:41,141   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/template
2025-08-31T08:28:41,142   copying build/lib/lm_eval/tasks/mmlu_prox/template/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/template
2025-08-31T08:28:41,144   copying build/lib/lm_eval/tasks/mmlu_prox/template/_lang_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/template
2025-08-31T08:28:41,147   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:41,148   copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:41,150   copying build/lib/lm_eval/tasks/mmlu_prox/de/_mmlu_prox_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:41,152   copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:41,153   copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:41,155   copying build/lib/lm_eval/tasks/mmlu_prox/de/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:41,157   copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:41,159   copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:41,161   copying build/lib/lm_eval/tasks/mmlu_prox/de/_de_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:41,163   copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:41,165   copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:41,167   copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:41,169   copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:41,171   copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:41,173   copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:41,175   copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:41,177   copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:41,178   copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de
2025-08-31T08:28:41,181   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:41,182   copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:41,184   copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:41,186   copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:41,187   copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:41,189   copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:41,191   copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:41,193   copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:41,195   copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:41,197   copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:41,200   copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:41,202   copying build/lib/lm_eval/tasks/mmlu_prox/zh/_zh_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:41,203   copying build/lib/lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:41,205   copying build/lib/lm_eval/tasks/mmlu_prox/zh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:41,208   copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:41,209   copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:41,211   copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:41,213   copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh
2025-08-31T08:28:41,216   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard
2025-08-31T08:28:41,216   copying build/lib/lm_eval/tasks/leaderboard/leaderboard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard
2025-08-31T08:28:41,219   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/gpqa
2025-08-31T08:28:41,220   copying build/lib/lm_eval/tasks/leaderboard/gpqa/gpqa_diamond_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa
2025-08-31T08:28:41,222   copying build/lib/lm_eval/tasks/leaderboard/gpqa/_leaderboard_gpqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa
2025-08-31T08:28:41,224   copying build/lib/lm_eval/tasks/leaderboard/gpqa/gpqa_main_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa
2025-08-31T08:28:41,226   copying build/lib/lm_eval/tasks/leaderboard/gpqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa
2025-08-31T08:28:41,228   copying build/lib/lm_eval/tasks/leaderboard/gpqa/gpqa_extended_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa
2025-08-31T08:28:41,230   copying build/lib/lm_eval/tasks/leaderboard/gpqa/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa
2025-08-31T08:28:41,232   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/musr
2025-08-31T08:28:41,233   copying build/lib/lm_eval/tasks/leaderboard/musr/musr_team_allocation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr
2025-08-31T08:28:41,235   copying build/lib/lm_eval/tasks/leaderboard/musr/_musr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr
2025-08-31T08:28:41,237   copying build/lib/lm_eval/tasks/leaderboard/musr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr
2025-08-31T08:28:41,238   copying build/lib/lm_eval/tasks/leaderboard/musr/musr_object_placements.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr
2025-08-31T08:28:41,240   copying build/lib/lm_eval/tasks/leaderboard/musr/musr_murder_mysteries.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr
2025-08-31T08:28:41,242   copying build/lib/lm_eval/tasks/leaderboard/musr/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr
2025-08-31T08:28:41,244   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/ifeval
2025-08-31T08:28:41,245   copying build/lib/lm_eval/tasks/leaderboard/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval
2025-08-31T08:28:41,249   copying build/lib/lm_eval/tasks/leaderboard/ifeval/_leaderboard_instruction_following.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval
2025-08-31T08:28:41,251   copying build/lib/lm_eval/tasks/leaderboard/ifeval/ifeval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval
2025-08-31T08:28:41,253   copying build/lib/lm_eval/tasks/leaderboard/ifeval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval
2025-08-31T08:28:41,255   copying build/lib/lm_eval/tasks/leaderboard/ifeval/instructions_util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval
2025-08-31T08:28:41,258   copying build/lib/lm_eval/tasks/leaderboard/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval
2025-08-31T08:28:41,261   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,262   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,264   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,266   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,268   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,269   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,271   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,273   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,275   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,277   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,279   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,282   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,284   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,286   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,289   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,291   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,293   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,296   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,298   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,299   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,301   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,303   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/_leaderboard_bbh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,304   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,306   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,308   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,309   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,311   copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc
2025-08-31T08:28:41,313   copying build/lib/lm_eval/tasks/leaderboard/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard
2025-08-31T08:28:41,316   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/mmlu_pro
2025-08-31T08:28:41,317   copying build/lib/lm_eval/tasks/leaderboard/mmlu_pro/mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/mmlu_pro
2025-08-31T08:28:41,320   copying build/lib/lm_eval/tasks/leaderboard/mmlu_pro/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/mmlu_pro
2025-08-31T08:28:41,322   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/math
2025-08-31T08:28:41,323   copying build/lib/lm_eval/tasks/leaderboard/math/math_precalculus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math
2025-08-31T08:28:41,325   copying build/lib/lm_eval/tasks/leaderboard/math/_leaderboard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math
2025-08-31T08:28:41,326   copying build/lib/lm_eval/tasks/leaderboard/math/math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math
2025-08-31T08:28:41,328   copying build/lib/lm_eval/tasks/leaderboard/math/math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math
2025-08-31T08:28:41,330   copying build/lib/lm_eval/tasks/leaderboard/math/math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math
2025-08-31T08:28:41,332   copying build/lib/lm_eval/tasks/leaderboard/math/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math
2025-08-31T08:28:41,334   copying build/lib/lm_eval/tasks/leaderboard/math/math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math
2025-08-31T08:28:41,336   copying build/lib/lm_eval/tasks/leaderboard/math/math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math
2025-08-31T08:28:41,338   copying build/lib/lm_eval/tasks/leaderboard/math/math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math
2025-08-31T08:28:41,339   copying build/lib/lm_eval/tasks/leaderboard/math/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math
2025-08-31T08:28:41,342   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mc_taco
2025-08-31T08:28:41,343   copying build/lib/lm_eval/tasks/mc_taco/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mc_taco
2025-08-31T08:28:41,345   copying build/lib/lm_eval/tasks/mc_taco/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mc_taco
2025-08-31T08:28:41,347   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mediqa_qa2019
2025-08-31T08:28:41,348   copying build/lib/lm_eval/tasks/mediqa_qa2019/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019
2025-08-31T08:28:41,350   copying build/lib/lm_eval/tasks/mediqa_qa2019/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019
2025-08-31T08:28:41,352   copying build/lib/lm_eval/tasks/mediqa_qa2019/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019
2025-08-31T08:28:41,354   copying build/lib/lm_eval/tasks/mediqa_qa2019/mediqa_qa2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019
2025-08-31T08:28:41,355   copying build/lib/lm_eval/tasks/mediqa_qa2019/mediqa_qa2019_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019
2025-08-31T08:28:41,358   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/headqa
2025-08-31T08:28:41,359   copying build/lib/lm_eval/tasks/headqa/headqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/headqa
2025-08-31T08:28:41,361   copying build/lib/lm_eval/tasks/headqa/headqa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/headqa
2025-08-31T08:28:41,362   copying build/lib/lm_eval/tasks/headqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/headqa
2025-08-31T08:28:41,365   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/fda
2025-08-31T08:28:41,366   copying build/lib/lm_eval/tasks/fda/fda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fda
2025-08-31T08:28:41,368   copying build/lib/lm_eval/tasks/fda/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fda
2025-08-31T08:28:41,371   copying build/lib/lm_eval/tasks/fda/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fda
2025-08-31T08:28:41,374   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hrm8k
2025-08-31T08:28:41,376   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hrm8k/en
2025-08-31T08:28:41,377   copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_omni_math_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en
2025-08-31T08:28:41,379   copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_ksm_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en
2025-08-31T08:28:41,381   copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en
2025-08-31T08:28:41,383   copying build/lib/lm_eval/tasks/hrm8k/en/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en
2025-08-31T08:28:41,385   copying build/lib/lm_eval/tasks/hrm8k/en/_hrm8k_en_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en
2025-08-31T08:28:41,387   copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_gsm8k_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en
2025-08-31T08:28:41,389   copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_math_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en
2025-08-31T08:28:41,391   copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_mmmlu_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en
2025-08-31T08:28:41,393   copying build/lib/lm_eval/tasks/hrm8k/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k
2025-08-31T08:28:41,395   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hrm8k/default
2025-08-31T08:28:41,396   copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default
2025-08-31T08:28:41,398   copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_mmmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default
2025-08-31T08:28:41,399   copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_ksm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default
2025-08-31T08:28:41,401   copying build/lib/lm_eval/tasks/hrm8k/default/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default
2025-08-31T08:28:41,403   copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_omni_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default
2025-08-31T08:28:41,405   copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default
2025-08-31T08:28:41,407   copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default
2025-08-31T08:28:41,409   copying build/lib/lm_eval/tasks/hrm8k/default/_hrm8k_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default
2025-08-31T08:28:41,412   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arab_culture
2025-08-31T08:28:41,413   copying build/lib/lm_eval/tasks/arab_culture/arab_culture_morocco.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,415   copying build/lib/lm_eval/tasks/arab_culture/arab_culture_palestine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,417   copying build/lib/lm_eval/tasks/arab_culture/arab_culture_egypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,418   copying build/lib/lm_eval/tasks/arab_culture/_arab_culture_levant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,420   copying build/lib/lm_eval/tasks/arab_culture/utils_mcq.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,422   copying build/lib/lm_eval/tasks/arab_culture/_arab_culture_gulf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,424   copying build/lib/lm_eval/tasks/arab_culture/arab_culture_yemen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,426   copying build/lib/lm_eval/tasks/arab_culture/_default_arab_culture_mcq_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,427   copying build/lib/lm_eval/tasks/arab_culture/arab_culture_libya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,429   copying build/lib/lm_eval/tasks/arab_culture/arab_culture_sudan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,431   copying build/lib/lm_eval/tasks/arab_culture/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,433   copying build/lib/lm_eval/tasks/arab_culture/_arab_culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,435   copying build/lib/lm_eval/tasks/arab_culture/_arab_culture_north_africa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,436   copying build/lib/lm_eval/tasks/arab_culture/arab_culture_algeria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,438   copying build/lib/lm_eval/tasks/arab_culture/_arab_culture_nile_valley.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,440   copying build/lib/lm_eval/tasks/arab_culture/arab_culture_tunisia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,442   copying build/lib/lm_eval/tasks/arab_culture/prompts.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,444   copying build/lib/lm_eval/tasks/arab_culture/arab_culture_lebanon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,445   copying build/lib/lm_eval/tasks/arab_culture/arab_culture_ksa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,447   copying build/lib/lm_eval/tasks/arab_culture/arab_culture_syria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,449   copying build/lib/lm_eval/tasks/arab_culture/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,450   copying build/lib/lm_eval/tasks/arab_culture/arab_culture_uae.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,452   copying build/lib/lm_eval/tasks/arab_culture/arab_culture_jordan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture
2025-08-31T08:28:41,455   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/fld
2025-08-31T08:28:41,456   copying build/lib/lm_eval/tasks/fld/fld_logical_formula_default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld
2025-08-31T08:28:41,458   copying build/lib/lm_eval/tasks/fld/fld_logical_formula_star.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld
2025-08-31T08:28:41,461   copying build/lib/lm_eval/tasks/fld/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld
2025-08-31T08:28:41,463   copying build/lib/lm_eval/tasks/fld/fld_default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld
2025-08-31T08:28:41,465   copying build/lib/lm_eval/tasks/fld/fld_star.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld
2025-08-31T08:28:41,467   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:41,468   copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:41,470   copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:41,472   copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:41,474   copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:41,475   copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_common -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:41,477   copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:41,479   copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:41,481   copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:41,483   copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc_common -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:41,485   copying build/lib/lm_eval/tasks/truthfulqa-multi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:41,487   copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:41,489   copying build/lib/lm_eval/tasks/truthfulqa-multi/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:41,491   copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:41,493   copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:41,494   copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:41,496   copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:41,498   copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:41,500   copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:41,502   copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi
2025-08-31T08:28:41,504   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mutual
2025-08-31T08:28:41,505   copying build/lib/lm_eval/tasks/mutual/mutual.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual
2025-08-31T08:28:41,507   copying build/lib/lm_eval/tasks/mutual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual
2025-08-31T08:28:41,509   copying build/lib/lm_eval/tasks/mutual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual
2025-08-31T08:28:41,510   copying build/lib/lm_eval/tasks/mutual/multual_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual
2025-08-31T08:28:41,513   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aclue
2025-08-31T08:28:41,514   copying build/lib/lm_eval/tasks/aclue/aclue_ancient_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue
2025-08-31T08:28:41,516   copying build/lib/lm_eval/tasks/aclue/aclue_poetry_quality_assessment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue
2025-08-31T08:28:41,517   copying build/lib/lm_eval/tasks/aclue/aclue_sentence_segmentation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue
2025-08-31T08:28:41,519   copying build/lib/lm_eval/tasks/aclue/aclue_poetry_sentiment_analysis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue
2025-08-31T08:28:41,521   copying build/lib/lm_eval/tasks/aclue/aclue_polysemy_resolution.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue
2025-08-31T08:28:41,523   copying build/lib/lm_eval/tasks/aclue/aclue_poetry_appreciate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue
2025-08-31T08:28:41,524   copying build/lib/lm_eval/tasks/aclue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue
2025-08-31T08:28:41,526   copying build/lib/lm_eval/tasks/aclue/aclue_poetry_context_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue
2025-08-31T08:28:41,528   copying build/lib/lm_eval/tasks/aclue/_aclue.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue
2025-08-31T08:28:41,530   copying build/lib/lm_eval/tasks/aclue/aclue_ancient_phonetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue
2025-08-31T08:28:41,531   copying build/lib/lm_eval/tasks/aclue/aclue_basic_ancient_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue
2025-08-31T08:28:41,533   copying build/lib/lm_eval/tasks/aclue/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue
2025-08-31T08:28:41,535   copying build/lib/lm_eval/tasks/aclue/aclue_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue
2025-08-31T08:28:41,537   copying build/lib/lm_eval/tasks/aclue/aclue_homographic_character_resolution.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue
2025-08-31T08:28:41,539   copying build/lib/lm_eval/tasks/aclue/aclue_ancient_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue
2025-08-31T08:28:41,540   copying build/lib/lm_eval/tasks/aclue/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue
2025-08-31T08:28:41,542   copying build/lib/lm_eval/tasks/aclue/aclue_couplet_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue
2025-08-31T08:28:41,543   copying build/lib/lm_eval/tasks/aclue/aclue_ancient_chinese_culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue
2025-08-31T08:28:41,545   copying build/lib/lm_eval/tasks/aclue/aclue_named_entity_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue
2025-08-31T08:28:41,547   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/portuguese_bench
2025-08-31T08:28:41,549   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:41,551   copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_es-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:41,553   copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_de-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:41,555   copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_fr-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:41,558   copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_eu-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:41,560   copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_gl-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:41,563   copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:41,565   copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/create_yamls_flores_pt.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:41,568   copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:41,571   copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:41,573   copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:41,575   copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:41,577   copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:41,579   copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_en-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:41,581   copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:41,582   copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:41,584   copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_it-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:41,586   copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_ca-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:41,588   copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:41,589   copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt
2025-08-31T08:28:41,591   copying build/lib/lm_eval/tasks/portuguese_bench/assin_entailment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench
2025-08-31T08:28:41,593   copying build/lib/lm_eval/tasks/portuguese_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench
2025-08-31T08:28:41,594   copying build/lib/lm_eval/tasks/portuguese_bench/portuguese_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench
2025-08-31T08:28:41,596   copying build/lib/lm_eval/tasks/portuguese_bench/assin_paraphrase.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench
2025-08-31T08:28:41,598   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/basqueglue
2025-08-31T08:28:41,599   copying build/lib/lm_eval/tasks/basqueglue/vaxx.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue
2025-08-31T08:28:41,601   copying build/lib/lm_eval/tasks/basqueglue/bhtc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue
2025-08-31T08:28:41,603   copying build/lib/lm_eval/tasks/basqueglue/coref.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue
2025-08-31T08:28:41,604   copying build/lib/lm_eval/tasks/basqueglue/qnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue
2025-08-31T08:28:41,606   copying build/lib/lm_eval/tasks/basqueglue/wic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue
2025-08-31T08:28:41,608   copying build/lib/lm_eval/tasks/basqueglue/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue
2025-08-31T08:28:41,609   copying build/lib/lm_eval/tasks/basqueglue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue
2025-08-31T08:28:41,611   copying build/lib/lm_eval/tasks/basqueglue/bec.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue
2025-08-31T08:28:41,613   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval
2025-08-31T08:28:41,615   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norquad
2025-08-31T08:28:41,616   copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad
2025-08-31T08:28:41,618   copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad
2025-08-31T08:28:41,619   copying build/lib/lm_eval/tasks/noreval/norquad/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad
2025-08-31T08:28:41,621   copying build/lib/lm_eval/tasks/noreval/norquad/_norquad_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad
2025-08-31T08:28:41,623   copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad
2025-08-31T08:28:41,625   copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad
2025-08-31T08:28:41,626   copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad
2025-08-31T08:28:41,629   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norsummarize-instruct
2025-08-31T08:28:41,630   copying build/lib/lm_eval/tasks/noreval/norsummarize-instruct/norsummarize_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsummarize-instruct
2025-08-31T08:28:41,632   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norcommonsenseqa
2025-08-31T08:28:41,633   copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/_norcommonsenseqa_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa
2025-08-31T08:28:41,635   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norcommonsenseqa/nno
2025-08-31T08:28:41,637   copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno
2025-08-31T08:28:41,639   copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno
2025-08-31T08:28:41,641   copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno
2025-08-31T08:28:41,643   copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno
2025-08-31T08:28:41,646   copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno
2025-08-31T08:28:41,648   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norcommonsenseqa/nob
2025-08-31T08:28:41,649   copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob
2025-08-31T08:28:41,651   copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob
2025-08-31T08:28:41,653   copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob
2025-08-31T08:28:41,654   copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob
2025-08-31T08:28:41,656   copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob
2025-08-31T08:28:41,658   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/ncb
2025-08-31T08:28:41,659   copying build/lib/lm_eval/tasks/noreval/ncb/ncb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ncb
2025-08-31T08:28:41,662   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norec
2025-08-31T08:28:41,663   copying build/lib/lm_eval/tasks/noreval/norec/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec
2025-08-31T08:28:41,665   copying build/lib/lm_eval/tasks/noreval/norec/_norec_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec
2025-08-31T08:28:41,667   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norec/norec_document
2025-08-31T08:28:41,668   copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document
2025-08-31T08:28:41,670   copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document
2025-08-31T08:28:41,672   copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document
2025-08-31T08:28:41,674   copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document
2025-08-31T08:28:41,676   copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document
2025-08-31T08:28:41,678   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norec/norec_sentence
2025-08-31T08:28:41,679   copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence
2025-08-31T08:28:41,681   copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence
2025-08-31T08:28:41,683   copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence
2025-08-31T08:28:41,685   copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence
2025-08-31T08:28:41,687   copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence
2025-08-31T08:28:41,689   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norrewrite-instruct
2025-08-31T08:28:41,690   copying build/lib/lm_eval/tasks/noreval/norrewrite-instruct/norrewrite_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norrewrite-instruct
2025-08-31T08:28:41,693   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noridiom
2025-08-31T08:28:41,694   copying build/lib/lm_eval/tasks/noreval/noridiom/_noridiom_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom
2025-08-31T08:28:41,695   copying build/lib/lm_eval/tasks/noreval/noridiom/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom
2025-08-31T08:28:41,698   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noridiom/nno
2025-08-31T08:28:41,699   copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno
2025-08-31T08:28:41,701   copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno
2025-08-31T08:28:41,703   copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno
2025-08-31T08:28:41,704   copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno
2025-08-31T08:28:41,706   copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno
2025-08-31T08:28:41,708   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noridiom/nob
2025-08-31T08:28:41,710   copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob
2025-08-31T08:28:41,712   copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob
2025-08-31T08:28:41,713   copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob
2025-08-31T08:28:41,716   copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob
2025-08-31T08:28:41,717   copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob
2025-08-31T08:28:41,720   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/ask_gec
2025-08-31T08:28:41,721   copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec
2025-08-31T08:28:41,723   copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec
2025-08-31T08:28:41,724   copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec
2025-08-31T08:28:41,726   copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec
2025-08-31T08:28:41,728   copying build/lib/lm_eval/tasks/noreval/ask_gec/errant.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec
2025-08-31T08:28:41,730   copying build/lib/lm_eval/tasks/noreval/ask_gec/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec
2025-08-31T08:28:41,732   copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec
2025-08-31T08:28:41,733   copying build/lib/lm_eval/tasks/noreval/ask_gec/_ask_gec_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec
2025-08-31T08:28:41,735   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba
2025-08-31T08:28:41,737   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng
2025-08-31T08:28:41,738   copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng
2025-08-31T08:28:41,740   copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng
2025-08-31T08:28:41,742   copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng
2025-08-31T08:28:41,743   copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng
2025-08-31T08:28:41,746   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng
2025-08-31T08:28:41,747   copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng
2025-08-31T08:28:41,749   copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng
2025-08-31T08:28:41,751   copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng
2025-08-31T08:28:41,752   copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng
2025-08-31T08:28:41,755   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno
2025-08-31T08:28:41,756   copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno
2025-08-31T08:28:41,758   copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno
2025-08-31T08:28:41,760   copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno
2025-08-31T08:28:41,761   copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno
2025-08-31T08:28:41,763   copying build/lib/lm_eval/tasks/noreval/tatoeba/_tatoeba_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba
2025-08-31T08:28:41,765   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob
2025-08-31T08:28:41,766   copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob
2025-08-31T08:28:41,768   copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob
2025-08-31T08:28:41,770   copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob
2025-08-31T08:28:41,772   copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob
2025-08-31T08:28:41,774   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa
2025-08-31T08:28:41,775   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice
2025-08-31T08:28:41,777   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/_nortruthfulqa_mc_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice
2025-08-31T08:28:41,779   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno
2025-08-31T08:28:41,780   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno
2025-08-31T08:28:41,782   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno
2025-08-31T08:28:41,784   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno
2025-08-31T08:28:41,786   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno
2025-08-31T08:28:41,788   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno
2025-08-31T08:28:41,790   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno
2025-08-31T08:28:41,792   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob
2025-08-31T08:28:41,793   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob
2025-08-31T08:28:41,795   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob
2025-08-31T08:28:41,797   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob
2025-08-31T08:28:41,799   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob
2025-08-31T08:28:41,801   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob
2025-08-31T08:28:41,803   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob
2025-08-31T08:28:41,805   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/generation
2025-08-31T08:28:41,806   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation
2025-08-31T08:28:41,810   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/generation/nno
2025-08-31T08:28:41,811   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno
2025-08-31T08:28:41,813   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno
2025-08-31T08:28:41,815   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno
2025-08-31T08:28:41,816   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno
2025-08-31T08:28:41,818   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno
2025-08-31T08:28:41,820   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/generation/nob
2025-08-31T08:28:41,821   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob
2025-08-31T08:28:41,823   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob
2025-08-31T08:28:41,825   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob
2025-08-31T08:28:41,827   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob
2025-08-31T08:28:41,829   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob
2025-08-31T08:28:41,830   copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/_nortruthfulqa_gen_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation
2025-08-31T08:28:41,833   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norbelebele
2025-08-31T08:28:41,834   copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele
2025-08-31T08:28:41,836   copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele
2025-08-31T08:28:41,838   copying build/lib/lm_eval/tasks/noreval/norbelebele/_norbelebele_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele
2025-08-31T08:28:41,840   copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele
2025-08-31T08:28:41,841   copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele
2025-08-31T08:28:41,843   copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele
2025-08-31T08:28:41,846   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nrk_quiz_qa
2025-08-31T08:28:41,847   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nrk_quiz_qa/nno
2025-08-31T08:28:41,848   copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno
2025-08-31T08:28:41,850   copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno
2025-08-31T08:28:41,852   copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno
2025-08-31T08:28:41,854   copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno
2025-08-31T08:28:41,856   copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno
2025-08-31T08:28:41,857   copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno
2025-08-31T08:28:41,860   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nrk_quiz_qa/nob
2025-08-31T08:28:41,861   copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob
2025-08-31T08:28:41,863   copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob
2025-08-31T08:28:41,864   copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob
2025-08-31T08:28:41,866   copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob
2025-08-31T08:28:41,869   copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob
2025-08-31T08:28:41,870   copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob
2025-08-31T08:28:41,872   copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/_nrk_quiz_qa_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa
2025-08-31T08:28:41,874   copying build/lib/lm_eval/tasks/noreval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval
2025-08-31T08:28:41,877   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norsumm
2025-08-31T08:28:41,878   copying build/lib/lm_eval/tasks/noreval/norsumm/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm
2025-08-31T08:28:41,881   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norsumm/nno
2025-08-31T08:28:41,882   copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno
2025-08-31T08:28:41,884   copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno
2025-08-31T08:28:41,886   copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno
2025-08-31T08:28:41,887   copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno
2025-08-31T08:28:41,889   copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno
2025-08-31T08:28:41,891   copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno
2025-08-31T08:28:41,893   copying build/lib/lm_eval/tasks/noreval/norsumm/_norsumm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm
2025-08-31T08:28:41,896   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norsumm/nob
2025-08-31T08:28:41,897   copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob
2025-08-31T08:28:41,899   copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob
2025-08-31T08:28:41,901   copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob
2025-08-31T08:28:41,903   copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob
2025-08-31T08:28:41,905   copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob
2025-08-31T08:28:41,907   copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob
2025-08-31T08:28:41,909   copying build/lib/lm_eval/tasks/noreval/noreval.jpg -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval
2025-08-31T08:28:41,925   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noropenbookqa
2025-08-31T08:28:41,926   copying build/lib/lm_eval/tasks/noreval/noropenbookqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa
2025-08-31T08:28:41,928   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noropenbookqa/nno
2025-08-31T08:28:41,929   copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno
2025-08-31T08:28:41,931   copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno
2025-08-31T08:28:41,933   copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno
2025-08-31T08:28:41,934   copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno
2025-08-31T08:28:41,936   copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno
2025-08-31T08:28:41,939   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noropenbookqa/nob
2025-08-31T08:28:41,940   copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob
2025-08-31T08:28:41,942   copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob
2025-08-31T08:28:41,943   copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob
2025-08-31T08:28:41,945   copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob
2025-08-31T08:28:41,947   copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob
2025-08-31T08:28:41,948   copying build/lib/lm_eval/tasks/noreval/noropenbookqa/_noropenbookqa_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa
2025-08-31T08:28:41,953   copying build/lib/lm_eval/__main__.py -> build/bdist.linux-armv7l/wheel/./lm_eval
2025-08-31T08:28:41,956   creating build/bdist.linux-armv7l/wheel/lm_eval/models
2025-08-31T08:28:41,957   copying build/lib/lm_eval/models/sglang_causallms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models
2025-08-31T08:28:41,960   copying build/lib/lm_eval/models/gguf.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models
2025-08-31T08:28:41,962   copying build/lib/lm_eval/models/hf_audiolm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models
2025-08-31T08:28:41,964   copying build/lib/lm_eval/models/anthropic_llms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models
2025-08-31T08:28:41,966   copying build/lib/lm_eval/models/textsynth.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models
2025-08-31T08:28:41,969   copying build/lib/lm_eval/models/hf_steered.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models
2025-08-31T08:28:41,971   copying build/lib/lm_eval/models/openai_completions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models
2025-08-31T08:28:41,973   copying build/lib/lm_eval/models/optimum_ipex.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models
2025-08-31T08:28:41,975   copying build/lib/lm_eval/models/vllm_causallms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models
2025-08-31T08:28:41,978   copying build/lib/lm_eval/models/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models
2025-08-31T08:28:41,980   copying build/lib/lm_eval/models/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models
2025-08-31T08:28:41,982   copying build/lib/lm_eval/models/vllm_vlms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models
2025-08-31T08:28:41,985   copying build/lib/lm_eval/models/optimum_lm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models
2025-08-31T08:28:41,986   copying build/lib/lm_eval/models/hf_vlms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models
2025-08-31T08:28:41,989   copying build/lib/lm_eval/models/nemo_lm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models
2025-08-31T08:28:41,992   copying build/lib/lm_eval/models/ibm_watsonx_ai.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models
2025-08-31T08:28:41,994   copying build/lib/lm_eval/models/sglang_generate_API.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models
2025-08-31T08:28:41,996   copying build/lib/lm_eval/models/mamba_lm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models
2025-08-31T08:28:41,998   copying build/lib/lm_eval/models/neuron_optimum.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models
2025-08-31T08:28:42,001   copying build/lib/lm_eval/models/dummy.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models
2025-08-31T08:28:42,003   copying build/lib/lm_eval/models/huggingface.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models
2025-08-31T08:28:42,006   copying build/lib/lm_eval/models/api_models.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models
2025-08-31T08:28:42,009   creating build/bdist.linux-armv7l/wheel/lm_eval/caching
2025-08-31T08:28:42,010   copying build/lib/lm_eval/caching/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/caching
2025-08-31T08:28:42,012   copying build/lib/lm_eval/caching/cache.py -> build/bdist.linux-armv7l/wheel/./lm_eval/caching
2025-08-31T08:28:42,014   copying build/lib/lm_eval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval
2025-08-31T08:28:42,017   creating build/bdist.linux-armv7l/wheel/lm_eval/decontamination
2025-08-31T08:28:42,018   copying build/lib/lm_eval/decontamination/decontaminate.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination
2025-08-31T08:28:42,020   copying build/lib/lm_eval/decontamination/janitor.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination
2025-08-31T08:28:42,023   copying build/lib/lm_eval/decontamination/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination
2025-08-31T08:28:42,024   copying build/lib/lm_eval/decontamination/archiver.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination
2025-08-31T08:28:42,027   creating build/bdist.linux-armv7l/wheel/lm_eval/prompts
2025-08-31T08:28:42,028   copying build/lib/lm_eval/prompts/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/prompts
2025-08-31T08:28:42,030   copying build/lib/lm_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval
2025-08-31T08:28:42,033   creating build/bdist.linux-armv7l/wheel/lm_eval/filters
2025-08-31T08:28:42,034   copying build/lib/lm_eval/filters/custom.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters
2025-08-31T08:28:42,036   copying build/lib/lm_eval/filters/selection.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters
2025-08-31T08:28:42,037   copying build/lib/lm_eval/filters/extraction.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters
2025-08-31T08:28:42,040   copying build/lib/lm_eval/filters/transformation.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters
2025-08-31T08:28:42,042   copying build/lib/lm_eval/filters/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters
2025-08-31T08:28:42,043   copying build/lib/lm_eval/filters/decontamination.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters
2025-08-31T08:28:42,045   copying build/lib/lm_eval/evaluator_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval
2025-08-31T08:28:42,051   running install_egg_info
2025-08-31T08:28:42,057   Copying lm_eval.egg-info to build/bdist.linux-armv7l/wheel/./lm_eval-0.4.9.1-py3.11.egg-info
2025-08-31T08:28:42,080   running install_scripts
2025-08-31T08:28:42,093   creating build/bdist.linux-armv7l/wheel/lm_eval-0.4.9.1.dist-info/WHEEL
2025-08-31T08:28:42,096   creating '/tmp/pip-wheel-kdnoe99r/.tmp-hiue7ez8/lm_eval-0.4.9.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2025-08-31T08:28:42,098   adding 'lm_eval/__init__.py'
2025-08-31T08:28:42,101   adding 'lm_eval/__main__.py'
2025-08-31T08:28:42,105   adding 'lm_eval/evaluator.py'
2025-08-31T08:28:42,108   adding 'lm_eval/evaluator_utils.py'
2025-08-31T08:28:42,111   adding 'lm_eval/utils.py'
2025-08-31T08:28:42,113   adding 'lm_eval/api/__init__.py'
2025-08-31T08:28:42,114   adding 'lm_eval/api/filter.py'
2025-08-31T08:28:42,116   adding 'lm_eval/api/group.py'
2025-08-31T08:28:42,117   adding 'lm_eval/api/instance.py'
2025-08-31T08:28:42,120   adding 'lm_eval/api/metrics.py'
2025-08-31T08:28:42,123   adding 'lm_eval/api/model.py'
2025-08-31T08:28:42,124   adding 'lm_eval/api/registry.py'
2025-08-31T08:28:42,126   adding 'lm_eval/api/samplers.py'
2025-08-31T08:28:42,134   adding 'lm_eval/api/task.py'
2025-08-31T08:28:42,137   adding 'lm_eval/caching/__init__.py'
2025-08-31T08:28:42,138   adding 'lm_eval/caching/cache.py'
2025-08-31T08:28:42,140   adding 'lm_eval/decontamination/__init__.py'
2025-08-31T08:28:42,141   adding 'lm_eval/decontamination/archiver.py'
2025-08-31T08:28:42,143   adding 'lm_eval/decontamination/decontaminate.py'
2025-08-31T08:28:42,145   adding 'lm_eval/decontamination/janitor.py'
2025-08-31T08:28:42,147   adding 'lm_eval/filters/__init__.py'
2025-08-31T08:28:42,149   adding 'lm_eval/filters/custom.py'
2025-08-31T08:28:42,150   adding 'lm_eval/filters/decontamination.py'
2025-08-31T08:28:42,152   adding 'lm_eval/filters/extraction.py'
2025-08-31T08:28:42,153   adding 'lm_eval/filters/selection.py'
2025-08-31T08:28:42,154   adding 'lm_eval/filters/transformation.py'
2025-08-31T08:28:42,156   adding 'lm_eval/loggers/__init__.py'
2025-08-31T08:28:42,159   adding 'lm_eval/loggers/evaluation_tracker.py'
2025-08-31T08:28:42,160   adding 'lm_eval/loggers/utils.py'
2025-08-31T08:28:42,163   adding 'lm_eval/loggers/wandb_logger.py'
2025-08-31T08:28:42,165   adding 'lm_eval/models/__init__.py'
2025-08-31T08:28:42,167   adding 'lm_eval/models/anthropic_llms.py'
2025-08-31T08:28:42,171   adding 'lm_eval/models/api_models.py'
2025-08-31T08:28:42,172   adding 'lm_eval/models/dummy.py'
2025-08-31T08:28:42,174   adding 'lm_eval/models/gguf.py'
2025-08-31T08:28:42,176   adding 'lm_eval/models/hf_audiolm.py'
2025-08-31T08:28:42,178   adding 'lm_eval/models/hf_steered.py'
2025-08-31T08:28:42,182   adding 'lm_eval/models/hf_vlms.py'
2025-08-31T08:28:42,190   adding 'lm_eval/models/huggingface.py'
2025-08-31T08:28:42,192   adding 'lm_eval/models/ibm_watsonx_ai.py'
2025-08-31T08:28:42,194   adding 'lm_eval/models/mamba_lm.py'
2025-08-31T08:28:42,197   adding 'lm_eval/models/nemo_lm.py'
2025-08-31T08:28:42,200   adding 'lm_eval/models/neuron_optimum.py'
2025-08-31T08:28:42,202   adding 'lm_eval/models/openai_completions.py'
2025-08-31T08:28:42,204   adding 'lm_eval/models/optimum_ipex.py'
2025-08-31T08:28:42,205   adding 'lm_eval/models/optimum_lm.py'
2025-08-31T08:28:42,208   adding 'lm_eval/models/sglang_causallms.py'
2025-08-31T08:28:42,209   adding 'lm_eval/models/sglang_generate_API.py'
2025-08-31T08:28:42,211   adding 'lm_eval/models/textsynth.py'
2025-08-31T08:28:42,215   adding 'lm_eval/models/utils.py'
2025-08-31T08:28:42,219   adding 'lm_eval/models/vllm_causallms.py'
2025-08-31T08:28:42,222   adding 'lm_eval/models/vllm_vlms.py'
2025-08-31T08:28:42,224   adding 'lm_eval/prompts/__init__.py'
2025-08-31T08:28:42,231   adding 'lm_eval/tasks/README.md'
2025-08-31T08:28:42,235   adding 'lm_eval/tasks/__init__.py'
2025-08-31T08:28:42,237   adding 'lm_eval/tasks/aclue/README.md'
2025-08-31T08:28:42,239   adding 'lm_eval/tasks/aclue/_aclue.yaml'
2025-08-31T08:28:42,240   adding 'lm_eval/tasks/aclue/_default_template_yaml'
2025-08-31T08:28:42,241   adding 'lm_eval/tasks/aclue/_generate_configs.py'
2025-08-31T08:28:42,242   adding 'lm_eval/tasks/aclue/aclue_ancient_chinese_culture.yaml'
2025-08-31T08:28:42,243   adding 'lm_eval/tasks/aclue/aclue_ancient_literature.yaml'
2025-08-31T08:28:42,244   adding 'lm_eval/tasks/aclue/aclue_ancient_medical.yaml'
2025-08-31T08:28:42,245   adding 'lm_eval/tasks/aclue/aclue_ancient_phonetics.yaml'
2025-08-31T08:28:42,247   adding 'lm_eval/tasks/aclue/aclue_basic_ancient_chinese.yaml'
2025-08-31T08:28:42,248   adding 'lm_eval/tasks/aclue/aclue_couplet_prediction.yaml'
2025-08-31T08:28:42,249   adding 'lm_eval/tasks/aclue/aclue_homographic_character_resolution.yaml'
2025-08-31T08:28:42,250   adding 'lm_eval/tasks/aclue/aclue_named_entity_recognition.yaml'
2025-08-31T08:28:42,251   adding 'lm_eval/tasks/aclue/aclue_poetry_appreciate.yaml'
2025-08-31T08:28:42,252   adding 'lm_eval/tasks/aclue/aclue_poetry_context_prediction.yaml'
2025-08-31T08:28:42,253   adding 'lm_eval/tasks/aclue/aclue_poetry_quality_assessment.yaml'
2025-08-31T08:28:42,254   adding 'lm_eval/tasks/aclue/aclue_poetry_sentiment_analysis.yaml'
2025-08-31T08:28:42,256   adding 'lm_eval/tasks/aclue/aclue_polysemy_resolution.yaml'
2025-08-31T08:28:42,257   adding 'lm_eval/tasks/aclue/aclue_reading_comprehension.yaml'
2025-08-31T08:28:42,258   adding 'lm_eval/tasks/aclue/aclue_sentence_segmentation.yaml'
2025-08-31T08:28:42,260   adding 'lm_eval/tasks/acpbench/README.md'
2025-08-31T08:28:42,262   adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/_boolq_cot_2shot_yaml'
2025-08-31T08:28:42,264   adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/act_reach.yaml'
2025-08-31T08:28:42,265   adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/app.yaml'
2025-08-31T08:28:42,266   adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/just.yaml'
2025-08-31T08:28:42,268   adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/land.yaml'
2025-08-31T08:28:42,269   adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/prog.yaml'
2025-08-31T08:28:42,271   adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/reach.yaml'
2025-08-31T08:28:42,272   adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/val.yaml'
2025-08-31T08:28:42,274   adding 'lm_eval/tasks/acpbench/gen_2shot/_gen_yaml_2shot'
2025-08-31T08:28:42,275   adding 'lm_eval/tasks/acpbench/gen_2shot/acp_grammar.lark'
2025-08-31T08:28:42,280   adding 'lm_eval/tasks/acpbench/gen_2shot/acp_utils.py'
2025-08-31T08:28:42,281   adding 'lm_eval/tasks/acpbench/gen_2shot/act_reach.yaml'
2025-08-31T08:28:42,283   adding 'lm_eval/tasks/acpbench/gen_2shot/app.yaml'
2025-08-31T08:28:42,284   adding 'lm_eval/tasks/acpbench/gen_2shot/just.yaml'
2025-08-31T08:28:42,285   adding 'lm_eval/tasks/acpbench/gen_2shot/land.yaml'
2025-08-31T08:28:42,287   adding 'lm_eval/tasks/acpbench/gen_2shot/next_act.yaml'
2025-08-31T08:28:42,288   adding 'lm_eval/tasks/acpbench/gen_2shot/prog.yaml'
2025-08-31T08:28:42,290   adding 'lm_eval/tasks/acpbench/gen_2shot/reach.yaml'
2025-08-31T08:28:42,291   adding 'lm_eval/tasks/acpbench/gen_2shot/val.yaml'
2025-08-31T08:28:42,293   adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/_gen_yaml_2shot'
2025-08-31T08:28:42,294   adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_grammar.lark'
2025-08-31T08:28:42,299   adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_utils.py'
2025-08-31T08:28:42,301   adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/act_reach.yaml'
2025-08-31T08:28:42,303   adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/app.yaml'
2025-08-31T08:28:42,305   adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/just.yaml'
2025-08-31T08:28:42,307   adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/land.yaml'
2025-08-31T08:28:42,309   adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/next_act.yaml'
2025-08-31T08:28:42,311   adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/prog.yaml'
2025-08-31T08:28:42,312   adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/reach.yaml'
2025-08-31T08:28:42,314   adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/val.yaml'
2025-08-31T08:28:42,316   adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/_mcq_cot_2shot_yaml'
2025-08-31T08:28:42,317   adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/act_reach.yaml'
2025-08-31T08:28:42,318   adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/app.yaml'
2025-08-31T08:28:42,320   adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/just.yaml'
2025-08-31T08:28:42,321   adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/land.yaml'
2025-08-31T08:28:42,322   adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/prog.yaml'
2025-08-31T08:28:42,324   adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/reach.yaml'
2025-08-31T08:28:42,325   adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/val.yaml'
2025-08-31T08:28:42,327   adding 'lm_eval/tasks/aexams/README.md'
2025-08-31T08:28:42,328   adding 'lm_eval/tasks/aexams/_aexams.yaml'
2025-08-31T08:28:42,329   adding 'lm_eval/tasks/aexams/_default_template_yaml'
2025-08-31T08:28:42,331   adding 'lm_eval/tasks/aexams/aexams_Biology.yaml'
2025-08-31T08:28:42,332   adding 'lm_eval/tasks/aexams/aexams_IslamicStudies.yaml'
2025-08-31T08:28:42,333   adding 'lm_eval/tasks/aexams/aexams_Physics.yaml'
2025-08-31T08:28:42,334   adding 'lm_eval/tasks/aexams/aexams_Science.yaml'
2025-08-31T08:28:42,335   adding 'lm_eval/tasks/aexams/aexams_Social.yaml'
2025-08-31T08:28:42,337   adding 'lm_eval/tasks/afrimgsm/README.md'
2025-08-31T08:28:42,338   adding 'lm_eval/tasks/afrimgsm/gen_utils.py'
2025-08-31T08:28:42,339   adding 'lm_eval/tasks/afrimgsm/gen_yaml.sh'
2025-08-31T08:28:42,341   adding 'lm_eval/tasks/afrimgsm/run.sh'
2025-08-31T08:28:42,342   adding 'lm_eval/tasks/afrimgsm/utils.py'
2025-08-31T08:28:42,344   adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm.yaml'
2025-08-31T08:28:42,346   adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_amh.yaml'
2025-08-31T08:28:42,347   adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_eng.yaml'
2025-08-31T08:28:42,348   adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ewe.yaml'
2025-08-31T08:28:42,349   adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_fra.yaml'
2025-08-31T08:28:42,350   adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_hau.yaml'
2025-08-31T08:28:42,351   adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ibo.yaml'
2025-08-31T08:28:42,353   adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_kin.yaml'
2025-08-31T08:28:42,354   adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lin.yaml'
2025-08-31T08:28:42,355   adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lug.yaml'
2025-08-31T08:28:42,356   adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_orm.yaml'
2025-08-31T08:28:42,357   adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sna.yaml'
2025-08-31T08:28:42,358   adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sot.yaml'
2025-08-31T08:28:42,359   adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_swa.yaml'
2025-08-31T08:28:42,360   adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_twi.yaml'
2025-08-31T08:28:42,361   adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_vai.yaml'
2025-08-31T08:28:42,363   adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_wol.yaml'
2025-08-31T08:28:42,364   adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_xho.yaml'
2025-08-31T08:28:42,365   adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yaml'
2025-08-31T08:28:42,367   adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yor.yaml'
2025-08-31T08:28:42,368   adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_zul.yaml'
2025-08-31T08:28:42,369   adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_amh.yaml'
2025-08-31T08:28:42,371   adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_eng.yaml'
2025-08-31T08:28:42,372   adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ewe.yaml'
2025-08-31T08:28:42,373   adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_fra.yaml'
2025-08-31T08:28:42,374   adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_hau.yaml'
2025-08-31T08:28:42,375   adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ibo.yaml'
2025-08-31T08:28:42,376   adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_kin.yaml'
2025-08-31T08:28:42,377   adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lin.yaml'
2025-08-31T08:28:42,378   adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lug.yaml'
2025-08-31T08:28:42,379   adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_orm.yaml'
2025-08-31T08:28:42,380   adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sna.yaml'
2025-08-31T08:28:42,381   adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sot.yaml'
2025-08-31T08:28:42,382   adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_swa.yaml'
2025-08-31T08:28:42,383   adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_twi.yaml'
2025-08-31T08:28:42,384   adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_vai.yaml'
2025-08-31T08:28:42,385   adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_wol.yaml'
2025-08-31T08:28:42,386   adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_xho.yaml'
2025-08-31T08:28:42,388   adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yaml'
2025-08-31T08:28:42,389   adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yor.yaml'
2025-08-31T08:28:42,390   adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_zul.yaml'
2025-08-31T08:28:42,391   adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_amh.yaml'
2025-08-31T08:28:42,393   adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_eng.yaml'
2025-08-31T08:28:42,394   adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ewe.yaml'
2025-08-31T08:28:42,395   adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_fra.yaml'
2025-08-31T08:28:42,396   adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_hau.yaml'
2025-08-31T08:28:42,397   adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ibo.yaml'
2025-08-31T08:28:42,398   adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_kin.yaml'
2025-08-31T08:28:42,399   adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lin.yaml'
2025-08-31T08:28:42,401   adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lug.yaml'
2025-08-31T08:28:42,402   adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_orm.yaml'
2025-08-31T08:28:42,403   adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sna.yaml'
2025-08-31T08:28:42,404   adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sot.yaml'
2025-08-31T08:28:42,405   adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_swa.yaml'
2025-08-31T08:28:42,406   adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_twi.yaml'
2025-08-31T08:28:42,407   adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_vai.yaml'
2025-08-31T08:28:42,408   adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_wol.yaml'
2025-08-31T08:28:42,410   adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_xho.yaml'
2025-08-31T08:28:42,411   adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yaml'
2025-08-31T08:28:42,412   adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yor.yaml'
2025-08-31T08:28:42,413   adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_zul.yaml'
2025-08-31T08:28:42,415   adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_amh.yaml'
2025-08-31T08:28:42,417   adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_eng.yaml'
2025-08-31T08:28:42,418   adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ewe.yaml'
2025-08-31T08:28:42,419   adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_fra.yaml'
2025-08-31T08:28:42,420   adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_hau.yaml'
2025-08-31T08:28:42,422   adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ibo.yaml'
2025-08-31T08:28:42,423   adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_kin.yaml'
2025-08-31T08:28:42,424   adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lin.yaml'
2025-08-31T08:28:42,425   adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lug.yaml'
2025-08-31T08:28:42,426   adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_orm.yaml'
2025-08-31T08:28:42,427   adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sna.yaml'
2025-08-31T08:28:42,428   adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sot.yaml'
2025-08-31T08:28:42,429   adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_swa.yaml'
2025-08-31T08:28:42,430   adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_twi.yaml'
2025-08-31T08:28:42,431   adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_vai.yaml'
2025-08-31T08:28:42,432   adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_wol.yaml'
2025-08-31T08:28:42,433   adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_xho.yaml'
2025-08-31T08:28:42,435   adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yaml'
2025-08-31T08:28:42,436   adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yor.yaml'
2025-08-31T08:28:42,437   adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_zul.yaml'
2025-08-31T08:28:42,439   adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_amh.yaml'
2025-08-31T08:28:42,440   adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_eng.yaml'
2025-08-31T08:28:42,441   adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ewe.yaml'
2025-08-31T08:28:42,442   adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_fra.yaml'
2025-08-31T08:28:42,443   adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_hau.yaml'
2025-08-31T08:28:42,444   adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ibo.yaml'
2025-08-31T08:28:42,445   adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_kin.yaml'
2025-08-31T08:28:42,447   adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lin.yaml'
2025-08-31T08:28:42,448   adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lug.yaml'
2025-08-31T08:28:42,449   adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_orm.yaml'
2025-08-31T08:28:42,450   adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sna.yaml'
2025-08-31T08:28:42,451   adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sot.yaml'
2025-08-31T08:28:42,452   adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_swa.yaml'
2025-08-31T08:28:42,453   adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_twi.yaml'
2025-08-31T08:28:42,455   adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_vai.yaml'
2025-08-31T08:28:42,456   adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_wol.yaml'
2025-08-31T08:28:42,457   adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_xho.yaml'
2025-08-31T08:28:42,458   adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yaml'
2025-08-31T08:28:42,459   adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yor.yaml'
2025-08-31T08:28:42,460   adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_zul.yaml'
2025-08-31T08:28:42,462   adding 'lm_eval/tasks/afrimgsm/direct_cot/afrimgsm_cot.yaml'
2025-08-31T08:28:42,464   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_amh.yaml'
2025-08-31T08:28:42,465   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_eng.yaml'
2025-08-31T08:28:42,466   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ewe.yaml'
2025-08-31T08:28:42,467   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_fra.yaml'
2025-08-31T08:28:42,468   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_hau.yaml'
2025-08-31T08:28:42,470   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ibo.yaml'
2025-08-31T08:28:42,471   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_kin.yaml'
2025-08-31T08:28:42,472   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lin.yaml'
2025-08-31T08:28:42,473   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lug.yaml'
2025-08-31T08:28:42,474   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_orm.yaml'
2025-08-31T08:28:42,475   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sna.yaml'
2025-08-31T08:28:42,476   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sot.yaml'
2025-08-31T08:28:42,478   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_swa.yaml'
2025-08-31T08:28:42,479   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_twi.yaml'
2025-08-31T08:28:42,480   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_vai.yaml'
2025-08-31T08:28:42,481   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_wol.yaml'
2025-08-31T08:28:42,482   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_xho.yaml'
2025-08-31T08:28:42,483   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yaml'
2025-08-31T08:28:42,484   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yor.yaml'
2025-08-31T08:28:42,485   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_zul.yaml'
2025-08-31T08:28:42,487   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_amh.yaml'
2025-08-31T08:28:42,488   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_eng.yaml'
2025-08-31T08:28:42,489   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ewe.yaml'
2025-08-31T08:28:42,490   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_fra.yaml'
2025-08-31T08:28:42,492   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_hau.yaml'
2025-08-31T08:28:42,493   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ibo.yaml'
2025-08-31T08:28:42,494   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_kin.yaml'
2025-08-31T08:28:42,495   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lin.yaml'
2025-08-31T08:28:42,496   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lug.yaml'
2025-08-31T08:28:42,497   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_orm.yaml'
2025-08-31T08:28:42,498   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sna.yaml'
2025-08-31T08:28:42,499   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sot.yaml'
2025-08-31T08:28:42,500   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_swa.yaml'
2025-08-31T08:28:42,501   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_twi.yaml'
2025-08-31T08:28:42,502   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_vai.yaml'
2025-08-31T08:28:42,504   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_wol.yaml'
2025-08-31T08:28:42,505   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_xho.yaml'
2025-08-31T08:28:42,506   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yaml'
2025-08-31T08:28:42,507   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yor.yaml'
2025-08-31T08:28:42,508   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_zul.yaml'
2025-08-31T08:28:42,510   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_amh.yaml'
2025-08-31T08:28:42,512   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_eng.yaml'
2025-08-31T08:28:42,513   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ewe.yaml'
2025-08-31T08:28:42,514   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_fra.yaml'
2025-08-31T08:28:42,515   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_hau.yaml'
2025-08-31T08:28:42,517   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ibo.yaml'
2025-08-31T08:28:42,518   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_kin.yaml'
2025-08-31T08:28:42,519   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lin.yaml'
2025-08-31T08:28:42,520   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lug.yaml'
2025-08-31T08:28:42,521   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_orm.yaml'
2025-08-31T08:28:42,522   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sna.yaml'
2025-08-31T08:28:42,524   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sot.yaml'
2025-08-31T08:28:42,525   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_swa.yaml'
2025-08-31T08:28:42,526   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_twi.yaml'
2025-08-31T08:28:42,527   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_vai.yaml'
2025-08-31T08:28:42,528   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_wol.yaml'
2025-08-31T08:28:42,529   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_xho.yaml'
2025-08-31T08:28:42,530   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yaml'
2025-08-31T08:28:42,531   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yor.yaml'
2025-08-31T08:28:42,532   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_zul.yaml'
2025-08-31T08:28:42,534   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_amh.yaml'
2025-08-31T08:28:42,535   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_eng.yaml'
2025-08-31T08:28:42,536   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ewe.yaml'
2025-08-31T08:28:42,537   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_fra.yaml'
2025-08-31T08:28:42,538   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_hau.yaml'
2025-08-31T08:28:42,539   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ibo.yaml'
2025-08-31T08:28:42,540   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_kin.yaml'
2025-08-31T08:28:42,541   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lin.yaml'
2025-08-31T08:28:42,543   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lug.yaml'
2025-08-31T08:28:42,544   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_orm.yaml'
2025-08-31T08:28:42,545   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sna.yaml'
2025-08-31T08:28:42,546   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sot.yaml'
2025-08-31T08:28:42,547   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_swa.yaml'
2025-08-31T08:28:42,548   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_twi.yaml'
2025-08-31T08:28:42,550   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_vai.yaml'
2025-08-31T08:28:42,551   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_wol.yaml'
2025-08-31T08:28:42,552   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_xho.yaml'
2025-08-31T08:28:42,554   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yaml'
2025-08-31T08:28:42,555   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yor.yaml'
2025-08-31T08:28:42,556   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_zul.yaml'
2025-08-31T08:28:42,558   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_amh.yaml'
2025-08-31T08:28:42,559   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_eng.yaml'
2025-08-31T08:28:42,560   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ewe.yaml'
2025-08-31T08:28:42,561   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_fra.yaml'
2025-08-31T08:28:42,562   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_hau.yaml'
2025-08-31T08:28:42,564   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ibo.yaml'
2025-08-31T08:28:42,565   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_kin.yaml'
2025-08-31T08:28:42,566   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lin.yaml'
2025-08-31T08:28:42,567   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lug.yaml'
2025-08-31T08:28:42,568   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_orm.yaml'
2025-08-31T08:28:42,570   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sna.yaml'
2025-08-31T08:28:42,571   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sot.yaml'
2025-08-31T08:28:42,572   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_swa.yaml'
2025-08-31T08:28:42,573   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_twi.yaml'
2025-08-31T08:28:42,574   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_vai.yaml'
2025-08-31T08:28:42,575   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_wol.yaml'
2025-08-31T08:28:42,576   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_xho.yaml'
2025-08-31T08:28:42,577   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yaml'
2025-08-31T08:28:42,578   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yor.yaml'
2025-08-31T08:28:42,579   adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_zul.yaml'
2025-08-31T08:28:42,581   adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_tt.yaml'
2025-08-31T08:28:42,583   adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_amh.yaml'
2025-08-31T08:28:42,584   adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ewe.yaml'
2025-08-31T08:28:42,585   adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_fra.yaml'
2025-08-31T08:28:42,586   adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_hau.yaml'
2025-08-31T08:28:42,587   adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ibo.yaml'
2025-08-31T08:28:42,588   adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_kin.yaml'
2025-08-31T08:28:42,590   adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lin.yaml'
2025-08-31T08:28:42,591   adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lug.yaml'
2025-08-31T08:28:42,592   adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_orm.yaml'
2025-08-31T08:28:42,593   adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sna.yaml'
2025-08-31T08:28:42,594   adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sot.yaml'
2025-08-31T08:28:42,595   adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_swa.yaml'
2025-08-31T08:28:42,596   adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_twi.yaml'
2025-08-31T08:28:42,597   adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_wol.yaml'
2025-08-31T08:28:42,598   adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_xho.yaml'
2025-08-31T08:28:42,599   adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yaml'
2025-08-31T08:28:42,601   adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yor.yaml'
2025-08-31T08:28:42,602   adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_zul.yaml'
2025-08-31T08:28:42,604   adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_amh.yaml'
2025-08-31T08:28:42,605   adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ewe.yaml'
2025-08-31T08:28:42,606   adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_fra.yaml'
2025-08-31T08:28:42,607   adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_hau.yaml'
2025-08-31T08:28:42,609   adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ibo.yaml'
2025-08-31T08:28:42,610   adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_kin.yaml'
2025-08-31T08:28:42,611   adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lin.yaml'
2025-08-31T08:28:42,612   adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lug.yaml'
2025-08-31T08:28:42,614   adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_orm.yaml'
2025-08-31T08:28:42,615   adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sna.yaml'
2025-08-31T08:28:42,616   adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sot.yaml'
2025-08-31T08:28:42,617   adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_swa.yaml'
2025-08-31T08:28:42,619   adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_twi.yaml'
2025-08-31T08:28:42,620   adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_wol.yaml'
2025-08-31T08:28:42,621   adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_xho.yaml'
2025-08-31T08:28:42,622   adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yaml'
2025-08-31T08:28:42,623   adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yor.yaml'
2025-08-31T08:28:42,624   adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_zul.yaml'
2025-08-31T08:28:42,626   adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_amh.yaml'
2025-08-31T08:28:42,627   adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ewe.yaml'
2025-08-31T08:28:42,628   adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_fra.yaml'
2025-08-31T08:28:42,629   adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_hau.yaml'
2025-08-31T08:28:42,630   adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ibo.yaml'
2025-08-31T08:28:42,631   adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_kin.yaml'
2025-08-31T08:28:42,633   adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lin.yaml'
2025-08-31T08:28:42,634   adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lug.yaml'
2025-08-31T08:28:42,635   adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_orm.yaml'
2025-08-31T08:28:42,636   adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sna.yaml'
2025-08-31T08:28:42,637   adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sot.yaml'
2025-08-31T08:28:42,638   adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_swa.yaml'
2025-08-31T08:28:42,639   adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_twi.yaml'
2025-08-31T08:28:42,641   adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_wol.yaml'
2025-08-31T08:28:42,642   adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_xho.yaml'
2025-08-31T08:28:42,643   adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yaml'
2025-08-31T08:28:42,644   adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yor.yaml'
2025-08-31T08:28:42,645   adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_zul.yaml'
2025-08-31T08:28:42,648   adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_amh.yaml'
2025-08-31T08:28:42,649   adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ewe.yaml'
2025-08-31T08:28:42,650   adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_fra.yaml'
2025-08-31T08:28:42,651   adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_hau.yaml'
2025-08-31T08:28:42,653   adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ibo.yaml'
2025-08-31T08:28:42,654   adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_kin.yaml'
2025-08-31T08:28:42,655   adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lin.yaml'
2025-08-31T08:28:42,657   adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lug.yaml'
2025-08-31T08:28:42,658   adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_orm.yaml'
2025-08-31T08:28:42,659   adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sna.yaml'
2025-08-31T08:28:42,660   adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sot.yaml'
2025-08-31T08:28:42,662   adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_swa.yaml'
2025-08-31T08:28:42,663   adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_twi.yaml'
2025-08-31T08:28:42,664   adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_wol.yaml'
2025-08-31T08:28:42,666   adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_xho.yaml'
2025-08-31T08:28:42,667   adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yaml'
2025-08-31T08:28:42,668   adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yor.yaml'
2025-08-31T08:28:42,669   adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_zul.yaml'
2025-08-31T08:28:42,671   adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_amh.yaml'
2025-08-31T08:28:42,672   adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ewe.yaml'
2025-08-31T08:28:42,674   adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_fra.yaml'
2025-08-31T08:28:42,675   adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_hau.yaml'
2025-08-31T08:28:42,676   adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ibo.yaml'
2025-08-31T08:28:42,677   adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_kin.yaml'
2025-08-31T08:28:42,678   adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lin.yaml'
2025-08-31T08:28:42,679   adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lug.yaml'
2025-08-31T08:28:42,680   adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_orm.yaml'
2025-08-31T08:28:42,682   adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sna.yaml'
2025-08-31T08:28:42,683   adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sot.yaml'
2025-08-31T08:28:42,684   adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_swa.yaml'
2025-08-31T08:28:42,685   adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_twi.yaml'
2025-08-31T08:28:42,686   adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_wol.yaml'
2025-08-31T08:28:42,688   adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_xho.yaml'
2025-08-31T08:28:42,689   adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yaml'
2025-08-31T08:28:42,690   adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yor.yaml'
2025-08-31T08:28:42,691   adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_zul.yaml'
2025-08-31T08:28:42,693   adding 'lm_eval/tasks/afrimgsm/translate_cot/afrimgsm_tt_cot.yaml'
2025-08-31T08:28:42,695   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_amh.yaml'
2025-08-31T08:28:42,696   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ewe.yaml'
2025-08-31T08:28:42,697   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_fra.yaml'
2025-08-31T08:28:42,698   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_hau.yaml'
2025-08-31T08:28:42,700   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ibo.yaml'
2025-08-31T08:28:42,701   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_kin.yaml'
2025-08-31T08:28:42,702   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lin.yaml'
2025-08-31T08:28:42,703   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lug.yaml'
2025-08-31T08:28:42,705   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_orm.yaml'
2025-08-31T08:28:42,706   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sna.yaml'
2025-08-31T08:28:42,707   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sot.yaml'
2025-08-31T08:28:42,708   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_swa.yaml'
2025-08-31T08:28:42,709   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_twi.yaml'
2025-08-31T08:28:42,711   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_vai.yaml'
2025-08-31T08:28:42,712   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_wol.yaml'
2025-08-31T08:28:42,713   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_xho.yaml'
2025-08-31T08:28:42,714   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yaml'
2025-08-31T08:28:42,716   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yor.yaml'
2025-08-31T08:28:42,717   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_zul.yaml'
2025-08-31T08:28:42,718   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_amh.yaml'
2025-08-31T08:28:42,720   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ewe.yaml'
2025-08-31T08:28:42,721   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_fra.yaml'
2025-08-31T08:28:42,722   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_hau.yaml'
2025-08-31T08:28:42,723   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ibo.yaml'
2025-08-31T08:28:42,724   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_kin.yaml'
2025-08-31T08:28:42,725   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lin.yaml'
2025-08-31T08:28:42,726   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lug.yaml'
2025-08-31T08:28:42,728   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_orm.yaml'
2025-08-31T08:28:42,729   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sna.yaml'
2025-08-31T08:28:42,730   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sot.yaml'
2025-08-31T08:28:42,731   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_swa.yaml'
2025-08-31T08:28:42,732   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_twi.yaml'
2025-08-31T08:28:42,733   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_vai.yaml'
2025-08-31T08:28:42,734   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_wol.yaml'
2025-08-31T08:28:42,736   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_xho.yaml'
2025-08-31T08:28:42,737   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yaml'
2025-08-31T08:28:42,738   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yor.yaml'
2025-08-31T08:28:42,739   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_zul.yaml'
2025-08-31T08:28:42,741   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_amh.yaml'
2025-08-31T08:28:42,742   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ewe.yaml'
2025-08-31T08:28:42,743   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_fra.yaml'
2025-08-31T08:28:42,744   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_hau.yaml'
2025-08-31T08:28:42,745   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ibo.yaml'
2025-08-31T08:28:42,747   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_kin.yaml'
2025-08-31T08:28:42,748   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lin.yaml'
2025-08-31T08:28:42,749   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lug.yaml'
2025-08-31T08:28:42,750   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_orm.yaml'
2025-08-31T08:28:42,751   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sna.yaml'
2025-08-31T08:28:42,752   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sot.yaml'
2025-08-31T08:28:42,753   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_swa.yaml'
2025-08-31T08:28:42,754   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_twi.yaml'
2025-08-31T08:28:42,756   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_vai.yaml'
2025-08-31T08:28:42,757   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_wol.yaml'
2025-08-31T08:28:42,758   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_xho.yaml'
2025-08-31T08:28:42,759   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yaml'
2025-08-31T08:28:42,760   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yor.yaml'
2025-08-31T08:28:42,761   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_zul.yaml'
2025-08-31T08:28:42,763   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_amh.yaml'
2025-08-31T08:28:42,764   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ewe.yaml'
2025-08-31T08:28:42,765   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_fra.yaml'
2025-08-31T08:28:42,766   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_hau.yaml'
2025-08-31T08:28:42,767   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ibo.yaml'
2025-08-31T08:28:42,768   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_kin.yaml'
2025-08-31T08:28:42,770   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lin.yaml'
2025-08-31T08:28:42,771   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lug.yaml'
2025-08-31T08:28:42,772   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_orm.yaml'
2025-08-31T08:28:42,773   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sna.yaml'
2025-08-31T08:28:42,775   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sot.yaml'
2025-08-31T08:28:42,776   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_swa.yaml'
2025-08-31T08:28:42,777   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_twi.yaml'
2025-08-31T08:28:42,778   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_vai.yaml'
2025-08-31T08:28:42,779   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_wol.yaml'
2025-08-31T08:28:42,780   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_xho.yaml'
2025-08-31T08:28:42,782   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yaml'
2025-08-31T08:28:42,783   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yor.yaml'
2025-08-31T08:28:42,784   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_zul.yaml'
2025-08-31T08:28:42,786   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_amh.yaml'
2025-08-31T08:28:42,787   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ewe.yaml'
2025-08-31T08:28:42,788   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_fra.yaml'
2025-08-31T08:28:42,789   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_hau.yaml'
2025-08-31T08:28:42,791   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ibo.yaml'
2025-08-31T08:28:42,792   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_kin.yaml'
2025-08-31T08:28:42,793   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lin.yaml'
2025-08-31T08:28:42,794   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lug.yaml'
2025-08-31T08:28:42,795   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_orm.yaml'
2025-08-31T08:28:42,797   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sna.yaml'
2025-08-31T08:28:42,798   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sot.yaml'
2025-08-31T08:28:42,799   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_swa.yaml'
2025-08-31T08:28:42,800   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_twi.yaml'
2025-08-31T08:28:42,802   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_vai.yaml'
2025-08-31T08:28:42,803   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_wol.yaml'
2025-08-31T08:28:42,804   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_xho.yaml'
2025-08-31T08:28:42,805   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yaml'
2025-08-31T08:28:42,806   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yor.yaml'
2025-08-31T08:28:42,807   adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_zul.yaml'
2025-08-31T08:28:42,809   adding 'lm_eval/tasks/afrimmlu/README.md'
2025-08-31T08:28:42,810   adding 'lm_eval/tasks/afrimmlu/fewshot.sh'
2025-08-31T08:28:42,812   adding 'lm_eval/tasks/afrimmlu/gen_utils.py'
2025-08-31T08:28:42,813   adding 'lm_eval/tasks/afrimmlu/utils.py'
2025-08-31T08:28:42,815   adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu.yaml'
2025-08-31T08:28:42,817   adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct'
2025-08-31T08:28:42,818   adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_amh.yaml'
2025-08-31T08:28:42,819   adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_eng.yaml'
2025-08-31T08:28:42,820   adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ewe.yaml'
2025-08-31T08:28:42,821   adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_fra.yaml'
2025-08-31T08:28:42,822   adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_hau.yaml'
2025-08-31T08:28:42,824   adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ibo.yaml'
2025-08-31T08:28:42,825   adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_kin.yaml'
2025-08-31T08:28:42,826   adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lin.yaml'
2025-08-31T08:28:42,827   adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lug.yaml'
2025-08-31T08:28:42,828   adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_orm.yaml'
2025-08-31T08:28:42,830   adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sna.yaml'
2025-08-31T08:28:42,831   adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sot.yaml'
2025-08-31T08:28:42,832   adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_swa.yaml'
2025-08-31T08:28:42,833   adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_twi.yaml'
2025-08-31T08:28:42,834   adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_wol.yaml'
2025-08-31T08:28:42,836   adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_xho.yaml'
2025-08-31T08:28:42,837   adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_yor.yaml'
2025-08-31T08:28:42,838   adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_zul.yaml'
2025-08-31T08:28:42,839   adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/utils.py'
2025-08-31T08:28:42,841   adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct'
2025-08-31T08:28:42,842   adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_amh.yaml'
2025-08-31T08:28:42,843   adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_eng.yaml'
2025-08-31T08:28:42,844   adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ewe.yaml'
2025-08-31T08:28:42,846   adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_fra.yaml'
2025-08-31T08:28:42,847   adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_hau.yaml'
2025-08-31T08:28:42,848   adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ibo.yaml'
2025-08-31T08:28:42,849   adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_kin.yaml'
2025-08-31T08:28:42,850   adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lin.yaml'
2025-08-31T08:28:42,851   adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lug.yaml'
2025-08-31T08:28:42,853   adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_orm.yaml'
2025-08-31T08:28:42,854   adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sna.yaml'
2025-08-31T08:28:42,855   adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sot.yaml'
2025-08-31T08:28:42,856   adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_swa.yaml'
2025-08-31T08:28:42,857   adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_twi.yaml'
2025-08-31T08:28:42,858   adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_wol.yaml'
2025-08-31T08:28:42,859   adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_xho.yaml'
2025-08-31T08:28:42,860   adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_yor.yaml'
2025-08-31T08:28:42,861   adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_zul.yaml'
2025-08-31T08:28:42,862   adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/utils.py'
2025-08-31T08:28:42,864   adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct'
2025-08-31T08:28:42,865   adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_amh.yaml'
2025-08-31T08:28:42,866   adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_eng.yaml'
2025-08-31T08:28:42,868   adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ewe.yaml'
2025-08-31T08:28:42,869   adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_fra.yaml'
2025-08-31T08:28:42,870   adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_hau.yaml'
2025-08-31T08:28:42,871   adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ibo.yaml'
2025-08-31T08:28:42,872   adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_kin.yaml'
2025-08-31T08:28:42,873   adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lin.yaml'
2025-08-31T08:28:42,874   adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lug.yaml'
2025-08-31T08:28:42,875   adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_orm.yaml'
2025-08-31T08:28:42,877   adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sna.yaml'
2025-08-31T08:28:42,878   adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sot.yaml'
2025-08-31T08:28:42,879   adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_swa.yaml'
2025-08-31T08:28:42,880   adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_twi.yaml'
2025-08-31T08:28:42,881   adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_wol.yaml'
2025-08-31T08:28:42,882   adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_xho.yaml'
2025-08-31T08:28:42,883   adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_yor.yaml'
2025-08-31T08:28:42,884   adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_zul.yaml'
2025-08-31T08:28:42,886   adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/utils.py'
2025-08-31T08:28:42,888   adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct'
2025-08-31T08:28:42,889   adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_amh.yaml'
2025-08-31T08:28:42,890   adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_eng.yaml'
2025-08-31T08:28:42,891   adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ewe.yaml'
2025-08-31T08:28:42,892   adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_fra.yaml'
2025-08-31T08:28:42,893   adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_hau.yaml'
2025-08-31T08:28:42,894   adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ibo.yaml'
2025-08-31T08:28:42,896   adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_kin.yaml'
2025-08-31T08:28:42,897   adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lin.yaml'
2025-08-31T08:28:42,898   adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lug.yaml'
2025-08-31T08:28:42,899   adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_orm.yaml'
2025-08-31T08:28:42,900   adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sna.yaml'
2025-08-31T08:28:42,901   adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sot.yaml'
2025-08-31T08:28:42,903   adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_swa.yaml'
2025-08-31T08:28:42,903   adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_twi.yaml'
2025-08-31T08:28:42,904   adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_wol.yaml'
2025-08-31T08:28:42,906   adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_xho.yaml'
2025-08-31T08:28:42,907   adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_yor.yaml'
2025-08-31T08:28:42,908   adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_zul.yaml'
2025-08-31T08:28:42,909   adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/utils.py'
2025-08-31T08:28:42,911   adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct'
2025-08-31T08:28:42,912   adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_amh.yaml'
2025-08-31T08:28:42,913   adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_eng.yaml'
2025-08-31T08:28:42,914   adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ewe.yaml'
2025-08-31T08:28:42,915   adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_fra.yaml'
2025-08-31T08:28:42,917   adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_hau.yaml'
2025-08-31T08:28:42,918   adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ibo.yaml'
2025-08-31T08:28:42,919   adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_kin.yaml'
2025-08-31T08:28:42,920   adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lin.yaml'
2025-08-31T08:28:42,921   adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lug.yaml'
2025-08-31T08:28:42,922   adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_orm.yaml'
2025-08-31T08:28:42,923   adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sna.yaml'
2025-08-31T08:28:42,924   adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sot.yaml'
2025-08-31T08:28:42,925   adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_swa.yaml'
2025-08-31T08:28:42,926   adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_twi.yaml'
2025-08-31T08:28:42,928   adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_wol.yaml'
2025-08-31T08:28:42,929   adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_xho.yaml'
2025-08-31T08:28:42,930   adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_yor.yaml'
2025-08-31T08:28:42,931   adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_zul.yaml'
2025-08-31T08:28:42,932   adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/utils.py'
2025-08-31T08:28:42,934   adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_tt.yaml'
2025-08-31T08:28:42,936   adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate'
2025-08-31T08:28:42,937   adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_amh.yaml'
2025-08-31T08:28:42,938   adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ewe.yaml'
2025-08-31T08:28:42,939   adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_fra.yaml'
2025-08-31T08:28:42,940   adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_hau.yaml'
2025-08-31T08:28:42,942   adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ibo.yaml'
2025-08-31T08:28:42,943   adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_kin.yaml'
2025-08-31T08:28:42,944   adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lin.yaml'
2025-08-31T08:28:42,945   adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lug.yaml'
2025-08-31T08:28:42,946   adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_orm.yaml'
2025-08-31T08:28:42,947   adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sna.yaml'
2025-08-31T08:28:42,948   adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sot.yaml'
2025-08-31T08:28:42,950   adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_swa.yaml'
2025-08-31T08:28:42,951   adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_twi.yaml'
2025-08-31T08:28:42,952   adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_wol.yaml'
2025-08-31T08:28:42,953   adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_xho.yaml'
2025-08-31T08:28:42,954   adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_yor.yaml'
2025-08-31T08:28:42,955   adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_zul.yaml'
2025-08-31T08:28:42,956   adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/utils.py'
2025-08-31T08:28:42,958   adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate'
2025-08-31T08:28:42,959   adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_amh.yaml'
2025-08-31T08:28:42,960   adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ewe.yaml'
2025-08-31T08:28:42,961   adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_fra.yaml'
2025-08-31T08:28:42,962   adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_hau.yaml'
2025-08-31T08:28:42,964   adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ibo.yaml'
2025-08-31T08:28:42,965   adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_kin.yaml'
2025-08-31T08:28:42,966   adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lin.yaml'
2025-08-31T08:28:42,967   adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lug.yaml'
2025-08-31T08:28:42,968   adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_orm.yaml'
2025-08-31T08:28:42,969   adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sna.yaml'
2025-08-31T08:28:42,970   adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sot.yaml'
2025-08-31T08:28:42,971   adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_swa.yaml'
2025-08-31T08:28:42,973   adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_twi.yaml'
2025-08-31T08:28:42,974   adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_wol.yaml'
2025-08-31T08:28:42,975   adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_xho.yaml'
2025-08-31T08:28:42,976   adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_yor.yaml'
2025-08-31T08:28:42,977   adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_zul.yaml'
2025-08-31T08:28:42,978   adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/utils.py'
2025-08-31T08:28:42,980   adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate'
2025-08-31T08:28:42,981   adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_amh.yaml'
2025-08-31T08:28:42,983   adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ewe.yaml'
2025-08-31T08:28:42,984   adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_fra.yaml'
2025-08-31T08:28:42,985   adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_hau.yaml'
2025-08-31T08:28:42,986   adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ibo.yaml'
2025-08-31T08:28:42,987   adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_kin.yaml'
2025-08-31T08:28:42,989   adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lin.yaml'
2025-08-31T08:28:42,990   adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lug.yaml'
2025-08-31T08:28:42,991   adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_orm.yaml'
2025-08-31T08:28:42,993   adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sna.yaml'
2025-08-31T08:28:42,994   adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sot.yaml'
2025-08-31T08:28:42,995   adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_swa.yaml'
2025-08-31T08:28:42,996   adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_twi.yaml'
2025-08-31T08:28:42,998   adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_wol.yaml'
2025-08-31T08:28:42,999   adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_xho.yaml'
2025-08-31T08:28:43,000   adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_yor.yaml'
2025-08-31T08:28:43,001   adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_zul.yaml'
2025-08-31T08:28:43,002   adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/utils.py'
2025-08-31T08:28:43,004   adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate'
2025-08-31T08:28:43,005   adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_amh.yaml'
2025-08-31T08:28:43,006   adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ewe.yaml'
2025-08-31T08:28:43,007   adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_fra.yaml'
2025-08-31T08:28:43,008   adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_hau.yaml'
2025-08-31T08:28:43,009   adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ibo.yaml'
2025-08-31T08:28:43,010   adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_kin.yaml'
2025-08-31T08:28:43,011   adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lin.yaml'
2025-08-31T08:28:43,012   adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lug.yaml'
2025-08-31T08:28:43,013   adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_orm.yaml'
2025-08-31T08:28:43,015   adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sna.yaml'
2025-08-31T08:28:43,016   adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sot.yaml'
2025-08-31T08:28:43,017   adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_swa.yaml'
2025-08-31T08:28:43,018   adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_twi.yaml'
2025-08-31T08:28:43,019   adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_wol.yaml'
2025-08-31T08:28:43,020   adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_xho.yaml'
2025-08-31T08:28:43,021   adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_yor.yaml'
2025-08-31T08:28:43,022   adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_zul.yaml'
2025-08-31T08:28:43,024   adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/utils.py'
2025-08-31T08:28:43,026   adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate'
2025-08-31T08:28:43,027   adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_amh.yaml'
2025-08-31T08:28:43,028   adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ewe.yaml'
2025-08-31T08:28:43,029   adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_fra.yaml'
2025-08-31T08:28:43,030   adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_hau.yaml'
2025-08-31T08:28:43,031   adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ibo.yaml'
2025-08-31T08:28:43,033   adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_kin.yaml'
2025-08-31T08:28:43,034   adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lin.yaml'
2025-08-31T08:28:43,035   adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lug.yaml'
2025-08-31T08:28:43,036   adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_orm.yaml'
2025-08-31T08:28:43,037   adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sna.yaml'
2025-08-31T08:28:43,038   adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sot.yaml'
2025-08-31T08:28:43,039   adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_swa.yaml'
2025-08-31T08:28:43,041   adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_twi.yaml'
2025-08-31T08:28:43,042   adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_wol.yaml'
2025-08-31T08:28:43,043   adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_xho.yaml'
2025-08-31T08:28:43,044   adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_yor.yaml'
2025-08-31T08:28:43,045   adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_zul.yaml'
2025-08-31T08:28:43,046   adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/utils.py'
2025-08-31T08:28:43,048   adding 'lm_eval/tasks/afrixnli/README.md'
2025-08-31T08:28:43,050   adding 'lm_eval/tasks/afrixnli/gen_utils.py'
2025-08-31T08:28:43,051   adding 'lm_eval/tasks/afrixnli/utils.py'
2025-08-31T08:28:43,053   adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_amh.yaml'
2025-08-31T08:28:43,054   adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_eng.yaml'
2025-08-31T08:28:43,055   adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ewe.yaml'
2025-08-31T08:28:43,056   adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_fra.yaml'
2025-08-31T08:28:43,057   adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_hau.yaml'
2025-08-31T08:28:43,059   adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ibo.yaml'
2025-08-31T08:28:43,060   adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_kin.yaml'
2025-08-31T08:28:43,061   adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lin.yaml'
2025-08-31T08:28:43,062   adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lug.yaml'
2025-08-31T08:28:43,063   adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_orm.yaml'
2025-08-31T08:28:43,064   adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sna.yaml'
2025-08-31T08:28:43,065   adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sot.yaml'
2025-08-31T08:28:43,066   adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_swa.yaml'
2025-08-31T08:28:43,068   adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_twi.yaml'
2025-08-31T08:28:43,069   adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_wol.yaml'
2025-08-31T08:28:43,070   adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_xho.yaml'
2025-08-31T08:28:43,071   adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yaml'
2025-08-31T08:28:43,072   adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yor.yaml'
2025-08-31T08:28:43,073   adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_zul.yaml'
2025-08-31T08:28:43,074   adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/utils.py'
2025-08-31T08:28:43,076   adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_amh.yaml'
2025-08-31T08:28:43,077   adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_eng.yaml'
2025-08-31T08:28:43,079   adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ewe.yaml'
2025-08-31T08:28:43,080   adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_fra.yaml'
2025-08-31T08:28:43,081   adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_hau.yaml'
2025-08-31T08:28:43,082   adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ibo.yaml'
2025-08-31T08:28:43,083   adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_kin.yaml'
2025-08-31T08:28:43,085   adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lin.yaml'
2025-08-31T08:28:43,086   adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lug.yaml'
2025-08-31T08:28:43,087   adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_orm.yaml'
2025-08-31T08:28:43,088   adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sna.yaml'
2025-08-31T08:28:43,089   adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sot.yaml'
2025-08-31T08:28:43,090   adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_swa.yaml'
2025-08-31T08:28:43,092   adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_twi.yaml'
2025-08-31T08:28:43,093   adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_wol.yaml'
2025-08-31T08:28:43,094   adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_xho.yaml'
2025-08-31T08:28:43,095   adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yaml'
2025-08-31T08:28:43,096   adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yor.yaml'
2025-08-31T08:28:43,097   adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_zul.yaml'
2025-08-31T08:28:43,098   adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/utils.py'
2025-08-31T08:28:43,100   adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_amh.yaml'
2025-08-31T08:28:43,101   adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ewe.yaml'
2025-08-31T08:28:43,102   adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_fra.yaml'
2025-08-31T08:28:43,103   adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_hau.yaml'
2025-08-31T08:28:43,105   adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ibo.yaml'
2025-08-31T08:28:43,106   adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_kin.yaml'
2025-08-31T08:28:43,107   adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lin.yaml'
2025-08-31T08:28:43,108   adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lug.yaml'
2025-08-31T08:28:43,109   adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_orm.yaml'
2025-08-31T08:28:43,110   adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sna.yaml'
2025-08-31T08:28:43,111   adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sot.yaml'
2025-08-31T08:28:43,113   adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_swa.yaml'
2025-08-31T08:28:43,114   adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_twi.yaml'
2025-08-31T08:28:43,115   adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_wol.yaml'
2025-08-31T08:28:43,116   adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_xho.yaml'
2025-08-31T08:28:43,117   adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yaml'
2025-08-31T08:28:43,118   adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yor.yaml'
2025-08-31T08:28:43,119   adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_zul.yaml'
2025-08-31T08:28:43,121   adding 'lm_eval/tasks/afrixnli/anli prompt/translate/utils.py'
2025-08-31T08:28:43,122   adding 'lm_eval/tasks/afrixnli/direct/afrixnli.yaml'
2025-08-31T08:28:43,124   adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_amh.yaml'
2025-08-31T08:28:43,125   adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_eng.yaml'
2025-08-31T08:28:43,127   adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ewe.yaml'
2025-08-31T08:28:43,128   adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_fra.yaml'
2025-08-31T08:28:43,129   adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_hau.yaml'
2025-08-31T08:28:43,130   adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ibo.yaml'
2025-08-31T08:28:43,131   adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_kin.yaml'
2025-08-31T08:28:43,132   adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lin.yaml'
2025-08-31T08:28:43,134   adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lug.yaml'
2025-08-31T08:28:43,135   adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_orm.yaml'
2025-08-31T08:28:43,136   adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sna.yaml'
2025-08-31T08:28:43,137   adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sot.yaml'
2025-08-31T08:28:43,138   adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_swa.yaml'
2025-08-31T08:28:43,140   adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_twi.yaml'
2025-08-31T08:28:43,141   adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_wol.yaml'
2025-08-31T08:28:43,142   adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_xho.yaml'
2025-08-31T08:28:43,143   adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yaml'
2025-08-31T08:28:43,144   adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yor.yaml'
2025-08-31T08:28:43,145   adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_zul.yaml'
2025-08-31T08:28:43,146   adding 'lm_eval/tasks/afrixnli/direct/prompt_1/utils.py'
2025-08-31T08:28:43,148   adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_amh.yaml'
2025-08-31T08:28:43,149   adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_eng.yaml'
2025-08-31T08:28:43,150   adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ewe.yaml'
2025-08-31T08:28:43,151   adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_fra.yaml'
2025-08-31T08:28:43,152   adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_hau.yaml'
2025-08-31T08:28:43,153   adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ibo.yaml'
2025-08-31T08:28:43,155   adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_kin.yaml'
2025-08-31T08:28:43,156   adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lin.yaml'
2025-08-31T08:28:43,157   adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lug.yaml'
2025-08-31T08:28:43,158   adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_orm.yaml'
2025-08-31T08:28:43,159   adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sna.yaml'
2025-08-31T08:28:43,160   adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sot.yaml'
2025-08-31T08:28:43,162   adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_swa.yaml'
2025-08-31T08:28:43,163   adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_twi.yaml'
2025-08-31T08:28:43,164   adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_wol.yaml'
2025-08-31T08:28:43,165   adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_xho.yaml'
2025-08-31T08:28:43,166   adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yaml'
2025-08-31T08:28:43,168   adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yor.yaml'
2025-08-31T08:28:43,169   adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_zul.yaml'
2025-08-31T08:28:43,170   adding 'lm_eval/tasks/afrixnli/direct/prompt_2/utils.py'
2025-08-31T08:28:43,172   adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_amh.yaml'
2025-08-31T08:28:43,173   adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_eng.yaml'
2025-08-31T08:28:43,174   adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ewe.yaml'
2025-08-31T08:28:43,175   adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_fra.yaml'
2025-08-31T08:28:43,176   adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_hau.yaml'
2025-08-31T08:28:43,178   adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ibo.yaml'
2025-08-31T08:28:43,179   adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_kin.yaml'
2025-08-31T08:28:43,180   adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lin.yaml'
2025-08-31T08:28:43,181   adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lug.yaml'
2025-08-31T08:28:43,182   adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_orm.yaml'
2025-08-31T08:28:43,184   adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sna.yaml'
2025-08-31T08:28:43,185   adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sot.yaml'
2025-08-31T08:28:43,186   adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_swa.yaml'
2025-08-31T08:28:43,187   adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_twi.yaml'
2025-08-31T08:28:43,189   adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_wol.yaml'
2025-08-31T08:28:43,190   adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_xho.yaml'
2025-08-31T08:28:43,191   adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yaml'
2025-08-31T08:28:43,192   adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yor.yaml'
2025-08-31T08:28:43,194   adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_zul.yaml'
2025-08-31T08:28:43,195   adding 'lm_eval/tasks/afrixnli/direct/prompt_3/utils.py'
2025-08-31T08:28:43,196   adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_amh.yaml'
2025-08-31T08:28:43,198   adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_eng.yaml'
2025-08-31T08:28:43,199   adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ewe.yaml'
2025-08-31T08:28:43,200   adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_fra.yaml'
2025-08-31T08:28:43,201   adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_hau.yaml'
2025-08-31T08:28:43,202   adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ibo.yaml'
2025-08-31T08:28:43,203   adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_kin.yaml'
2025-08-31T08:28:43,205   adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lin.yaml'
2025-08-31T08:28:43,206   adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lug.yaml'
2025-08-31T08:28:43,207   adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_orm.yaml'
2025-08-31T08:28:43,208   adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sna.yaml'
2025-08-31T08:28:43,209   adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sot.yaml'
2025-08-31T08:28:43,211   adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_swa.yaml'
2025-08-31T08:28:43,212   adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_twi.yaml'
2025-08-31T08:28:43,213   adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_wol.yaml'
2025-08-31T08:28:43,214   adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_xho.yaml'
2025-08-31T08:28:43,215   adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yaml'
2025-08-31T08:28:43,216   adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yor.yaml'
2025-08-31T08:28:43,218   adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_zul.yaml'
2025-08-31T08:28:43,219   adding 'lm_eval/tasks/afrixnli/direct/prompt_4/utils.py'
2025-08-31T08:28:43,221   adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_amh.yaml'
2025-08-31T08:28:43,222   adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_eng.yaml'
2025-08-31T08:28:43,224   adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ewe.yaml'
2025-08-31T08:28:43,225   adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_fra.yaml'
2025-08-31T08:28:43,226   adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_hau.yaml'
2025-08-31T08:28:43,227   adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ibo.yaml'
2025-08-31T08:28:43,228   adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_kin.yaml'
2025-08-31T08:28:43,230   adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lin.yaml'
2025-08-31T08:28:43,231   adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lug.yaml'
2025-08-31T08:28:43,232   adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_orm.yaml'
2025-08-31T08:28:43,233   adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sna.yaml'
2025-08-31T08:28:43,234   adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sot.yaml'
2025-08-31T08:28:43,235   adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_swa.yaml'
2025-08-31T08:28:43,237   adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_twi.yaml'
2025-08-31T08:28:43,238   adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_wol.yaml'
2025-08-31T08:28:43,239   adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_xho.yaml'
2025-08-31T08:28:43,240   adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yaml'
2025-08-31T08:28:43,241   adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yor.yaml'
2025-08-31T08:28:43,242   adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_zul.yaml'
2025-08-31T08:28:43,244   adding 'lm_eval/tasks/afrixnli/direct/prompt_5/utils.py'
2025-08-31T08:28:43,246   adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_amh.yaml'
2025-08-31T08:28:43,247   adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_eng.yaml'
2025-08-31T08:28:43,248   adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ewe.yaml'
2025-08-31T08:28:43,250   adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_fra.yaml'
2025-08-31T08:28:43,251   adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_hau.yaml'
2025-08-31T08:28:43,252   adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ibo.yaml'
2025-08-31T08:28:43,253   adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_kin.yaml'
2025-08-31T08:28:43,255   adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lin.yaml'
2025-08-31T08:28:43,256   adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lug.yaml'
2025-08-31T08:28:43,257   adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_orm.yaml'
2025-08-31T08:28:43,258   adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sna.yaml'
2025-08-31T08:28:43,259   adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sot.yaml'
2025-08-31T08:28:43,260   adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_swa.yaml'
2025-08-31T08:28:43,262   adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_twi.yaml'
2025-08-31T08:28:43,263   adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_wol.yaml'
2025-08-31T08:28:43,264   adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_xho.yaml'
2025-08-31T08:28:43,265   adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yaml'
2025-08-31T08:28:43,266   adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yor.yaml'
2025-08-31T08:28:43,267   adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_zul.yaml'
2025-08-31T08:28:43,269   adding 'lm_eval/tasks/afrixnli/lai prompt/direct/utils.py'
2025-08-31T08:28:43,270   adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_amh.yaml'
2025-08-31T08:28:43,272   adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ewe.yaml'
2025-08-31T08:28:43,273   adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_fra.yaml'
2025-08-31T08:28:43,274   adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_hau.yaml'
2025-08-31T08:28:43,275   adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ibo.yaml'
2025-08-31T08:28:43,276   adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_kin.yaml'
2025-08-31T08:28:43,277   adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lin.yaml'
2025-08-31T08:28:43,278   adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lug.yaml'
2025-08-31T08:28:43,279   adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_orm.yaml'
2025-08-31T08:28:43,281   adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sna.yaml'
2025-08-31T08:28:43,282   adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sot.yaml'
2025-08-31T08:28:43,283   adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_swa.yaml'
2025-08-31T08:28:43,284   adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_twi.yaml'
2025-08-31T08:28:43,285   adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_wol.yaml'
2025-08-31T08:28:43,286   adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_xho.yaml'
2025-08-31T08:28:43,287   adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yaml'
2025-08-31T08:28:43,289   adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yor.yaml'
2025-08-31T08:28:43,290   adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_zul.yaml'
2025-08-31T08:28:43,291   adding 'lm_eval/tasks/afrixnli/lai prompt/translate/utils.py'
2025-08-31T08:28:43,293   adding 'lm_eval/tasks/afrixnli/translate/afrixnli_tt.yaml'
2025-08-31T08:28:43,295   adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_amh.yaml'
2025-08-31T08:28:43,296   adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ewe.yaml'
2025-08-31T08:28:43,297   adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_fra.yaml'
2025-08-31T08:28:43,298   adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_hau.yaml'
2025-08-31T08:28:43,299   adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ibo.yaml'
2025-08-31T08:28:43,300   adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_kin.yaml'
2025-08-31T08:28:43,301   adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lin.yaml'
2025-08-31T08:28:43,302   adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lug.yaml'
2025-08-31T08:28:43,303   adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_orm.yaml'
2025-08-31T08:28:43,305   adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sna.yaml'
2025-08-31T08:28:43,306   adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sot.yaml'
2025-08-31T08:28:43,307   adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_swa.yaml'
2025-08-31T08:28:43,308   adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_twi.yaml'
2025-08-31T08:28:43,309   adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_wol.yaml'
2025-08-31T08:28:43,311   adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_xho.yaml'
2025-08-31T08:28:43,312   adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yaml'
2025-08-31T08:28:43,313   adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yor.yaml'
2025-08-31T08:28:43,314   adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_zul.yaml'
2025-08-31T08:28:43,315   adding 'lm_eval/tasks/afrixnli/translate/prompt_1/utils.py'
2025-08-31T08:28:43,317   adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_amh.yaml'
2025-08-31T08:28:43,318   adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ewe.yaml'
2025-08-31T08:28:43,319   adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_fra.yaml'
2025-08-31T08:28:43,321   adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_hau.yaml'
2025-08-31T08:28:43,322   adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ibo.yaml'
2025-08-31T08:28:43,323   adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_kin.yaml'
2025-08-31T08:28:43,324   adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lin.yaml'
2025-08-31T08:28:43,325   adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lug.yaml'
2025-08-31T08:28:43,326   adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_orm.yaml'
2025-08-31T08:28:43,327   adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sna.yaml'
2025-08-31T08:28:43,329   adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sot.yaml'
2025-08-31T08:28:43,330   adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_swa.yaml'
2025-08-31T08:28:43,331   adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_twi.yaml'
2025-08-31T08:28:43,332   adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_wol.yaml'
2025-08-31T08:28:43,333   adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_xho.yaml'
2025-08-31T08:28:43,335   adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yaml'
2025-08-31T08:28:43,336   adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yor.yaml'
2025-08-31T08:28:43,337   adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_zul.yaml'
2025-08-31T08:28:43,338   adding 'lm_eval/tasks/afrixnli/translate/prompt_2/utils.py'
2025-08-31T08:28:43,340   adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_amh.yaml'
2025-08-31T08:28:43,341   adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ewe.yaml'
2025-08-31T08:28:43,342   adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_fra.yaml'
2025-08-31T08:28:43,343   adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_hau.yaml'
2025-08-31T08:28:43,344   adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ibo.yaml'
2025-08-31T08:28:43,346   adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_kin.yaml'
2025-08-31T08:28:43,347   adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lin.yaml'
2025-08-31T08:28:43,348   adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lug.yaml'
2025-08-31T08:28:43,349   adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_orm.yaml'
2025-08-31T08:28:43,350   adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sna.yaml'
2025-08-31T08:28:43,351   adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sot.yaml'
2025-08-31T08:28:43,353   adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_swa.yaml'
2025-08-31T08:28:43,354   adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_twi.yaml'
2025-08-31T08:28:43,355   adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_wol.yaml'
2025-08-31T08:28:43,356   adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_xho.yaml'
2025-08-31T08:28:43,357   adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yaml'
2025-08-31T08:28:43,359   adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yor.yaml'
2025-08-31T08:28:43,360   adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_zul.yaml'
2025-08-31T08:28:43,361   adding 'lm_eval/tasks/afrixnli/translate/prompt_3/utils.py'
2025-08-31T08:28:43,363   adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_amh.yaml'
2025-08-31T08:28:43,364   adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ewe.yaml'
2025-08-31T08:28:43,365   adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_fra.yaml'
2025-08-31T08:28:43,366   adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_hau.yaml'
2025-08-31T08:28:43,368   adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ibo.yaml'
2025-08-31T08:28:43,369   adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_kin.yaml'
2025-08-31T08:28:43,370   adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lin.yaml'
2025-08-31T08:28:43,371   adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lug.yaml'
2025-08-31T08:28:43,372   adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_orm.yaml'
2025-08-31T08:28:43,373   adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sna.yaml'
2025-08-31T08:28:43,375   adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sot.yaml'
2025-08-31T08:28:43,376   adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_swa.yaml'
2025-08-31T08:28:43,377   adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_twi.yaml'
2025-08-31T08:28:43,378   adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_wol.yaml'
2025-08-31T08:28:43,379   adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_xho.yaml'
2025-08-31T08:28:43,381   adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yaml'
2025-08-31T08:28:43,382   adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yor.yaml'
2025-08-31T08:28:43,383   adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_zul.yaml'
2025-08-31T08:28:43,385   adding 'lm_eval/tasks/afrixnli/translate/prompt_4/utils.py'
2025-08-31T08:28:43,386   adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_amh.yaml'
2025-08-31T08:28:43,388   adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ewe.yaml'
2025-08-31T08:28:43,389   adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_fra.yaml'
2025-08-31T08:28:43,390   adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_hau.yaml'
2025-08-31T08:28:43,391   adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ibo.yaml'
2025-08-31T08:28:43,392   adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_kin.yaml'
2025-08-31T08:28:43,393   adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lin.yaml'
2025-08-31T08:28:43,394   adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lug.yaml'
2025-08-31T08:28:43,395   adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_orm.yaml'
2025-08-31T08:28:43,396   adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sna.yaml'
2025-08-31T08:28:43,397   adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sot.yaml'
2025-08-31T08:28:43,398   adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_swa.yaml'
2025-08-31T08:28:43,400   adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_twi.yaml'
2025-08-31T08:28:43,401   adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_wol.yaml'
2025-08-31T08:28:43,402   adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_xho.yaml'
2025-08-31T08:28:43,403   adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yaml'
2025-08-31T08:28:43,404   adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yor.yaml'
2025-08-31T08:28:43,405   adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_zul.yaml'
2025-08-31T08:28:43,407   adding 'lm_eval/tasks/afrixnli/translate/prompt_5/utils.py'
2025-08-31T08:28:43,409   adding 'lm_eval/tasks/afrobench/README.md'
2025-08-31T08:28:43,410   adding 'lm_eval/tasks/afrobench/afrobench-lite.yaml'
2025-08-31T08:28:43,411   adding 'lm_eval/tasks/afrobench/afrobench.yaml'
2025-08-31T08:28:43,413   adding 'lm_eval/tasks/afrobench/adr/README.md'
2025-08-31T08:28:43,414   adding 'lm_eval/tasks/afrobench/adr/afridiacritics.yaml'
2025-08-31T08:28:43,416   adding 'lm_eval/tasks/afrobench/adr/gen_utils.py'
2025-08-31T08:28:43,417   adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_bbj.yaml'
2025-08-31T08:28:43,418   adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_fon.yaml'
2025-08-31T08:28:43,420   adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_ibo.yaml'
2025-08-31T08:28:43,421   adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_wol.yaml'
2025-08-31T08:28:43,422   adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yaml'
2025-08-31T08:28:43,423   adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yor.yaml'
2025-08-31T08:28:43,425   adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_bbj.yaml'
2025-08-31T08:28:43,426   adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_fon.yaml'
2025-08-31T08:28:43,427   adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_ibo.yaml'
2025-08-31T08:28:43,429   adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_wol.yaml'
2025-08-31T08:28:43,430   adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yaml'
2025-08-31T08:28:43,431   adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yor.yaml'
2025-08-31T08:28:43,433   adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_bbj.yaml'
2025-08-31T08:28:43,434   adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_fon.yaml'
2025-08-31T08:28:43,435   adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_ibo.yaml'
2025-08-31T08:28:43,436   adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_wol.yaml'
2025-08-31T08:28:43,437   adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yaml'
2025-08-31T08:28:43,438   adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yor.yaml'
2025-08-31T08:28:43,440   adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_bbj.yaml'
2025-08-31T08:28:43,441   adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_fon.yaml'
2025-08-31T08:28:43,443   adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_ibo.yaml'
2025-08-31T08:28:43,444   adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_wol.yaml'
2025-08-31T08:28:43,445   adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yaml'
2025-08-31T08:28:43,446   adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yor.yaml'
2025-08-31T08:28:43,448   adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_bbj.yaml'
2025-08-31T08:28:43,449   adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_fon.yaml'
2025-08-31T08:28:43,450   adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_ibo.yaml'
2025-08-31T08:28:43,451   adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_wol.yaml'
2025-08-31T08:28:43,452   adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yaml'
2025-08-31T08:28:43,453   adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yor.yaml'
2025-08-31T08:28:43,455   adding 'lm_eval/tasks/afrobench/afriqa/README.md'
2025-08-31T08:28:43,457   adding 'lm_eval/tasks/afrobench/afriqa/afriqa.yaml'
2025-08-31T08:28:43,458   adding 'lm_eval/tasks/afrobench/afriqa/utils.py'
2025-08-31T08:28:43,460   adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa'
2025-08-31T08:28:43,461   adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_bem.yaml'
2025-08-31T08:28:43,462   adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_fon.yaml'
2025-08-31T08:28:43,463   adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_hau.yaml'
2025-08-31T08:28:43,464   adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_ibo.yaml'
2025-08-31T08:28:43,465   adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_kin.yaml'
2025-08-31T08:28:43,466   adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_swa.yaml'
2025-08-31T08:28:43,468   adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_twi.yaml'
2025-08-31T08:28:43,469   adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_yor.yaml'
2025-08-31T08:28:43,470   adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_zul.yaml'
2025-08-31T08:28:43,471   adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/utils.py'
2025-08-31T08:28:43,473   adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa'
2025-08-31T08:28:43,474   adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_bem.yaml'
2025-08-31T08:28:43,475   adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_fon.yaml'
2025-08-31T08:28:43,476   adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_hau.yaml'
2025-08-31T08:28:43,478   adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_ibo.yaml'
2025-08-31T08:28:43,479   adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_kin.yaml'
2025-08-31T08:28:43,480   adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_swa.yaml'
2025-08-31T08:28:43,481   adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_twi.yaml'
2025-08-31T08:28:43,482   adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_yor.yaml'
2025-08-31T08:28:43,484   adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_zul.yaml'
2025-08-31T08:28:43,485   adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/utils.py'
2025-08-31T08:28:43,487   adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa'
2025-08-31T08:28:43,488   adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_bem.yaml'
2025-08-31T08:28:43,489   adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_fon.yaml'
2025-08-31T08:28:43,490   adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_hau.yaml'
2025-08-31T08:28:43,492   adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_ibo.yaml'
2025-08-31T08:28:43,493   adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_kin.yaml'
2025-08-31T08:28:43,494   adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_swa.yaml'
2025-08-31T08:28:43,495   adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_twi.yaml'
2025-08-31T08:28:43,496   adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_yor.yaml'
2025-08-31T08:28:43,497   adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_zul.yaml'
2025-08-31T08:28:43,499   adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/utils.py'
2025-08-31T08:28:43,501   adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa'
2025-08-31T08:28:43,502   adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_bem.yaml'
2025-08-31T08:28:43,503   adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_fon.yaml'
2025-08-31T08:28:43,504   adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_hau.yaml'
2025-08-31T08:28:43,505   adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_ibo.yaml'
2025-08-31T08:28:43,507   adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_kin.yaml'
2025-08-31T08:28:43,508   adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_swa.yaml'
2025-08-31T08:28:43,509   adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_twi.yaml'
2025-08-31T08:28:43,510   adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_yor.yaml'
2025-08-31T08:28:43,511   adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_zul.yaml'
2025-08-31T08:28:43,513   adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/utils.py'
2025-08-31T08:28:43,514   adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa'
2025-08-31T08:28:43,516   adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_bem.yaml'
2025-08-31T08:28:43,517   adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_fon.yaml'
2025-08-31T08:28:43,518   adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_hau.yaml'
2025-08-31T08:28:43,519   adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_ibo.yaml'
2025-08-31T08:28:43,520   adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_kin.yaml'
2025-08-31T08:28:43,521   adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_swa.yaml'
2025-08-31T08:28:43,523   adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_twi.yaml'
2025-08-31T08:28:43,524   adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_yor.yaml'
2025-08-31T08:28:43,525   adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_zul.yaml'
2025-08-31T08:28:43,526   adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/utils.py'
2025-08-31T08:28:43,528   adding 'lm_eval/tasks/afrobench/afrisenti/README.md'
2025-08-31T08:28:43,530   adding 'lm_eval/tasks/afrobench/afrisenti/afrisenti.yaml'
2025-08-31T08:28:43,531   adding 'lm_eval/tasks/afrobench/afrisenti/fewshot.sh'
2025-08-31T08:28:43,533   adding 'lm_eval/tasks/afrobench/afrisenti/utils.py'
2025-08-31T08:28:43,535   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti'
2025-08-31T08:28:43,536   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_amh.yaml'
2025-08-31T08:28:43,537   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_arq.yaml'
2025-08-31T08:28:43,538   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ary.yaml'
2025-08-31T08:28:43,539   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_hau.yaml'
2025-08-31T08:28:43,540   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ibo.yaml'
2025-08-31T08:28:43,542   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_kin.yaml'
2025-08-31T08:28:43,543   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_orm.yaml'
2025-08-31T08:28:43,544   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_pcm.yaml'
2025-08-31T08:28:43,545   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_por.yaml'
2025-08-31T08:28:43,546   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_swa.yaml'
2025-08-31T08:28:43,547   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tir.yaml'
2025-08-31T08:28:43,548   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tso.yaml'
2025-08-31T08:28:43,550   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_twi.yaml'
2025-08-31T08:28:43,551   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_yor.yaml'
2025-08-31T08:28:43,552   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/run.sh'
2025-08-31T08:28:43,553   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/utils.py'
2025-08-31T08:28:43,554   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/xx.py'
2025-08-31T08:28:43,556   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti'
2025-08-31T08:28:43,557   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_amh.yaml'
2025-08-31T08:28:43,559   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_arq.yaml'
2025-08-31T08:28:43,560   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ary.yaml'
2025-08-31T08:28:43,561   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_hau.yaml'
2025-08-31T08:28:43,562   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ibo.yaml'
2025-08-31T08:28:43,563   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_kin.yaml'
2025-08-31T08:28:43,564   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_orm.yaml'
2025-08-31T08:28:43,565   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_pcm.yaml'
2025-08-31T08:28:43,566   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_por.yaml'
2025-08-31T08:28:43,567   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_swa.yaml'
2025-08-31T08:28:43,568   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tir.yaml'
2025-08-31T08:28:43,570   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tso.yaml'
2025-08-31T08:28:43,571   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_twi.yaml'
2025-08-31T08:28:43,572   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_yor.yaml'
2025-08-31T08:28:43,573   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/run.sh'
2025-08-31T08:28:43,574   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/utils.py'
2025-08-31T08:28:43,575   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/xx.py'
2025-08-31T08:28:43,577   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti'
2025-08-31T08:28:43,578   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_amh.yaml'
2025-08-31T08:28:43,580   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_arq.yaml'
2025-08-31T08:28:43,581   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ary.yaml'
2025-08-31T08:28:43,582   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_hau.yaml'
2025-08-31T08:28:43,583   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ibo.yaml'
2025-08-31T08:28:43,584   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_kin.yaml'
2025-08-31T08:28:43,586   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_orm.yaml'
2025-08-31T08:28:43,587   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_pcm.yaml'
2025-08-31T08:28:43,588   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_por.yaml'
2025-08-31T08:28:43,589   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_swa.yaml'
2025-08-31T08:28:43,590   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tir.yaml'
2025-08-31T08:28:43,592   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tso.yaml'
2025-08-31T08:28:43,593   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_twi.yaml'
2025-08-31T08:28:43,594   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_yor.yaml'
2025-08-31T08:28:43,595   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/utils.py'
2025-08-31T08:28:43,596   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/xx.py'
2025-08-31T08:28:43,598   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti'
2025-08-31T08:28:43,599   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_amh.yaml'
2025-08-31T08:28:43,600   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_arq.yaml'
2025-08-31T08:28:43,602   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ary.yaml'
2025-08-31T08:28:43,603   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_hau.yaml'
2025-08-31T08:28:43,604   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ibo.yaml'
2025-08-31T08:28:43,605   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_kin.yaml'
2025-08-31T08:28:43,606   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_orm.yaml'
2025-08-31T08:28:43,607   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_pcm.yaml'
2025-08-31T08:28:43,609   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_por.yaml'
2025-08-31T08:28:43,610   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_swa.yaml'
2025-08-31T08:28:43,611   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tir.yaml'
2025-08-31T08:28:43,612   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tso.yaml'
2025-08-31T08:28:43,613   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_twi.yaml'
2025-08-31T08:28:43,614   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_yor.yaml'
2025-08-31T08:28:43,615   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/utils.py'
2025-08-31T08:28:43,617   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/xx.py'
2025-08-31T08:28:43,619   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti'
2025-08-31T08:28:43,620   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_amh.yaml'
2025-08-31T08:28:43,621   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_arq.yaml'
2025-08-31T08:28:43,622   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ary.yaml'
2025-08-31T08:28:43,623   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_hau.yaml'
2025-08-31T08:28:43,625   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ibo.yaml'
2025-08-31T08:28:43,626   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_kin.yaml'
2025-08-31T08:28:43,627   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_orm.yaml'
2025-08-31T08:28:43,629   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_pcm.yaml'
2025-08-31T08:28:43,630   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_por.yaml'
2025-08-31T08:28:43,631   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_swa.yaml'
2025-08-31T08:28:43,633   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tir.yaml'
2025-08-31T08:28:43,634   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tso.yaml'
2025-08-31T08:28:43,635   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_twi.yaml'
2025-08-31T08:28:43,637   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_yor.yaml'
2025-08-31T08:28:43,638   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/utils.py'
2025-08-31T08:28:43,639   adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/xx.py'
2025-08-31T08:28:43,641   adding 'lm_eval/tasks/afrobench/belebele/README.md'
2025-08-31T08:28:43,642   adding 'lm_eval/tasks/afrobench/belebele/belebele.yaml'
2025-08-31T08:28:43,644   adding 'lm_eval/tasks/afrobench/belebele/utils.py'
2025-08-31T08:28:43,646   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele'
2025-08-31T08:28:43,647   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_afr.yaml'
2025-08-31T08:28:43,648   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_amh.yaml'
2025-08-31T08:28:43,650   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ary.yaml'
2025-08-31T08:28:43,651   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_arz.yaml'
2025-08-31T08:28:43,652   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_bam.yaml'
2025-08-31T08:28:43,653   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_eng.yaml'
2025-08-31T08:28:43,654   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fra.yaml'
2025-08-31T08:28:43,655   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fuv.yaml'
2025-08-31T08:28:43,657   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_gaz.yaml'
2025-08-31T08:28:43,658   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_hau.yaml'
2025-08-31T08:28:43,659   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ibo.yaml'
2025-08-31T08:28:43,660   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kea.yaml'
2025-08-31T08:28:43,661   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kin.yaml'
2025-08-31T08:28:43,663   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lin.yaml'
2025-08-31T08:28:43,664   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lug.yaml'
2025-08-31T08:28:43,665   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_luo.yaml'
2025-08-31T08:28:43,666   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_nya.yaml'
2025-08-31T08:28:43,667   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_plt.yaml'
2025-08-31T08:28:43,668   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_por.yaml'
2025-08-31T08:28:43,669   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sna.yaml'
2025-08-31T08:28:43,670   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_som.yaml'
2025-08-31T08:28:43,672   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sot.yaml'
2025-08-31T08:28:43,673   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ssw.yaml'
2025-08-31T08:28:43,674   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_swa.yaml'
2025-08-31T08:28:43,675   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tir.yaml'
2025-08-31T08:28:43,676   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tsn.yaml'
2025-08-31T08:28:43,677   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tso.yaml'
2025-08-31T08:28:43,678   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_wol.yaml'
2025-08-31T08:28:43,679   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_xho.yaml'
2025-08-31T08:28:43,680   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_yor.yaml'
2025-08-31T08:28:43,682   adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_zul.yaml'
2025-08-31T08:28:43,684   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele'
2025-08-31T08:28:43,685   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_afr.yaml'
2025-08-31T08:28:43,686   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_amh.yaml'
2025-08-31T08:28:43,687   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ary.yaml'
2025-08-31T08:28:43,689   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_arz.yaml'
2025-08-31T08:28:43,690   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_bam.yaml'
2025-08-31T08:28:43,691   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_eng.yaml'
2025-08-31T08:28:43,692   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fra.yaml'
2025-08-31T08:28:43,694   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fuv.yaml'
2025-08-31T08:28:43,695   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_gaz.yaml'
2025-08-31T08:28:43,696   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_hau.yaml'
2025-08-31T08:28:43,697   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ibo.yaml'
2025-08-31T08:28:43,698   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kea.yaml'
2025-08-31T08:28:43,699   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kin.yaml'
2025-08-31T08:28:43,701   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lin.yaml'
2025-08-31T08:28:43,702   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lug.yaml'
2025-08-31T08:28:43,703   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_luo.yaml'
2025-08-31T08:28:43,704   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_nya.yaml'
2025-08-31T08:28:43,705   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_plt.yaml'
2025-08-31T08:28:43,707   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_por.yaml'
2025-08-31T08:28:43,708   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sna.yaml'
2025-08-31T08:28:43,709   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_som.yaml'
2025-08-31T08:28:43,710   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sot.yaml'
2025-08-31T08:28:43,711   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ssw.yaml'
2025-08-31T08:28:43,713   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_swa.yaml'
2025-08-31T08:28:43,714   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tir.yaml'
2025-08-31T08:28:43,715   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tsn.yaml'
2025-08-31T08:28:43,716   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tso.yaml'
2025-08-31T08:28:43,718   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_wol.yaml'
2025-08-31T08:28:43,719   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_xho.yaml'
2025-08-31T08:28:43,720   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_yor.yaml'
2025-08-31T08:28:43,721   adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_zul.yaml'
2025-08-31T08:28:43,723   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele'
2025-08-31T08:28:43,724   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_afr.yaml'
2025-08-31T08:28:43,725   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_amh.yaml'
2025-08-31T08:28:43,727   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ary.yaml'
2025-08-31T08:28:43,728   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_arz.yaml'
2025-08-31T08:28:43,729   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_bam.yaml'
2025-08-31T08:28:43,730   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_eng.yaml'
2025-08-31T08:28:43,731   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fra.yaml'
2025-08-31T08:28:43,733   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fuv.yaml'
2025-08-31T08:28:43,734   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_gaz.yaml'
2025-08-31T08:28:43,735   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_hau.yaml'
2025-08-31T08:28:43,736   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ibo.yaml'
2025-08-31T08:28:43,737   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kea.yaml'
2025-08-31T08:28:43,739   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kin.yaml'
2025-08-31T08:28:43,740   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lin.yaml'
2025-08-31T08:28:43,741   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lug.yaml'
2025-08-31T08:28:43,742   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_luo.yaml'
2025-08-31T08:28:43,743   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_nya.yaml'
2025-08-31T08:28:43,744   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_plt.yaml'
2025-08-31T08:28:43,746   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_por.yaml'
2025-08-31T08:28:43,747   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sna.yaml'
2025-08-31T08:28:43,748   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_som.yaml'
2025-08-31T08:28:43,749   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sot.yaml'
2025-08-31T08:28:43,750   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ssw.yaml'
2025-08-31T08:28:43,752   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_swa.yaml'
2025-08-31T08:28:43,753   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tir.yaml'
2025-08-31T08:28:43,754   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tsn.yaml'
2025-08-31T08:28:43,755   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tso.yaml'
2025-08-31T08:28:43,757   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_wol.yaml'
2025-08-31T08:28:43,758   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_xho.yaml'
2025-08-31T08:28:43,759   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_yor.yaml'
2025-08-31T08:28:43,760   adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_zul.yaml'
2025-08-31T08:28:43,762   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele'
2025-08-31T08:28:43,764   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_afr.yaml'
2025-08-31T08:28:43,765   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_amh.yaml'
2025-08-31T08:28:43,766   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ary.yaml'
2025-08-31T08:28:43,767   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_arz.yaml'
2025-08-31T08:28:43,770   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_bam.yaml'
2025-08-31T08:28:43,771   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_eng.yaml'
2025-08-31T08:28:43,772   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fra.yaml'
2025-08-31T08:28:43,774   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fuv.yaml'
2025-08-31T08:28:43,775   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_gaz.yaml'
2025-08-31T08:28:43,776   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_hau.yaml'
2025-08-31T08:28:43,777   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ibo.yaml'
2025-08-31T08:28:43,778   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kea.yaml'
2025-08-31T08:28:43,780   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kin.yaml'
2025-08-31T08:28:43,781   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lin.yaml'
2025-08-31T08:28:43,782   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lug.yaml'
2025-08-31T08:28:43,783   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_luo.yaml'
2025-08-31T08:28:43,784   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_nya.yaml'
2025-08-31T08:28:43,786   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_plt.yaml'
2025-08-31T08:28:43,787   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_por.yaml'
2025-08-31T08:28:43,788   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sna.yaml'
2025-08-31T08:28:43,789   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_som.yaml'
2025-08-31T08:28:43,790   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sot.yaml'
2025-08-31T08:28:43,791   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ssw.yaml'
2025-08-31T08:28:43,793   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_swa.yaml'
2025-08-31T08:28:43,794   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tir.yaml'
2025-08-31T08:28:43,795   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tsn.yaml'
2025-08-31T08:28:43,796   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tso.yaml'
2025-08-31T08:28:43,797   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_wol.yaml'
2025-08-31T08:28:43,799   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_xho.yaml'
2025-08-31T08:28:43,800   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_yor.yaml'
2025-08-31T08:28:43,801   adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_zul.yaml'
2025-08-31T08:28:43,803   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele'
2025-08-31T08:28:43,805   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_afr.yaml'
2025-08-31T08:28:43,806   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_amh.yaml'
2025-08-31T08:28:43,807   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ary.yaml'
2025-08-31T08:28:43,808   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_arz.yaml'
2025-08-31T08:28:43,809   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_bam.yaml'
2025-08-31T08:28:43,811   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_eng.yaml'
2025-08-31T08:28:43,812   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fra.yaml'
2025-08-31T08:28:43,814   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fuv.yaml'
2025-08-31T08:28:43,815   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_gaz.yaml'
2025-08-31T08:28:43,817   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_hau.yaml'
2025-08-31T08:28:43,818   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ibo.yaml'
2025-08-31T08:28:43,819   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kea.yaml'
2025-08-31T08:28:43,820   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kin.yaml'
2025-08-31T08:28:43,821   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lin.yaml'
2025-08-31T08:28:43,823   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lug.yaml'
2025-08-31T08:28:43,824   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_luo.yaml'
2025-08-31T08:28:43,825   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_nya.yaml'
2025-08-31T08:28:43,827   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_plt.yaml'
2025-08-31T08:28:43,828   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_por.yaml'
2025-08-31T08:28:43,829   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sna.yaml'
2025-08-31T08:28:43,830   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_som.yaml'
2025-08-31T08:28:43,831   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sot.yaml'
2025-08-31T08:28:43,832   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ssw.yaml'
2025-08-31T08:28:43,833   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_swa.yaml'
2025-08-31T08:28:43,834   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tir.yaml'
2025-08-31T08:28:43,835   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tsn.yaml'
2025-08-31T08:28:43,837   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tso.yaml'
2025-08-31T08:28:43,838   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_wol.yaml'
2025-08-31T08:28:43,839   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_xho.yaml'
2025-08-31T08:28:43,840   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_yor.yaml'
2025-08-31T08:28:43,841   adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_zul.yaml'
2025-08-31T08:28:43,843   adding 'lm_eval/tasks/afrobench/flores/README.md'
2025-08-31T08:28:43,844   adding 'lm_eval/tasks/afrobench/flores/flores.yaml'
2025-08-31T08:28:43,846   adding 'lm_eval/tasks/afrobench/flores/gen_utils.py'
2025-08-31T08:28:43,848   adding 'lm_eval/tasks/afrobench/flores/prompt_1/flores'
2025-08-31T08:28:43,850   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores'
2025-08-31T08:28:43,852   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Arab-eng_Latn.yaml'
2025-08-31T08:28:43,853   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,854   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_acq_Arab-eng_Latn.yaml'
2025-08-31T08:28:43,855   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aeb_Arab-eng_Latn.yaml'
2025-08-31T08:28:43,856   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_afr_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,858   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aka_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,859   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_amh_Ethi-eng_Latn.yaml'
2025-08-31T08:28:43,860   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ary_Arab-eng_Latn.yaml'
2025-08-31T08:28:43,861   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_arz_Arab-eng_Latn.yaml'
2025-08-31T08:28:43,862   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bam_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,864   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ban_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,865   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bem_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,866   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_cjk_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,867   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dik_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,869   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dyu_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,870   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ewe_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,871   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fon_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,872   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fra_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,873   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fuv_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,875   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_gaz_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,876   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_hau_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,877   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ibo_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,878   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kab_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,879   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kam_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,880   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kbp_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,881   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kea_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,883   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kik_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,884   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kin_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,885   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kmb_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,886   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Arab-eng_Latn.yaml'
2025-08-31T08:28:43,888   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,889   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kon_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,890   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lin_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,891   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lua_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,892   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lug_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,894   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_luo_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,895   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_mos_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,896   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nso_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,897   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nus_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,898   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nya_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,900   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_plt_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,901   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_run_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,902   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sag_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,904   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sna_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,905   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_som_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,906   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sot_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,907   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ssw_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,908   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sun_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,910   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_swh_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,911   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,912   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Tfng-eng_Latn.yaml'
2025-08-31T08:28:43,913   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tir_Ethi-eng_Latn.yaml'
2025-08-31T08:28:43,914   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tsn_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,916   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tso_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,917   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tum_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,918   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_twi_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,919   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tzm_Tfng-eng_Latn.yaml'
2025-08-31T08:28:43,920   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_umb_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,921   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_wol_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,922   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_xho_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,924   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_yor_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,925   adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_zul_Latn-eng_Latn.yaml'
2025-08-31T08:28:43,928   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores'
2025-08-31T08:28:43,929   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Arab.yaml'
2025-08-31T08:28:43,930   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Latn.yaml'
2025-08-31T08:28:43,931   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-acq_Arab.yaml'
2025-08-31T08:28:43,932   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aeb_Arab.yaml'
2025-08-31T08:28:43,933   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-afr_Latn.yaml'
2025-08-31T08:28:43,934   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aka_Latn.yaml'
2025-08-31T08:28:43,935   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-amh_Ethi.yaml'
2025-08-31T08:28:43,936   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ary_Arab.yaml'
2025-08-31T08:28:43,938   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-arz_Arab.yaml'
2025-08-31T08:28:43,939   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bam_Latn.yaml'
2025-08-31T08:28:43,940   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ban_Latn.yaml'
2025-08-31T08:28:43,941   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bem_Latn.yaml'
2025-08-31T08:28:43,942   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-cjk_Latn.yaml'
2025-08-31T08:28:43,944   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dik_Latn.yaml'
2025-08-31T08:28:43,945   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dyu_Latn.yaml'
2025-08-31T08:28:43,946   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ewe_Latn.yaml'
2025-08-31T08:28:43,947   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fon_Latn.yaml'
2025-08-31T08:28:43,948   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fra_Latn.yaml'
2025-08-31T08:28:43,949   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fuv_Latn.yaml'
2025-08-31T08:28:43,951   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-gaz_Latn.yaml'
2025-08-31T08:28:43,952   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-hau_Latn.yaml'
2025-08-31T08:28:43,953   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ibo_Latn.yaml'
2025-08-31T08:28:43,954   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kab_Latn.yaml'
2025-08-31T08:28:43,955   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kam_Latn.yaml'
2025-08-31T08:28:43,957   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kbp_Latn.yaml'
2025-08-31T08:28:43,958   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kea_Latn.yaml'
2025-08-31T08:28:43,959   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kik_Latn.yaml'
2025-08-31T08:28:43,960   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kin_Latn.yaml'
2025-08-31T08:28:43,962   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kmb_Latn.yaml'
2025-08-31T08:28:43,963   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Arab.yaml'
2025-08-31T08:28:43,964   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Latn.yaml'
2025-08-31T08:28:43,965   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kon_Latn.yaml'
2025-08-31T08:28:43,966   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lin_Latn.yaml'
2025-08-31T08:28:43,967   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lua_Latn.yaml'
2025-08-31T08:28:43,968   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lug_Latn.yaml'
2025-08-31T08:28:43,969   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-luo_Latn.yaml'
2025-08-31T08:28:43,971   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-mos_Latn.yaml'
2025-08-31T08:28:43,972   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nso_Latn.yaml'
2025-08-31T08:28:43,973   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nus_Latn.yaml'
2025-08-31T08:28:43,974   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nya_Latn.yaml'
2025-08-31T08:28:43,975   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-plt_Latn.yaml'
2025-08-31T08:28:43,976   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-run_Latn.yaml'
2025-08-31T08:28:43,978   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sag_Latn.yaml'
2025-08-31T08:28:43,979   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sna_Latn.yaml'
2025-08-31T08:28:43,980   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-som_Latn.yaml'
2025-08-31T08:28:43,981   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sot_Latn.yaml'
2025-08-31T08:28:43,982   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ssw_Latn.yaml'
2025-08-31T08:28:43,983   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sun_Latn.yaml'
2025-08-31T08:28:43,984   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-swh_Latn.yaml'
2025-08-31T08:28:43,986   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Latn.yaml'
2025-08-31T08:28:43,987   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Tfng.yaml'
2025-08-31T08:28:43,988   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tir_Ethi.yaml'
2025-08-31T08:28:43,989   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tsn_Latn.yaml'
2025-08-31T08:28:43,990   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tso_Latn.yaml'
2025-08-31T08:28:43,992   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tum_Latn.yaml'
2025-08-31T08:28:43,993   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-twi_Latn.yaml'
2025-08-31T08:28:43,994   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tzm_Tfng.yaml'
2025-08-31T08:28:43,995   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-umb_Latn.yaml'
2025-08-31T08:28:43,996   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-wol_Latn.yaml'
2025-08-31T08:28:43,997   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-xho_Latn.yaml'
2025-08-31T08:28:43,999   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-yor_Latn.yaml'
2025-08-31T08:28:44,000   adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-zul_Latn.yaml'
2025-08-31T08:28:44,001   adding 'lm_eval/tasks/afrobench/flores/prompt_2/flores'
2025-08-31T08:28:44,004   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores'
2025-08-31T08:28:44,005   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Arab-eng_Latn.yaml'
2025-08-31T08:28:44,006   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,007   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_acq_Arab-eng_Latn.yaml'
2025-08-31T08:28:44,009   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aeb_Arab-eng_Latn.yaml'
2025-08-31T08:28:44,010   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_afr_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,011   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aka_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,012   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_amh_Ethi-eng_Latn.yaml'
2025-08-31T08:28:44,013   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ary_Arab-eng_Latn.yaml'
2025-08-31T08:28:44,014   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_arz_Arab-eng_Latn.yaml'
2025-08-31T08:28:44,015   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bam_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,016   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ban_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,018   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bem_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,019   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_cjk_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,020   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dik_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,021   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dyu_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,022   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ewe_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,024   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fon_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,025   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fra_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,026   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fuv_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,027   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_gaz_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,028   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_hau_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,029   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ibo_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,030   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kab_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,032   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kam_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,033   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kbp_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,034   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kea_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,035   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kik_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,036   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kin_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,038   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kmb_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,039   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Arab-eng_Latn.yaml'
2025-08-31T08:28:44,040   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,041   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kon_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,042   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lin_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,043   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lua_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,044   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lug_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,045   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_luo_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,047   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_mos_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,048   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nso_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,049   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nus_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,050   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nya_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,051   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_plt_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,052   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_run_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,053   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sag_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,054   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sna_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,056   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_som_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,057   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sot_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,058   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ssw_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,059   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sun_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,060   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_swh_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,062   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,063   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Tfng-eng_Latn.yaml'
2025-08-31T08:28:44,064   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tir_Ethi-eng_Latn.yaml'
2025-08-31T08:28:44,065   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tsn_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,067   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tso_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,068   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tum_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,069   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_twi_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,070   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tzm_Tfng-eng_Latn.yaml'
2025-08-31T08:28:44,071   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_umb_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,072   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_wol_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,074   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_xho_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,075   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_yor_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,076   adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_zul_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,079   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores'
2025-08-31T08:28:44,081   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Arab.yaml'
2025-08-31T08:28:44,082   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Latn.yaml'
2025-08-31T08:28:44,083   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-acq_Arab.yaml'
2025-08-31T08:28:44,085   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aeb_Arab.yaml'
2025-08-31T08:28:44,086   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-afr_Latn.yaml'
2025-08-31T08:28:44,087   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aka_Latn.yaml'
2025-08-31T08:28:44,088   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-amh_Ethi.yaml'
2025-08-31T08:28:44,089   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ary_Arab.yaml'
2025-08-31T08:28:44,091   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-arz_Arab.yaml'
2025-08-31T08:28:44,092   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bam_Latn.yaml'
2025-08-31T08:28:44,093   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ban_Latn.yaml'
2025-08-31T08:28:44,094   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bem_Latn.yaml'
2025-08-31T08:28:44,095   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-cjk_Latn.yaml'
2025-08-31T08:28:44,096   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dik_Latn.yaml'
2025-08-31T08:28:44,098   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dyu_Latn.yaml'
2025-08-31T08:28:44,099   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ewe_Latn.yaml'
2025-08-31T08:28:44,101   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fon_Latn.yaml'
2025-08-31T08:28:44,102   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fra_Latn.yaml'
2025-08-31T08:28:44,103   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fuv_Latn.yaml'
2025-08-31T08:28:44,104   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-gaz_Latn.yaml'
2025-08-31T08:28:44,105   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-hau_Latn.yaml'
2025-08-31T08:28:44,107   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ibo_Latn.yaml'
2025-08-31T08:28:44,108   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kab_Latn.yaml'
2025-08-31T08:28:44,109   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kam_Latn.yaml'
2025-08-31T08:28:44,111   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kbp_Latn.yaml'
2025-08-31T08:28:44,112   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kea_Latn.yaml'
2025-08-31T08:28:44,113   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kik_Latn.yaml'
2025-08-31T08:28:44,114   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kin_Latn.yaml'
2025-08-31T08:28:44,116   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kmb_Latn.yaml'
2025-08-31T08:28:44,117   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Arab.yaml'
2025-08-31T08:28:44,118   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Latn.yaml'
2025-08-31T08:28:44,119   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kon_Latn.yaml'
2025-08-31T08:28:44,121   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lin_Latn.yaml'
2025-08-31T08:28:44,122   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lua_Latn.yaml'
2025-08-31T08:28:44,124   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lug_Latn.yaml'
2025-08-31T08:28:44,125   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-luo_Latn.yaml'
2025-08-31T08:28:44,126   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-mos_Latn.yaml'
2025-08-31T08:28:44,127   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nso_Latn.yaml'
2025-08-31T08:28:44,128   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nus_Latn.yaml'
2025-08-31T08:28:44,129   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nya_Latn.yaml'
2025-08-31T08:28:44,131   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-plt_Latn.yaml'
2025-08-31T08:28:44,132   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-run_Latn.yaml'
2025-08-31T08:28:44,133   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sag_Latn.yaml'
2025-08-31T08:28:44,134   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sna_Latn.yaml'
2025-08-31T08:28:44,135   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-som_Latn.yaml'
2025-08-31T08:28:44,137   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sot_Latn.yaml'
2025-08-31T08:28:44,138   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ssw_Latn.yaml'
2025-08-31T08:28:44,139   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sun_Latn.yaml'
2025-08-31T08:28:44,140   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-swh_Latn.yaml'
2025-08-31T08:28:44,142   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Latn.yaml'
2025-08-31T08:28:44,143   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Tfng.yaml'
2025-08-31T08:28:44,144   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tir_Ethi.yaml'
2025-08-31T08:28:44,145   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tsn_Latn.yaml'
2025-08-31T08:28:44,147   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tso_Latn.yaml'
2025-08-31T08:28:44,148   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tum_Latn.yaml'
2025-08-31T08:28:44,149   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-twi_Latn.yaml'
2025-08-31T08:28:44,151   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tzm_Tfng.yaml'
2025-08-31T08:28:44,152   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-umb_Latn.yaml'
2025-08-31T08:28:44,153   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-wol_Latn.yaml'
2025-08-31T08:28:44,154   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-xho_Latn.yaml'
2025-08-31T08:28:44,155   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-yor_Latn.yaml'
2025-08-31T08:28:44,157   adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-zul_Latn.yaml'
2025-08-31T08:28:44,158   adding 'lm_eval/tasks/afrobench/flores/prompt_3/flores'
2025-08-31T08:28:44,161   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores'
2025-08-31T08:28:44,163   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Arab-eng_Latn.yaml'
2025-08-31T08:28:44,164   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,165   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_acq_Arab-eng_Latn.yaml'
2025-08-31T08:28:44,166   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aeb_Arab-eng_Latn.yaml'
2025-08-31T08:28:44,168   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_afr_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,169   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aka_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,170   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_amh_Ethi-eng_Latn.yaml'
2025-08-31T08:28:44,171   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ary_Arab-eng_Latn.yaml'
2025-08-31T08:28:44,172   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_arz_Arab-eng_Latn.yaml'
2025-08-31T08:28:44,174   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bam_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,175   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ban_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,176   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bem_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,177   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_cjk_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,178   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dik_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,180   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dyu_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,181   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ewe_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,182   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fon_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,183   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fra_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,184   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fuv_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,186   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_gaz_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,187   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_hau_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,188   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ibo_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,189   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kab_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,190   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kam_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,192   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kbp_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,193   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kea_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,194   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kik_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,195   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kin_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,196   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kmb_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,198   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Arab-eng_Latn.yaml'
2025-08-31T08:28:44,199   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,200   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kon_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,202   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lin_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,203   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lua_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,204   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lug_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,205   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_luo_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,206   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_mos_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,208   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nso_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,209   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nus_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,210   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nya_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,211   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_plt_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,212   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_run_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,213   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sag_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,215   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sna_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,216   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_som_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,217   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sot_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,218   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ssw_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,220   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sun_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,221   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_swh_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,222   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,223   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Tfng-eng_Latn.yaml'
2025-08-31T08:28:44,225   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tir_Ethi-eng_Latn.yaml'
2025-08-31T08:28:44,226   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tsn_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,227   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tso_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,228   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tum_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,230   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_twi_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,231   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tzm_Tfng-eng_Latn.yaml'
2025-08-31T08:28:44,232   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_umb_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,233   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_wol_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,236   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_xho_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,237   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_yor_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,238   adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_zul_Latn-eng_Latn.yaml'
2025-08-31T08:28:44,241   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores'
2025-08-31T08:28:44,242   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Arab.yaml'
2025-08-31T08:28:44,243   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Latn.yaml'
2025-08-31T08:28:44,245   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-acq_Arab.yaml'
2025-08-31T08:28:44,246   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aeb_Arab.yaml'
2025-08-31T08:28:44,247   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-afr_Latn.yaml'
2025-08-31T08:28:44,249   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aka_Latn.yaml'
2025-08-31T08:28:44,250   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-amh_Ethi.yaml'
2025-08-31T08:28:44,251   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ary_Arab.yaml'
2025-08-31T08:28:44,252   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-arz_Arab.yaml'
2025-08-31T08:28:44,253   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bam_Latn.yaml'
2025-08-31T08:28:44,254   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ban_Latn.yaml'
2025-08-31T08:28:44,255   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bem_Latn.yaml'
2025-08-31T08:28:44,257   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-cjk_Latn.yaml'
2025-08-31T08:28:44,258   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dik_Latn.yaml'
2025-08-31T08:28:44,259   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dyu_Latn.yaml'
2025-08-31T08:28:44,260   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ewe_Latn.yaml'
2025-08-31T08:28:44,261   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fon_Latn.yaml'
2025-08-31T08:28:44,263   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fra_Latn.yaml'
2025-08-31T08:28:44,264   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fuv_Latn.yaml'
2025-08-31T08:28:44,265   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-gaz_Latn.yaml'
2025-08-31T08:28:44,267   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-hau_Latn.yaml'
2025-08-31T08:28:44,268   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ibo_Latn.yaml'
2025-08-31T08:28:44,269   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kab_Latn.yaml'
2025-08-31T08:28:44,270   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kam_Latn.yaml'
2025-08-31T08:28:44,272   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kbp_Latn.yaml'
2025-08-31T08:28:44,273   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kea_Latn.yaml'
2025-08-31T08:28:44,274   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kik_Latn.yaml'
2025-08-31T08:28:44,276   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kin_Latn.yaml'
2025-08-31T08:28:44,277   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kmb_Latn.yaml'
2025-08-31T08:28:44,278   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Arab.yaml'
2025-08-31T08:28:44,279   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Latn.yaml'
2025-08-31T08:28:44,280   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kon_Latn.yaml'
2025-08-31T08:28:44,282   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lin_Latn.yaml'
2025-08-31T08:28:44,283   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lua_Latn.yaml'
2025-08-31T08:28:44,284   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lug_Latn.yaml'
2025-08-31T08:28:44,286   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-luo_Latn.yaml'
2025-08-31T08:28:44,287   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-mos_Latn.yaml'
2025-08-31T08:28:44,288   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nso_Latn.yaml'
2025-08-31T08:28:44,290   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nus_Latn.yaml'
2025-08-31T08:28:44,291   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nya_Latn.yaml'
2025-08-31T08:28:44,292   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-plt_Latn.yaml'
2025-08-31T08:28:44,293   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-run_Latn.yaml'
2025-08-31T08:28:44,294   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sag_Latn.yaml'
2025-08-31T08:28:44,296   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sna_Latn.yaml'
2025-08-31T08:28:44,297   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-som_Latn.yaml'
2025-08-31T08:28:44,298   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sot_Latn.yaml'
2025-08-31T08:28:44,300   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ssw_Latn.yaml'
2025-08-31T08:28:44,301   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sun_Latn.yaml'
2025-08-31T08:28:44,302   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-swh_Latn.yaml'
2025-08-31T08:28:44,303   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Latn.yaml'
2025-08-31T08:28:44,304   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Tfng.yaml'
2025-08-31T08:28:44,305   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tir_Ethi.yaml'
2025-08-31T08:28:44,307   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tsn_Latn.yaml'
2025-08-31T08:28:44,308   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tso_Latn.yaml'
2025-08-31T08:28:44,309   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tum_Latn.yaml'
2025-08-31T08:28:44,310   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-twi_Latn.yaml'
2025-08-31T08:28:44,311   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tzm_Tfng.yaml'
2025-08-31T08:28:44,312   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-umb_Latn.yaml'
2025-08-31T08:28:44,314   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-wol_Latn.yaml'
2025-08-31T08:28:44,315   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-xho_Latn.yaml'
2025-08-31T08:28:44,316   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-yor_Latn.yaml'
2025-08-31T08:28:44,317   adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-zul_Latn.yaml'
2025-08-31T08:28:44,319   adding 'lm_eval/tasks/afrobench/injongointent/README.md'
2025-08-31T08:28:44,321   adding 'lm_eval/tasks/afrobench/injongointent/gen_utils.py'
2025-08-31T08:28:44,322   adding 'lm_eval/tasks/afrobench/injongointent/injongointent.yaml'
2025-08-31T08:28:44,324   adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent'
2025-08-31T08:28:44,326   adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_amh.yaml'
2025-08-31T08:28:44,327   adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_eng.yaml'
2025-08-31T08:28:44,328   adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ewe.yaml'
2025-08-31T08:28:44,329   adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_hau.yaml'
2025-08-31T08:28:44,330   adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ibo.yaml'
2025-08-31T08:28:44,332   adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_kin.yaml'
2025-08-31T08:28:44,333   adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lin.yaml'
2025-08-31T08:28:44,334   adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lug.yaml'
2025-08-31T08:28:44,335   adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_orm.yaml'
2025-08-31T08:28:44,337   adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sna.yaml'
2025-08-31T08:28:44,338   adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sot.yaml'
2025-08-31T08:28:44,339   adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_swa.yaml'
2025-08-31T08:28:44,340   adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_twi.yaml'
2025-08-31T08:28:44,342   adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_wol.yaml'
2025-08-31T08:28:44,343   adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_xho.yaml'
2025-08-31T08:28:44,344   adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_yor.yaml'
2025-08-31T08:28:44,346   adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_zul.yaml'
2025-08-31T08:28:44,347   adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/utils.py'
2025-08-31T08:28:44,349   adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent'
2025-08-31T08:28:44,350   adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_amh.yaml'
2025-08-31T08:28:44,351   adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_eng.yaml'
2025-08-31T08:28:44,353   adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ewe.yaml'
2025-08-31T08:28:44,354   adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_hau.yaml'
2025-08-31T08:28:44,355   adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ibo.yaml'
2025-08-31T08:28:44,357   adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_kin.yaml'
2025-08-31T08:28:44,358   adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lin.yaml'
2025-08-31T08:28:44,360   adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lug.yaml'
2025-08-31T08:28:44,361   adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_orm.yaml'
2025-08-31T08:28:44,362   adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sna.yaml'
2025-08-31T08:28:44,364   adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sot.yaml'
2025-08-31T08:28:44,365   adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_swa.yaml'
2025-08-31T08:28:44,366   adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_twi.yaml'
2025-08-31T08:28:44,368   adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_wol.yaml'
2025-08-31T08:28:44,369   adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_xho.yaml'
2025-08-31T08:28:44,370   adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_yor.yaml'
2025-08-31T08:28:44,371   adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_zul.yaml'
2025-08-31T08:28:44,373   adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/utils.py'
2025-08-31T08:28:44,375   adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent'
2025-08-31T08:28:44,376   adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_amh.yaml'
2025-08-31T08:28:44,377   adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_eng.yaml'
2025-08-31T08:28:44,378   adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ewe.yaml'
2025-08-31T08:28:44,380   adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_hau.yaml'
2025-08-31T08:28:44,381   adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ibo.yaml'
2025-08-31T08:28:44,382   adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_kin.yaml'
2025-08-31T08:28:44,383   adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lin.yaml'
2025-08-31T08:28:44,384   adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lug.yaml'
2025-08-31T08:28:44,386   adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_orm.yaml'
2025-08-31T08:28:44,387   adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sna.yaml'
2025-08-31T08:28:44,388   adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sot.yaml'
2025-08-31T08:28:44,390   adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_swa.yaml'
2025-08-31T08:28:44,391   adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_twi.yaml'
2025-08-31T08:28:44,392   adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_wol.yaml'
2025-08-31T08:28:44,393   adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_xho.yaml'
2025-08-31T08:28:44,395   adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_yor.yaml'
2025-08-31T08:28:44,396   adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_zul.yaml'
2025-08-31T08:28:44,398   adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/utils.py'
2025-08-31T08:28:44,400   adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent'
2025-08-31T08:28:44,401   adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_amh.yaml'
2025-08-31T08:28:44,402   adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_eng.yaml'
2025-08-31T08:28:44,403   adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ewe.yaml'
2025-08-31T08:28:44,405   adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_hau.yaml'
2025-08-31T08:28:44,406   adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ibo.yaml'
2025-08-31T08:28:44,407   adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_kin.yaml'
2025-08-31T08:28:44,408   adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lin.yaml'
2025-08-31T08:28:44,410   adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lug.yaml'
2025-08-31T08:28:44,411   adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_orm.yaml'
2025-08-31T08:28:44,412   adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sna.yaml'
2025-08-31T08:28:44,414   adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sot.yaml'
2025-08-31T08:28:44,415   adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_swa.yaml'
2025-08-31T08:28:44,416   adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_twi.yaml'
2025-08-31T08:28:44,417   adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_wol.yaml'
2025-08-31T08:28:44,419   adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_xho.yaml'
2025-08-31T08:28:44,420   adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_yor.yaml'
2025-08-31T08:28:44,421   adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_zul.yaml'
2025-08-31T08:28:44,422   adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/utils.py'
2025-08-31T08:28:44,424   adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent'
2025-08-31T08:28:44,425   adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_amh.yaml'
2025-08-31T08:28:44,427   adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_eng.yaml'
2025-08-31T08:28:44,428   adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ewe.yaml'
2025-08-31T08:28:44,429   adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_hau.yaml'
2025-08-31T08:28:44,431   adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ibo.yaml'
2025-08-31T08:28:44,432   adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_kin.yaml'
2025-08-31T08:28:44,433   adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lin.yaml'
2025-08-31T08:28:44,435   adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lug.yaml'
2025-08-31T08:28:44,436   adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_orm.yaml'
2025-08-31T08:28:44,437   adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sna.yaml'
2025-08-31T08:28:44,439   adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sot.yaml'
2025-08-31T08:28:44,440   adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_swa.yaml'
2025-08-31T08:28:44,441   adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_twi.yaml'
2025-08-31T08:28:44,442   adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_wol.yaml'
2025-08-31T08:28:44,444   adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_xho.yaml'
2025-08-31T08:28:44,445   adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_yor.yaml'
2025-08-31T08:28:44,446   adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_zul.yaml'
2025-08-31T08:28:44,447   adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/utils.py'
2025-08-31T08:28:44,449   adding 'lm_eval/tasks/afrobench/mafand/README.md'
2025-08-31T08:28:44,451   adding 'lm_eval/tasks/afrobench/mafand/gen_utils.py'
2025-08-31T08:28:44,452   adding 'lm_eval/tasks/afrobench/mafand/mafand.yaml'
2025-08-31T08:28:44,455   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand'
2025-08-31T08:28:44,456   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_amh-en.yaml'
2025-08-31T08:28:44,457   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bam-fr.yaml'
2025-08-31T08:28:44,458   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bbj-fr.yaml'
2025-08-31T08:28:44,459   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ewe-fr.yaml'
2025-08-31T08:28:44,461   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_fon-fr.yaml'
2025-08-31T08:28:44,462   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_hau-en.yaml'
2025-08-31T08:28:44,463   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ibo-en.yaml'
2025-08-31T08:28:44,464   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_kin-en.yaml'
2025-08-31T08:28:44,465   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_lug-en.yaml'
2025-08-31T08:28:44,466   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_luo-en.yaml'
2025-08-31T08:28:44,467   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_mos-fr.yaml'
2025-08-31T08:28:44,468   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_nya-en.yaml'
2025-08-31T08:28:44,469   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_pcm-en.yaml'
2025-08-31T08:28:44,471   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_sna-en.yaml'
2025-08-31T08:28:44,472   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_swa-en.yaml'
2025-08-31T08:28:44,473   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_tsn-en.yaml'
2025-08-31T08:28:44,474   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_twi-en.yaml'
2025-08-31T08:28:44,475   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_wol-fr.yaml'
2025-08-31T08:28:44,476   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_xho-en.yaml'
2025-08-31T08:28:44,477   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_yor-en.yaml'
2025-08-31T08:28:44,478   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_zul-en.yaml'
2025-08-31T08:28:44,480   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/utils.py'
2025-08-31T08:28:44,482   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand'
2025-08-31T08:28:44,483   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-amh.yaml'
2025-08-31T08:28:44,484   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-hau.yaml'
2025-08-31T08:28:44,485   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-ibo.yaml'
2025-08-31T08:28:44,487   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-kin.yaml'
2025-08-31T08:28:44,488   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-lug.yaml'
2025-08-31T08:28:44,489   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-luo.yaml'
2025-08-31T08:28:44,490   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-nya.yaml'
2025-08-31T08:28:44,491   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-pcm.yaml'
2025-08-31T08:28:44,492   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-sna.yaml'
2025-08-31T08:28:44,494   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-swa.yaml'
2025-08-31T08:28:44,495   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-tsn.yaml'
2025-08-31T08:28:44,496   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-twi.yaml'
2025-08-31T08:28:44,497   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-xho.yaml'
2025-08-31T08:28:44,498   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-yor.yaml'
2025-08-31T08:28:44,499   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-zul.yaml'
2025-08-31T08:28:44,500   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bam.yaml'
2025-08-31T08:28:44,501   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bbj.yaml'
2025-08-31T08:28:44,502   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-ewe.yaml'
2025-08-31T08:28:44,503   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-fon.yaml'
2025-08-31T08:28:44,505   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-mos.yaml'
2025-08-31T08:28:44,506   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-wol.yaml'
2025-08-31T08:28:44,507   adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/utils.py'
2025-08-31T08:28:44,510   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand'
2025-08-31T08:28:44,511   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_amh-en.yaml'
2025-08-31T08:28:44,512   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bam-fr.yaml'
2025-08-31T08:28:44,513   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bbj-fr.yaml'
2025-08-31T08:28:44,514   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ewe-fr.yaml'
2025-08-31T08:28:44,515   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_fon-fr.yaml'
2025-08-31T08:28:44,517   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_hau-en.yaml'
2025-08-31T08:28:44,518   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ibo-en.yaml'
2025-08-31T08:28:44,519   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_kin-en.yaml'
2025-08-31T08:28:44,520   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_lug-en.yaml'
2025-08-31T08:28:44,521   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_luo-en.yaml'
2025-08-31T08:28:44,522   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_mos-fr.yaml'
2025-08-31T08:28:44,523   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_nya-en.yaml'
2025-08-31T08:28:44,524   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_pcm-en.yaml'
2025-08-31T08:28:44,525   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_sna-en.yaml'
2025-08-31T08:28:44,527   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_swa-en.yaml'
2025-08-31T08:28:44,528   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_tsn-en.yaml'
2025-08-31T08:28:44,529   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_twi-en.yaml'
2025-08-31T08:28:44,530   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_wol-fr.yaml'
2025-08-31T08:28:44,531   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_xho-en.yaml'
2025-08-31T08:28:44,532   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_yor-en.yaml'
2025-08-31T08:28:44,533   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_zul-en.yaml'
2025-08-31T08:28:44,535   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/utils.py'
2025-08-31T08:28:44,537   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand'
2025-08-31T08:28:44,538   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-amh.yaml'
2025-08-31T08:28:44,540   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-hau.yaml'
2025-08-31T08:28:44,541   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-ibo.yaml'
2025-08-31T08:28:44,542   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-kin.yaml'
2025-08-31T08:28:44,543   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-lug.yaml'
2025-08-31T08:28:44,544   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-luo.yaml'
2025-08-31T08:28:44,545   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-nya.yaml'
2025-08-31T08:28:44,546   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-pcm.yaml'
2025-08-31T08:28:44,547   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-sna.yaml'
2025-08-31T08:28:44,548   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-swa.yaml'
2025-08-31T08:28:44,549   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-tsn.yaml'
2025-08-31T08:28:44,550   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-twi.yaml'
2025-08-31T08:28:44,551   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-xho.yaml'
2025-08-31T08:28:44,553   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-yor.yaml'
2025-08-31T08:28:44,554   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-zul.yaml'
2025-08-31T08:28:44,555   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bam.yaml'
2025-08-31T08:28:44,556   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bbj.yaml'
2025-08-31T08:28:44,557   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-ewe.yaml'
2025-08-31T08:28:44,558   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-fon.yaml'
2025-08-31T08:28:44,559   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-mos.yaml'
2025-08-31T08:28:44,560   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-wol.yaml'
2025-08-31T08:28:44,561   adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/utils.py'
2025-08-31T08:28:44,564   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand'
2025-08-31T08:28:44,566   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_amh-en.yaml'
2025-08-31T08:28:44,567   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bam-fr.yaml'
2025-08-31T08:28:44,568   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bbj-fr.yaml'
2025-08-31T08:28:44,569   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ewe-fr.yaml'
2025-08-31T08:28:44,570   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_fon-fr.yaml'
2025-08-31T08:28:44,571   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_hau-en.yaml'
2025-08-31T08:28:44,573   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ibo-en.yaml'
2025-08-31T08:28:44,574   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_kin-en.yaml'
2025-08-31T08:28:44,575   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_lug-en.yaml'
2025-08-31T08:28:44,576   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_luo-en.yaml'
2025-08-31T08:28:44,577   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_mos-fr.yaml'
2025-08-31T08:28:44,578   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_nya-en.yaml'
2025-08-31T08:28:44,580   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_pcm-en.yaml'
2025-08-31T08:28:44,581   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_sna-en.yaml'
2025-08-31T08:28:44,582   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_swa-en.yaml'
2025-08-31T08:28:44,583   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_tsn-en.yaml'
2025-08-31T08:28:44,584   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_twi-en.yaml'
2025-08-31T08:28:44,585   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_wol-fr.yaml'
2025-08-31T08:28:44,586   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_xho-en.yaml'
2025-08-31T08:28:44,588   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_yor-en.yaml'
2025-08-31T08:28:44,589   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_zul-en.yaml'
2025-08-31T08:28:44,590   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/utils.py'
2025-08-31T08:28:44,592   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand'
2025-08-31T08:28:44,593   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-amh.yaml'
2025-08-31T08:28:44,594   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-hau.yaml'
2025-08-31T08:28:44,595   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-ibo.yaml'
2025-08-31T08:28:44,596   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-kin.yaml'
2025-08-31T08:28:44,597   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-lug.yaml'
2025-08-31T08:28:44,598   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-luo.yaml'
2025-08-31T08:28:44,599   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-nya.yaml'
2025-08-31T08:28:44,601   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-pcm.yaml'
2025-08-31T08:28:44,602   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-sna.yaml'
2025-08-31T08:28:44,603   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-swa.yaml'
2025-08-31T08:28:44,604   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-tsn.yaml'
2025-08-31T08:28:44,605   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-twi.yaml'
2025-08-31T08:28:44,606   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-xho.yaml'
2025-08-31T08:28:44,607   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-yor.yaml'
2025-08-31T08:28:44,609   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-zul.yaml'
2025-08-31T08:28:44,610   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bam.yaml'
2025-08-31T08:28:44,611   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bbj.yaml'
2025-08-31T08:28:44,612   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-ewe.yaml'
2025-08-31T08:28:44,613   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-fon.yaml'
2025-08-31T08:28:44,614   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-mos.yaml'
2025-08-31T08:28:44,616   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-wol.yaml'
2025-08-31T08:28:44,617   adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/utils.py'
2025-08-31T08:28:44,619   adding 'lm_eval/tasks/afrobench/masakhaner/README.md'
2025-08-31T08:28:44,620   adding 'lm_eval/tasks/afrobench/masakhaner/gen_utils.py'
2025-08-31T08:28:44,622   adding 'lm_eval/tasks/afrobench/masakhaner/masakhaner.yaml'
2025-08-31T08:28:44,624   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner'
2025-08-31T08:28:44,625   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_am.yaml'
2025-08-31T08:28:44,626   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bbj.yaml'
2025-08-31T08:28:44,627   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bm.yaml'
2025-08-31T08:28:44,629   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ee.yaml'
2025-08-31T08:28:44,630   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ha.yaml'
2025-08-31T08:28:44,631   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ig.yaml'
2025-08-31T08:28:44,632   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_lg.yaml'
2025-08-31T08:28:44,634   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_luo.yaml'
2025-08-31T08:28:44,635   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_mos.yaml'
2025-08-31T08:28:44,636   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ny.yaml'
2025-08-31T08:28:44,637   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_pcm.yaml'
2025-08-31T08:28:44,638   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_rw.yaml'
2025-08-31T08:28:44,639   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sn.yaml'
2025-08-31T08:28:44,640   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sw.yaml'
2025-08-31T08:28:44,642   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tn.yaml'
2025-08-31T08:28:44,643   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tw.yaml'
2025-08-31T08:28:44,644   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_wo.yaml'
2025-08-31T08:28:44,645   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_xh.yaml'
2025-08-31T08:28:44,646   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_yo.yaml'
2025-08-31T08:28:44,648   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_zu.yaml'
2025-08-31T08:28:44,649   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/utils.py'
2025-08-31T08:28:44,651   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner'
2025-08-31T08:28:44,652   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_am.yaml'
2025-08-31T08:28:44,654   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bbj.yaml'
2025-08-31T08:28:44,655   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bm.yaml'
2025-08-31T08:28:44,656   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ee.yaml'
2025-08-31T08:28:44,657   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ha.yaml'
2025-08-31T08:28:44,659   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ig.yaml'
2025-08-31T08:28:44,660   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_lg.yaml'
2025-08-31T08:28:44,661   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_luo.yaml'
2025-08-31T08:28:44,663   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_mos.yaml'
2025-08-31T08:28:44,664   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ny.yaml'
2025-08-31T08:28:44,665   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_pcm.yaml'
2025-08-31T08:28:44,666   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_rw.yaml'
2025-08-31T08:28:44,668   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sn.yaml'
2025-08-31T08:28:44,669   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sw.yaml'
2025-08-31T08:28:44,670   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tn.yaml'
2025-08-31T08:28:44,671   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tw.yaml'
2025-08-31T08:28:44,673   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_wo.yaml'
2025-08-31T08:28:44,674   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_xh.yaml'
2025-08-31T08:28:44,675   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_yo.yaml'
2025-08-31T08:28:44,676   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_zu.yaml'
2025-08-31T08:28:44,678   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/utils.py'
2025-08-31T08:28:44,680   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner'
2025-08-31T08:28:44,681   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_am.yaml'
2025-08-31T08:28:44,683   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bbj.yaml'
2025-08-31T08:28:44,684   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bm.yaml'
2025-08-31T08:28:44,685   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ee.yaml'
2025-08-31T08:28:44,687   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ha.yaml'
2025-08-31T08:28:44,688   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ig.yaml'
2025-08-31T08:28:44,689   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_lg.yaml'
2025-08-31T08:28:44,690   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_luo.yaml'
2025-08-31T08:28:44,691   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_mos.yaml'
2025-08-31T08:28:44,692   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ny.yaml'
2025-08-31T08:28:44,693   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_pcm.yaml'
2025-08-31T08:28:44,695   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_rw.yaml'
2025-08-31T08:28:44,696   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sn.yaml'
2025-08-31T08:28:44,697   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sw.yaml'
2025-08-31T08:28:44,698   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tn.yaml'
2025-08-31T08:28:44,699   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tw.yaml'
2025-08-31T08:28:44,700   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_wo.yaml'
2025-08-31T08:28:44,702   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_xh.yaml'
2025-08-31T08:28:44,703   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_yo.yaml'
2025-08-31T08:28:44,704   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_zu.yaml'
2025-08-31T08:28:44,705   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/utils.py'
2025-08-31T08:28:44,707   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner'
2025-08-31T08:28:44,709   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_am.yaml'
2025-08-31T08:28:44,710   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bbj.yaml'
2025-08-31T08:28:44,711   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bm.yaml'
2025-08-31T08:28:44,712   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ee.yaml'
2025-08-31T08:28:44,713   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ha.yaml'
2025-08-31T08:28:44,714   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ig.yaml'
2025-08-31T08:28:44,716   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_lg.yaml'
2025-08-31T08:28:44,717   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_luo.yaml'
2025-08-31T08:28:44,718   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_mos.yaml'
2025-08-31T08:28:44,719   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ny.yaml'
2025-08-31T08:28:44,720   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_pcm.yaml'
2025-08-31T08:28:44,722   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_rw.yaml'
2025-08-31T08:28:44,723   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sn.yaml'
2025-08-31T08:28:44,724   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sw.yaml'
2025-08-31T08:28:44,725   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tn.yaml'
2025-08-31T08:28:44,726   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tw.yaml'
2025-08-31T08:28:44,728   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_wo.yaml'
2025-08-31T08:28:44,729   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_xh.yaml'
2025-08-31T08:28:44,730   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_yo.yaml'
2025-08-31T08:28:44,731   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_zu.yaml'
2025-08-31T08:28:44,733   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/utils.py'
2025-08-31T08:28:44,735   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner'
2025-08-31T08:28:44,736   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_am.yaml'
2025-08-31T08:28:44,737   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bbj.yaml'
2025-08-31T08:28:44,738   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bm.yaml'
2025-08-31T08:28:44,739   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ee.yaml'
2025-08-31T08:28:44,740   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ha.yaml'
2025-08-31T08:28:44,742   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ig.yaml'
2025-08-31T08:28:44,743   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_lg.yaml'
2025-08-31T08:28:44,744   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_luo.yaml'
2025-08-31T08:28:44,745   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_mos.yaml'
2025-08-31T08:28:44,746   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ny.yaml'
2025-08-31T08:28:44,747   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_pcm.yaml'
2025-08-31T08:28:44,748   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_rw.yaml'
2025-08-31T08:28:44,749   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sn.yaml'
2025-08-31T08:28:44,750   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sw.yaml'
2025-08-31T08:28:44,752   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tn.yaml'
2025-08-31T08:28:44,753   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tw.yaml'
2025-08-31T08:28:44,754   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_wo.yaml'
2025-08-31T08:28:44,755   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_xh.yaml'
2025-08-31T08:28:44,756   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_yo.yaml'
2025-08-31T08:28:44,758   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_zu.yaml'
2025-08-31T08:28:44,759   adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/utils.py'
2025-08-31T08:28:44,761   adding 'lm_eval/tasks/afrobench/masakhanews/README.md'
2025-08-31T08:28:44,762   adding 'lm_eval/tasks/afrobench/masakhanews/masakhanews.yaml'
2025-08-31T08:28:44,764   adding 'lm_eval/tasks/afrobench/masakhanews/utils.py'
2025-08-31T08:28:44,766   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews'
2025-08-31T08:28:44,767   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_amh.yaml'
2025-08-31T08:28:44,768   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_eng.yaml'
2025-08-31T08:28:44,769   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_fra.yaml'
2025-08-31T08:28:44,770   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_hau.yaml'
2025-08-31T08:28:44,771   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_ibo.yaml'
2025-08-31T08:28:44,773   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lin.yaml'
2025-08-31T08:28:44,774   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lug.yaml'
2025-08-31T08:28:44,775   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_orm.yaml'
2025-08-31T08:28:44,776   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_pcm.yaml'
2025-08-31T08:28:44,777   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_run.yaml'
2025-08-31T08:28:44,778   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_sna.yaml'
2025-08-31T08:28:44,779   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_som.yaml'
2025-08-31T08:28:44,781   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_swa.yaml'
2025-08-31T08:28:44,782   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_tir.yaml'
2025-08-31T08:28:44,783   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_xho.yaml'
2025-08-31T08:28:44,784   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_yor.yaml'
2025-08-31T08:28:44,785   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/utils.py'
2025-08-31T08:28:44,787   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews'
2025-08-31T08:28:44,788   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_amh.yaml'
2025-08-31T08:28:44,790   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_eng.yaml'
2025-08-31T08:28:44,791   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_fra.yaml'
2025-08-31T08:28:44,792   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_hau.yaml'
2025-08-31T08:28:44,793   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_ibo.yaml'
2025-08-31T08:28:44,794   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lin.yaml'
2025-08-31T08:28:44,795   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lug.yaml'
2025-08-31T08:28:44,796   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_orm.yaml'
2025-08-31T08:28:44,797   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_pcm.yaml'
2025-08-31T08:28:44,798   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_run.yaml'
2025-08-31T08:28:44,799   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_sna.yaml'
2025-08-31T08:28:44,800   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_som.yaml'
2025-08-31T08:28:44,801   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_swa.yaml'
2025-08-31T08:28:44,803   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_tir.yaml'
2025-08-31T08:28:44,804   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_xho.yaml'
2025-08-31T08:28:44,805   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_yor.yaml'
2025-08-31T08:28:44,806   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/utils.py'
2025-08-31T08:28:44,808   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews'
2025-08-31T08:28:44,809   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_amh.yaml'
2025-08-31T08:28:44,810   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_eng.yaml'
2025-08-31T08:28:44,811   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_fra.yaml'
2025-08-31T08:28:44,812   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_hau.yaml'
2025-08-31T08:28:44,813   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_ibo.yaml'
2025-08-31T08:28:44,815   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lin.yaml'
2025-08-31T08:28:44,816   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lug.yaml'
2025-08-31T08:28:44,817   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_orm.yaml'
2025-08-31T08:28:44,818   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_pcm.yaml'
2025-08-31T08:28:44,819   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_run.yaml'
2025-08-31T08:28:44,821   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_sna.yaml'
2025-08-31T08:28:44,822   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_som.yaml'
2025-08-31T08:28:44,823   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_swa.yaml'
2025-08-31T08:28:44,824   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_tir.yaml'
2025-08-31T08:28:44,825   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_xho.yaml'
2025-08-31T08:28:44,827   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_yor.yaml'
2025-08-31T08:28:44,828   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/utils.py'
2025-08-31T08:28:44,830   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews'
2025-08-31T08:28:44,831   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_amh.yaml'
2025-08-31T08:28:44,832   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_eng.yaml'
2025-08-31T08:28:44,833   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_fra.yaml'
2025-08-31T08:28:44,834   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_hau.yaml'
2025-08-31T08:28:44,836   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_ibo.yaml'
2025-08-31T08:28:44,837   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lin.yaml'
2025-08-31T08:28:44,838   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lug.yaml'
2025-08-31T08:28:44,839   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_orm.yaml'
2025-08-31T08:28:44,840   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_pcm.yaml'
2025-08-31T08:28:44,841   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_run.yaml'
2025-08-31T08:28:44,842   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_sna.yaml'
2025-08-31T08:28:44,843   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_som.yaml'
2025-08-31T08:28:44,844   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_swa.yaml'
2025-08-31T08:28:44,845   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_tir.yaml'
2025-08-31T08:28:44,846   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_xho.yaml'
2025-08-31T08:28:44,847   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_yor.yaml'
2025-08-31T08:28:44,848   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/utils.py'
2025-08-31T08:28:44,850   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews'
2025-08-31T08:28:44,852   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_amh.yaml'
2025-08-31T08:28:44,853   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_eng.yaml'
2025-08-31T08:28:44,854   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_fra.yaml'
2025-08-31T08:28:44,855   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_hau.yaml'
2025-08-31T08:28:44,857   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_ibo.yaml'
2025-08-31T08:28:44,858   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lin.yaml'
2025-08-31T08:28:44,859   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lug.yaml'
2025-08-31T08:28:44,860   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_orm.yaml'
2025-08-31T08:28:44,861   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_pcm.yaml'
2025-08-31T08:28:44,863   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_run.yaml'
2025-08-31T08:28:44,864   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_sna.yaml'
2025-08-31T08:28:44,865   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_som.yaml'
2025-08-31T08:28:44,866   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_swa.yaml'
2025-08-31T08:28:44,868   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_tir.yaml'
2025-08-31T08:28:44,869   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_xho.yaml'
2025-08-31T08:28:44,870   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_yor.yaml'
2025-08-31T08:28:44,871   adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/utils.py'
2025-08-31T08:28:44,873   adding 'lm_eval/tasks/afrobench/masakhapos/README.md'
2025-08-31T08:28:44,875   adding 'lm_eval/tasks/afrobench/masakhapos/gen_utils.py'
2025-08-31T08:28:44,876   adding 'lm_eval/tasks/afrobench/masakhapos/masakhapos.yaml'
2025-08-31T08:28:44,877   adding 'lm_eval/tasks/afrobench/masakhapos/utils.py'
2025-08-31T08:28:44,879   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bam.yaml'
2025-08-31T08:28:44,880   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bbj.yaml'
2025-08-31T08:28:44,881   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ewe.yaml'
2025-08-31T08:28:44,883   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_fon.yaml'
2025-08-31T08:28:44,884   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_hau.yaml'
2025-08-31T08:28:44,885   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ibo.yaml'
2025-08-31T08:28:44,886   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_kin.yaml'
2025-08-31T08:28:44,888   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_lug.yaml'
2025-08-31T08:28:44,889   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_luo.yaml'
2025-08-31T08:28:44,890   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_mos.yaml'
2025-08-31T08:28:44,891   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_nya.yaml'
2025-08-31T08:28:44,892   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_pcm.yaml'
2025-08-31T08:28:44,893   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_sna.yaml'
2025-08-31T08:28:44,894   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_swa.yaml'
2025-08-31T08:28:44,896   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_tsn.yaml'
2025-08-31T08:28:44,897   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_twi.yaml'
2025-08-31T08:28:44,898   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_wol.yaml'
2025-08-31T08:28:44,899   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_xho.yaml'
2025-08-31T08:28:44,900   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yaml'
2025-08-31T08:28:44,901   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yor.yaml'
2025-08-31T08:28:44,903   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_zul.yaml'
2025-08-31T08:28:44,904   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/utils.py'
2025-08-31T08:28:44,906   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bam.yaml'
2025-08-31T08:28:44,907   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bbj.yaml'
2025-08-31T08:28:44,908   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ewe.yaml'
2025-08-31T08:28:44,909   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_fon.yaml'
2025-08-31T08:28:44,910   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_hau.yaml'
2025-08-31T08:28:44,911   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ibo.yaml'
2025-08-31T08:28:44,913   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_kin.yaml'
2025-08-31T08:28:44,914   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_lug.yaml'
2025-08-31T08:28:44,915   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_luo.yaml'
2025-08-31T08:28:44,916   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_mos.yaml'
2025-08-31T08:28:44,917   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_nya.yaml'
2025-08-31T08:28:44,918   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_pcm.yaml'
2025-08-31T08:28:44,920   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_sna.yaml'
2025-08-31T08:28:44,921   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_swa.yaml'
2025-08-31T08:28:44,922   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_tsn.yaml'
2025-08-31T08:28:44,923   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_twi.yaml'
2025-08-31T08:28:44,924   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_wol.yaml'
2025-08-31T08:28:44,926   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_xho.yaml'
2025-08-31T08:28:44,927   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yaml'
2025-08-31T08:28:44,928   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yor.yaml'
2025-08-31T08:28:44,929   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_zul.yaml'
2025-08-31T08:28:44,931   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/utils.py'
2025-08-31T08:28:44,933   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bam.yaml'
2025-08-31T08:28:44,934   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bbj.yaml'
2025-08-31T08:28:44,935   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ewe.yaml'
2025-08-31T08:28:44,936   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_fon.yaml'
2025-08-31T08:28:44,937   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_hau.yaml'
2025-08-31T08:28:44,939   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ibo.yaml'
2025-08-31T08:28:44,940   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_kin.yaml'
2025-08-31T08:28:44,941   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_lug.yaml'
2025-08-31T08:28:44,942   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_luo.yaml'
2025-08-31T08:28:44,943   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_mos.yaml'
2025-08-31T08:28:44,944   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_nya.yaml'
2025-08-31T08:28:44,946   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_pcm.yaml'
2025-08-31T08:28:44,947   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_sna.yaml'
2025-08-31T08:28:44,948   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_swa.yaml'
2025-08-31T08:28:44,949   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_tsn.yaml'
2025-08-31T08:28:44,950   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_twi.yaml'
2025-08-31T08:28:44,951   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_wol.yaml'
2025-08-31T08:28:44,952   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_xho.yaml'
2025-08-31T08:28:44,954   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yaml'
2025-08-31T08:28:44,955   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yor.yaml'
2025-08-31T08:28:44,956   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_zul.yaml'
2025-08-31T08:28:44,957   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/utils.py'
2025-08-31T08:28:44,959   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bam.yaml'
2025-08-31T08:28:44,960   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bbj.yaml'
2025-08-31T08:28:44,962   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ewe.yaml'
2025-08-31T08:28:44,963   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_fon.yaml'
2025-08-31T08:28:44,964   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_hau.yaml'
2025-08-31T08:28:44,966   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ibo.yaml'
2025-08-31T08:28:44,967   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_kin.yaml'
2025-08-31T08:28:44,968   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_lug.yaml'
2025-08-31T08:28:44,969   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_luo.yaml'
2025-08-31T08:28:44,970   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_mos.yaml'
2025-08-31T08:28:44,972   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_nya.yaml'
2025-08-31T08:28:44,973   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_pcm.yaml'
2025-08-31T08:28:44,974   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_sna.yaml'
2025-08-31T08:28:44,975   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_swa.yaml'
2025-08-31T08:28:44,977   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_tsn.yaml'
2025-08-31T08:28:44,978   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_twi.yaml'
2025-08-31T08:28:44,979   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_wol.yaml'
2025-08-31T08:28:44,980   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_xho.yaml'
2025-08-31T08:28:44,982   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yaml'
2025-08-31T08:28:44,983   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yor.yaml'
2025-08-31T08:28:44,984   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_zul.yaml'
2025-08-31T08:28:44,985   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/utils.py'
2025-08-31T08:28:44,988   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bam.yaml'
2025-08-31T08:28:44,989   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bbj.yaml'
2025-08-31T08:28:44,990   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ewe.yaml'
2025-08-31T08:28:44,991   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_fon.yaml'
2025-08-31T08:28:44,993   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_hau.yaml'
2025-08-31T08:28:44,994   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ibo.yaml'
2025-08-31T08:28:44,995   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_kin.yaml'
2025-08-31T08:28:44,996   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_lug.yaml'
2025-08-31T08:28:44,997   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_luo.yaml'
2025-08-31T08:28:44,998   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_mos.yaml'
2025-08-31T08:28:45,000   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_nya.yaml'
2025-08-31T08:28:45,001   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_pcm.yaml'
2025-08-31T08:28:45,002   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_sna.yaml'
2025-08-31T08:28:45,003   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_swa.yaml'
2025-08-31T08:28:45,004   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_tsn.yaml'
2025-08-31T08:28:45,005   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_twi.yaml'
2025-08-31T08:28:45,007   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_wol.yaml'
2025-08-31T08:28:45,008   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_xho.yaml'
2025-08-31T08:28:45,009   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yaml'
2025-08-31T08:28:45,010   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yor.yaml'
2025-08-31T08:28:45,011   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_zul.yaml'
2025-08-31T08:28:45,013   adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/utils.py'
2025-08-31T08:28:45,015   adding 'lm_eval/tasks/afrobench/naijarc/README.md'
2025-08-31T08:28:45,016   adding 'lm_eval/tasks/afrobench/naijarc/naijarc.yaml'
2025-08-31T08:28:45,017   adding 'lm_eval/tasks/afrobench/naijarc/utils.py'
2025-08-31T08:28:45,019   adding 'lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc'
2025-08-31T08:28:45,020   adding 'lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_hau.yaml'
2025-08-31T08:28:45,021   adding 'lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_ibo.yaml'
2025-08-31T08:28:45,023   adding 'lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_yor.yaml'
2025-08-31T08:28:45,024   adding 'lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc'
2025-08-31T08:28:45,025   adding 'lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_hau.yaml'
2025-08-31T08:28:45,027   adding 'lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_ibo.yaml'
2025-08-31T08:28:45,028   adding 'lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_yor.yaml'
2025-08-31T08:28:45,029   adding 'lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc'
2025-08-31T08:28:45,031   adding 'lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_hau.yaml'
2025-08-31T08:28:45,032   adding 'lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_ibo.yaml'
2025-08-31T08:28:45,033   adding 'lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_yor.yaml'
2025-08-31T08:28:45,035   adding 'lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc'
2025-08-31T08:28:45,036   adding 'lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_hau.yaml'
2025-08-31T08:28:45,037   adding 'lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_ibo.yaml'
2025-08-31T08:28:45,038   adding 'lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_yor.yaml'
2025-08-31T08:28:45,040   adding 'lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc'
2025-08-31T08:28:45,041   adding 'lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_hau.yaml'
2025-08-31T08:28:45,042   adding 'lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_ibo.yaml'
2025-08-31T08:28:45,044   adding 'lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_yor.yaml'
2025-08-31T08:28:45,045   adding 'lm_eval/tasks/afrobench/nollysenti/README.md'
2025-08-31T08:28:45,047   adding 'lm_eval/tasks/afrobench/nollysenti/nollysenti.yaml'
2025-08-31T08:28:45,048   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti'
2025-08-31T08:28:45,050   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_eng.yaml'
2025-08-31T08:28:45,051   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_hau.yaml'
2025-08-31T08:28:45,052   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_ibo.yaml'
2025-08-31T08:28:45,053   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_pcm.yaml'
2025-08-31T08:28:45,054   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_yor.yaml'
2025-08-31T08:28:45,055   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/utils.py'
2025-08-31T08:28:45,056   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti'
2025-08-31T08:28:45,058   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_eng.yaml'
2025-08-31T08:28:45,059   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_hau.yaml'
2025-08-31T08:28:45,060   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_ibo.yaml'
2025-08-31T08:28:45,061   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_pcm.yaml'
2025-08-31T08:28:45,062   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_yor.yaml'
2025-08-31T08:28:45,063   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/utils.py'
2025-08-31T08:28:45,065   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti'
2025-08-31T08:28:45,066   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_eng.yaml'
2025-08-31T08:28:45,067   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_hau.yaml'
2025-08-31T08:28:45,068   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_ibo.yaml'
2025-08-31T08:28:45,069   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_pcm.yaml'
2025-08-31T08:28:45,070   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_yor.yaml'
2025-08-31T08:28:45,071   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/utils.py'
2025-08-31T08:28:45,073   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti'
2025-08-31T08:28:45,074   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_eng.yaml'
2025-08-31T08:28:45,075   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_hau.yaml'
2025-08-31T08:28:45,076   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_ibo.yaml'
2025-08-31T08:28:45,078   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_pcm.yaml'
2025-08-31T08:28:45,079   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_yor.yaml'
2025-08-31T08:28:45,080   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/utils.py'
2025-08-31T08:28:45,081   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti'
2025-08-31T08:28:45,083   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_eng.yaml'
2025-08-31T08:28:45,084   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_hau.yaml'
2025-08-31T08:28:45,085   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_ibo.yaml'
2025-08-31T08:28:45,086   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_pcm.yaml'
2025-08-31T08:28:45,087   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_yor.yaml'
2025-08-31T08:28:45,088   adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/utils.py'
2025-08-31T08:28:45,090   adding 'lm_eval/tasks/afrobench/ntrex/README.md'
2025-08-31T08:28:45,092   adding 'lm_eval/tasks/afrobench/ntrex/gen_utils.py'
2025-08-31T08:28:45,093   adding 'lm_eval/tasks/afrobench/ntrex/ntrex.yaml'
2025-08-31T08:28:45,096   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex'
2025-08-31T08:28:45,097   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_afr_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,098   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_amh_Ethi-eng_Latn.yaml'
2025-08-31T08:28:45,099   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_arb_Arab-eng_Latn.yaml'
2025-08-31T08:28:45,100   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_bem_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,101   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ewe_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,103   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_fra_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,104   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_hau_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,105   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ibo_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,106   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_kin_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,107   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mey_Arab-eng_Latn.yaml'
2025-08-31T08:28:45,108   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mlg_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,109   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_msa_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,110   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nde_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,111   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nso_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,112   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nya_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,113   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_orm_Ethi-eng_Latn.yaml'
2025-08-31T08:28:45,114   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_shi_Arab-eng_Latn.yaml'
2025-08-31T08:28:45,115   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_sna_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,116   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_som_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,117   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ssw_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,118   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_swa_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,120   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tam_Taml-eng_Latn.yaml'
2025-08-31T08:28:45,121   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tel_Telu-eng_Latn.yaml'
2025-08-31T08:28:45,122   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tir_Ethi-eng_Latn.yaml'
2025-08-31T08:28:45,123   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ton_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,124   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tsn_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,125   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_urd_Arab-eng_Latn.yaml'
2025-08-31T08:28:45,126   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ven_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,127   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_wol_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,129   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_xho_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,130   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_yor_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,131   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_zul_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,133   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex'
2025-08-31T08:28:45,134   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-afr_Latn.yaml'
2025-08-31T08:28:45,135   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-amh_Ethi.yaml'
2025-08-31T08:28:45,136   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-arb_Arab.yaml'
2025-08-31T08:28:45,138   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-bem_Latn.yaml'
2025-08-31T08:28:45,139   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ewe_Latn.yaml'
2025-08-31T08:28:45,140   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-fra_Latn.yaml'
2025-08-31T08:28:45,141   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-hau_Latn.yaml'
2025-08-31T08:28:45,142   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ibo_Latn.yaml'
2025-08-31T08:28:45,143   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-kin_Latn.yaml'
2025-08-31T08:28:45,144   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mey_Arab.yaml'
2025-08-31T08:28:45,145   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mlg_Latn.yaml'
2025-08-31T08:28:45,146   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-msa_Latn.yaml'
2025-08-31T08:28:45,147   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nde_Latn.yaml'
2025-08-31T08:28:45,149   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nso_Latn.yaml'
2025-08-31T08:28:45,150   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nya_Latn.yaml'
2025-08-31T08:28:45,151   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-orm_Ethi.yaml'
2025-08-31T08:28:45,152   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-shi_Arab.yaml'
2025-08-31T08:28:45,153   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-sna_Latn.yaml'
2025-08-31T08:28:45,154   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-som_Latn.yaml'
2025-08-31T08:28:45,155   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ssw_Latn.yaml'
2025-08-31T08:28:45,156   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-swa_Latn.yaml'
2025-08-31T08:28:45,157   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tam_Taml.yaml'
2025-08-31T08:28:45,158   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tel_Telu.yaml'
2025-08-31T08:28:45,160   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tir_Ethi.yaml'
2025-08-31T08:28:45,161   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ton_Latn.yaml'
2025-08-31T08:28:45,162   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tsn_Latn.yaml'
2025-08-31T08:28:45,163   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-urd_Arab.yaml'
2025-08-31T08:28:45,164   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ven_Latn.yaml'
2025-08-31T08:28:45,165   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-wol_Latn.yaml'
2025-08-31T08:28:45,166   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-xho_Latn.yaml'
2025-08-31T08:28:45,168   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-yor_Latn.yaml'
2025-08-31T08:28:45,169   adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-zul_Latn.yaml'
2025-08-31T08:28:45,171   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex'
2025-08-31T08:28:45,172   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_afr_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,174   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_amh_Ethi-eng_Latn.yaml'
2025-08-31T08:28:45,175   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_arb_Arab-eng_Latn.yaml'
2025-08-31T08:28:45,176   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_bem_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,177   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ewe_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,178   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_fra_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,179   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_hau_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,181   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ibo_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,182   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_kin_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,183   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mey_Arab-eng_Latn.yaml'
2025-08-31T08:28:45,184   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mlg_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,185   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_msa_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,187   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nde_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,188   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nso_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,189   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nya_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,190   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_orm_Ethi-eng_Latn.yaml'
2025-08-31T08:28:45,191   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_shi_Arab-eng_Latn.yaml'
2025-08-31T08:28:45,192   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_sna_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,193   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_som_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,195   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ssw_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,196   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_swa_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,197   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tam_Taml-eng_Latn.yaml'
2025-08-31T08:28:45,198   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tel_Telu-eng_Latn.yaml'
2025-08-31T08:28:45,199   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tir_Ethi-eng_Latn.yaml'
2025-08-31T08:28:45,200   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ton_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,201   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tsn_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,203   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_urd_Arab-eng_Latn.yaml'
2025-08-31T08:28:45,204   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ven_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,205   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_wol_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,206   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_xho_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,207   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_yor_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,209   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_zul_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,211   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex'
2025-08-31T08:28:45,212   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-afr_Latn.yaml'
2025-08-31T08:28:45,213   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-amh_Ethi.yaml'
2025-08-31T08:28:45,214   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-arb_Arab.yaml'
2025-08-31T08:28:45,215   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-bem_Latn.yaml'
2025-08-31T08:28:45,217   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ewe_Latn.yaml'
2025-08-31T08:28:45,218   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-fra_Latn.yaml'
2025-08-31T08:28:45,219   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-hau_Latn.yaml'
2025-08-31T08:28:45,220   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ibo_Latn.yaml'
2025-08-31T08:28:45,222   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-kin_Latn.yaml'
2025-08-31T08:28:45,223   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mey_Arab.yaml'
2025-08-31T08:28:45,224   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mlg_Latn.yaml'
2025-08-31T08:28:45,225   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-msa_Latn.yaml'
2025-08-31T08:28:45,226   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nde_Latn.yaml'
2025-08-31T08:28:45,227   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nso_Latn.yaml'
2025-08-31T08:28:45,229   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nya_Latn.yaml'
2025-08-31T08:28:45,230   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-orm_Ethi.yaml'
2025-08-31T08:28:45,231   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-shi_Arab.yaml'
2025-08-31T08:28:45,232   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-sna_Latn.yaml'
2025-08-31T08:28:45,233   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-som_Latn.yaml'
2025-08-31T08:28:45,234   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ssw_Latn.yaml'
2025-08-31T08:28:45,236   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-swa_Latn.yaml'
2025-08-31T08:28:45,237   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tam_Taml.yaml'
2025-08-31T08:28:45,238   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tel_Telu.yaml'
2025-08-31T08:28:45,239   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tir_Ethi.yaml'
2025-08-31T08:28:45,240   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ton_Latn.yaml'
2025-08-31T08:28:45,241   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tsn_Latn.yaml'
2025-08-31T08:28:45,243   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-urd_Arab.yaml'
2025-08-31T08:28:45,244   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ven_Latn.yaml'
2025-08-31T08:28:45,245   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-wol_Latn.yaml'
2025-08-31T08:28:45,246   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-xho_Latn.yaml'
2025-08-31T08:28:45,247   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-yor_Latn.yaml'
2025-08-31T08:28:45,248   adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-zul_Latn.yaml'
2025-08-31T08:28:45,251   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex'
2025-08-31T08:28:45,252   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_afr_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,253   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_amh_Ethi-eng_Latn.yaml'
2025-08-31T08:28:45,255   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_arb_Arab-eng_Latn.yaml'
2025-08-31T08:28:45,256   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_bem_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,257   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ewe_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,258   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_fra_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,260   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_hau_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,261   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ibo_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,262   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_kin_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,263   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mey_Arab-eng_Latn.yaml'
2025-08-31T08:28:45,265   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mlg_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,266   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_msa_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,267   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nde_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,268   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nso_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,269   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nya_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,270   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_orm_Ethi-eng_Latn.yaml'
2025-08-31T08:28:45,271   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_shi_Arab-eng_Latn.yaml'
2025-08-31T08:28:45,272   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_sna_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,273   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_som_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,275   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ssw_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,276   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_swa_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,277   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tam_Taml-eng_Latn.yaml'
2025-08-31T08:28:45,278   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tel_Telu-eng_Latn.yaml'
2025-08-31T08:28:45,279   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tir_Ethi-eng_Latn.yaml'
2025-08-31T08:28:45,280   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ton_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,282   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tsn_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,283   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_urd_Arab-eng_Latn.yaml'
2025-08-31T08:28:45,284   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ven_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,285   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_wol_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,286   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_xho_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,287   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_yor_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,288   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_zul_Latn-eng_Latn.yaml'
2025-08-31T08:28:45,291   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex'
2025-08-31T08:28:45,292   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-afr_Latn.yaml'
2025-08-31T08:28:45,293   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-amh_Ethi.yaml'
2025-08-31T08:28:45,294   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-arb_Arab.yaml'
2025-08-31T08:28:45,295   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-bem_Latn.yaml'
2025-08-31T08:28:45,297   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ewe_Latn.yaml'
2025-08-31T08:28:45,298   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-fra_Latn.yaml'
2025-08-31T08:28:45,299   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-hau_Latn.yaml'
2025-08-31T08:28:45,300   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ibo_Latn.yaml'
2025-08-31T08:28:45,301   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-kin_Latn.yaml'
2025-08-31T08:28:45,302   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mey_Arab.yaml'
2025-08-31T08:28:45,304   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mlg_Latn.yaml'
2025-08-31T08:28:45,305   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-msa_Latn.yaml'
2025-08-31T08:28:45,306   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nde_Latn.yaml'
2025-08-31T08:28:45,307   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nso_Latn.yaml'
2025-08-31T08:28:45,308   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nya_Latn.yaml'
2025-08-31T08:28:45,309   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-orm_Ethi.yaml'
2025-08-31T08:28:45,310   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-shi_Arab.yaml'
2025-08-31T08:28:45,311   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-sna_Latn.yaml'
2025-08-31T08:28:45,313   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-som_Latn.yaml'
2025-08-31T08:28:45,314   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ssw_Latn.yaml'
2025-08-31T08:28:45,315   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-swa_Latn.yaml'
2025-08-31T08:28:45,316   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tam_Taml.yaml'
2025-08-31T08:28:45,317   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tel_Telu.yaml'
2025-08-31T08:28:45,318   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tir_Ethi.yaml'
2025-08-31T08:28:45,319   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ton_Latn.yaml'
2025-08-31T08:28:45,320   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tsn_Latn.yaml'
2025-08-31T08:28:45,321   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-urd_Arab.yaml'
2025-08-31T08:28:45,323   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ven_Latn.yaml'
2025-08-31T08:28:45,324   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-wol_Latn.yaml'
2025-08-31T08:28:45,325   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-xho_Latn.yaml'
2025-08-31T08:28:45,326   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-yor_Latn.yaml'
2025-08-31T08:28:45,327   adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-zul_Latn.yaml'
2025-08-31T08:28:45,329   adding 'lm_eval/tasks/afrobench/openai_mmlu/README.md'
2025-08-31T08:28:45,330   adding 'lm_eval/tasks/afrobench/openai_mmlu/openai_mmlu.yaml'
2025-08-31T08:28:45,332   adding 'lm_eval/tasks/afrobench/openai_mmlu/utils.py'
2025-08-31T08:28:45,334   adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu'
2025-08-31T08:28:45,335   adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_ara.yaml'
2025-08-31T08:28:45,336   adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_swa.yaml'
2025-08-31T08:28:45,337   adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_yor.yaml'
2025-08-31T08:28:45,339   adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu'
2025-08-31T08:28:45,341   adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_ara.yaml'
2025-08-31T08:28:45,342   adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_swa.yaml'
2025-08-31T08:28:45,343   adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_yor.yaml'
2025-08-31T08:28:45,345   adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu'
2025-08-31T08:28:45,346   adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_ara.yaml'
2025-08-31T08:28:45,347   adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_swa.yaml'
2025-08-31T08:28:45,348   adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_yor.yaml'
2025-08-31T08:28:45,350   adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu'
2025-08-31T08:28:45,351   adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_ara.yaml'
2025-08-31T08:28:45,352   adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_swa.yaml'
2025-08-31T08:28:45,354   adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_yor.yaml'
2025-08-31T08:28:45,355   adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu'
2025-08-31T08:28:45,356   adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_ara.yaml'
2025-08-31T08:28:45,358   adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_swa.yaml'
2025-08-31T08:28:45,359   adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_yor.yaml'
2025-08-31T08:28:45,360   adding 'lm_eval/tasks/afrobench/salt/README.md'
2025-08-31T08:28:45,362   adding 'lm_eval/tasks/afrobench/salt/gen_utils.py'
2025-08-31T08:28:45,363   adding 'lm_eval/tasks/afrobench/salt/salt.yaml'
2025-08-31T08:28:45,364   adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt'
2025-08-31T08:28:45,366   adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_ach-eng.yaml'
2025-08-31T08:28:45,367   adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ach.yaml'
2025-08-31T08:28:45,368   adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ibo.yaml'
2025-08-31T08:28:45,369   adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lgg.yaml'
2025-08-31T08:28:45,370   adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lug.yaml'
2025-08-31T08:28:45,371   adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-nyn.yaml'
2025-08-31T08:28:45,372   adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-swa.yaml'
2025-08-31T08:28:45,373   adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-teo.yaml'
2025-08-31T08:28:45,374   adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_ibo-eng.yaml'
2025-08-31T08:28:45,376   adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_lgg-eng.yaml'
2025-08-31T08:28:45,377   adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_lug-eng.yaml'
2025-08-31T08:28:45,378   adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_nyn-eng.yaml'
2025-08-31T08:28:45,379   adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_swa-eng.yaml'
2025-08-31T08:28:45,380   adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_teo-eng.yaml'
2025-08-31T08:28:45,382   adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt'
2025-08-31T08:28:45,383   adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_ach-eng.yaml'
2025-08-31T08:28:45,384   adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ach.yaml'
2025-08-31T08:28:45,385   adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ibo.yaml'
2025-08-31T08:28:45,387   adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lgg.yaml'
2025-08-31T08:28:45,388   adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lug.yaml'
2025-08-31T08:28:45,389   adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-nyn.yaml'
2025-08-31T08:28:45,390   adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-swa.yaml'
2025-08-31T08:28:45,391   adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-teo.yaml'
2025-08-31T08:28:45,393   adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_ibo-eng.yaml'
2025-08-31T08:28:45,394   adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_lgg-eng.yaml'
2025-08-31T08:28:45,395   adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_lug-eng.yaml'
2025-08-31T08:28:45,396   adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_nyn-eng.yaml'
2025-08-31T08:28:45,397   adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_swa-eng.yaml'
2025-08-31T08:28:45,398   adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_teo-eng.yaml'
2025-08-31T08:28:45,400   adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt'
2025-08-31T08:28:45,401   adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_ach-eng.yaml'
2025-08-31T08:28:45,403   adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ach.yaml'
2025-08-31T08:28:45,404   adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ibo.yaml'
2025-08-31T08:28:45,405   adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lgg.yaml'
2025-08-31T08:28:45,407   adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lug.yaml'
2025-08-31T08:28:45,408   adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-nyn.yaml'
2025-08-31T08:28:45,409   adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-swa.yaml'
2025-08-31T08:28:45,410   adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-teo.yaml'
2025-08-31T08:28:45,412   adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_ibo-eng.yaml'
2025-08-31T08:28:45,413   adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_lgg-eng.yaml'
2025-08-31T08:28:45,414   adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_lug-eng.yaml'
2025-08-31T08:28:45,415   adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_nyn-eng.yaml'
2025-08-31T08:28:45,416   adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_swa-eng.yaml'
2025-08-31T08:28:45,417   adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_teo-eng.yaml'
2025-08-31T08:28:45,419   adding 'lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench.sh'
2025-08-31T08:28:45,420   adding 'lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench_lite.sh'
2025-08-31T08:28:45,422   adding 'lm_eval/tasks/afrobench/sib/README.md'
2025-08-31T08:28:45,423   adding 'lm_eval/tasks/afrobench/sib/sib.yaml'
2025-08-31T08:28:45,425   adding 'lm_eval/tasks/afrobench/sib/utils.py'
2025-08-31T08:28:45,427   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib'
2025-08-31T08:28:45,429   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_aeb.yaml'
2025-08-31T08:28:45,430   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_afr.yaml'
2025-08-31T08:28:45,431   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_aka.yaml'
2025-08-31T08:28:45,432   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_amh.yaml'
2025-08-31T08:28:45,433   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_ary.yaml'
2025-08-31T08:28:45,434   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_arz.yaml'
2025-08-31T08:28:45,436   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_bam.yaml'
2025-08-31T08:28:45,437   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_bem.yaml'
2025-08-31T08:28:45,438   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_cjk.yaml'
2025-08-31T08:28:45,439   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_dik.yaml'
2025-08-31T08:28:45,440   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_dyu.yaml'
2025-08-31T08:28:45,441   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_eng.yaml'
2025-08-31T08:28:45,442   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_ewe.yaml'
2025-08-31T08:28:45,444   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_fon.yaml'
2025-08-31T08:28:45,445   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_fra.yaml'
2025-08-31T08:28:45,446   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_fuv.yaml'
2025-08-31T08:28:45,447   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_gaz.yaml'
2025-08-31T08:28:45,448   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_hau.yaml'
2025-08-31T08:28:45,449   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_ibo.yaml'
2025-08-31T08:28:45,451   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kab.yaml'
2025-08-31T08:28:45,452   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kam.yaml'
2025-08-31T08:28:45,453   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kbp.yaml'
2025-08-31T08:28:45,454   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kea.yaml'
2025-08-31T08:28:45,455   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kik.yaml'
2025-08-31T08:28:45,456   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kin.yaml'
2025-08-31T08:28:45,458   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kmb.yaml'
2025-08-31T08:28:45,459   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_knc.yaml'
2025-08-31T08:28:45,460   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kon.yaml'
2025-08-31T08:28:45,461   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_lin.yaml'
2025-08-31T08:28:45,462   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_lua.yaml'
2025-08-31T08:28:45,463   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_lug.yaml'
2025-08-31T08:28:45,464   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_luo.yaml'
2025-08-31T08:28:45,466   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_mos.yaml'
2025-08-31T08:28:45,467   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_nso.yaml'
2025-08-31T08:28:45,468   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_nus.yaml'
2025-08-31T08:28:45,469   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_nya.yaml'
2025-08-31T08:28:45,470   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_plt.yaml'
2025-08-31T08:28:45,471   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_por.yaml'
2025-08-31T08:28:45,472   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_run.yaml'
2025-08-31T08:28:45,473   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_sag.yaml'
2025-08-31T08:28:45,475   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_sna.yaml'
2025-08-31T08:28:45,476   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_som.yaml'
2025-08-31T08:28:45,477   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_sot.yaml'
2025-08-31T08:28:45,478   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_ssw.yaml'
2025-08-31T08:28:45,479   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_swa.yaml'
2025-08-31T08:28:45,480   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_taq.yaml'
2025-08-31T08:28:45,481   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_tir.yaml'
2025-08-31T08:28:45,482   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_tso.yaml'
2025-08-31T08:28:45,483   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_tum.yaml'
2025-08-31T08:28:45,485   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_twi.yaml'
2025-08-31T08:28:45,486   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_tzm.yaml'
2025-08-31T08:28:45,487   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_umb.yaml'
2025-08-31T08:28:45,488   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_wol.yaml'
2025-08-31T08:28:45,489   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_xho.yaml'
2025-08-31T08:28:45,490   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_yor.yaml'
2025-08-31T08:28:45,492   adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_zul.yaml'
2025-08-31T08:28:45,493   adding 'lm_eval/tasks/afrobench/sib/prompt_1/utils.py'
2025-08-31T08:28:45,495   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib'
2025-08-31T08:28:45,496   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_aeb.yaml'
2025-08-31T08:28:45,498   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_afr.yaml'
2025-08-31T08:28:45,499   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_aka.yaml'
2025-08-31T08:28:45,500   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_amh.yaml'
2025-08-31T08:28:45,501   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_ary.yaml'
2025-08-31T08:28:45,502   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_arz.yaml'
2025-08-31T08:28:45,504   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_bam.yaml'
2025-08-31T08:28:45,505   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_bem.yaml'
2025-08-31T08:28:45,506   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_cjk.yaml'
2025-08-31T08:28:45,507   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_dik.yaml'
2025-08-31T08:28:45,508   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_dyu.yaml'
2025-08-31T08:28:45,509   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_eng.yaml'
2025-08-31T08:28:45,511   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_ewe.yaml'
2025-08-31T08:28:45,512   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_fon.yaml'
2025-08-31T08:28:45,513   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_fra.yaml'
2025-08-31T08:28:45,514   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_fuv.yaml'
2025-08-31T08:28:45,515   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_gaz.yaml'
2025-08-31T08:28:45,517   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_hau.yaml'
2025-08-31T08:28:45,518   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_ibo.yaml'
2025-08-31T08:28:45,519   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kab.yaml'
2025-08-31T08:28:45,520   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kam.yaml'
2025-08-31T08:28:45,521   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kbp.yaml'
2025-08-31T08:28:45,522   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kea.yaml'
2025-08-31T08:28:45,523   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kik.yaml'
2025-08-31T08:28:45,525   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kin.yaml'
2025-08-31T08:28:45,526   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kmb.yaml'
2025-08-31T08:28:45,527   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_knc.yaml'
2025-08-31T08:28:45,528   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kon.yaml'
2025-08-31T08:28:45,529   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_lin.yaml'
2025-08-31T08:28:45,531   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_lua.yaml'
2025-08-31T08:28:45,532   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_lug.yaml'
2025-08-31T08:28:45,533   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_luo.yaml'
2025-08-31T08:28:45,534   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_mos.yaml'
2025-08-31T08:28:45,536   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_nso.yaml'
2025-08-31T08:28:45,537   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_nus.yaml'
2025-08-31T08:28:45,538   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_nya.yaml'
2025-08-31T08:28:45,539   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_plt.yaml'
2025-08-31T08:28:45,540   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_por.yaml'
2025-08-31T08:28:45,541   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_run.yaml'
2025-08-31T08:28:45,542   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_sag.yaml'
2025-08-31T08:28:45,544   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_sna.yaml'
2025-08-31T08:28:45,545   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_som.yaml'
2025-08-31T08:28:45,546   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_sot.yaml'
2025-08-31T08:28:45,547   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_ssw.yaml'
2025-08-31T08:28:45,548   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_swa.yaml'
2025-08-31T08:28:45,549   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_taq.yaml'
2025-08-31T08:28:45,551   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_tir.yaml'
2025-08-31T08:28:45,552   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_tso.yaml'
2025-08-31T08:28:45,553   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_tum.yaml'
2025-08-31T08:28:45,554   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_twi.yaml'
2025-08-31T08:28:45,555   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_tzm.yaml'
2025-08-31T08:28:45,556   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_umb.yaml'
2025-08-31T08:28:45,558   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_wol.yaml'
2025-08-31T08:28:45,559   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_xho.yaml'
2025-08-31T08:28:45,560   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_yor.yaml'
2025-08-31T08:28:45,561   adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_zul.yaml'
2025-08-31T08:28:45,562   adding 'lm_eval/tasks/afrobench/sib/prompt_2/utils.py'
2025-08-31T08:28:45,565   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib'
2025-08-31T08:28:45,566   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_aeb.yaml'
2025-08-31T08:28:45,567   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_afr.yaml'
2025-08-31T08:28:45,568   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_aka.yaml'
2025-08-31T08:28:45,570   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_amh.yaml'
2025-08-31T08:28:45,571   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_ary.yaml'
2025-08-31T08:28:45,572   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_arz.yaml'
2025-08-31T08:28:45,573   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_bam.yaml'
2025-08-31T08:28:45,574   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_bem.yaml'
2025-08-31T08:28:45,576   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_cjk.yaml'
2025-08-31T08:28:45,577   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_dik.yaml'
2025-08-31T08:28:45,578   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_dyu.yaml'
2025-08-31T08:28:45,579   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_eng.yaml'
2025-08-31T08:28:45,581   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_ewe.yaml'
2025-08-31T08:28:45,582   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_fon.yaml'
2025-08-31T08:28:45,583   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_fra.yaml'
2025-08-31T08:28:45,585   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_fuv.yaml'
2025-08-31T08:28:45,586   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_gaz.yaml'
2025-08-31T08:28:45,587   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_hau.yaml'
2025-08-31T08:28:45,588   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_ibo.yaml'
2025-08-31T08:28:45,590   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kab.yaml'
2025-08-31T08:28:45,591   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kam.yaml'
2025-08-31T08:28:45,592   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kbp.yaml'
2025-08-31T08:28:45,593   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kea.yaml'
2025-08-31T08:28:45,594   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kik.yaml'
2025-08-31T08:28:45,595   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kin.yaml'
2025-08-31T08:28:45,597   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kmb.yaml'
2025-08-31T08:28:45,598   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_knc.yaml'
2025-08-31T08:28:45,599   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kon.yaml'
2025-08-31T08:28:45,600   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_lin.yaml'
2025-08-31T08:28:45,601   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_lua.yaml'
2025-08-31T08:28:45,602   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_lug.yaml'
2025-08-31T08:28:45,604   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_luo.yaml'
2025-08-31T08:28:45,605   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_mos.yaml'
2025-08-31T08:28:45,606   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_nso.yaml'
2025-08-31T08:28:45,607   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_nus.yaml'
2025-08-31T08:28:45,608   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_nya.yaml'
2025-08-31T08:28:45,609   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_plt.yaml'
2025-08-31T08:28:45,611   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_por.yaml'
2025-08-31T08:28:45,612   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_run.yaml'
2025-08-31T08:28:45,613   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_sag.yaml'
2025-08-31T08:28:45,614   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_sna.yaml'
2025-08-31T08:28:45,615   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_som.yaml'
2025-08-31T08:28:45,616   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_sot.yaml'
2025-08-31T08:28:45,618   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_ssw.yaml'
2025-08-31T08:28:45,619   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_swa.yaml'
2025-08-31T08:28:45,620   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_taq.yaml'
2025-08-31T08:28:45,621   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_tir.yaml'
2025-08-31T08:28:45,622   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_tso.yaml'
2025-08-31T08:28:45,623   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_tum.yaml'
2025-08-31T08:28:45,625   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_twi.yaml'
2025-08-31T08:28:45,626   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_tzm.yaml'
2025-08-31T08:28:45,627   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_umb.yaml'
2025-08-31T08:28:45,629   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_wol.yaml'
2025-08-31T08:28:45,630   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_xho.yaml'
2025-08-31T08:28:45,631   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_yor.yaml'
2025-08-31T08:28:45,632   adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_zul.yaml'
2025-08-31T08:28:45,633   adding 'lm_eval/tasks/afrobench/sib/prompt_3/utils.py'
2025-08-31T08:28:45,636   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib'
2025-08-31T08:28:45,637   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_aeb.yaml'
2025-08-31T08:28:45,638   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_afr.yaml'
2025-08-31T08:28:45,640   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_aka.yaml'
2025-08-31T08:28:45,641   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_amh.yaml'
2025-08-31T08:28:45,642   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_ary.yaml'
2025-08-31T08:28:45,643   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_arz.yaml'
2025-08-31T08:28:45,644   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_bam.yaml'
2025-08-31T08:28:45,646   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_bem.yaml'
2025-08-31T08:28:45,647   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_cjk.yaml'
2025-08-31T08:28:45,648   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_dik.yaml'
2025-08-31T08:28:45,649   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_dyu.yaml'
2025-08-31T08:28:45,650   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_eng.yaml'
2025-08-31T08:28:45,651   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_ewe.yaml'
2025-08-31T08:28:45,652   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_fon.yaml'
2025-08-31T08:28:45,653   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_fra.yaml'
2025-08-31T08:28:45,654   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_fuv.yaml'
2025-08-31T08:28:45,656   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_gaz.yaml'
2025-08-31T08:28:45,657   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_hau.yaml'
2025-08-31T08:28:45,658   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_ibo.yaml'
2025-08-31T08:28:45,659   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kab.yaml'
2025-08-31T08:28:45,660   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kam.yaml'
2025-08-31T08:28:45,662   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kbp.yaml'
2025-08-31T08:28:45,663   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kea.yaml'
2025-08-31T08:28:45,664   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kik.yaml'
2025-08-31T08:28:45,665   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kin.yaml'
2025-08-31T08:28:45,666   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kmb.yaml'
2025-08-31T08:28:45,667   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_knc.yaml'
2025-08-31T08:28:45,669   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kon.yaml'
2025-08-31T08:28:45,670   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_lin.yaml'
2025-08-31T08:28:45,671   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_lua.yaml'
2025-08-31T08:28:45,672   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_lug.yaml'
2025-08-31T08:28:45,673   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_luo.yaml'
2025-08-31T08:28:45,674   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_mos.yaml'
2025-08-31T08:28:45,676   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_nso.yaml'
2025-08-31T08:28:45,677   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_nus.yaml'
2025-08-31T08:28:45,678   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_nya.yaml'
2025-08-31T08:28:45,679   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_plt.yaml'
2025-08-31T08:28:45,680   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_por.yaml'
2025-08-31T08:28:45,682   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_run.yaml'
2025-08-31T08:28:45,683   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_sag.yaml'
2025-08-31T08:28:45,684   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_sna.yaml'
2025-08-31T08:28:45,685   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_som.yaml'
2025-08-31T08:28:45,686   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_sot.yaml'
2025-08-31T08:28:45,688   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_ssw.yaml'
2025-08-31T08:28:45,689   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_swa.yaml'
2025-08-31T08:28:45,690   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_taq.yaml'
2025-08-31T08:28:45,691   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_tir.yaml'
2025-08-31T08:28:45,692   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_tso.yaml'
2025-08-31T08:28:45,693   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_tum.yaml'
2025-08-31T08:28:45,695   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_twi.yaml'
2025-08-31T08:28:45,696   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_tzm.yaml'
2025-08-31T08:28:45,697   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_umb.yaml'
2025-08-31T08:28:45,698   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_wol.yaml'
2025-08-31T08:28:45,699   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_xho.yaml'
2025-08-31T08:28:45,701   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_yor.yaml'
2025-08-31T08:28:45,702   adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_zul.yaml'
2025-08-31T08:28:45,703   adding 'lm_eval/tasks/afrobench/sib/prompt_4/utils.py'
2025-08-31T08:28:45,705   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib'
2025-08-31T08:28:45,706   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_aeb.yaml'
2025-08-31T08:28:45,708   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_afr.yaml'
2025-08-31T08:28:45,709   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_aka.yaml'
2025-08-31T08:28:45,710   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_amh.yaml'
2025-08-31T08:28:45,711   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_ary.yaml'
2025-08-31T08:28:45,712   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_arz.yaml'
2025-08-31T08:28:45,713   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_bam.yaml'
2025-08-31T08:28:45,715   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_bem.yaml'
2025-08-31T08:28:45,716   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_cjk.yaml'
2025-08-31T08:28:45,717   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_dik.yaml'
2025-08-31T08:28:45,718   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_dyu.yaml'
2025-08-31T08:28:45,719   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_eng.yaml'
2025-08-31T08:28:45,721   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_ewe.yaml'
2025-08-31T08:28:45,722   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_fon.yaml'
2025-08-31T08:28:45,723   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_fra.yaml'
2025-08-31T08:28:45,724   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_fuv.yaml'
2025-08-31T08:28:45,725   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_gaz.yaml'
2025-08-31T08:28:45,726   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_hau.yaml'
2025-08-31T08:28:45,728   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_ibo.yaml'
2025-08-31T08:28:45,729   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kab.yaml'
2025-08-31T08:28:45,730   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kam.yaml'
2025-08-31T08:28:45,731   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kbp.yaml'
2025-08-31T08:28:45,732   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kea.yaml'
2025-08-31T08:28:45,734   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kik.yaml'
2025-08-31T08:28:45,735   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kin.yaml'
2025-08-31T08:28:45,736   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kmb.yaml'
2025-08-31T08:28:45,737   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_knc.yaml'
2025-08-31T08:28:45,738   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kon.yaml'
2025-08-31T08:28:45,740   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_lin.yaml'
2025-08-31T08:28:45,741   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_lua.yaml'
2025-08-31T08:28:45,742   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_lug.yaml'
2025-08-31T08:28:45,743   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_luo.yaml'
2025-08-31T08:28:45,745   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_mos.yaml'
2025-08-31T08:28:45,746   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_nso.yaml'
2025-08-31T08:28:45,747   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_nus.yaml'
2025-08-31T08:28:45,748   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_nya.yaml'
2025-08-31T08:28:45,750   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_plt.yaml'
2025-08-31T08:28:45,751   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_por.yaml'
2025-08-31T08:28:45,752   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_run.yaml'
2025-08-31T08:28:45,754   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_sag.yaml'
2025-08-31T08:28:45,755   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_sna.yaml'
2025-08-31T08:28:45,756   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_som.yaml'
2025-08-31T08:28:45,757   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_sot.yaml'
2025-08-31T08:28:45,759   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_ssw.yaml'
2025-08-31T08:28:45,760   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_swa.yaml'
2025-08-31T08:28:45,761   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_taq.yaml'
2025-08-31T08:28:45,762   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_tir.yaml'
2025-08-31T08:28:45,763   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_tso.yaml'
2025-08-31T08:28:45,765   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_tum.yaml'
2025-08-31T08:28:45,766   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_twi.yaml'
2025-08-31T08:28:45,767   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_tzm.yaml'
2025-08-31T08:28:45,768   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_umb.yaml'
2025-08-31T08:28:45,769   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_wol.yaml'
2025-08-31T08:28:45,770   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_xho.yaml'
2025-08-31T08:28:45,771   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_yor.yaml'
2025-08-31T08:28:45,773   adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_zul.yaml'
2025-08-31T08:28:45,774   adding 'lm_eval/tasks/afrobench/sib/prompt_5/utils.py'
2025-08-31T08:28:45,775   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/README.md'
2025-08-31T08:28:45,777   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/uhura.yaml'
2025-08-31T08:28:45,778   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/utils.py'
2025-08-31T08:28:45,780   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy'
2025-08-31T08:28:45,784   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_am.yaml'
2025-08-31T08:28:45,785   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_en.yaml'
2025-08-31T08:28:45,786   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_ha.yaml'
2025-08-31T08:28:45,787   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_nso.yaml'
2025-08-31T08:28:45,789   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_sw.yaml'
2025-08-31T08:28:45,790   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_yo.yaml'
2025-08-31T08:28:45,791   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_zu.yaml'
2025-08-31T08:28:45,792   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/utils.py'
2025-08-31T08:28:45,794   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy'
2025-08-31T08:28:45,795   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_am.yaml'
2025-08-31T08:28:45,796   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_en.yaml'
2025-08-31T08:28:45,797   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_ha.yaml'
2025-08-31T08:28:45,799   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_nso.yaml'
2025-08-31T08:28:45,800   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_sw.yaml'
2025-08-31T08:28:45,801   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_yo.yaml'
2025-08-31T08:28:45,802   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_zu.yaml'
2025-08-31T08:28:45,804   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/utils.py'
2025-08-31T08:28:45,805   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy'
2025-08-31T08:28:45,807   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_am.yaml'
2025-08-31T08:28:45,808   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_en.yaml'
2025-08-31T08:28:45,809   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_ha.yaml'
2025-08-31T08:28:45,810   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_nso.yaml'
2025-08-31T08:28:45,811   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_sw.yaml'
2025-08-31T08:28:45,812   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_yo.yaml'
2025-08-31T08:28:45,814   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_zu.yaml'
2025-08-31T08:28:45,815   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/utils.py'
2025-08-31T08:28:45,817   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy'
2025-08-31T08:28:45,818   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_am.yaml'
2025-08-31T08:28:45,819   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_en.yaml'
2025-08-31T08:28:45,820   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_ha.yaml'
2025-08-31T08:28:45,821   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_nso.yaml'
2025-08-31T08:28:45,822   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_sw.yaml'
2025-08-31T08:28:45,823   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_yo.yaml'
2025-08-31T08:28:45,824   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_zu.yaml'
2025-08-31T08:28:45,825   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/utils.py'
2025-08-31T08:28:45,827   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy'
2025-08-31T08:28:45,828   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_am.yaml'
2025-08-31T08:28:45,829   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_en.yaml'
2025-08-31T08:28:45,830   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_ha.yaml'
2025-08-31T08:28:45,831   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_nso.yaml'
2025-08-31T08:28:45,832   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_sw.yaml'
2025-08-31T08:28:45,833   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_yo.yaml'
2025-08-31T08:28:45,835   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_zu.yaml'
2025-08-31T08:28:45,836   adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/utils.py'
2025-08-31T08:28:45,838   adding 'lm_eval/tasks/afrobench/xlsum/README.md'
2025-08-31T08:28:45,839   adding 'lm_eval/tasks/afrobench/xlsum/utils.py'
2025-08-31T08:28:45,840   adding 'lm_eval/tasks/afrobench/xlsum/xlsum.yaml'
2025-08-31T08:28:45,842   adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/utils.py'
2025-08-31T08:28:45,843   adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum'
2025-08-31T08:28:45,844   adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_amharic.yaml'
2025-08-31T08:28:45,845   adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_arabic.yaml'
2025-08-31T08:28:45,847   adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_hausa.yaml'
2025-08-31T08:28:45,848   adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_igbo.yaml'
2025-08-31T08:28:45,849   adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_kirundi.yaml'
2025-08-31T08:28:45,850   adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_oromo.yaml'
2025-08-31T08:28:45,851   adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_pidgin.yaml'
2025-08-31T08:28:45,852   adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_somali.yaml'
2025-08-31T08:28:45,853   adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_swahili.yaml'
2025-08-31T08:28:45,855   adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_telugu.yaml'
2025-08-31T08:28:45,856   adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_tigrinya.yaml'
2025-08-31T08:28:45,857   adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_yoruba.yaml'
2025-08-31T08:28:45,859   adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/utils.py'
2025-08-31T08:28:45,860   adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum'
2025-08-31T08:28:45,861   adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_amharic.yaml'
2025-08-31T08:28:45,862   adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_arabic.yaml'
2025-08-31T08:28:45,863   adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_hausa.yaml'
2025-08-31T08:28:45,864   adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_igbo.yaml'
2025-08-31T08:28:45,866   adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_kirundi.yaml'
2025-08-31T08:28:45,867   adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_oromo.yaml'
2025-08-31T08:28:45,868   adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_pidgin.yaml'
2025-08-31T08:28:45,869   adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_somali.yaml'
2025-08-31T08:28:45,870   adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_swahili.yaml'
2025-08-31T08:28:45,871   adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_telugu.yaml'
2025-08-31T08:28:45,872   adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_tigrinya.yaml'
2025-08-31T08:28:45,873   adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_yoruba.yaml'
2025-08-31T08:28:45,875   adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/utils.py'
2025-08-31T08:28:45,876   adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum'
2025-08-31T08:28:45,877   adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_amharic.yaml'
2025-08-31T08:28:45,878   adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_arabic.yaml'
2025-08-31T08:28:45,879   adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_hausa.yaml'
2025-08-31T08:28:45,880   adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_igbo.yaml'
2025-08-31T08:28:45,881   adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_kirundi.yaml'
2025-08-31T08:28:45,882   adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_oromo.yaml'
2025-08-31T08:28:45,883   adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_pidgin.yaml'
2025-08-31T08:28:45,885   adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_somali.yaml'
2025-08-31T08:28:45,886   adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_swahili.yaml'
2025-08-31T08:28:45,887   adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_telugu.yaml'
2025-08-31T08:28:45,888   adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_tigrinya.yaml'
2025-08-31T08:28:45,889   adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_yoruba.yaml'
2025-08-31T08:28:45,892   adding 'lm_eval/tasks/agieval/README.md'
2025-08-31T08:28:45,893   adding 'lm_eval/tasks/agieval/agieval.yaml'
2025-08-31T08:28:45,894   adding 'lm_eval/tasks/agieval/agieval_cn.yaml'
2025-08-31T08:28:45,895   adding 'lm_eval/tasks/agieval/agieval_en.yaml'
2025-08-31T08:28:45,896   adding 'lm_eval/tasks/agieval/agieval_nous.yaml'
2025-08-31T08:28:45,898   adding 'lm_eval/tasks/agieval/aqua-rat.yaml'
2025-08-31T08:28:45,899   adding 'lm_eval/tasks/agieval/gaokao-biology.yaml'
2025-08-31T08:28:45,900   adding 'lm_eval/tasks/agieval/gaokao-chemistry.yaml'
2025-08-31T08:28:45,901   adding 'lm_eval/tasks/agieval/gaokao-chinese.yaml'
2025-08-31T08:28:45,902   adding 'lm_eval/tasks/agieval/gaokao-english.yaml'
2025-08-31T08:28:45,903   adding 'lm_eval/tasks/agieval/gaokao-geography.yaml'
2025-08-31T08:28:45,904   adding 'lm_eval/tasks/agieval/gaokao-history.yaml'
2025-08-31T08:28:45,905   adding 'lm_eval/tasks/agieval/gaokao-mathcloze.yaml'
2025-08-31T08:28:45,907   adding 'lm_eval/tasks/agieval/gaokao-mathqa.yaml'
2025-08-31T08:28:45,908   adding 'lm_eval/tasks/agieval/gaokao-physics.yaml'
2025-08-31T08:28:45,909   adding 'lm_eval/tasks/agieval/jec-qa-ca.yaml'
2025-08-31T08:28:45,910   adding 'lm_eval/tasks/agieval/jec-qa-kd.yaml'
2025-08-31T08:28:45,911   adding 'lm_eval/tasks/agieval/logiqa-en.yaml'
2025-08-31T08:28:45,912   adding 'lm_eval/tasks/agieval/logiqa-zh.yaml'
2025-08-31T08:28:45,913   adding 'lm_eval/tasks/agieval/lsat-ar.yaml'
2025-08-31T08:28:45,914   adding 'lm_eval/tasks/agieval/lsat-lr.yaml'
2025-08-31T08:28:45,915   adding 'lm_eval/tasks/agieval/lsat-rc.yaml'
2025-08-31T08:28:45,917   adding 'lm_eval/tasks/agieval/math.yaml'
2025-08-31T08:28:45,918   adding 'lm_eval/tasks/agieval/sat-en-without-passage.yaml'
2025-08-31T08:28:45,919   adding 'lm_eval/tasks/agieval/sat-en.yaml'
2025-08-31T08:28:45,920   adding 'lm_eval/tasks/agieval/sat-math.yaml'
2025-08-31T08:28:45,922   adding 'lm_eval/tasks/agieval/utils.py'
2025-08-31T08:28:45,924   adding 'lm_eval/tasks/alghafa/copa_ar/README.md'
2025-08-31T08:28:45,925   adding 'lm_eval/tasks/alghafa/copa_ar/copa_ar.yaml'
2025-08-31T08:28:45,927   adding 'lm_eval/tasks/alghafa/piqa_ar/README.md'
2025-08-31T08:28:45,928   adding 'lm_eval/tasks/alghafa/piqa_ar/piqa_ar.yaml'
2025-08-31T08:28:45,930   adding 'lm_eval/tasks/anli/README.md'
2025-08-31T08:28:45,931   adding 'lm_eval/tasks/anli/anli_r1.yaml'
2025-08-31T08:28:45,932   adding 'lm_eval/tasks/anli/anli_r2.yaml'
2025-08-31T08:28:45,933   adding 'lm_eval/tasks/anli/anli_r3.yaml'
2025-08-31T08:28:45,935   adding 'lm_eval/tasks/arab_culture/README.md'
2025-08-31T08:28:45,936   adding 'lm_eval/tasks/arab_culture/_arab_culture.yaml'
2025-08-31T08:28:45,937   adding 'lm_eval/tasks/arab_culture/_arab_culture_gulf.yaml'
2025-08-31T08:28:45,938   adding 'lm_eval/tasks/arab_culture/_arab_culture_levant.yaml'
2025-08-31T08:28:45,939   adding 'lm_eval/tasks/arab_culture/_arab_culture_nile_valley.yaml'
2025-08-31T08:28:45,940   adding 'lm_eval/tasks/arab_culture/_arab_culture_north_africa.yaml'
2025-08-31T08:28:45,941   adding 'lm_eval/tasks/arab_culture/_default_arab_culture_mcq_template_yaml'
2025-08-31T08:28:45,943   adding 'lm_eval/tasks/arab_culture/_generate_configs.py'
2025-08-31T08:28:45,944   adding 'lm_eval/tasks/arab_culture/arab_culture_algeria.yaml'
2025-08-31T08:28:45,945   adding 'lm_eval/tasks/arab_culture/arab_culture_egypt.yaml'
2025-08-31T08:28:45,946   adding 'lm_eval/tasks/arab_culture/arab_culture_jordan.yaml'
2025-08-31T08:28:45,947   adding 'lm_eval/tasks/arab_culture/arab_culture_ksa.yaml'
2025-08-31T08:28:45,948   adding 'lm_eval/tasks/arab_culture/arab_culture_lebanon.yaml'
2025-08-31T08:28:45,949   adding 'lm_eval/tasks/arab_culture/arab_culture_libya.yaml'
2025-08-31T08:28:45,950   adding 'lm_eval/tasks/arab_culture/arab_culture_morocco.yaml'
2025-08-31T08:28:45,951   adding 'lm_eval/tasks/arab_culture/arab_culture_palestine.yaml'
2025-08-31T08:28:45,952   adding 'lm_eval/tasks/arab_culture/arab_culture_sudan.yaml'
2025-08-31T08:28:45,953   adding 'lm_eval/tasks/arab_culture/arab_culture_syria.yaml'
2025-08-31T08:28:45,954   adding 'lm_eval/tasks/arab_culture/arab_culture_tunisia.yaml'
2025-08-31T08:28:45,956   adding 'lm_eval/tasks/arab_culture/arab_culture_uae.yaml'
2025-08-31T08:28:45,957   adding 'lm_eval/tasks/arab_culture/arab_culture_yemen.yaml'
2025-08-31T08:28:45,958   adding 'lm_eval/tasks/arab_culture/prompts.py'
2025-08-31T08:28:45,960   adding 'lm_eval/tasks/arab_culture/utils_mcq.py'
2025-08-31T08:28:45,962   adding 'lm_eval/tasks/arab_culture_completion/README.md'
2025-08-31T08:28:45,963   adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion.yaml'
2025-08-31T08:28:45,964   adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion_gulf.yaml'
2025-08-31T08:28:45,966   adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion_levant.yaml'
2025-08-31T08:28:45,967   adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion_nile_valley.yaml'
2025-08-31T08:28:45,968   adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion_north_africa.yaml'
2025-08-31T08:28:45,969   adding 'lm_eval/tasks/arab_culture_completion/_default_arab_culture_completion_template_yaml'
2025-08-31T08:28:45,970   adding 'lm_eval/tasks/arab_culture_completion/_generate_configs.py'
2025-08-31T08:28:45,971   adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_algeria.yaml'
2025-08-31T08:28:45,973   adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_egypt.yaml'
2025-08-31T08:28:45,974   adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_jordan.yaml'
2025-08-31T08:28:45,975   adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_ksa.yaml'
2025-08-31T08:28:45,976   adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_lebanon.yaml'
2025-08-31T08:28:45,977   adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_libya.yaml'
2025-08-31T08:28:45,978   adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_morocco.yaml'
2025-08-31T08:28:45,980   adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_palestine.yaml'
2025-08-31T08:28:45,981   adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_sudan.yaml'
2025-08-31T08:28:45,982   adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_syria.yaml'
2025-08-31T08:28:45,983   adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_tunisia.yaml'
2025-08-31T08:28:45,984   adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_uae.yaml'
2025-08-31T08:28:45,985   adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_yemen.yaml'
2025-08-31T08:28:45,987   adding 'lm_eval/tasks/arab_culture_completion/prompts.py'
2025-08-31T08:28:45,988   adding 'lm_eval/tasks/arab_culture_completion/utils_completion.py'
2025-08-31T08:28:45,991   adding 'lm_eval/tasks/arabic_leaderboard_complete/README.md'
2025-08-31T08:28:45,992   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_complete.yaml'
2025-08-31T08:28:45,994   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa.yaml'
2025-08-31T08:28:45,995   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_mcq_exams_test_ar.yaml'
2025-08-31T08:28:45,996   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_dialects.yaml'
2025-08-31T08:28:45,997   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_msa.yaml'
2025-08-31T08:28:45,998   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task.yaml'
2025-08-31T08:28:45,999   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task.yaml'
2025-08-31T08:28:46,000   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task.yaml'
2025-08-31T08:28:46,002   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task.yaml'
2025-08-31T08:28:46,003   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task.yaml'
2025-08-31T08:28:46,004   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_sentiment_task.yaml'
2025-08-31T08:28:46,005   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/utils.py'
2025-08-31T08:28:46,007   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_exams.yaml'
2025-08-31T08:28:46,008   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_leaderboard_arabic_exams.yaml'
2025-08-31T08:28:46,009   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/utils.py'
2025-08-31T08:28:46,012   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu.yaml'
2025-08-31T08:28:46,014   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_abstract_algebra.yaml'
2025-08-31T08:28:46,015   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_anatomy.yaml'
2025-08-31T08:28:46,016   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_astronomy.yaml'
2025-08-31T08:28:46,017   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_business_ethics.yaml'
2025-08-31T08:28:46,018   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_clinical_knowledge.yaml'
2025-08-31T08:28:46,020   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_biology.yaml'
2025-08-31T08:28:46,021   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_chemistry.yaml'
2025-08-31T08:28:46,022   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_computer_science.yaml'
2025-08-31T08:28:46,023   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_mathematics.yaml'
2025-08-31T08:28:46,024   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_medicine.yaml'
2025-08-31T08:28:46,025   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_physics.yaml'
2025-08-31T08:28:46,026   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_computer_security.yaml'
2025-08-31T08:28:46,027   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_conceptual_physics.yaml'
2025-08-31T08:28:46,029   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_econometrics.yaml'
2025-08-31T08:28:46,030   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_electrical_engineering.yaml'
2025-08-31T08:28:46,031   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_elementary_mathematics.yaml'
2025-08-31T08:28:46,032   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_formal_logic.yaml'
2025-08-31T08:28:46,033   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_global_facts.yaml'
2025-08-31T08:28:46,034   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_biology.yaml'
2025-08-31T08:28:46,035   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_chemistry.yaml'
2025-08-31T08:28:46,037   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_computer_science.yaml'
2025-08-31T08:28:46,038   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_european_history.yaml'
2025-08-31T08:28:46,039   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_geography.yaml'
2025-08-31T08:28:46,040   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics.yaml'
2025-08-31T08:28:46,041   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics.yaml'
2025-08-31T08:28:46,043   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_mathematics.yaml'
2025-08-31T08:28:46,044   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_microeconomics.yaml'
2025-08-31T08:28:46,045   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_physics.yaml'
2025-08-31T08:28:46,046   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_psychology.yaml'
2025-08-31T08:28:46,047   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_statistics.yaml'
2025-08-31T08:28:46,049   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_us_history.yaml'
2025-08-31T08:28:46,050   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_world_history.yaml'
2025-08-31T08:28:46,051   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_aging.yaml'
2025-08-31T08:28:46,052   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_sexuality.yaml'
2025-08-31T08:28:46,053   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_international_law.yaml'
2025-08-31T08:28:46,054   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_jurisprudence.yaml'
2025-08-31T08:28:46,055   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_logical_fallacies.yaml'
2025-08-31T08:28:46,056   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_machine_learning.yaml'
2025-08-31T08:28:46,058   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_management.yaml'
2025-08-31T08:28:46,059   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_marketing.yaml'
2025-08-31T08:28:46,060   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_medical_genetics.yaml'
2025-08-31T08:28:46,061   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_miscellaneous.yaml'
2025-08-31T08:28:46,062   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_disputes.yaml'
2025-08-31T08:28:46,063   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_scenarios.yaml'
2025-08-31T08:28:46,092   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_nutrition.yaml'
2025-08-31T08:28:46,093   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_philosophy.yaml'
2025-08-31T08:28:46,094   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_prehistory.yaml'
2025-08-31T08:28:46,095   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_accounting.yaml'
2025-08-31T08:28:46,096   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_law.yaml'
2025-08-31T08:28:46,098   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_medicine.yaml'
2025-08-31T08:28:46,099   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_psychology.yaml'
2025-08-31T08:28:46,100   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_public_relations.yaml'
2025-08-31T08:28:46,101   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_security_studies.yaml'
2025-08-31T08:28:46,102   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_sociology.yaml'
2025-08-31T08:28:46,104   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_us_foreign_policy.yaml'
2025-08-31T08:28:46,105   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_virology.yaml'
2025-08-31T08:28:46,106   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_world_religions.yaml'
2025-08-31T08:28:46,107   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/utils.py'
2025-08-31T08:28:46,109   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_leaderboard_arabic_mt_arc_challenge.yaml'
2025-08-31T08:28:46,110   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_mt_arc_challenge.yaml'
2025-08-31T08:28:46,111   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/utils.py'
2025-08-31T08:28:46,113   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_leaderboard_arabic_mt_arc_easy.yaml'
2025-08-31T08:28:46,114   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_mt_arc_easy.yaml'
2025-08-31T08:28:46,115   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/utils.py'
2025-08-31T08:28:46,116   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_leaderboard_arabic_mt_boolq.yaml'
2025-08-31T08:28:46,118   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_mt_boolq.yaml'
2025-08-31T08:28:46,119   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/utils.py'
2025-08-31T08:28:46,120   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_leaderboard_arabic_mt_copa.yaml'
2025-08-31T08:28:46,121   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_mt_copa.yaml'
2025-08-31T08:28:46,123   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/utils.py'
2025-08-31T08:28:46,124   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_leaderboard_arabic_mt_hellaswag.yaml'
2025-08-31T08:28:46,125   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_mt_hellaswag.yaml'
2025-08-31T08:28:46,127   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/utils.py'
2025-08-31T08:28:46,128   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_leaderboard_arabic_mt_mmlu.yaml'
2025-08-31T08:28:46,130   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_mt_mmlu.yaml'
2025-08-31T08:28:46,131   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/utils.py'
2025-08-31T08:28:46,132   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_leaderboard_arabic_mt_openbook_qa.yaml'
2025-08-31T08:28:46,133   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_mt_openbook_qa.yaml'
2025-08-31T08:28:46,135   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/utils.py'
2025-08-31T08:28:46,136   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_leaderboard_arabic_mt_piqa.yaml'
2025-08-31T08:28:46,138   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_mt_piqa.yaml'
2025-08-31T08:28:46,139   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/utils.py'
2025-08-31T08:28:46,141   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_leaderboard_arabic_mt_race.yaml'
2025-08-31T08:28:46,142   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_mt_race.yaml'
2025-08-31T08:28:46,143   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/utils.py'
2025-08-31T08:28:46,145   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_leaderboard_arabic_mt_sciq.yaml'
2025-08-31T08:28:46,146   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_mt_sciq.yaml'
2025-08-31T08:28:46,147   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/utils.py'
2025-08-31T08:28:46,149   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_leaderboard_arabic_mt_toxigen.yaml'
2025-08-31T08:28:46,150   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_mt_toxigen.yaml'
2025-08-31T08:28:46,151   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/utils.py'
2025-08-31T08:28:46,154   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva.yaml'
2025-08-31T08:28:46,155   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Algeria.yaml'
2025-08-31T08:28:46,156   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Ancient_Egypt.yaml'
2025-08-31T08:28:46,157   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arab_Empire.yaml'
2025-08-31T08:28:46,158   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Architecture.yaml'
2025-08-31T08:28:46,160   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Art.yaml'
2025-08-31T08:28:46,161   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Astronomy.yaml'
2025-08-31T08:28:46,162   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Calligraphy.yaml'
2025-08-31T08:28:46,163   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ceremony.yaml'
2025-08-31T08:28:46,164   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Clothing.yaml'
2025-08-31T08:28:46,166   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Culture.yaml'
2025-08-31T08:28:46,167   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Food.yaml'
2025-08-31T08:28:46,168   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Funeral.yaml'
2025-08-31T08:28:46,169   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Geography.yaml'
2025-08-31T08:28:46,171   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_History.yaml'
2025-08-31T08:28:46,172   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Language_Origin.yaml'
2025-08-31T08:28:46,173   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Literature.yaml'
2025-08-31T08:28:46,174   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Math.yaml'
2025-08-31T08:28:46,176   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Medicine.yaml'
2025-08-31T08:28:46,177   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Music.yaml'
2025-08-31T08:28:46,178   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ornament.yaml'
2025-08-31T08:28:46,180   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Philosophy.yaml'
2025-08-31T08:28:46,181   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry.yaml'
2025-08-31T08:28:46,182   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Wedding.yaml'
2025-08-31T08:28:46,184   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Bahrain.yaml'
2025-08-31T08:28:46,186   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Comoros.yaml'
2025-08-31T08:28:46,187   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Egypt_modern.yaml'
2025-08-31T08:28:46,189   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromAncientEgypt.yaml'
2025-08-31T08:28:46,190   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromByzantium.yaml'
2025-08-31T08:28:46,192   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromChina.yaml'
2025-08-31T08:28:46,193   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromGreece.yaml'
2025-08-31T08:28:46,195   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromIslam.yaml'
2025-08-31T08:28:46,197   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromPersia.yaml'
2025-08-31T08:28:46,198   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromRome.yaml'
2025-08-31T08:28:46,199   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Iraq.yaml'
2025-08-31T08:28:46,201   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_Education.yaml'
2025-08-31T08:28:46,202   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_branches_and_schools.yaml'
2025-08-31T08:28:46,203   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islamic_law_system.yaml'
2025-08-31T08:28:46,204   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Jordan.yaml'
2025-08-31T08:28:46,205   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Kuwait.yaml'
2025-08-31T08:28:46,207   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Lebanon.yaml'
2025-08-31T08:28:46,208   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Libya.yaml'
2025-08-31T08:28:46,209   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mauritania.yaml'
2025-08-31T08:28:46,210   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mesopotamia_civilization.yaml'
2025-08-31T08:28:46,212   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Morocco.yaml'
2025-08-31T08:28:46,213   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Oman.yaml'
2025-08-31T08:28:46,214   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Palestine.yaml'
2025-08-31T08:28:46,215   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Qatar.yaml'
2025-08-31T08:28:46,217   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Saudi_Arabia.yaml'
2025-08-31T08:28:46,218   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Somalia.yaml'
2025-08-31T08:28:46,219   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Sudan.yaml'
2025-08-31T08:28:46,220   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Syria.yaml'
2025-08-31T08:28:46,221   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Tunisia.yaml'
2025-08-31T08:28:46,223   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_United_Arab_Emirates.yaml'
2025-08-31T08:28:46,224   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Yemen.yaml'
2025-08-31T08:28:46,225   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_communication.yaml'
2025-08-31T08:28:46,226   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_computer_and_phone.yaml'
2025-08-31T08:28:46,227   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_daily_life.yaml'
2025-08-31T08:28:46,228   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_entertainment.yaml'
2025-08-31T08:28:46,229   adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/utils.py'
2025-08-31T08:28:46,231   adding 'lm_eval/tasks/arabic_leaderboard_light/README.md'
2025-08-31T08:28:46,232   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_light.yaml'
2025-08-31T08:28:46,234   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_light.yaml'
2025-08-31T08:28:46,235   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_mcq_exams_test_ar_light.yaml'
2025-08-31T08:28:46,236   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_dialects_light.yaml'
2025-08-31T08:28:46,237   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_msa_light.yaml'
2025-08-31T08:28:46,239   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task_light.yaml'
2025-08-31T08:28:46,240   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task_light.yaml'
2025-08-31T08:28:46,241   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task_light.yaml'
2025-08-31T08:28:46,242   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task_light.yaml'
2025-08-31T08:28:46,244   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task_light.yaml'
2025-08-31T08:28:46,245   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_sentiment_task_light.yaml'
2025-08-31T08:28:46,246   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/utils.py'
2025-08-31T08:28:46,248   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_exams_light.yaml'
2025-08-31T08:28:46,249   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_leaderboard_arabic_exams_light.yaml'
2025-08-31T08:28:46,250   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/utils.py'
2025-08-31T08:28:46,253   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_abstract_algebra_light.yaml'
2025-08-31T08:28:46,254   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_anatomy_light.yaml'
2025-08-31T08:28:46,256   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_astronomy_light.yaml'
2025-08-31T08:28:46,257   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_business_ethics_light.yaml'
2025-08-31T08:28:46,258   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_clinical_knowledge_light.yaml'
2025-08-31T08:28:46,259   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_biology_light.yaml'
2025-08-31T08:28:46,261   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_chemistry_light.yaml'
2025-08-31T08:28:46,262   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_computer_science_light.yaml'
2025-08-31T08:28:46,263   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_mathematics_light.yaml'
2025-08-31T08:28:46,264   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_medicine_light.yaml'
2025-08-31T08:28:46,265   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_physics_light.yaml'
2025-08-31T08:28:46,266   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_computer_security_light.yaml'
2025-08-31T08:28:46,267   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_conceptual_physics_light.yaml'
2025-08-31T08:28:46,268   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_econometrics_light.yaml'
2025-08-31T08:28:46,270   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_electrical_engineering_light.yaml'
2025-08-31T08:28:46,271   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_elementary_mathematics_light.yaml'
2025-08-31T08:28:46,272   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_formal_logic_light.yaml'
2025-08-31T08:28:46,273   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_global_facts_light.yaml'
2025-08-31T08:28:46,274   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_biology_light.yaml'
2025-08-31T08:28:46,276   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_chemistry_light.yaml'
2025-08-31T08:28:46,277   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_computer_science_light.yaml'
2025-08-31T08:28:46,278   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_european_history_light.yaml'
2025-08-31T08:28:46,279   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_geography_light.yaml'
2025-08-31T08:28:46,280   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics_light.yaml'
2025-08-31T08:28:46,282   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics_light.yaml'
2025-08-31T08:28:46,283   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_mathematics_light.yaml'
2025-08-31T08:28:46,284   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_microeconomics_light.yaml'
2025-08-31T08:28:46,285   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_physics_light.yaml'
2025-08-31T08:28:46,287   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_psychology_light.yaml'
2025-08-31T08:28:46,288   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_statistics_light.yaml'
2025-08-31T08:28:46,289   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_us_history_light.yaml'
2025-08-31T08:28:46,290   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_world_history_light.yaml'
2025-08-31T08:28:46,291   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_aging_light.yaml'
2025-08-31T08:28:46,292   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_sexuality_light.yaml'
2025-08-31T08:28:46,293   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_international_law_light.yaml'
2025-08-31T08:28:46,294   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_jurisprudence_light.yaml'
2025-08-31T08:28:46,296   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_light.yaml'
2025-08-31T08:28:46,297   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_logical_fallacies_light.yaml'
2025-08-31T08:28:46,298   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_machine_learning_light.yaml'
2025-08-31T08:28:46,299   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_management_light.yaml'
2025-08-31T08:28:46,300   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_marketing_light.yaml'
2025-08-31T08:28:46,301   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_medical_genetics_light.yaml'
2025-08-31T08:28:46,303   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_miscellaneous_light.yaml'
2025-08-31T08:28:46,304   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_disputes_light.yaml'
2025-08-31T08:28:46,305   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_scenarios_light.yaml'
2025-08-31T08:28:46,306   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_nutrition_light.yaml'
2025-08-31T08:28:46,307   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_philosophy_light.yaml'
2025-08-31T08:28:46,309   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_prehistory_light.yaml'
2025-08-31T08:28:46,310   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_accounting_light.yaml'
2025-08-31T08:28:46,311   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_law_light.yaml'
2025-08-31T08:28:46,312   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_medicine_light.yaml'
2025-08-31T08:28:46,313   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_psychology_light.yaml'
2025-08-31T08:28:46,315   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_public_relations_light.yaml'
2025-08-31T08:28:46,316   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_security_studies_light.yaml'
2025-08-31T08:28:46,317   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_sociology_light.yaml'
2025-08-31T08:28:46,318   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_us_foreign_policy_light.yaml'
2025-08-31T08:28:46,319   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_virology_light.yaml'
2025-08-31T08:28:46,320   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_world_religions_light.yaml'
2025-08-31T08:28:46,321   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/utils.py'
2025-08-31T08:28:46,323   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_leaderboard_arabic_mt_arc_challenge_light.yaml'
2025-08-31T08:28:46,324   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_mt_arc_challenge_light.yaml'
2025-08-31T08:28:46,325   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/utils.py'
2025-08-31T08:28:46,327   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_leaderboard_arabic_mt_arc_easy_light.yaml'
2025-08-31T08:28:46,328   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_mt_arc_easy_light.yaml'
2025-08-31T08:28:46,329   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/utils.py'
2025-08-31T08:28:46,331   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_leaderboard_arabic_mt_boolq_light.yaml'
2025-08-31T08:28:46,332   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_mt_boolq_light.yaml'
2025-08-31T08:28:46,333   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/utils.py'
2025-08-31T08:28:46,335   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arabic_mt_copa_light.yaml'
2025-08-31T08:28:46,336   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arbic_leaderboard_arabic_mt_copa_light.yaml'
2025-08-31T08:28:46,337   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/utils.py'
2025-08-31T08:28:46,339   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_leaderboard_arabic_mt_hellaswag_light.yaml'
2025-08-31T08:28:46,340   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_mt_hellaswag_light.yaml'
2025-08-31T08:28:46,341   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/utils.py'
2025-08-31T08:28:46,343   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_leaderboard_arabic_mt_mmlu_light.yaml'
2025-08-31T08:28:46,344   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_mt_mmlu_light.yaml'
2025-08-31T08:28:46,345   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/utils.py'
2025-08-31T08:28:46,347   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_leaderboard_arabic_mt_openbook_qa_light.yaml'
2025-08-31T08:28:46,348   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_mt_openbook_qa_light.yaml'
2025-08-31T08:28:46,350   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/utils.py'
2025-08-31T08:28:46,351   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_leaderboard_arabic_mt_piqa_light.yaml'
2025-08-31T08:28:46,352   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_mt_piqa_light.yaml'
2025-08-31T08:28:46,353   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/utils.py'
2025-08-31T08:28:46,355   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_leaderboard_arabic_mt_race_light.yaml'
2025-08-31T08:28:46,356   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_mt_race_light.yaml'
2025-08-31T08:28:46,357   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/utils.py'
2025-08-31T08:28:46,359   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_leaderboard_arabic_mt_sciq_light.yaml'
2025-08-31T08:28:46,360   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_mt_sciq_light.yaml'
2025-08-31T08:28:46,361   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/utils.py'
2025-08-31T08:28:46,362   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_leaderboard_arabic_mt_toxigen_light.yaml'
2025-08-31T08:28:46,364   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_mt_toxigen_light.yaml'
2025-08-31T08:28:46,365   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/utils.py'
2025-08-31T08:28:46,368   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Algeria_light.yaml'
2025-08-31T08:28:46,369   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Ancient_Egypt_light.yaml'
2025-08-31T08:28:46,370   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arab_Empire_light.yaml'
2025-08-31T08:28:46,372   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Architecture_light.yaml'
2025-08-31T08:28:46,373   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Art_light.yaml'
2025-08-31T08:28:46,374   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Astronomy_light.yaml'
2025-08-31T08:28:46,375   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Calligraphy_light.yaml'
2025-08-31T08:28:46,376   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ceremony_light.yaml'
2025-08-31T08:28:46,378   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Clothing_light.yaml'
2025-08-31T08:28:46,379   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Culture_light.yaml'
2025-08-31T08:28:46,380   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Food_light.yaml'
2025-08-31T08:28:46,381   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Funeral_light.yaml'
2025-08-31T08:28:46,383   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Geography_light.yaml'
2025-08-31T08:28:46,384   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_History_light.yaml'
2025-08-31T08:28:46,385   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Language_Origin_light.yaml'
2025-08-31T08:28:46,386   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Literature_light.yaml'
2025-08-31T08:28:46,387   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Math_light.yaml'
2025-08-31T08:28:46,389   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Medicine_light.yaml'
2025-08-31T08:28:46,390   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Music_light.yaml'
2025-08-31T08:28:46,391   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ornament_light.yaml'
2025-08-31T08:28:46,392   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Philosophy_light.yaml'
2025-08-31T08:28:46,393   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry_light.yaml'
2025-08-31T08:28:46,394   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Wedding_light.yaml'
2025-08-31T08:28:46,395   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Bahrain_light.yaml'
2025-08-31T08:28:46,396   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Comoros_light.yaml'
2025-08-31T08:28:46,397   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Egypt_modern_light.yaml'
2025-08-31T08:28:46,399   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromAncientEgypt_light.yaml'
2025-08-31T08:28:46,400   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromByzantium_light.yaml'
2025-08-31T08:28:46,401   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromChina_light.yaml'
2025-08-31T08:28:46,402   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromGreece_light.yaml'
2025-08-31T08:28:46,403   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromIslam_light.yaml'
2025-08-31T08:28:46,405   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromPersia_light.yaml'
2025-08-31T08:28:46,406   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromRome_light.yaml'
2025-08-31T08:28:46,407   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Iraq_light.yaml'
2025-08-31T08:28:46,408   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_Education_light.yaml'
2025-08-31T08:28:46,409   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_branches_and_schools_light.yaml'
2025-08-31T08:28:46,411   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islamic_law_system_light.yaml'
2025-08-31T08:28:46,412   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Jordan_light.yaml'
2025-08-31T08:28:46,413   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Kuwait_light.yaml'
2025-08-31T08:28:46,414   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Lebanon_light.yaml'
2025-08-31T08:28:46,415   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Libya_light.yaml'
2025-08-31T08:28:46,417   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mauritania_light.yaml'
2025-08-31T08:28:46,418   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mesopotamia_civilization_light.yaml'
2025-08-31T08:28:46,419   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Morocco_light.yaml'
2025-08-31T08:28:46,420   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Oman_light.yaml'
2025-08-31T08:28:46,421   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Palestine_light.yaml'
2025-08-31T08:28:46,422   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Qatar_light.yaml'
2025-08-31T08:28:46,423   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Saudi_Arabia_light.yaml'
2025-08-31T08:28:46,424   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Somalia_light.yaml'
2025-08-31T08:28:46,425   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Sudan_light.yaml'
2025-08-31T08:28:46,426   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Syria_light.yaml'
2025-08-31T08:28:46,428   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Tunisia_light.yaml'
2025-08-31T08:28:46,429   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_United_Arab_Emirates_light.yaml'
2025-08-31T08:28:46,430   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Yemen_light.yaml'
2025-08-31T08:28:46,431   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_communication_light.yaml'
2025-08-31T08:28:46,432   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_computer_and_phone_light.yaml'
2025-08-31T08:28:46,433   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_daily_life_light.yaml'
2025-08-31T08:28:46,435   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_entertainment_light.yaml'
2025-08-31T08:28:46,436   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_light.yaml'
2025-08-31T08:28:46,437   adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/utils.py'
2025-08-31T08:28:46,440   adding 'lm_eval/tasks/arabicmmlu/README.md'
2025-08-31T08:28:46,441   adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu.yaml'
2025-08-31T08:28:46,442   adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_humanities.yaml'
2025-08-31T08:28:46,444   adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_language.yaml'
2025-08-31T08:28:46,445   adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_other.yaml'
2025-08-31T08:28:46,446   adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_social_science.yaml'
2025-08-31T08:28:46,447   adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_stem.yaml'
2025-08-31T08:28:46,448   adding 'lm_eval/tasks/arabicmmlu/_default_arabicmmlu_template_yaml'
2025-08-31T08:28:46,449   adding 'lm_eval/tasks/arabicmmlu/_generate_configs.py'
2025-08-31T08:28:46,451   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_accounting_university.yaml'
2025-08-31T08:28:46,452   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_general.yaml'
2025-08-31T08:28:46,453   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_grammar.yaml'
2025-08-31T08:28:46,454   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_high_school.yaml'
2025-08-31T08:28:46,455   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_middle_school.yaml'
2025-08-31T08:28:46,457   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_primary_school.yaml'
2025-08-31T08:28:46,458   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_biology_high_school.yaml'
2025-08-31T08:28:46,459   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_civics_high_school.yaml'
2025-08-31T08:28:46,460   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_civics_middle_school.yaml'
2025-08-31T08:28:46,461   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_high_school.yaml'
2025-08-31T08:28:46,462   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_middle_school.yaml'
2025-08-31T08:28:46,463   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_primary_school.yaml'
2025-08-31T08:28:46,464   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_university.yaml'
2025-08-31T08:28:46,465   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_driving_test.yaml'
2025-08-31T08:28:46,466   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_economics_high_school.yaml'
2025-08-31T08:28:46,467   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_economics_middle_school.yaml'
2025-08-31T08:28:46,468   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_economics_university.yaml'
2025-08-31T08:28:46,469   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge.yaml'
2025-08-31T08:28:46,470   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_middle_school.yaml'
2025-08-31T08:28:46,471   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_primary_school.yaml'
2025-08-31T08:28:46,472   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_geography_high_school.yaml'
2025-08-31T08:28:46,474   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_geography_middle_school.yaml'
2025-08-31T08:28:46,475   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_geography_primary_school.yaml'
2025-08-31T08:28:46,476   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_history_high_school.yaml'
2025-08-31T08:28:46,477   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_history_middle_school.yaml'
2025-08-31T08:28:46,478   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_history_primary_school.yaml'
2025-08-31T08:28:46,479   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies.yaml'
2025-08-31T08:28:46,480   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_high_school.yaml'
2025-08-31T08:28:46,481   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_middle_school.yaml'
2025-08-31T08:28:46,483   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_primary_school.yaml'
2025-08-31T08:28:46,484   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_law_professional.yaml'
2025-08-31T08:28:46,485   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_management_university.yaml'
2025-08-31T08:28:46,486   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_math_primary_school.yaml'
2025-08-31T08:28:46,487   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_middle_school.yaml'
2025-08-31T08:28:46,488   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_primary_school.yaml'
2025-08-31T08:28:46,489   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_philosophy_high_school.yaml'
2025-08-31T08:28:46,490   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_physics_high_school.yaml'
2025-08-31T08:28:46,492   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_political_science_university.yaml'
2025-08-31T08:28:46,493   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_middle_school.yaml'
2025-08-31T08:28:46,494   adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_primary_school.yaml'
2025-08-31T08:28:46,495   adding 'lm_eval/tasks/arabicmmlu/utils.py'
2025-08-31T08:28:46,497   adding 'lm_eval/tasks/aradice/README.md'
2025-08-31T08:28:46,498   adding 'lm_eval/tasks/aradice/aradice.yaml'
2025-08-31T08:28:46,501   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU.yaml'
2025-08-31T08:28:46,503   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_history.yaml'
2025-08-31T08:28:46,504   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml'
2025-08-31T08:28:46,505   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml'
2025-08-31T08:28:46,506   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml'
2025-08-31T08:28:46,507   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_civics.yaml'
2025-08-31T08:28:46,508   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_economics.yaml'
2025-08-31T08:28:46,509   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_geography.yaml'
2025-08-31T08:28:46,510   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_biology.yaml'
2025-08-31T08:28:46,511   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml'
2025-08-31T08:28:46,513   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_physics.yaml'
2025-08-31T08:28:46,514   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_history.yaml'
2025-08-31T08:28:46,515   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml'
2025-08-31T08:28:46,516   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml'
2025-08-31T08:28:46,517   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml'
2025-08-31T08:28:46,518   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml'
2025-08-31T08:28:46,519   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml'
2025-08-31T08:28:46,521   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml'
2025-08-31T08:28:46,522   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml'
2025-08-31T08:28:46,523   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml'
2025-08-31T08:28:46,524   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml'
2025-08-31T08:28:46,525   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml'
2025-08-31T08:28:46,526   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml'
2025-08-31T08:28:46,527   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml'
2025-08-31T08:28:46,528   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_driving-test.yaml'
2025-08-31T08:28:46,530   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml'
2025-08-31T08:28:46,531   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_history.yaml'
2025-08-31T08:28:46,532   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml'
2025-08-31T08:28:46,533   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml'
2025-08-31T08:28:46,534   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml'
2025-08-31T08:28:46,536   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml'
2025-08-31T08:28:46,537   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml'
2025-08-31T08:28:46,538   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml'
2025-08-31T08:28:46,539   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_math.yaml'
2025-08-31T08:28:46,540   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml'
2025-08-31T08:28:46,541   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_prof_humanities_law.yaml'
2025-08-31T08:28:46,543   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_other_management.yaml'
2025-08-31T08:28:46,544   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml'
2025-08-31T08:28:46,545   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml'
2025-08-31T08:28:46,546   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml'
2025-08-31T08:28:46,547   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml'
2025-08-31T08:28:46,548   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/_default_template_yaml'
2025-08-31T08:28:46,549   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/metrics.py'
2025-08-31T08:28:46,550   adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/utils.py'
2025-08-31T08:28:46,553   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU.yaml'
2025-08-31T08:28:46,554   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_history.yaml'
2025-08-31T08:28:46,555   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml'
2025-08-31T08:28:46,556   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml'
2025-08-31T08:28:46,557   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml'
2025-08-31T08:28:46,558   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_civics.yaml'
2025-08-31T08:28:46,560   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_economics.yaml'
2025-08-31T08:28:46,561   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_geography.yaml'
2025-08-31T08:28:46,562   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_biology.yaml'
2025-08-31T08:28:46,563   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml'
2025-08-31T08:28:46,564   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_physics.yaml'
2025-08-31T08:28:46,565   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_history.yaml'
2025-08-31T08:28:46,567   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml'
2025-08-31T08:28:46,568   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml'
2025-08-31T08:28:46,569   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml'
2025-08-31T08:28:46,570   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml'
2025-08-31T08:28:46,571   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml'
2025-08-31T08:28:46,572   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml'
2025-08-31T08:28:46,574   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml'
2025-08-31T08:28:46,575   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml'
2025-08-31T08:28:46,576   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml'
2025-08-31T08:28:46,577   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml'
2025-08-31T08:28:46,578   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml'
2025-08-31T08:28:46,579   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml'
2025-08-31T08:28:46,581   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_driving-test.yaml'
2025-08-31T08:28:46,582   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml'
2025-08-31T08:28:46,583   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_history.yaml'
2025-08-31T08:28:46,584   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml'
2025-08-31T08:28:46,585   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml'
2025-08-31T08:28:46,586   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml'
2025-08-31T08:28:46,587   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml'
2025-08-31T08:28:46,588   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml'
2025-08-31T08:28:46,589   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml'
2025-08-31T08:28:46,590   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_math.yaml'
2025-08-31T08:28:46,592   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml'
2025-08-31T08:28:46,593   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_prof_humanities_law.yaml'
2025-08-31T08:28:46,594   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_other_management.yaml'
2025-08-31T08:28:46,595   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml'
2025-08-31T08:28:46,596   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml'
2025-08-31T08:28:46,597   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml'
2025-08-31T08:28:46,598   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml'
2025-08-31T08:28:46,599   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/_default_template_yaml'
2025-08-31T08:28:46,600   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/metrics.py'
2025-08-31T08:28:46,602   adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/utils.py'
2025-08-31T08:28:46,604   adding 'lm_eval/tasks/aradice/boolq/EGY/boolq_egy.yaml'
2025-08-31T08:28:46,606   adding 'lm_eval/tasks/aradice/boolq/EGY/metrics.py'
2025-08-31T08:28:46,607   adding 'lm_eval/tasks/aradice/boolq/EGY/utils.py'
2025-08-31T08:28:46,609   adding 'lm_eval/tasks/aradice/boolq/ENG/boolq_eng.yaml'
2025-08-31T08:28:46,610   adding 'lm_eval/tasks/aradice/boolq/ENG/metrics.py'
2025-08-31T08:28:46,611   adding 'lm_eval/tasks/aradice/boolq/ENG/utils.py'
2025-08-31T08:28:46,613   adding 'lm_eval/tasks/aradice/boolq/LEV/boolq_lev.yaml'
2025-08-31T08:28:46,614   adding 'lm_eval/tasks/aradice/boolq/LEV/metrics.py'
2025-08-31T08:28:46,615   adding 'lm_eval/tasks/aradice/boolq/LEV/utils.py'
2025-08-31T08:28:46,617   adding 'lm_eval/tasks/aradice/boolq/MSA/boolq_msa.yaml'
2025-08-31T08:28:46,618   adding 'lm_eval/tasks/aradice/boolq/MSA/metrics.py'
2025-08-31T08:28:46,619   adding 'lm_eval/tasks/aradice/boolq/MSA/utils.py'
2025-08-31T08:28:46,621   adding 'lm_eval/tasks/aradice/cultural-benchmark/egypt.yaml'
2025-08-31T08:28:46,622   adding 'lm_eval/tasks/aradice/cultural-benchmark/jordan.yaml'
2025-08-31T08:28:46,623   adding 'lm_eval/tasks/aradice/cultural-benchmark/lebanon.yaml'
2025-08-31T08:28:46,625   adding 'lm_eval/tasks/aradice/cultural-benchmark/metrics.py'
2025-08-31T08:28:46,626   adding 'lm_eval/tasks/aradice/cultural-benchmark/palestine.yaml'
2025-08-31T08:28:46,627   adding 'lm_eval/tasks/aradice/cultural-benchmark/qatar.yaml'
2025-08-31T08:28:46,628   adding 'lm_eval/tasks/aradice/cultural-benchmark/syria.yaml'
2025-08-31T08:28:46,629   adding 'lm_eval/tasks/aradice/cultural-benchmark/utils.py'
2025-08-31T08:28:46,631   adding 'lm_eval/tasks/aradice/openbookqa/metrics.py'
2025-08-31T08:28:46,632   adding 'lm_eval/tasks/aradice/openbookqa/openbookqa_egy.yaml'
2025-08-31T08:28:46,633   adding 'lm_eval/tasks/aradice/openbookqa/openbookqa_eng.yaml'
2025-08-31T08:28:46,635   adding 'lm_eval/tasks/aradice/openbookqa/openbookqa_lev.yaml'
2025-08-31T08:28:46,636   adding 'lm_eval/tasks/aradice/openbookqa/openbookqa_msa.yaml'
2025-08-31T08:28:46,637   adding 'lm_eval/tasks/aradice/openbookqa/utils.py'
2025-08-31T08:28:46,638   adding 'lm_eval/tasks/aradice/piqa/metrics.py'
2025-08-31T08:28:46,639   adding 'lm_eval/tasks/aradice/piqa/piqa_egy.yaml'
2025-08-31T08:28:46,640   adding 'lm_eval/tasks/aradice/piqa/piqa_eng.yaml'
2025-08-31T08:28:46,641   adding 'lm_eval/tasks/aradice/piqa/piqa_lev.yaml'
2025-08-31T08:28:46,642   adding 'lm_eval/tasks/aradice/piqa/piqa_msa.yaml'
2025-08-31T08:28:46,644   adding 'lm_eval/tasks/aradice/truthfulqa_mcq/metrics.py'
2025-08-31T08:28:46,645   adding 'lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_egy.yaml'
2025-08-31T08:28:46,647   adding 'lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_eng.yaml'
2025-08-31T08:28:46,648   adding 'lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_lev.yaml'
2025-08-31T08:28:46,649   adding 'lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_msa.yaml'
2025-08-31T08:28:46,651   adding 'lm_eval/tasks/aradice/winogrande/metrics.py'
2025-08-31T08:28:46,652   adding 'lm_eval/tasks/aradice/winogrande/utils.py'
2025-08-31T08:28:46,653   adding 'lm_eval/tasks/aradice/winogrande/winogrande_egy.yaml'
2025-08-31T08:28:46,654   adding 'lm_eval/tasks/aradice/winogrande/winogrande_eng.yaml'
2025-08-31T08:28:46,656   adding 'lm_eval/tasks/aradice/winogrande/winogrande_lev.yaml'
2025-08-31T08:28:46,657   adding 'lm_eval/tasks/aradice/winogrande/winogrande_msa.yaml'
2025-08-31T08:28:46,659   adding 'lm_eval/tasks/arc/README.md'
2025-08-31T08:28:46,660   adding 'lm_eval/tasks/arc/arc_challenge.yaml'
2025-08-31T08:28:46,661   adding 'lm_eval/tasks/arc/arc_challenge_chat.yaml'
2025-08-31T08:28:46,662   adding 'lm_eval/tasks/arc/arc_easy.yaml'
2025-08-31T08:28:46,664   adding 'lm_eval/tasks/arc_mt/README.md'
2025-08-31T08:28:46,666   adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_da.yaml'
2025-08-31T08:28:46,667   adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_de.yaml'
2025-08-31T08:28:46,668   adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_el.yaml'
2025-08-31T08:28:46,669   adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_es.yaml'
2025-08-31T08:28:46,670   adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_fi.yaml'
2025-08-31T08:28:46,671   adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_hu.yaml'
2025-08-31T08:28:46,673   adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_is.yaml'
2025-08-31T08:28:46,674   adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_it.yaml'
2025-08-31T08:28:46,675   adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_nb.yaml'
2025-08-31T08:28:46,676   adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_pl.yaml'
2025-08-31T08:28:46,677   adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_pt.yaml'
2025-08-31T08:28:46,679   adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_sv.yaml'
2025-08-31T08:28:46,681   adding 'lm_eval/tasks/arithmetic/README.md'
2025-08-31T08:28:46,682   adding 'lm_eval/tasks/arithmetic/arithmetic_1dc.yaml'
2025-08-31T08:28:46,683   adding 'lm_eval/tasks/arithmetic/arithmetic_2da.yaml'
2025-08-31T08:28:46,684   adding 'lm_eval/tasks/arithmetic/arithmetic_2dm.yaml'
2025-08-31T08:28:46,685   adding 'lm_eval/tasks/arithmetic/arithmetic_2ds.yaml'
2025-08-31T08:28:46,686   adding 'lm_eval/tasks/arithmetic/arithmetic_3da.yaml'
2025-08-31T08:28:46,687   adding 'lm_eval/tasks/arithmetic/arithmetic_3ds.yaml'
2025-08-31T08:28:46,689   adding 'lm_eval/tasks/arithmetic/arithmetic_4da.yaml'
2025-08-31T08:28:46,690   adding 'lm_eval/tasks/arithmetic/arithmetic_4ds.yaml'
2025-08-31T08:28:46,691   adding 'lm_eval/tasks/arithmetic/arithmetic_5da.yaml'
2025-08-31T08:28:46,692   adding 'lm_eval/tasks/arithmetic/arithmetic_5ds.yaml'
2025-08-31T08:28:46,694   adding 'lm_eval/tasks/asdiv/README.md'
2025-08-31T08:28:46,695   adding 'lm_eval/tasks/asdiv/asdiv-cot-llama.yaml'
2025-08-31T08:28:46,696   adding 'lm_eval/tasks/asdiv/default.yaml'
2025-08-31T08:28:46,698   adding 'lm_eval/tasks/babi/README.md'
2025-08-31T08:28:46,700   adding 'lm_eval/tasks/babi/babi.yaml'
2025-08-31T08:28:46,702   adding 'lm_eval/tasks/basque_bench/README.md'
2025-08-31T08:28:46,703   adding 'lm_eval/tasks/basque_bench/arc_eu_challenge.yaml'
2025-08-31T08:28:46,704   adding 'lm_eval/tasks/basque_bench/arc_eu_easy.yaml'
2025-08-31T08:28:46,705   adding 'lm_eval/tasks/basque_bench/basque_bench.yaml'
2025-08-31T08:28:46,706   adding 'lm_eval/tasks/basque_bench/mgsm_cot_native_eu.yaml'
2025-08-31T08:28:46,707   adding 'lm_eval/tasks/basque_bench/mgsm_direct_eu.yaml'
2025-08-31T08:28:46,708   adding 'lm_eval/tasks/basque_bench/paws_eu.yaml'
2025-08-31T08:28:46,709   adding 'lm_eval/tasks/basque_bench/piqa_eu.yaml'
2025-08-31T08:28:46,710   adding 'lm_eval/tasks/basque_bench/utils.py'
2025-08-31T08:28:46,711   adding 'lm_eval/tasks/basque_bench/wnli_eu.yaml'
2025-08-31T08:28:46,713   adding 'lm_eval/tasks/basque_bench/xcopa_eu.yaml'
2025-08-31T08:28:46,714   adding 'lm_eval/tasks/basque_bench/flores_eu/_flores_common_yaml'
2025-08-31T08:28:46,716   adding 'lm_eval/tasks/basque_bench/flores_eu/create_yamls_flores_eu.py'
2025-08-31T08:28:46,717   adding 'lm_eval/tasks/basque_bench/flores_eu/flores_ca-eu.yaml'
2025-08-31T08:28:46,718   adding 'lm_eval/tasks/basque_bench/flores_eu/flores_de-eu.yaml'
2025-08-31T08:28:46,719   adding 'lm_eval/tasks/basque_bench/flores_eu/flores_en-eu.yaml'
2025-08-31T08:28:46,720   adding 'lm_eval/tasks/basque_bench/flores_eu/flores_es-eu.yaml'
2025-08-31T08:28:46,721   adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-ca.yaml'
2025-08-31T08:28:46,722   adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-de.yaml'
2025-08-31T08:28:46,723   adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-en.yaml'
2025-08-31T08:28:46,724   adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-es.yaml'
2025-08-31T08:28:46,725   adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-fr.yaml'
2025-08-31T08:28:46,726   adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-gl.yaml'
2025-08-31T08:28:46,728   adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-it.yaml'
2025-08-31T08:28:46,729   adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-pt.yaml'
2025-08-31T08:28:46,730   adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu.yaml'
2025-08-31T08:28:46,731   adding 'lm_eval/tasks/basque_bench/flores_eu/flores_fr-eu.yaml'
2025-08-31T08:28:46,732   adding 'lm_eval/tasks/basque_bench/flores_eu/flores_gl-eu.yaml'
2025-08-31T08:28:46,733   adding 'lm_eval/tasks/basque_bench/flores_eu/flores_it-eu.yaml'
2025-08-31T08:28:46,734   adding 'lm_eval/tasks/basque_bench/flores_eu/flores_pt-eu.yaml'
2025-08-31T08:28:46,736   adding 'lm_eval/tasks/basqueglue/README.md'
2025-08-31T08:28:46,738   adding 'lm_eval/tasks/basqueglue/bec.yaml'
2025-08-31T08:28:46,739   adding 'lm_eval/tasks/basqueglue/bhtc.yaml'
2025-08-31T08:28:46,740   adding 'lm_eval/tasks/basqueglue/coref.yaml'
2025-08-31T08:28:46,741   adding 'lm_eval/tasks/basqueglue/qnli.yaml'
2025-08-31T08:28:46,742   adding 'lm_eval/tasks/basqueglue/utils.py'
2025-08-31T08:28:46,744   adding 'lm_eval/tasks/basqueglue/vaxx.yaml'
2025-08-31T08:28:46,745   adding 'lm_eval/tasks/basqueglue/wic.yaml'
2025-08-31T08:28:46,747   adding 'lm_eval/tasks/bbh/README.md'
2025-08-31T08:28:46,748   adding 'lm_eval/tasks/bbh/_generate_configs.py'
2025-08-31T08:28:46,750   adding 'lm_eval/tasks/bbh/cot_fewshot/_bbh.yaml'
2025-08-31T08:28:46,752   adding 'lm_eval/tasks/bbh/cot_fewshot/_bbh_cot_fewshot.yaml'
2025-08-31T08:28:46,753   adding 'lm_eval/tasks/bbh/cot_fewshot/_cot_fewshot_template_yaml'
2025-08-31T08:28:46,754   adding 'lm_eval/tasks/bbh/cot_fewshot/boolean_expressions.yaml'
2025-08-31T08:28:46,756   adding 'lm_eval/tasks/bbh/cot_fewshot/causal_judgement.yaml'
2025-08-31T08:28:46,757   adding 'lm_eval/tasks/bbh/cot_fewshot/date_understanding.yaml'
2025-08-31T08:28:46,758   adding 'lm_eval/tasks/bbh/cot_fewshot/disambiguation_qa.yaml'
2025-08-31T08:28:46,760   adding 'lm_eval/tasks/bbh/cot_fewshot/dyck_languages.yaml'
2025-08-31T08:28:46,761   adding 'lm_eval/tasks/bbh/cot_fewshot/formal_fallacies.yaml'
2025-08-31T08:28:46,763   adding 'lm_eval/tasks/bbh/cot_fewshot/geometric_shapes.yaml'
2025-08-31T08:28:46,764   adding 'lm_eval/tasks/bbh/cot_fewshot/hyperbaton.yaml'
2025-08-31T08:28:46,765   adding 'lm_eval/tasks/bbh/cot_fewshot/logical_deduction_five_objects.yaml'
2025-08-31T08:28:46,766   adding 'lm_eval/tasks/bbh/cot_fewshot/logical_deduction_seven_objects.yaml'
2025-08-31T08:28:46,767   adding 'lm_eval/tasks/bbh/cot_fewshot/logical_deduction_three_objects.yaml'
2025-08-31T08:28:46,769   adding 'lm_eval/tasks/bbh/cot_fewshot/movie_recommendation.yaml'
2025-08-31T08:28:46,770   adding 'lm_eval/tasks/bbh/cot_fewshot/multistep_arithmetic_two.yaml'
2025-08-31T08:28:46,771   adding 'lm_eval/tasks/bbh/cot_fewshot/navigate.yaml'
2025-08-31T08:28:46,772   adding 'lm_eval/tasks/bbh/cot_fewshot/object_counting.yaml'
2025-08-31T08:28:46,773   adding 'lm_eval/tasks/bbh/cot_fewshot/penguins_in_a_table.yaml'
2025-08-31T08:28:46,775   adding 'lm_eval/tasks/bbh/cot_fewshot/reasoning_about_colored_objects.yaml'
2025-08-31T08:28:46,776   adding 'lm_eval/tasks/bbh/cot_fewshot/ruin_names.yaml'
2025-08-31T08:28:46,777   adding 'lm_eval/tasks/bbh/cot_fewshot/salient_translation_error_detection.yaml'
2025-08-31T08:28:46,779   adding 'lm_eval/tasks/bbh/cot_fewshot/snarks.yaml'
2025-08-31T08:28:46,780   adding 'lm_eval/tasks/bbh/cot_fewshot/sports_understanding.yaml'
2025-08-31T08:28:46,781   adding 'lm_eval/tasks/bbh/cot_fewshot/temporal_sequences.yaml'
2025-08-31T08:28:46,783   adding 'lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_five_objects.yaml'
2025-08-31T08:28:46,784   adding 'lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_seven_objects.yaml'
2025-08-31T08:28:46,785   adding 'lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_three_objects.yaml'
2025-08-31T08:28:46,787   adding 'lm_eval/tasks/bbh/cot_fewshot/web_of_lies.yaml'
2025-08-31T08:28:46,788   adding 'lm_eval/tasks/bbh/cot_fewshot/word_sorting.yaml'
2025-08-31T08:28:46,790   adding 'lm_eval/tasks/bbh/cot_zeroshot/_bbh_cot_zeroshot.yaml'
2025-08-31T08:28:46,791   adding 'lm_eval/tasks/bbh/cot_zeroshot/_cot_zeroshot_template_yaml'
2025-08-31T08:28:46,792   adding 'lm_eval/tasks/bbh/cot_zeroshot/boolean_expressions.yaml'
2025-08-31T08:28:46,794   adding 'lm_eval/tasks/bbh/cot_zeroshot/causal_judgement.yaml'
2025-08-31T08:28:46,795   adding 'lm_eval/tasks/bbh/cot_zeroshot/date_understanding.yaml'
2025-08-31T08:28:46,796   adding 'lm_eval/tasks/bbh/cot_zeroshot/disambiguation_qa.yaml'
2025-08-31T08:28:46,797   adding 'lm_eval/tasks/bbh/cot_zeroshot/dyck_languages.yaml'
2025-08-31T08:28:46,798   adding 'lm_eval/tasks/bbh/cot_zeroshot/formal_fallacies.yaml'
2025-08-31T08:28:46,800   adding 'lm_eval/tasks/bbh/cot_zeroshot/geometric_shapes.yaml'
2025-08-31T08:28:46,801   adding 'lm_eval/tasks/bbh/cot_zeroshot/hyperbaton.yaml'
2025-08-31T08:28:46,802   adding 'lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_five_objects.yaml'
2025-08-31T08:28:46,803   adding 'lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_seven_objects.yaml'
2025-08-31T08:28:46,804   adding 'lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_three_objects.yaml'
2025-08-31T08:28:46,805   adding 'lm_eval/tasks/bbh/cot_zeroshot/movie_recommendation.yaml'
2025-08-31T08:28:46,807   adding 'lm_eval/tasks/bbh/cot_zeroshot/multistep_arithmetic_two.yaml'
2025-08-31T08:28:46,808   adding 'lm_eval/tasks/bbh/cot_zeroshot/navigate.yaml'
2025-08-31T08:28:46,809   adding 'lm_eval/tasks/bbh/cot_zeroshot/object_counting.yaml'
2025-08-31T08:28:46,810   adding 'lm_eval/tasks/bbh/cot_zeroshot/penguins_in_a_table.yaml'
2025-08-31T08:28:46,812   adding 'lm_eval/tasks/bbh/cot_zeroshot/reasoning_about_colored_objects.yaml'
2025-08-31T08:28:46,813   adding 'lm_eval/tasks/bbh/cot_zeroshot/ruin_names.yaml'
2025-08-31T08:28:46,814   adding 'lm_eval/tasks/bbh/cot_zeroshot/salient_translation_error_detection.yaml'
2025-08-31T08:28:46,815   adding 'lm_eval/tasks/bbh/cot_zeroshot/snarks.yaml'
2025-08-31T08:28:46,817   adding 'lm_eval/tasks/bbh/cot_zeroshot/sports_understanding.yaml'
2025-08-31T08:28:46,818   adding 'lm_eval/tasks/bbh/cot_zeroshot/temporal_sequences.yaml'
2025-08-31T08:28:46,819   adding 'lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_five_objects.yaml'
2025-08-31T08:28:46,820   adding 'lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_seven_objects.yaml'
2025-08-31T08:28:46,821   adding 'lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_three_objects.yaml'
2025-08-31T08:28:46,823   adding 'lm_eval/tasks/bbh/cot_zeroshot/utils.py'
2025-08-31T08:28:46,824   adding 'lm_eval/tasks/bbh/cot_zeroshot/web_of_lies.yaml'
2025-08-31T08:28:46,825   adding 'lm_eval/tasks/bbh/cot_zeroshot/word_sorting.yaml'
2025-08-31T08:28:46,827   adding 'lm_eval/tasks/bbh/fewshot/_bbh_fewshot.yaml'
2025-08-31T08:28:46,828   adding 'lm_eval/tasks/bbh/fewshot/_fewshot_template_yaml'
2025-08-31T08:28:46,829   adding 'lm_eval/tasks/bbh/fewshot/boolean_expressions.yaml'
2025-08-31T08:28:46,830   adding 'lm_eval/tasks/bbh/fewshot/causal_judgement.yaml'
2025-08-31T08:28:46,832   adding 'lm_eval/tasks/bbh/fewshot/date_understanding.yaml'
2025-08-31T08:28:46,833   adding 'lm_eval/tasks/bbh/fewshot/disambiguation_qa.yaml'
2025-08-31T08:28:46,834   adding 'lm_eval/tasks/bbh/fewshot/dyck_languages.yaml'
2025-08-31T08:28:46,835   adding 'lm_eval/tasks/bbh/fewshot/formal_fallacies.yaml'
2025-08-31T08:28:46,837   adding 'lm_eval/tasks/bbh/fewshot/geometric_shapes.yaml'
2025-08-31T08:28:46,838   adding 'lm_eval/tasks/bbh/fewshot/hyperbaton.yaml'
2025-08-31T08:28:46,839   adding 'lm_eval/tasks/bbh/fewshot/logical_deduction_five_objects.yaml'
2025-08-31T08:28:46,840   adding 'lm_eval/tasks/bbh/fewshot/logical_deduction_seven_objects.yaml'
2025-08-31T08:28:46,841   adding 'lm_eval/tasks/bbh/fewshot/logical_deduction_three_objects.yaml'
2025-08-31T08:28:46,843   adding 'lm_eval/tasks/bbh/fewshot/movie_recommendation.yaml'
2025-08-31T08:28:46,844   adding 'lm_eval/tasks/bbh/fewshot/multistep_arithmetic_two.yaml'
2025-08-31T08:28:46,845   adding 'lm_eval/tasks/bbh/fewshot/navigate.yaml'
2025-08-31T08:28:46,846   adding 'lm_eval/tasks/bbh/fewshot/object_counting.yaml'
2025-08-31T08:28:46,847   adding 'lm_eval/tasks/bbh/fewshot/penguins_in_a_table.yaml'
2025-08-31T08:28:46,849   adding 'lm_eval/tasks/bbh/fewshot/reasoning_about_colored_objects.yaml'
2025-08-31T08:28:46,850   adding 'lm_eval/tasks/bbh/fewshot/ruin_names.yaml'
2025-08-31T08:28:46,852   adding 'lm_eval/tasks/bbh/fewshot/salient_translation_error_detection.yaml'
2025-08-31T08:28:46,853   adding 'lm_eval/tasks/bbh/fewshot/snarks.yaml'
2025-08-31T08:28:46,854   adding 'lm_eval/tasks/bbh/fewshot/sports_understanding.yaml'
2025-08-31T08:28:46,855   adding 'lm_eval/tasks/bbh/fewshot/temporal_sequences.yaml'
2025-08-31T08:28:46,857   adding 'lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_five_objects.yaml'
2025-08-31T08:28:46,858   adding 'lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_seven_objects.yaml'
2025-08-31T08:28:46,859   adding 'lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_three_objects.yaml'
2025-08-31T08:28:46,860   adding 'lm_eval/tasks/bbh/fewshot/web_of_lies.yaml'
2025-08-31T08:28:46,862   adding 'lm_eval/tasks/bbh/fewshot/word_sorting.yaml'
2025-08-31T08:28:46,864   adding 'lm_eval/tasks/bbh/zeroshot/_bbh_zeroshot.yaml'
2025-08-31T08:28:46,865   adding 'lm_eval/tasks/bbh/zeroshot/_zeroshot_template_yaml'
2025-08-31T08:28:46,866   adding 'lm_eval/tasks/bbh/zeroshot/boolean_expressions.yaml'
2025-08-31T08:28:46,867   adding 'lm_eval/tasks/bbh/zeroshot/causal_judgement.yaml'
2025-08-31T08:28:46,869   adding 'lm_eval/tasks/bbh/zeroshot/date_understanding.yaml'
2025-08-31T08:28:46,870   adding 'lm_eval/tasks/bbh/zeroshot/disambiguation_qa.yaml'
2025-08-31T08:28:46,871   adding 'lm_eval/tasks/bbh/zeroshot/dyck_languages.yaml'
2025-08-31T08:28:46,872   adding 'lm_eval/tasks/bbh/zeroshot/formal_fallacies.yaml'
2025-08-31T08:28:46,873   adding 'lm_eval/tasks/bbh/zeroshot/geometric_shapes.yaml'
2025-08-31T08:28:46,875   adding 'lm_eval/tasks/bbh/zeroshot/hyperbaton.yaml'
2025-08-31T08:28:46,876   adding 'lm_eval/tasks/bbh/zeroshot/logical_deduction_five_objects.yaml'
2025-08-31T08:28:46,877   adding 'lm_eval/tasks/bbh/zeroshot/logical_deduction_seven_objects.yaml'
2025-08-31T08:28:46,878   adding 'lm_eval/tasks/bbh/zeroshot/logical_deduction_three_objects.yaml'
2025-08-31T08:28:46,879   adding 'lm_eval/tasks/bbh/zeroshot/movie_recommendation.yaml'
2025-08-31T08:28:46,880   adding 'lm_eval/tasks/bbh/zeroshot/multistep_arithmetic_two.yaml'
2025-08-31T08:28:46,881   adding 'lm_eval/tasks/bbh/zeroshot/navigate.yaml'
2025-08-31T08:28:46,882   adding 'lm_eval/tasks/bbh/zeroshot/object_counting.yaml'
2025-08-31T08:28:46,884   adding 'lm_eval/tasks/bbh/zeroshot/penguins_in_a_table.yaml'
2025-08-31T08:28:46,885   adding 'lm_eval/tasks/bbh/zeroshot/reasoning_about_colored_objects.yaml'
2025-08-31T08:28:46,886   adding 'lm_eval/tasks/bbh/zeroshot/ruin_names.yaml'
2025-08-31T08:28:46,887   adding 'lm_eval/tasks/bbh/zeroshot/salient_translation_error_detection.yaml'
2025-08-31T08:28:46,888   adding 'lm_eval/tasks/bbh/zeroshot/snarks.yaml'
2025-08-31T08:28:46,890   adding 'lm_eval/tasks/bbh/zeroshot/sports_understanding.yaml'
2025-08-31T08:28:46,891   adding 'lm_eval/tasks/bbh/zeroshot/temporal_sequences.yaml'
2025-08-31T08:28:46,892   adding 'lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_five_objects.yaml'
2025-08-31T08:28:46,893   adding 'lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_seven_objects.yaml'
2025-08-31T08:28:46,894   adding 'lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_three_objects.yaml'
2025-08-31T08:28:46,896   adding 'lm_eval/tasks/bbh/zeroshot/utils.py'
2025-08-31T08:28:46,897   adding 'lm_eval/tasks/bbh/zeroshot/web_of_lies.yaml'
2025-08-31T08:28:46,898   adding 'lm_eval/tasks/bbh/zeroshot/word_sorting.yaml'
2025-08-31T08:28:46,900   adding 'lm_eval/tasks/bbq/README.md'
2025-08-31T08:28:46,902   adding 'lm_eval/tasks/bbq/bbq_generate.yaml'
2025-08-31T08:28:46,903   adding 'lm_eval/tasks/bbq/bbq_generate_ambig.yaml'
2025-08-31T08:28:46,904   adding 'lm_eval/tasks/bbq/bbq_generate_disambig.yaml'
2025-08-31T08:28:46,905   adding 'lm_eval/tasks/bbq/bbq_multiple_choice.yaml'
2025-08-31T08:28:46,906   adding 'lm_eval/tasks/bbq/bbq_multiple_choice_ambig.yaml'
2025-08-31T08:28:46,907   adding 'lm_eval/tasks/bbq/bbq_multiple_choice_disambig.yaml'
2025-08-31T08:28:46,909   adding 'lm_eval/tasks/bbq/utils.py'
2025-08-31T08:28:46,914   adding 'lm_eval/tasks/belebele/README.md'
2025-08-31T08:28:46,915   adding 'lm_eval/tasks/belebele/_belebele.yaml'
2025-08-31T08:28:46,916   adding 'lm_eval/tasks/belebele/_default_template_yaml'
2025-08-31T08:28:46,918   adding 'lm_eval/tasks/belebele/_generate_configs.py'
2025-08-31T08:28:46,919   adding 'lm_eval/tasks/belebele/belebele_acm_Arab.yaml'
2025-08-31T08:28:46,920   adding 'lm_eval/tasks/belebele/belebele_afr_Latn.yaml'
2025-08-31T08:28:46,921   adding 'lm_eval/tasks/belebele/belebele_als_Latn.yaml'
2025-08-31T08:28:46,922   adding 'lm_eval/tasks/belebele/belebele_amh_Ethi.yaml'
2025-08-31T08:28:46,923   adding 'lm_eval/tasks/belebele/belebele_apc_Arab.yaml'
2025-08-31T08:28:46,924   adding 'lm_eval/tasks/belebele/belebele_arb_Arab.yaml'
2025-08-31T08:28:46,925   adding 'lm_eval/tasks/belebele/belebele_arb_Latn.yaml'
2025-08-31T08:28:46,926   adding 'lm_eval/tasks/belebele/belebele_ars_Arab.yaml'
2025-08-31T08:28:46,927   adding 'lm_eval/tasks/belebele/belebele_ary_Arab.yaml'
2025-08-31T08:28:46,929   adding 'lm_eval/tasks/belebele/belebele_arz_Arab.yaml'
2025-08-31T08:28:46,930   adding 'lm_eval/tasks/belebele/belebele_asm_Beng.yaml'
2025-08-31T08:28:46,931   adding 'lm_eval/tasks/belebele/belebele_azj_Latn.yaml'
2025-08-31T08:28:46,932   adding 'lm_eval/tasks/belebele/belebele_bam_Latn.yaml'
2025-08-31T08:28:46,933   adding 'lm_eval/tasks/belebele/belebele_ben_Beng.yaml'
2025-08-31T08:28:46,934   adding 'lm_eval/tasks/belebele/belebele_ben_Latn.yaml'
2025-08-31T08:28:46,935   adding 'lm_eval/tasks/belebele/belebele_bod_Tibt.yaml'
2025-08-31T08:28:46,936   adding 'lm_eval/tasks/belebele/belebele_bul_Cyrl.yaml'
2025-08-31T08:28:46,937   adding 'lm_eval/tasks/belebele/belebele_cat_Latn.yaml'
2025-08-31T08:28:46,939   adding 'lm_eval/tasks/belebele/belebele_ceb_Latn.yaml'
2025-08-31T08:28:46,940   adding 'lm_eval/tasks/belebele/belebele_ces_Latn.yaml'
2025-08-31T08:28:46,941   adding 'lm_eval/tasks/belebele/belebele_ckb_Arab.yaml'
2025-08-31T08:28:46,942   adding 'lm_eval/tasks/belebele/belebele_dan_Latn.yaml'
2025-08-31T08:28:46,943   adding 'lm_eval/tasks/belebele/belebele_deu_Latn.yaml'
2025-08-31T08:28:46,944   adding 'lm_eval/tasks/belebele/belebele_ell_Grek.yaml'
2025-08-31T08:28:46,945   adding 'lm_eval/tasks/belebele/belebele_eng_Latn.yaml'
2025-08-31T08:28:46,946   adding 'lm_eval/tasks/belebele/belebele_est_Latn.yaml'
2025-08-31T08:28:46,947   adding 'lm_eval/tasks/belebele/belebele_eus_Latn.yaml'
2025-08-31T08:28:46,948   adding 'lm_eval/tasks/belebele/belebele_fin_Latn.yaml'
2025-08-31T08:28:46,949   adding 'lm_eval/tasks/belebele/belebele_fra_Latn.yaml'
2025-08-31T08:28:46,950   adding 'lm_eval/tasks/belebele/belebele_fuv_Latn.yaml'
2025-08-31T08:28:46,951   adding 'lm_eval/tasks/belebele/belebele_gaz_Latn.yaml'
2025-08-31T08:28:46,952   adding 'lm_eval/tasks/belebele/belebele_grn_Latn.yaml'
2025-08-31T08:28:46,953   adding 'lm_eval/tasks/belebele/belebele_guj_Gujr.yaml'
2025-08-31T08:28:46,954   adding 'lm_eval/tasks/belebele/belebele_hat_Latn.yaml'
2025-08-31T08:28:46,955   adding 'lm_eval/tasks/belebele/belebele_hau_Latn.yaml'
2025-08-31T08:28:46,956   adding 'lm_eval/tasks/belebele/belebele_heb_Hebr.yaml'
2025-08-31T08:28:46,958   adding 'lm_eval/tasks/belebele/belebele_hin_Deva.yaml'
2025-08-31T08:28:46,958   adding 'lm_eval/tasks/belebele/belebele_hin_Latn.yaml'
2025-08-31T08:28:46,960   adding 'lm_eval/tasks/belebele/belebele_hrv_Latn.yaml'
2025-08-31T08:28:46,961   adding 'lm_eval/tasks/belebele/belebele_hun_Latn.yaml'
2025-08-31T08:28:46,962   adding 'lm_eval/tasks/belebele/belebele_hye_Armn.yaml'
2025-08-31T08:28:46,963   adding 'lm_eval/tasks/belebele/belebele_ibo_Latn.yaml'
2025-08-31T08:28:46,964   adding 'lm_eval/tasks/belebele/belebele_ilo_Latn.yaml'
2025-08-31T08:28:46,965   adding 'lm_eval/tasks/belebele/belebele_ind_Latn.yaml'
2025-08-31T08:28:46,966   adding 'lm_eval/tasks/belebele/belebele_isl_Latn.yaml'
2025-08-31T08:28:46,967   adding 'lm_eval/tasks/belebele/belebele_ita_Latn.yaml'
2025-08-31T08:28:46,968   adding 'lm_eval/tasks/belebele/belebele_jav_Latn.yaml'
2025-08-31T08:28:46,969   adding 'lm_eval/tasks/belebele/belebele_jpn_Jpan.yaml'
2025-08-31T08:28:46,971   adding 'lm_eval/tasks/belebele/belebele_kac_Latn.yaml'
2025-08-31T08:28:46,972   adding 'lm_eval/tasks/belebele/belebele_kan_Knda.yaml'
2025-08-31T08:28:46,973   adding 'lm_eval/tasks/belebele/belebele_kat_Geor.yaml'
2025-08-31T08:28:46,974   adding 'lm_eval/tasks/belebele/belebele_kaz_Cyrl.yaml'
2025-08-31T08:28:46,975   adding 'lm_eval/tasks/belebele/belebele_kea_Latn.yaml'
2025-08-31T08:28:46,976   adding 'lm_eval/tasks/belebele/belebele_khk_Cyrl.yaml'
2025-08-31T08:28:46,977   adding 'lm_eval/tasks/belebele/belebele_khm_Khmr.yaml'
2025-08-31T08:28:46,979   adding 'lm_eval/tasks/belebele/belebele_kin_Latn.yaml'
2025-08-31T08:28:46,980   adding 'lm_eval/tasks/belebele/belebele_kir_Cyrl.yaml'
2025-08-31T08:28:46,981   adding 'lm_eval/tasks/belebele/belebele_kor_Hang.yaml'
2025-08-31T08:28:46,982   adding 'lm_eval/tasks/belebele/belebele_lao_Laoo.yaml'
2025-08-31T08:28:46,983   adding 'lm_eval/tasks/belebele/belebele_lin_Latn.yaml'
2025-08-31T08:28:46,984   adding 'lm_eval/tasks/belebele/belebele_lit_Latn.yaml'
2025-08-31T08:28:46,986   adding 'lm_eval/tasks/belebele/belebele_lug_Latn.yaml'
2025-08-31T08:28:46,987   adding 'lm_eval/tasks/belebele/belebele_luo_Latn.yaml'
2025-08-31T08:28:46,988   adding 'lm_eval/tasks/belebele/belebele_lvs_Latn.yaml'
2025-08-31T08:28:46,989   adding 'lm_eval/tasks/belebele/belebele_mal_Mlym.yaml'
2025-08-31T08:28:46,990   adding 'lm_eval/tasks/belebele/belebele_mar_Deva.yaml'
2025-08-31T08:28:46,991   adding 'lm_eval/tasks/belebele/belebele_mkd_Cyrl.yaml'
2025-08-31T08:28:46,992   adding 'lm_eval/tasks/belebele/belebele_mlt_Latn.yaml'
2025-08-31T08:28:46,993   adding 'lm_eval/tasks/belebele/belebele_mri_Latn.yaml'
2025-08-31T08:28:46,994   adding 'lm_eval/tasks/belebele/belebele_mya_Mymr.yaml'
2025-08-31T08:28:46,996   adding 'lm_eval/tasks/belebele/belebele_nld_Latn.yaml'
2025-08-31T08:28:46,997   adding 'lm_eval/tasks/belebele/belebele_nob_Latn.yaml'
2025-08-31T08:28:46,998   adding 'lm_eval/tasks/belebele/belebele_npi_Deva.yaml'
2025-08-31T08:28:46,999   adding 'lm_eval/tasks/belebele/belebele_npi_Latn.yaml'
2025-08-31T08:28:47,000   adding 'lm_eval/tasks/belebele/belebele_nso_Latn.yaml'
2025-08-31T08:28:47,001   adding 'lm_eval/tasks/belebele/belebele_nya_Latn.yaml'
2025-08-31T08:28:47,002   adding 'lm_eval/tasks/belebele/belebele_ory_Orya.yaml'
2025-08-31T08:28:47,003   adding 'lm_eval/tasks/belebele/belebele_pan_Guru.yaml'
2025-08-31T08:28:47,004   adding 'lm_eval/tasks/belebele/belebele_pbt_Arab.yaml'
2025-08-31T08:28:47,005   adding 'lm_eval/tasks/belebele/belebele_pes_Arab.yaml'
2025-08-31T08:28:47,006   adding 'lm_eval/tasks/belebele/belebele_plt_Latn.yaml'
2025-08-31T08:28:47,007   adding 'lm_eval/tasks/belebele/belebele_pol_Latn.yaml'
2025-08-31T08:28:47,008   adding 'lm_eval/tasks/belebele/belebele_por_Latn.yaml'
2025-08-31T08:28:47,009   adding 'lm_eval/tasks/belebele/belebele_ron_Latn.yaml'
2025-08-31T08:28:47,010   adding 'lm_eval/tasks/belebele/belebele_rus_Cyrl.yaml'
2025-08-31T08:28:47,011   adding 'lm_eval/tasks/belebele/belebele_shn_Mymr.yaml'
2025-08-31T08:28:47,012   adding 'lm_eval/tasks/belebele/belebele_sin_Latn.yaml'
2025-08-31T08:28:47,013   adding 'lm_eval/tasks/belebele/belebele_sin_Sinh.yaml'
2025-08-31T08:28:47,014   adding 'lm_eval/tasks/belebele/belebele_slk_Latn.yaml'
2025-08-31T08:28:47,015   adding 'lm_eval/tasks/belebele/belebele_slv_Latn.yaml'
2025-08-31T08:28:47,017   adding 'lm_eval/tasks/belebele/belebele_sna_Latn.yaml'
2025-08-31T08:28:47,018   adding 'lm_eval/tasks/belebele/belebele_snd_Arab.yaml'
2025-08-31T08:28:47,019   adding 'lm_eval/tasks/belebele/belebele_som_Latn.yaml'
2025-08-31T08:28:47,020   adding 'lm_eval/tasks/belebele/belebele_sot_Latn.yaml'
2025-08-31T08:28:47,021   adding 'lm_eval/tasks/belebele/belebele_spa_Latn.yaml'
2025-08-31T08:28:47,022   adding 'lm_eval/tasks/belebele/belebele_srp_Cyrl.yaml'
2025-08-31T08:28:47,023   adding 'lm_eval/tasks/belebele/belebele_ssw_Latn.yaml'
2025-08-31T08:28:47,024   adding 'lm_eval/tasks/belebele/belebele_sun_Latn.yaml'
2025-08-31T08:28:47,025   adding 'lm_eval/tasks/belebele/belebele_swe_Latn.yaml'
2025-08-31T08:28:47,026   adding 'lm_eval/tasks/belebele/belebele_swh_Latn.yaml'
2025-08-31T08:28:47,027   adding 'lm_eval/tasks/belebele/belebele_tam_Taml.yaml'
2025-08-31T08:28:47,029   adding 'lm_eval/tasks/belebele/belebele_tel_Telu.yaml'
2025-08-31T08:28:47,030   adding 'lm_eval/tasks/belebele/belebele_tgk_Cyrl.yaml'
2025-08-31T08:28:47,031   adding 'lm_eval/tasks/belebele/belebele_tgl_Latn.yaml'
2025-08-31T08:28:47,032   adding 'lm_eval/tasks/belebele/belebele_tha_Thai.yaml'
2025-08-31T08:28:47,033   adding 'lm_eval/tasks/belebele/belebele_tir_Ethi.yaml'
2025-08-31T08:28:47,034   adding 'lm_eval/tasks/belebele/belebele_tsn_Latn.yaml'
2025-08-31T08:28:47,035   adding 'lm_eval/tasks/belebele/belebele_tso_Latn.yaml'
2025-08-31T08:28:47,036   adding 'lm_eval/tasks/belebele/belebele_tur_Latn.yaml'
2025-08-31T08:28:47,037   adding 'lm_eval/tasks/belebele/belebele_ukr_Cyrl.yaml'
2025-08-31T08:28:47,039   adding 'lm_eval/tasks/belebele/belebele_urd_Arab.yaml'
2025-08-31T08:28:47,040   adding 'lm_eval/tasks/belebele/belebele_urd_Latn.yaml'
2025-08-31T08:28:47,041   adding 'lm_eval/tasks/belebele/belebele_uzn_Latn.yaml'
2025-08-31T08:28:47,042   adding 'lm_eval/tasks/belebele/belebele_vie_Latn.yaml'
2025-08-31T08:28:47,043   adding 'lm_eval/tasks/belebele/belebele_war_Latn.yaml'
2025-08-31T08:28:47,044   adding 'lm_eval/tasks/belebele/belebele_wol_Latn.yaml'
2025-08-31T08:28:47,045   adding 'lm_eval/tasks/belebele/belebele_xho_Latn.yaml'
2025-08-31T08:28:47,046   adding 'lm_eval/tasks/belebele/belebele_yor_Latn.yaml'
2025-08-31T08:28:47,048   adding 'lm_eval/tasks/belebele/belebele_zho_Hans.yaml'
2025-08-31T08:28:47,049   adding 'lm_eval/tasks/belebele/belebele_zho_Hant.yaml'
2025-08-31T08:28:47,050   adding 'lm_eval/tasks/belebele/belebele_zsm_Latn.yaml'
2025-08-31T08:28:47,051   adding 'lm_eval/tasks/belebele/belebele_zul_Latn.yaml'
2025-08-31T08:28:47,052   adding 'lm_eval/tasks/benchmarks/README.md'
2025-08-31T08:28:47,053   adding 'lm_eval/tasks/benchmarks/minerva_math.yaml'
2025-08-31T08:28:47,054   adding 'lm_eval/tasks/benchmarks/openllm.yaml'
2025-08-31T08:28:47,055   adding 'lm_eval/tasks/benchmarks/pythia.yaml'
2025-08-31T08:28:47,057   adding 'lm_eval/tasks/benchmarks/t0_eval.yaml'
2025-08-31T08:28:47,058   adding 'lm_eval/tasks/benchmarks/flan/_held_in_template_yaml'
2025-08-31T08:28:47,060   adding 'lm_eval/tasks/benchmarks/flan/flan_held_in.yaml'
2025-08-31T08:28:47,061   adding 'lm_eval/tasks/benchmarks/flan/flan_held_out.yaml'
2025-08-31T08:28:47,063   adding 'lm_eval/tasks/benchmarks/multimedqa/README.md'
2025-08-31T08:28:47,064   adding 'lm_eval/tasks/benchmarks/multimedqa/multimedqa.yaml'
2025-08-31T08:28:47,066   adding 'lm_eval/tasks/bertaqa/README.md'
2025-08-31T08:28:47,067   adding 'lm_eval/tasks/bertaqa/_bertaqa_template'
2025-08-31T08:28:47,068   adding 'lm_eval/tasks/bertaqa/bertaqa_en.yaml'
2025-08-31T08:28:47,069   adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_gemma-7b.yaml'
2025-08-31T08:28:47,070   adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_hitz.yaml'
2025-08-31T08:28:47,071   adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_itzuli.yaml'
2025-08-31T08:28:47,072   adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.1.yaml'
2025-08-31T08:28:47,073   adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.yaml'
2025-08-31T08:28:47,075   adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.1.yaml'
2025-08-31T08:28:47,076   adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.yaml'
2025-08-31T08:28:47,077   adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.1.yaml'
2025-08-31T08:28:47,078   adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.yaml'
2025-08-31T08:28:47,079   adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-13b.yaml'
2025-08-31T08:28:47,080   adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-70b.yaml'
2025-08-31T08:28:47,081   adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-7b.yaml'
2025-08-31T08:28:47,082   adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_madlad.yaml'
2025-08-31T08:28:47,083   adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_nllb.yaml'
2025-08-31T08:28:47,084   adding 'lm_eval/tasks/bertaqa/bertaqa_eu.yaml'
2025-08-31T08:28:47,087   adding 'lm_eval/tasks/bigbench/README.md'
2025-08-31T08:28:47,089   adding 'lm_eval/tasks/bigbench/generate_tasks.py'
2025-08-31T08:28:47,090   adding 'lm_eval/tasks/bigbench/generate_until_template_yaml'
2025-08-31T08:28:47,091   adding 'lm_eval/tasks/bigbench/multiple_choice_template_a_yaml'
2025-08-31T08:28:47,092   adding 'lm_eval/tasks/bigbench/multiple_choice_template_b_yaml'
2025-08-31T08:28:47,093   adding 'lm_eval/tasks/bigbench/push_bigbench_dataset.py'
2025-08-31T08:28:47,098   adding 'lm_eval/tasks/bigbench/generate_until/abstract_narrative_understanding.yaml'
2025-08-31T08:28:47,099   adding 'lm_eval/tasks/bigbench/generate_until/anachronisms.yaml'
2025-08-31T08:28:47,100   adding 'lm_eval/tasks/bigbench/generate_until/analogical_similarity.yaml'
2025-08-31T08:28:47,101   adding 'lm_eval/tasks/bigbench/generate_until/analytic_entailment.yaml'
2025-08-31T08:28:47,102   adding 'lm_eval/tasks/bigbench/generate_until/arithmetic.yaml'
2025-08-31T08:28:47,104   adding 'lm_eval/tasks/bigbench/generate_until/ascii_word_recognition.yaml'
2025-08-31T08:28:47,105   adding 'lm_eval/tasks/bigbench/generate_until/authorship_verification.yaml'
2025-08-31T08:28:47,106   adding 'lm_eval/tasks/bigbench/generate_until/auto_categorization.yaml'
2025-08-31T08:28:47,107   adding 'lm_eval/tasks/bigbench/generate_until/auto_debugging.yaml'
2025-08-31T08:28:47,108   adding 'lm_eval/tasks/bigbench/generate_until/bbq_lite_json.yaml'
2025-08-31T08:28:47,109   adding 'lm_eval/tasks/bigbench/generate_until/bridging_anaphora_resolution_barqa.yaml'
2025-08-31T08:28:47,111   adding 'lm_eval/tasks/bigbench/generate_until/causal_judgment.yaml'
2025-08-31T08:28:47,112   adding 'lm_eval/tasks/bigbench/generate_until/cause_and_effect.yaml'
2025-08-31T08:28:47,113   adding 'lm_eval/tasks/bigbench/generate_until/checkmate_in_one.yaml'
2025-08-31T08:28:47,114   adding 'lm_eval/tasks/bigbench/generate_until/chess_state_tracking.yaml'
2025-08-31T08:28:47,115   adding 'lm_eval/tasks/bigbench/generate_until/chinese_remainder_theorem.yaml'
2025-08-31T08:28:47,116   adding 'lm_eval/tasks/bigbench/generate_until/cifar10_classification.yaml'
2025-08-31T08:28:47,117   adding 'lm_eval/tasks/bigbench/generate_until/code_line_description.yaml'
2025-08-31T08:28:47,118   adding 'lm_eval/tasks/bigbench/generate_until/codenames.yaml'
2025-08-31T08:28:47,119   adding 'lm_eval/tasks/bigbench/generate_until/color.yaml'
2025-08-31T08:28:47,120   adding 'lm_eval/tasks/bigbench/generate_until/common_morpheme.yaml'
2025-08-31T08:28:47,121   adding 'lm_eval/tasks/bigbench/generate_until/conceptual_combinations.yaml'
2025-08-31T08:28:47,122   adding 'lm_eval/tasks/bigbench/generate_until/conlang_translation.yaml'
2025-08-31T08:28:47,123   adding 'lm_eval/tasks/bigbench/generate_until/contextual_parametric_knowledge_conflicts.yaml'
2025-08-31T08:28:47,124   adding 'lm_eval/tasks/bigbench/generate_until/crash_blossom.yaml'
2025-08-31T08:28:47,125   adding 'lm_eval/tasks/bigbench/generate_until/crass_ai.yaml'
2025-08-31T08:28:47,126   adding 'lm_eval/tasks/bigbench/generate_until/cryobiology_spanish.yaml'
2025-08-31T08:28:47,128   adding 'lm_eval/tasks/bigbench/generate_until/cryptonite.yaml'
2025-08-31T08:28:47,129   adding 'lm_eval/tasks/bigbench/generate_until/cs_algorithms.yaml'
2025-08-31T08:28:47,130   adding 'lm_eval/tasks/bigbench/generate_until/dark_humor_detection.yaml'
2025-08-31T08:28:47,131   adding 'lm_eval/tasks/bigbench/generate_until/date_understanding.yaml'
2025-08-31T08:28:47,132   adding 'lm_eval/tasks/bigbench/generate_until/disambiguation_qa.yaml'
2025-08-31T08:28:47,133   adding 'lm_eval/tasks/bigbench/generate_until/discourse_marker_prediction.yaml'
2025-08-31T08:28:47,134   adding 'lm_eval/tasks/bigbench/generate_until/disfl_qa.yaml'
2025-08-31T08:28:47,135   adding 'lm_eval/tasks/bigbench/generate_until/dyck_languages.yaml'
2025-08-31T08:28:47,136   adding 'lm_eval/tasks/bigbench/generate_until/elementary_math_qa.yaml'
2025-08-31T08:28:47,137   adding 'lm_eval/tasks/bigbench/generate_until/emoji_movie.yaml'
2025-08-31T08:28:47,139   adding 'lm_eval/tasks/bigbench/generate_until/emojis_emotion_prediction.yaml'
2025-08-31T08:28:47,140   adding 'lm_eval/tasks/bigbench/generate_until/empirical_judgments.yaml'
2025-08-31T08:28:47,141   adding 'lm_eval/tasks/bigbench/generate_until/english_proverbs.yaml'
2025-08-31T08:28:47,142   adding 'lm_eval/tasks/bigbench/generate_until/english_russian_proverbs.yaml'
2025-08-31T08:28:47,143   adding 'lm_eval/tasks/bigbench/generate_until/entailed_polarity.yaml'
2025-08-31T08:28:47,144   adding 'lm_eval/tasks/bigbench/generate_until/entailed_polarity_hindi.yaml'
2025-08-31T08:28:47,145   adding 'lm_eval/tasks/bigbench/generate_until/epistemic_reasoning.yaml'
2025-08-31T08:28:47,147   adding 'lm_eval/tasks/bigbench/generate_until/evaluating_information_essentiality.yaml'
2025-08-31T08:28:47,148   adding 'lm_eval/tasks/bigbench/generate_until/fact_checker.yaml'
2025-08-31T08:28:47,149   adding 'lm_eval/tasks/bigbench/generate_until/fantasy_reasoning.yaml'
2025-08-31T08:28:47,150   adding 'lm_eval/tasks/bigbench/generate_until/few_shot_nlg.yaml'
2025-08-31T08:28:47,151   adding 'lm_eval/tasks/bigbench/generate_until/figure_of_speech_detection.yaml'
2025-08-31T08:28:47,152   adding 'lm_eval/tasks/bigbench/generate_until/formal_fallacies_syllogisms_negation.yaml'
2025-08-31T08:28:47,153   adding 'lm_eval/tasks/bigbench/generate_until/gem.yaml'
2025-08-31T08:28:47,155   adding 'lm_eval/tasks/bigbench/generate_until/gender_inclusive_sentences_german.yaml'
2025-08-31T08:28:47,156   adding 'lm_eval/tasks/bigbench/generate_until/general_knowledge.yaml'
2025-08-31T08:28:47,157   adding 'lm_eval/tasks/bigbench/generate_until/geometric_shapes.yaml'
2025-08-31T08:28:47,158   adding 'lm_eval/tasks/bigbench/generate_until/goal_step_wikihow.yaml'
2025-08-31T08:28:47,159   adding 'lm_eval/tasks/bigbench/generate_until/gre_reading_comprehension.yaml'
2025-08-31T08:28:47,160   adding 'lm_eval/tasks/bigbench/generate_until/hhh_alignment.yaml'
2025-08-31T08:28:47,161   adding 'lm_eval/tasks/bigbench/generate_until/hindi_question_answering.yaml'
2025-08-31T08:28:47,162   adding 'lm_eval/tasks/bigbench/generate_until/hindu_knowledge.yaml'
2025-08-31T08:28:47,163   adding 'lm_eval/tasks/bigbench/generate_until/hinglish_toxicity.yaml'
2025-08-31T08:28:47,164   adding 'lm_eval/tasks/bigbench/generate_until/human_organs_senses.yaml'
2025-08-31T08:28:47,165   adding 'lm_eval/tasks/bigbench/generate_until/hyperbaton.yaml'
2025-08-31T08:28:47,166   adding 'lm_eval/tasks/bigbench/generate_until/identify_math_theorems.yaml'
2025-08-31T08:28:47,167   adding 'lm_eval/tasks/bigbench/generate_until/identify_odd_metaphor.yaml'
2025-08-31T08:28:47,169   adding 'lm_eval/tasks/bigbench/generate_until/implicatures.yaml'
2025-08-31T08:28:47,170   adding 'lm_eval/tasks/bigbench/generate_until/implicit_relations.yaml'
2025-08-31T08:28:47,171   adding 'lm_eval/tasks/bigbench/generate_until/intent_recognition.yaml'
2025-08-31T08:28:47,172   adding 'lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_nli.yaml'
2025-08-31T08:28:47,173   adding 'lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_transliterate.yaml'
2025-08-31T08:28:47,174   adding 'lm_eval/tasks/bigbench/generate_until/intersect_geometry.yaml'
2025-08-31T08:28:47,176   adding 'lm_eval/tasks/bigbench/generate_until/irony_identification.yaml'
2025-08-31T08:28:47,177   adding 'lm_eval/tasks/bigbench/generate_until/kanji_ascii.yaml'
2025-08-31T08:28:47,179   adding 'lm_eval/tasks/bigbench/generate_until/kannada.yaml'
2025-08-31T08:28:47,180   adding 'lm_eval/tasks/bigbench/generate_until/key_value_maps.yaml'
2025-08-31T08:28:47,181   adding 'lm_eval/tasks/bigbench/generate_until/known_unknowns.yaml'
2025-08-31T08:28:47,182   adding 'lm_eval/tasks/bigbench/generate_until/language_games.yaml'
2025-08-31T08:28:47,183   adding 'lm_eval/tasks/bigbench/generate_until/language_identification.yaml'
2025-08-31T08:28:47,184   adding 'lm_eval/tasks/bigbench/generate_until/linguistic_mappings.yaml'
2025-08-31T08:28:47,185   adding 'lm_eval/tasks/bigbench/generate_until/linguistics_puzzles.yaml'
2025-08-31T08:28:47,186   adding 'lm_eval/tasks/bigbench/generate_until/list_functions.yaml'
2025-08-31T08:28:47,188   adding 'lm_eval/tasks/bigbench/generate_until/logic_grid_puzzle.yaml'
2025-08-31T08:28:47,189   adding 'lm_eval/tasks/bigbench/generate_until/logical_args.yaml'
2025-08-31T08:28:47,190   adding 'lm_eval/tasks/bigbench/generate_until/logical_deduction.yaml'
2025-08-31T08:28:47,191   adding 'lm_eval/tasks/bigbench/generate_until/logical_fallacy_detection.yaml'
2025-08-31T08:28:47,192   adding 'lm_eval/tasks/bigbench/generate_until/logical_sequence.yaml'
2025-08-31T08:28:47,193   adding 'lm_eval/tasks/bigbench/generate_until/mathematical_induction.yaml'
2025-08-31T08:28:47,194   adding 'lm_eval/tasks/bigbench/generate_until/matrixshapes.yaml'
2025-08-31T08:28:47,195   adding 'lm_eval/tasks/bigbench/generate_until/metaphor_boolean.yaml'
2025-08-31T08:28:47,197   adding 'lm_eval/tasks/bigbench/generate_until/metaphor_understanding.yaml'
2025-08-31T08:28:47,198   adding 'lm_eval/tasks/bigbench/generate_until/minute_mysteries_qa.yaml'
2025-08-31T08:28:47,199   adding 'lm_eval/tasks/bigbench/generate_until/misconceptions.yaml'
2025-08-31T08:28:47,200   adding 'lm_eval/tasks/bigbench/generate_until/misconceptions_russian.yaml'
2025-08-31T08:28:47,201   adding 'lm_eval/tasks/bigbench/generate_until/mnist_ascii.yaml'
2025-08-31T08:28:47,202   adding 'lm_eval/tasks/bigbench/generate_until/modified_arithmetic.yaml'
2025-08-31T08:28:47,204   adding 'lm_eval/tasks/bigbench/generate_until/moral_permissibility.yaml'
2025-08-31T08:28:47,205   adding 'lm_eval/tasks/bigbench/generate_until/movie_dialog_same_or_different.yaml'
2025-08-31T08:28:47,206   adding 'lm_eval/tasks/bigbench/generate_until/movie_recommendation.yaml'
2025-08-31T08:28:47,207   adding 'lm_eval/tasks/bigbench/generate_until/mult_data_wrangling.yaml'
2025-08-31T08:28:47,208   adding 'lm_eval/tasks/bigbench/generate_until/multiemo.yaml'
2025-08-31T08:28:47,209   adding 'lm_eval/tasks/bigbench/generate_until/natural_instructions.yaml'
2025-08-31T08:28:47,210   adding 'lm_eval/tasks/bigbench/generate_until/navigate.yaml'
2025-08-31T08:28:47,211   adding 'lm_eval/tasks/bigbench/generate_until/nonsense_words_grammar.yaml'
2025-08-31T08:28:47,212   adding 'lm_eval/tasks/bigbench/generate_until/novel_concepts.yaml'
2025-08-31T08:28:47,213   adding 'lm_eval/tasks/bigbench/generate_until/object_counting.yaml'
2025-08-31T08:28:47,214   adding 'lm_eval/tasks/bigbench/generate_until/odd_one_out.yaml'
2025-08-31T08:28:47,215   adding 'lm_eval/tasks/bigbench/generate_until/operators.yaml'
2025-08-31T08:28:47,216   adding 'lm_eval/tasks/bigbench/generate_until/paragraph_segmentation.yaml'
2025-08-31T08:28:47,218   adding 'lm_eval/tasks/bigbench/generate_until/parsinlu_qa.yaml'
2025-08-31T08:28:47,219   adding 'lm_eval/tasks/bigbench/generate_until/parsinlu_reading_comprehension.yaml'
2025-08-31T08:28:47,220   adding 'lm_eval/tasks/bigbench/generate_until/penguins_in_a_table.yaml'
2025-08-31T08:28:47,221   adding 'lm_eval/tasks/bigbench/generate_until/periodic_elements.yaml'
2025-08-31T08:28:47,222   adding 'lm_eval/tasks/bigbench/generate_until/persian_idioms.yaml'
2025-08-31T08:28:47,223   adding 'lm_eval/tasks/bigbench/generate_until/phrase_relatedness.yaml'
2025-08-31T08:28:47,224   adding 'lm_eval/tasks/bigbench/generate_until/physical_intuition.yaml'
2025-08-31T08:28:47,225   adding 'lm_eval/tasks/bigbench/generate_until/physics.yaml'
2025-08-31T08:28:47,226   adding 'lm_eval/tasks/bigbench/generate_until/physics_questions.yaml'
2025-08-31T08:28:47,227   adding 'lm_eval/tasks/bigbench/generate_until/play_dialog_same_or_different.yaml'
2025-08-31T08:28:47,229   adding 'lm_eval/tasks/bigbench/generate_until/polish_sequence_labeling.yaml'
2025-08-31T08:28:47,230   adding 'lm_eval/tasks/bigbench/generate_until/presuppositions_as_nli.yaml'
2025-08-31T08:28:47,231   adding 'lm_eval/tasks/bigbench/generate_until/qa_wikidata.yaml'
2025-08-31T08:28:47,232   adding 'lm_eval/tasks/bigbench/generate_until/question_selection.yaml'
2025-08-31T08:28:47,233   adding 'lm_eval/tasks/bigbench/generate_until/real_or_fake_text.yaml'
2025-08-31T08:28:47,234   adding 'lm_eval/tasks/bigbench/generate_until/reasoning_about_colored_objects.yaml'
2025-08-31T08:28:47,235   adding 'lm_eval/tasks/bigbench/generate_until/repeat_copy_logic.yaml'
2025-08-31T08:28:47,237   adding 'lm_eval/tasks/bigbench/generate_until/rephrase.yaml'
2025-08-31T08:28:47,238   adding 'lm_eval/tasks/bigbench/generate_until/riddle_sense.yaml'
2025-08-31T08:28:47,239   adding 'lm_eval/tasks/bigbench/generate_until/ruin_names.yaml'
2025-08-31T08:28:47,240   adding 'lm_eval/tasks/bigbench/generate_until/salient_translation_error_detection.yaml'
2025-08-31T08:28:47,241   adding 'lm_eval/tasks/bigbench/generate_until/scientific_press_release.yaml'
2025-08-31T08:28:47,242   adding 'lm_eval/tasks/bigbench/generate_until/semantic_parsing_in_context_sparc.yaml'
2025-08-31T08:28:47,243   adding 'lm_eval/tasks/bigbench/generate_until/semantic_parsing_spider.yaml'
2025-08-31T08:28:47,244   adding 'lm_eval/tasks/bigbench/generate_until/sentence_ambiguity.yaml'
2025-08-31T08:28:47,245   adding 'lm_eval/tasks/bigbench/generate_until/similarities_abstraction.yaml'
2025-08-31T08:28:47,246   adding 'lm_eval/tasks/bigbench/generate_until/simp_turing_concept.yaml'
2025-08-31T08:28:47,248   adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json.yaml'
2025-08-31T08:28:47,249   adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_multiple_choice.yaml'
2025-08-31T08:28:47,250   adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_subtasks.yaml'
2025-08-31T08:28:47,252   adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_multiple_targets_json.yaml'
2025-08-31T08:28:47,253   adding 'lm_eval/tasks/bigbench/generate_until/simple_ethical_questions.yaml'
2025-08-31T08:28:47,254   adding 'lm_eval/tasks/bigbench/generate_until/simple_text_editing.yaml'
2025-08-31T08:28:47,255   adding 'lm_eval/tasks/bigbench/generate_until/snarks.yaml'
2025-08-31T08:28:47,256   adding 'lm_eval/tasks/bigbench/generate_until/social_iqa.yaml'
2025-08-31T08:28:47,257   adding 'lm_eval/tasks/bigbench/generate_until/social_support.yaml'
2025-08-31T08:28:47,258   adding 'lm_eval/tasks/bigbench/generate_until/sports_understanding.yaml'
2025-08-31T08:28:47,259   adding 'lm_eval/tasks/bigbench/generate_until/strange_stories.yaml'
2025-08-31T08:28:47,260   adding 'lm_eval/tasks/bigbench/generate_until/strategyqa.yaml'
2025-08-31T08:28:47,261   adding 'lm_eval/tasks/bigbench/generate_until/sufficient_information.yaml'
2025-08-31T08:28:47,262   adding 'lm_eval/tasks/bigbench/generate_until/suicide_risk.yaml'
2025-08-31T08:28:47,263   adding 'lm_eval/tasks/bigbench/generate_until/swahili_english_proverbs.yaml'
2025-08-31T08:28:47,265   adding 'lm_eval/tasks/bigbench/generate_until/swedish_to_german_proverbs.yaml'
2025-08-31T08:28:47,266   adding 'lm_eval/tasks/bigbench/generate_until/symbol_interpretation.yaml'
2025-08-31T08:28:47,267   adding 'lm_eval/tasks/bigbench/generate_until/temporal_sequences.yaml'
2025-08-31T08:28:47,268   adding 'lm_eval/tasks/bigbench/generate_until/tense.yaml'
2025-08-31T08:28:47,269   adding 'lm_eval/tasks/bigbench/generate_until/timedial.yaml'
2025-08-31T08:28:47,270   adding 'lm_eval/tasks/bigbench/generate_until/topical_chat.yaml'
2025-08-31T08:28:47,271   adding 'lm_eval/tasks/bigbench/generate_until/tracking_shuffled_objects.yaml'
2025-08-31T08:28:47,272   adding 'lm_eval/tasks/bigbench/generate_until/understanding_fables.yaml'
2025-08-31T08:28:47,273   adding 'lm_eval/tasks/bigbench/generate_until/undo_permutation.yaml'
2025-08-31T08:28:47,274   adding 'lm_eval/tasks/bigbench/generate_until/unit_conversion.yaml'
2025-08-31T08:28:47,275   adding 'lm_eval/tasks/bigbench/generate_until/unit_interpretation.yaml'
2025-08-31T08:28:47,277   adding 'lm_eval/tasks/bigbench/generate_until/unnatural_in_context_learning.yaml'
2025-08-31T08:28:47,278   adding 'lm_eval/tasks/bigbench/generate_until/vitaminc_fact_verification.yaml'
2025-08-31T08:28:47,279   adding 'lm_eval/tasks/bigbench/generate_until/what_is_the_tao.yaml'
2025-08-31T08:28:47,280   adding 'lm_eval/tasks/bigbench/generate_until/which_wiki_edit.yaml'
2025-08-31T08:28:47,281   adding 'lm_eval/tasks/bigbench/generate_until/winowhy.yaml'
2025-08-31T08:28:47,282   adding 'lm_eval/tasks/bigbench/generate_until/word_sorting.yaml'
2025-08-31T08:28:47,283   adding 'lm_eval/tasks/bigbench/generate_until/word_unscrambling.yaml'
2025-08-31T08:28:47,287   adding 'lm_eval/tasks/bigbench/multiple_choice/abstract_narrative_understanding.yaml'
2025-08-31T08:28:47,288   adding 'lm_eval/tasks/bigbench/multiple_choice/anachronisms.yaml'
2025-08-31T08:28:47,289   adding 'lm_eval/tasks/bigbench/multiple_choice/analogical_similarity.yaml'
2025-08-31T08:28:47,290   adding 'lm_eval/tasks/bigbench/multiple_choice/analytic_entailment.yaml'
2025-08-31T08:28:47,292   adding 'lm_eval/tasks/bigbench/multiple_choice/arithmetic.yaml'
2025-08-31T08:28:47,293   adding 'lm_eval/tasks/bigbench/multiple_choice/authorship_verification.yaml'
2025-08-31T08:28:47,294   adding 'lm_eval/tasks/bigbench/multiple_choice/bbq_lite_json.yaml'
2025-08-31T08:28:47,295   adding 'lm_eval/tasks/bigbench/multiple_choice/causal_judgment.yaml'
2025-08-31T08:28:47,296   adding 'lm_eval/tasks/bigbench/multiple_choice/cause_and_effect.yaml'
2025-08-31T08:28:47,297   adding 'lm_eval/tasks/bigbench/multiple_choice/checkmate_in_one.yaml'
2025-08-31T08:28:47,299   adding 'lm_eval/tasks/bigbench/multiple_choice/cifar10_classification.yaml'
2025-08-31T08:28:47,300   adding 'lm_eval/tasks/bigbench/multiple_choice/code_line_description.yaml'
2025-08-31T08:28:47,301   adding 'lm_eval/tasks/bigbench/multiple_choice/color.yaml'
2025-08-31T08:28:47,302   adding 'lm_eval/tasks/bigbench/multiple_choice/common_morpheme.yaml'
2025-08-31T08:28:47,303   adding 'lm_eval/tasks/bigbench/multiple_choice/conceptual_combinations.yaml'
2025-08-31T08:28:47,304   adding 'lm_eval/tasks/bigbench/multiple_choice/contextual_parametric_knowledge_conflicts.yaml'
2025-08-31T08:28:47,305   adding 'lm_eval/tasks/bigbench/multiple_choice/crash_blossom.yaml'
2025-08-31T08:28:47,306   adding 'lm_eval/tasks/bigbench/multiple_choice/crass_ai.yaml'
2025-08-31T08:28:47,307   adding 'lm_eval/tasks/bigbench/multiple_choice/cryobiology_spanish.yaml'
2025-08-31T08:28:47,308   adding 'lm_eval/tasks/bigbench/multiple_choice/cs_algorithms.yaml'
2025-08-31T08:28:47,309   adding 'lm_eval/tasks/bigbench/multiple_choice/dark_humor_detection.yaml'
2025-08-31T08:28:47,310   adding 'lm_eval/tasks/bigbench/multiple_choice/date_understanding.yaml'
2025-08-31T08:28:47,311   adding 'lm_eval/tasks/bigbench/multiple_choice/disambiguation_qa.yaml'
2025-08-31T08:28:47,312   adding 'lm_eval/tasks/bigbench/multiple_choice/discourse_marker_prediction.yaml'
2025-08-31T08:28:47,313   adding 'lm_eval/tasks/bigbench/multiple_choice/dyck_languages.yaml'
2025-08-31T08:28:47,315   adding 'lm_eval/tasks/bigbench/multiple_choice/elementary_math_qa.yaml'
2025-08-31T08:28:47,316   adding 'lm_eval/tasks/bigbench/multiple_choice/emoji_movie.yaml'
2025-08-31T08:28:47,317   adding 'lm_eval/tasks/bigbench/multiple_choice/emojis_emotion_prediction.yaml'
2025-08-31T08:28:47,318   adding 'lm_eval/tasks/bigbench/multiple_choice/empirical_judgments.yaml'
2025-08-31T08:28:47,319   adding 'lm_eval/tasks/bigbench/multiple_choice/english_proverbs.yaml'
2025-08-31T08:28:47,320   adding 'lm_eval/tasks/bigbench/multiple_choice/english_russian_proverbs.yaml'
2025-08-31T08:28:47,321   adding 'lm_eval/tasks/bigbench/multiple_choice/entailed_polarity.yaml'
2025-08-31T08:28:47,322   adding 'lm_eval/tasks/bigbench/multiple_choice/entailed_polarity_hindi.yaml'
2025-08-31T08:28:47,323   adding 'lm_eval/tasks/bigbench/multiple_choice/epistemic_reasoning.yaml'
2025-08-31T08:28:47,324   adding 'lm_eval/tasks/bigbench/multiple_choice/evaluating_information_essentiality.yaml'
2025-08-31T08:28:47,326   adding 'lm_eval/tasks/bigbench/multiple_choice/fact_checker.yaml'
2025-08-31T08:28:47,327   adding 'lm_eval/tasks/bigbench/multiple_choice/fantasy_reasoning.yaml'
2025-08-31T08:28:47,328   adding 'lm_eval/tasks/bigbench/multiple_choice/figure_of_speech_detection.yaml'
2025-08-31T08:28:47,329   adding 'lm_eval/tasks/bigbench/multiple_choice/formal_fallacies_syllogisms_negation.yaml'
2025-08-31T08:28:47,330   adding 'lm_eval/tasks/bigbench/multiple_choice/general_knowledge.yaml'
2025-08-31T08:28:47,331   adding 'lm_eval/tasks/bigbench/multiple_choice/geometric_shapes.yaml'
2025-08-31T08:28:47,333   adding 'lm_eval/tasks/bigbench/multiple_choice/goal_step_wikihow.yaml'
2025-08-31T08:28:47,334   adding 'lm_eval/tasks/bigbench/multiple_choice/gre_reading_comprehension.yaml'
2025-08-31T08:28:47,335   adding 'lm_eval/tasks/bigbench/multiple_choice/hhh_alignment.yaml'
2025-08-31T08:28:47,336   adding 'lm_eval/tasks/bigbench/multiple_choice/hindu_knowledge.yaml'
2025-08-31T08:28:47,337   adding 'lm_eval/tasks/bigbench/multiple_choice/hinglish_toxicity.yaml'
2025-08-31T08:28:47,338   adding 'lm_eval/tasks/bigbench/multiple_choice/human_organs_senses.yaml'
2025-08-31T08:28:47,340   adding 'lm_eval/tasks/bigbench/multiple_choice/hyperbaton.yaml'
2025-08-31T08:28:47,341   adding 'lm_eval/tasks/bigbench/multiple_choice/identify_math_theorems.yaml'
2025-08-31T08:28:47,342   adding 'lm_eval/tasks/bigbench/multiple_choice/identify_odd_metaphor.yaml'
2025-08-31T08:28:47,343   adding 'lm_eval/tasks/bigbench/multiple_choice/implicatures.yaml'
2025-08-31T08:28:47,344   adding 'lm_eval/tasks/bigbench/multiple_choice/implicit_relations.yaml'
2025-08-31T08:28:47,345   adding 'lm_eval/tasks/bigbench/multiple_choice/intent_recognition.yaml'
2025-08-31T08:28:47,347   adding 'lm_eval/tasks/bigbench/multiple_choice/international_phonetic_alphabet_nli.yaml'
2025-08-31T08:28:47,348   adding 'lm_eval/tasks/bigbench/multiple_choice/intersect_geometry.yaml'
2025-08-31T08:28:47,349   adding 'lm_eval/tasks/bigbench/multiple_choice/irony_identification.yaml'
2025-08-31T08:28:47,350   adding 'lm_eval/tasks/bigbench/multiple_choice/kanji_ascii.yaml'
2025-08-31T08:28:47,351   adding 'lm_eval/tasks/bigbench/multiple_choice/kannada.yaml'
2025-08-31T08:28:47,352   adding 'lm_eval/tasks/bigbench/multiple_choice/key_value_maps.yaml'
2025-08-31T08:28:47,353   adding 'lm_eval/tasks/bigbench/multiple_choice/known_unknowns.yaml'
2025-08-31T08:28:47,355   adding 'lm_eval/tasks/bigbench/multiple_choice/language_identification.yaml'
2025-08-31T08:28:47,356   adding 'lm_eval/tasks/bigbench/multiple_choice/logic_grid_puzzle.yaml'
2025-08-31T08:28:47,357   adding 'lm_eval/tasks/bigbench/multiple_choice/logical_args.yaml'
2025-08-31T08:28:47,358   adding 'lm_eval/tasks/bigbench/multiple_choice/logical_deduction.yaml'
2025-08-31T08:28:47,359   adding 'lm_eval/tasks/bigbench/multiple_choice/logical_fallacy_detection.yaml'
2025-08-31T08:28:47,360   adding 'lm_eval/tasks/bigbench/multiple_choice/logical_sequence.yaml'
2025-08-31T08:28:47,362   adding 'lm_eval/tasks/bigbench/multiple_choice/mathematical_induction.yaml'
2025-08-31T08:28:47,363   adding 'lm_eval/tasks/bigbench/multiple_choice/metaphor_boolean.yaml'
2025-08-31T08:28:47,364   adding 'lm_eval/tasks/bigbench/multiple_choice/metaphor_understanding.yaml'
2025-08-31T08:28:47,365   adding 'lm_eval/tasks/bigbench/multiple_choice/misconceptions.yaml'
2025-08-31T08:28:47,367   adding 'lm_eval/tasks/bigbench/multiple_choice/misconceptions_russian.yaml'
2025-08-31T08:28:47,368   adding 'lm_eval/tasks/bigbench/multiple_choice/mnist_ascii.yaml'
2025-08-31T08:28:47,369   adding 'lm_eval/tasks/bigbench/multiple_choice/moral_permissibility.yaml'
2025-08-31T08:28:47,370   adding 'lm_eval/tasks/bigbench/multiple_choice/movie_dialog_same_or_different.yaml'
2025-08-31T08:28:47,371   adding 'lm_eval/tasks/bigbench/multiple_choice/movie_recommendation.yaml'
2025-08-31T08:28:47,372   adding 'lm_eval/tasks/bigbench/multiple_choice/multiemo.yaml'
2025-08-31T08:28:47,373   adding 'lm_eval/tasks/bigbench/multiple_choice/navigate.yaml'
2025-08-31T08:28:47,374   adding 'lm_eval/tasks/bigbench/multiple_choice/nonsense_words_grammar.yaml'
2025-08-31T08:28:47,376   adding 'lm_eval/tasks/bigbench/multiple_choice/novel_concepts.yaml'
2025-08-31T08:28:47,377   adding 'lm_eval/tasks/bigbench/multiple_choice/odd_one_out.yaml'
2025-08-31T08:28:47,378   adding 'lm_eval/tasks/bigbench/multiple_choice/parsinlu_qa.yaml'
2025-08-31T08:28:47,379   adding 'lm_eval/tasks/bigbench/multiple_choice/penguins_in_a_table.yaml'
2025-08-31T08:28:47,380   adding 'lm_eval/tasks/bigbench/multiple_choice/periodic_elements.yaml'
2025-08-31T08:28:47,381   adding 'lm_eval/tasks/bigbench/multiple_choice/persian_idioms.yaml'
2025-08-31T08:28:47,382   adding 'lm_eval/tasks/bigbench/multiple_choice/phrase_relatedness.yaml'
2025-08-31T08:28:47,383   adding 'lm_eval/tasks/bigbench/multiple_choice/physical_intuition.yaml'
2025-08-31T08:28:47,384   adding 'lm_eval/tasks/bigbench/multiple_choice/physics.yaml'
2025-08-31T08:28:47,386   adding 'lm_eval/tasks/bigbench/multiple_choice/play_dialog_same_or_different.yaml'
2025-08-31T08:28:47,387   adding 'lm_eval/tasks/bigbench/multiple_choice/presuppositions_as_nli.yaml'
2025-08-31T08:28:47,388   adding 'lm_eval/tasks/bigbench/multiple_choice/question_selection.yaml'
2025-08-31T08:28:47,389   adding 'lm_eval/tasks/bigbench/multiple_choice/real_or_fake_text.yaml'
2025-08-31T08:28:47,390   adding 'lm_eval/tasks/bigbench/multiple_choice/reasoning_about_colored_objects.yaml'
2025-08-31T08:28:47,391   adding 'lm_eval/tasks/bigbench/multiple_choice/riddle_sense.yaml'
2025-08-31T08:28:47,393   adding 'lm_eval/tasks/bigbench/multiple_choice/ruin_names.yaml'
2025-08-31T08:28:47,394   adding 'lm_eval/tasks/bigbench/multiple_choice/salient_translation_error_detection.yaml'
2025-08-31T08:28:47,395   adding 'lm_eval/tasks/bigbench/multiple_choice/sentence_ambiguity.yaml'
2025-08-31T08:28:47,396   adding 'lm_eval/tasks/bigbench/multiple_choice/similarities_abstraction.yaml'
2025-08-31T08:28:47,397   adding 'lm_eval/tasks/bigbench/multiple_choice/simple_ethical_questions.yaml'
2025-08-31T08:28:47,399   adding 'lm_eval/tasks/bigbench/multiple_choice/snarks.yaml'
2025-08-31T08:28:47,400   adding 'lm_eval/tasks/bigbench/multiple_choice/social_iqa.yaml'
2025-08-31T08:28:47,401   adding 'lm_eval/tasks/bigbench/multiple_choice/social_support.yaml'
2025-08-31T08:28:47,402   adding 'lm_eval/tasks/bigbench/multiple_choice/sports_understanding.yaml'
2025-08-31T08:28:47,403   adding 'lm_eval/tasks/bigbench/multiple_choice/strange_stories.yaml'
2025-08-31T08:28:47,404   adding 'lm_eval/tasks/bigbench/multiple_choice/strategyqa.yaml'
2025-08-31T08:28:47,405   adding 'lm_eval/tasks/bigbench/multiple_choice/suicide_risk.yaml'
2025-08-31T08:28:47,406   adding 'lm_eval/tasks/bigbench/multiple_choice/swahili_english_proverbs.yaml'
2025-08-31T08:28:47,407   adding 'lm_eval/tasks/bigbench/multiple_choice/swedish_to_german_proverbs.yaml'
2025-08-31T08:28:47,409   adding 'lm_eval/tasks/bigbench/multiple_choice/symbol_interpretation.yaml'
2025-08-31T08:28:47,410   adding 'lm_eval/tasks/bigbench/multiple_choice/temporal_sequences.yaml'
2025-08-31T08:28:47,411   adding 'lm_eval/tasks/bigbench/multiple_choice/timedial.yaml'
2025-08-31T08:28:47,412   adding 'lm_eval/tasks/bigbench/multiple_choice/tracking_shuffled_objects.yaml'
2025-08-31T08:28:47,413   adding 'lm_eval/tasks/bigbench/multiple_choice/understanding_fables.yaml'
2025-08-31T08:28:47,414   adding 'lm_eval/tasks/bigbench/multiple_choice/undo_permutation.yaml'
2025-08-31T08:28:47,415   adding 'lm_eval/tasks/bigbench/multiple_choice/unit_conversion.yaml'
2025-08-31T08:28:47,417   adding 'lm_eval/tasks/bigbench/multiple_choice/unit_interpretation.yaml'
2025-08-31T08:28:47,418   adding 'lm_eval/tasks/bigbench/multiple_choice/vitaminc_fact_verification.yaml'
2025-08-31T08:28:47,419   adding 'lm_eval/tasks/bigbench/multiple_choice/what_is_the_tao.yaml'
2025-08-31T08:28:47,420   adding 'lm_eval/tasks/bigbench/multiple_choice/which_wiki_edit.yaml'
2025-08-31T08:28:47,421   adding 'lm_eval/tasks/bigbench/multiple_choice/winowhy.yaml'
2025-08-31T08:28:47,424   adding 'lm_eval/tasks/blimp/README.md'
2025-08-31T08:28:47,426   adding 'lm_eval/tasks/blimp/_blimp.yaml'
2025-08-31T08:28:47,427   adding 'lm_eval/tasks/blimp/_template_yaml'
2025-08-31T08:28:47,428   adding 'lm_eval/tasks/blimp/adjunct_island.yaml'
2025-08-31T08:28:47,429   adding 'lm_eval/tasks/blimp/anaphor_gender_agreement.yaml'
2025-08-31T08:28:47,430   adding 'lm_eval/tasks/blimp/anaphor_number_agreement.yaml'
2025-08-31T08:28:47,432   adding 'lm_eval/tasks/blimp/animate_subject_passive.yaml'
2025-08-31T08:28:47,433   adding 'lm_eval/tasks/blimp/animate_subject_trans.yaml'
2025-08-31T08:28:47,434   adding 'lm_eval/tasks/blimp/causative.yaml'
2025-08-31T08:28:47,435   adding 'lm_eval/tasks/blimp/complex_NP_island.yaml'
2025-08-31T08:28:47,436   adding 'lm_eval/tasks/blimp/coordinate_structure_constraint_complex_left_branch.yaml'
2025-08-31T08:28:47,437   adding 'lm_eval/tasks/blimp/coordinate_structure_constraint_object_extraction.yaml'
2025-08-31T08:28:47,438   adding 'lm_eval/tasks/blimp/determiner_noun_agreement_1.yaml'
2025-08-31T08:28:47,439   adding 'lm_eval/tasks/blimp/determiner_noun_agreement_2.yaml'
2025-08-31T08:28:47,441   adding 'lm_eval/tasks/blimp/determiner_noun_agreement_irregular_1.yaml'
2025-08-31T08:28:47,442   adding 'lm_eval/tasks/blimp/determiner_noun_agreement_irregular_2.yaml'
2025-08-31T08:28:47,443   adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_2.yaml'
2025-08-31T08:28:47,444   adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_1.yaml'
2025-08-31T08:28:47,445   adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_2.yaml'
2025-08-31T08:28:47,446   adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adjective_1.yaml'
2025-08-31T08:28:47,447   adding 'lm_eval/tasks/blimp/distractor_agreement_relational_noun.yaml'
2025-08-31T08:28:47,449   adding 'lm_eval/tasks/blimp/distractor_agreement_relative_clause.yaml'
2025-08-31T08:28:47,450   adding 'lm_eval/tasks/blimp/drop_argument.yaml'
2025-08-31T08:28:47,451   adding 'lm_eval/tasks/blimp/ellipsis_n_bar_1.yaml'
2025-08-31T08:28:47,452   adding 'lm_eval/tasks/blimp/ellipsis_n_bar_2.yaml'
2025-08-31T08:28:47,453   adding 'lm_eval/tasks/blimp/existential_there_object_raising.yaml'
2025-08-31T08:28:47,454   adding 'lm_eval/tasks/blimp/existential_there_quantifiers_1.yaml'
2025-08-31T08:28:47,456   adding 'lm_eval/tasks/blimp/existential_there_quantifiers_2.yaml'
2025-08-31T08:28:47,457   adding 'lm_eval/tasks/blimp/existential_there_subject_raising.yaml'
2025-08-31T08:28:47,458   adding 'lm_eval/tasks/blimp/expletive_it_object_raising.yaml'
2025-08-31T08:28:47,459   adding 'lm_eval/tasks/blimp/generate_configs.py'
2025-08-31T08:28:47,460   adding 'lm_eval/tasks/blimp/inchoative.yaml'
2025-08-31T08:28:47,463   adding 'lm_eval/tasks/blimp/intransitive.yaml'
2025-08-31T08:28:47,464   adding 'lm_eval/tasks/blimp/irregular_past_participle_adjectives.yaml'
2025-08-31T08:28:47,465   adding 'lm_eval/tasks/blimp/irregular_past_participle_verbs.yaml'
2025-08-31T08:28:47,466   adding 'lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_1.yaml'
2025-08-31T08:28:47,467   adding 'lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_2.yaml'
2025-08-31T08:28:47,468   adding 'lm_eval/tasks/blimp/left_branch_island_echo_question.yaml'
2025-08-31T08:28:47,470   adding 'lm_eval/tasks/blimp/left_branch_island_simple_question.yaml'
2025-08-31T08:28:47,471   adding 'lm_eval/tasks/blimp/matrix_question_npi_licensor_present.yaml'
2025-08-31T08:28:47,472   adding 'lm_eval/tasks/blimp/npi_present_1.yaml'
2025-08-31T08:28:47,473   adding 'lm_eval/tasks/blimp/npi_present_2.yaml'
2025-08-31T08:28:47,474   adding 'lm_eval/tasks/blimp/only_npi_licensor_present.yaml'
2025-08-31T08:28:47,476   adding 'lm_eval/tasks/blimp/only_npi_scope.yaml'
2025-08-31T08:28:47,477   adding 'lm_eval/tasks/blimp/passive_1.yaml'
2025-08-31T08:28:47,478   adding 'lm_eval/tasks/blimp/passive_2.yaml'
2025-08-31T08:28:47,479   adding 'lm_eval/tasks/blimp/principle_A_c_command.yaml'
2025-08-31T08:28:47,480   adding 'lm_eval/tasks/blimp/principle_A_case_1.yaml'
2025-08-31T08:28:47,481   adding 'lm_eval/tasks/blimp/principle_A_case_2.yaml'
2025-08-31T08:28:47,483   adding 'lm_eval/tasks/blimp/principle_A_domain_1.yaml'
2025-08-31T08:28:47,484   adding 'lm_eval/tasks/blimp/principle_A_domain_2.yaml'
2025-08-31T08:28:47,485   adding 'lm_eval/tasks/blimp/principle_A_domain_3.yaml'
2025-08-31T08:28:47,486   adding 'lm_eval/tasks/blimp/principle_A_reconstruction.yaml'
2025-08-31T08:28:47,487   adding 'lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_1.yaml'
2025-08-31T08:28:47,488   adding 'lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_2.yaml'
2025-08-31T08:28:47,490   adding 'lm_eval/tasks/blimp/sentential_negation_npi_licensor_present.yaml'
2025-08-31T08:28:47,491   adding 'lm_eval/tasks/blimp/sentential_negation_npi_scope.yaml'
2025-08-31T08:28:47,492   adding 'lm_eval/tasks/blimp/sentential_subject_island.yaml'
2025-08-31T08:28:47,493   adding 'lm_eval/tasks/blimp/superlative_quantifiers_1.yaml'
2025-08-31T08:28:47,494   adding 'lm_eval/tasks/blimp/superlative_quantifiers_2.yaml'
2025-08-31T08:28:47,496   adding 'lm_eval/tasks/blimp/tough_vs_raising_1.yaml'
2025-08-31T08:28:47,497   adding 'lm_eval/tasks/blimp/tough_vs_raising_2.yaml'
2025-08-31T08:28:47,498   adding 'lm_eval/tasks/blimp/transitive.yaml'
2025-08-31T08:28:47,499   adding 'lm_eval/tasks/blimp/wh_island.yaml'
2025-08-31T08:28:47,500   adding 'lm_eval/tasks/blimp/wh_questions_object_gap.yaml'
2025-08-31T08:28:47,502   adding 'lm_eval/tasks/blimp/wh_questions_subject_gap.yaml'
2025-08-31T08:28:47,503   adding 'lm_eval/tasks/blimp/wh_questions_subject_gap_long_distance.yaml'
2025-08-31T08:28:47,504   adding 'lm_eval/tasks/blimp/wh_vs_that_no_gap.yaml'
2025-08-31T08:28:47,505   adding 'lm_eval/tasks/blimp/wh_vs_that_no_gap_long_distance.yaml'
2025-08-31T08:28:47,507   adding 'lm_eval/tasks/blimp/wh_vs_that_with_gap.yaml'
2025-08-31T08:28:47,508   adding 'lm_eval/tasks/blimp/wh_vs_that_with_gap_long_distance.yaml'
2025-08-31T08:28:47,509   adding 'lm_eval/tasks/c4/README.md'
2025-08-31T08:28:47,511   adding 'lm_eval/tasks/c4/c4.yaml'
2025-08-31T08:28:47,512   adding 'lm_eval/tasks/c4/preprocess_c4.py'
2025-08-31T08:28:47,514   adding 'lm_eval/tasks/careqa/README.md'
2025-08-31T08:28:47,515   adding 'lm_eval/tasks/careqa/careqa_en.yaml'
2025-08-31T08:28:47,516   adding 'lm_eval/tasks/careqa/careqa_es.yaml'
2025-08-31T08:28:47,517   adding 'lm_eval/tasks/careqa/careqa_open.yaml'
2025-08-31T08:28:47,518   adding 'lm_eval/tasks/careqa/careqa_open_perplexity.yaml'
2025-08-31T08:28:47,520   adding 'lm_eval/tasks/careqa/utils.py'
2025-08-31T08:28:47,521   adding 'lm_eval/tasks/careqa/utils_open.py'
2025-08-31T08:28:47,522   adding 'lm_eval/tasks/careqa/utils_perplexity.py'
2025-08-31T08:28:47,525   adding 'lm_eval/tasks/catalan_bench/README.md'
2025-08-31T08:28:47,526   adding 'lm_eval/tasks/catalan_bench/_arc_ca_common_yaml'
2025-08-31T08:28:47,527   adding 'lm_eval/tasks/catalan_bench/_cabreu_common_yaml'
2025-08-31T08:28:47,528   adding 'lm_eval/tasks/catalan_bench/arc_ca_challenge.yaml'
2025-08-31T08:28:47,530   adding 'lm_eval/tasks/catalan_bench/arc_ca_easy.yaml'
2025-08-31T08:28:47,531   adding 'lm_eval/tasks/catalan_bench/cabreu_abstractive.yaml'
2025-08-31T08:28:47,532   adding 'lm_eval/tasks/catalan_bench/cabreu_extractive.yaml'
2025-08-31T08:28:47,533   adding 'lm_eval/tasks/catalan_bench/cabreu_extreme.yaml'
2025-08-31T08:28:47,534   adding 'lm_eval/tasks/catalan_bench/catalan_bench.yaml'
2025-08-31T08:28:47,536   adding 'lm_eval/tasks/catalan_bench/catalanqa.yaml'
2025-08-31T08:28:47,537   adding 'lm_eval/tasks/catalan_bench/catcola.yaml'
2025-08-31T08:28:47,538   adding 'lm_eval/tasks/catalan_bench/cocoteros_va.yaml'
2025-08-31T08:28:47,539   adding 'lm_eval/tasks/catalan_bench/copa_ca.yaml'
2025-08-31T08:28:47,541   adding 'lm_eval/tasks/catalan_bench/coqcat.yaml'
2025-08-31T08:28:47,542   adding 'lm_eval/tasks/catalan_bench/mgsm_direct_ca.yaml'
2025-08-31T08:28:47,543   adding 'lm_eval/tasks/catalan_bench/openbookqa_ca.yaml'
2025-08-31T08:28:47,544   adding 'lm_eval/tasks/catalan_bench/parafraseja.yaml'
2025-08-31T08:28:47,546   adding 'lm_eval/tasks/catalan_bench/paws_ca.yaml'
2025-08-31T08:28:47,547   adding 'lm_eval/tasks/catalan_bench/piqa_ca.yaml'
2025-08-31T08:28:47,548   adding 'lm_eval/tasks/catalan_bench/siqa_ca.yaml'
2025-08-31T08:28:47,550   adding 'lm_eval/tasks/catalan_bench/teca.yaml'
2025-08-31T08:28:47,551   adding 'lm_eval/tasks/catalan_bench/utils.py'
2025-08-31T08:28:47,553   adding 'lm_eval/tasks/catalan_bench/wnli_ca.yaml'
2025-08-31T08:28:47,554   adding 'lm_eval/tasks/catalan_bench/xnli_ca.yaml'
2025-08-31T08:28:47,555   adding 'lm_eval/tasks/catalan_bench/xquad_ca.yaml'
2025-08-31T08:28:47,557   adding 'lm_eval/tasks/catalan_bench/xstorycloze_ca.yaml'
2025-08-31T08:28:47,558   adding 'lm_eval/tasks/catalan_bench/flores_ca/_flores_common_yaml'
2025-08-31T08:28:47,560   adding 'lm_eval/tasks/catalan_bench/flores_ca/create_yamls_flores_ca.py'
2025-08-31T08:28:47,562   adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-de.yaml'
2025-08-31T08:28:47,563   adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-en.yaml'
2025-08-31T08:28:47,564   adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-es.yaml'
2025-08-31T08:28:47,565   adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-eu.yaml'
2025-08-31T08:28:47,566   adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-fr.yaml'
2025-08-31T08:28:47,567   adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-gl.yaml'
2025-08-31T08:28:47,569   adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-it.yaml'
2025-08-31T08:28:47,570   adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-pt.yaml'
2025-08-31T08:28:47,571   adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca.yaml'
2025-08-31T08:28:47,572   adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_de-ca.yaml'
2025-08-31T08:28:47,574   adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_en-ca.yaml'
2025-08-31T08:28:47,575   adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_es-ca.yaml'
2025-08-31T08:28:47,576   adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_eu-ca.yaml'
2025-08-31T08:28:47,577   adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_fr-ca.yaml'
2025-08-31T08:28:47,578   adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_gl-ca.yaml'
2025-08-31T08:28:47,579   adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_it-ca.yaml'
2025-08-31T08:28:47,580   adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_pt-ca.yaml'
2025-08-31T08:28:47,582   adding 'lm_eval/tasks/catalan_bench/phrases_va/_phrases_va_common'
2025-08-31T08:28:47,583   adding 'lm_eval/tasks/catalan_bench/phrases_va/phrases_ca-va.yaml'
2025-08-31T08:28:47,584   adding 'lm_eval/tasks/catalan_bench/phrases_va/phrases_va-ca.yaml'
2025-08-31T08:28:47,587   adding 'lm_eval/tasks/ceval/README.md'
2025-08-31T08:28:47,588   adding 'lm_eval/tasks/ceval/_ceval-valid.yaml'
2025-08-31T08:28:47,589   adding 'lm_eval/tasks/ceval/_default_ceval_yaml'
2025-08-31T08:28:47,591   adding 'lm_eval/tasks/ceval/_generate_configs.py'
2025-08-31T08:28:47,592   adding 'lm_eval/tasks/ceval/ceval-valid_accountant.yaml'
2025-08-31T08:28:47,593   adding 'lm_eval/tasks/ceval/ceval-valid_advanced_mathematics.yaml'
2025-08-31T08:28:47,594   adding 'lm_eval/tasks/ceval/ceval-valid_art_studies.yaml'
2025-08-31T08:28:47,595   adding 'lm_eval/tasks/ceval/ceval-valid_basic_medicine.yaml'
2025-08-31T08:28:47,596   adding 'lm_eval/tasks/ceval/ceval-valid_business_administration.yaml'
2025-08-31T08:28:47,598   adding 'lm_eval/tasks/ceval/ceval-valid_chinese_language_and_literature.yaml'
2025-08-31T08:28:47,599   adding 'lm_eval/tasks/ceval/ceval-valid_civil_servant.yaml'
2025-08-31T08:28:47,600   adding 'lm_eval/tasks/ceval/ceval-valid_clinical_medicine.yaml'
2025-08-31T08:28:47,601   adding 'lm_eval/tasks/ceval/ceval-valid_college_chemistry.yaml'
2025-08-31T08:28:47,602   adding 'lm_eval/tasks/ceval/ceval-valid_college_economics.yaml'
2025-08-31T08:28:47,603   adding 'lm_eval/tasks/ceval/ceval-valid_college_physics.yaml'
2025-08-31T08:28:47,605   adding 'lm_eval/tasks/ceval/ceval-valid_college_programming.yaml'
2025-08-31T08:28:47,606   adding 'lm_eval/tasks/ceval/ceval-valid_computer_architecture.yaml'
2025-08-31T08:28:47,607   adding 'lm_eval/tasks/ceval/ceval-valid_computer_network.yaml'
2025-08-31T08:28:47,608   adding 'lm_eval/tasks/ceval/ceval-valid_discrete_mathematics.yaml'
2025-08-31T08:28:47,609   adding 'lm_eval/tasks/ceval/ceval-valid_education_science.yaml'
2025-08-31T08:28:47,610   adding 'lm_eval/tasks/ceval/ceval-valid_electrical_engineer.yaml'
2025-08-31T08:28:47,612   adding 'lm_eval/tasks/ceval/ceval-valid_environmental_impact_assessment_engineer.yaml'
2025-08-31T08:28:47,613   adding 'lm_eval/tasks/ceval/ceval-valid_fire_engineer.yaml'
2025-08-31T08:28:47,614   adding 'lm_eval/tasks/ceval/ceval-valid_high_school_biology.yaml'
2025-08-31T08:28:47,615   adding 'lm_eval/tasks/ceval/ceval-valid_high_school_chemistry.yaml'
2025-08-31T08:28:47,616   adding 'lm_eval/tasks/ceval/ceval-valid_high_school_chinese.yaml'
2025-08-31T08:28:47,617   adding 'lm_eval/tasks/ceval/ceval-valid_high_school_geography.yaml'
2025-08-31T08:28:47,619   adding 'lm_eval/tasks/ceval/ceval-valid_high_school_history.yaml'
2025-08-31T08:28:47,620   adding 'lm_eval/tasks/ceval/ceval-valid_high_school_mathematics.yaml'
2025-08-31T08:28:47,621   adding 'lm_eval/tasks/ceval/ceval-valid_high_school_physics.yaml'
2025-08-31T08:28:47,622   adding 'lm_eval/tasks/ceval/ceval-valid_high_school_politics.yaml'
2025-08-31T08:28:47,623   adding 'lm_eval/tasks/ceval/ceval-valid_ideological_and_moral_cultivation.yaml'
2025-08-31T08:28:47,624   adding 'lm_eval/tasks/ceval/ceval-valid_law.yaml'
2025-08-31T08:28:47,626   adding 'lm_eval/tasks/ceval/ceval-valid_legal_professional.yaml'
2025-08-31T08:28:47,627   adding 'lm_eval/tasks/ceval/ceval-valid_logic.yaml'
2025-08-31T08:28:47,628   adding 'lm_eval/tasks/ceval/ceval-valid_mao_zedong_thought.yaml'
2025-08-31T08:28:47,629   adding 'lm_eval/tasks/ceval/ceval-valid_marxism.yaml'
2025-08-31T08:28:47,630   adding 'lm_eval/tasks/ceval/ceval-valid_metrology_engineer.yaml'
2025-08-31T08:28:47,631   adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_biology.yaml'
2025-08-31T08:28:47,633   adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_chemistry.yaml'
2025-08-31T08:28:47,634   adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_geography.yaml'
2025-08-31T08:28:47,635   adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_history.yaml'
2025-08-31T08:28:47,636   adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_mathematics.yaml'
2025-08-31T08:28:47,637   adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_physics.yaml'
2025-08-31T08:28:47,638   adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_politics.yaml'
2025-08-31T08:28:47,640   adding 'lm_eval/tasks/ceval/ceval-valid_modern_chinese_history.yaml'
2025-08-31T08:28:47,641   adding 'lm_eval/tasks/ceval/ceval-valid_operating_system.yaml'
2025-08-31T08:28:47,642   adding 'lm_eval/tasks/ceval/ceval-valid_physician.yaml'
2025-08-31T08:28:47,643   adding 'lm_eval/tasks/ceval/ceval-valid_plant_protection.yaml'
2025-08-31T08:28:47,644   adding 'lm_eval/tasks/ceval/ceval-valid_probability_and_statistics.yaml'
2025-08-31T08:28:47,645   adding 'lm_eval/tasks/ceval/ceval-valid_professional_tour_guide.yaml'
2025-08-31T08:28:47,647   adding 'lm_eval/tasks/ceval/ceval-valid_sports_science.yaml'
2025-08-31T08:28:47,648   adding 'lm_eval/tasks/ceval/ceval-valid_tax_accountant.yaml'
2025-08-31T08:28:47,649   adding 'lm_eval/tasks/ceval/ceval-valid_teacher_qualification.yaml'
2025-08-31T08:28:47,650   adding 'lm_eval/tasks/ceval/ceval-valid_urban_and_rural_planner.yaml'
2025-08-31T08:28:47,651   adding 'lm_eval/tasks/ceval/ceval-valid_veterinary_medicine.yaml'
2025-08-31T08:28:47,653   adding 'lm_eval/tasks/chartqa/README.md'
2025-08-31T08:28:47,654   adding 'lm_eval/tasks/chartqa/chartqa.yaml'
2025-08-31T08:28:47,656   adding 'lm_eval/tasks/chartqa/chartqa_llama.yaml'
2025-08-31T08:28:47,657   adding 'lm_eval/tasks/chartqa/chartqa_llama_90.yaml'
2025-08-31T08:28:47,659   adding 'lm_eval/tasks/chartqa/utils.py'
2025-08-31T08:28:47,663   adding 'lm_eval/tasks/cmmlu/README.md'
2025-08-31T08:28:47,665   adding 'lm_eval/tasks/cmmlu/_cmmlu.yaml'
2025-08-31T08:28:47,666   adding 'lm_eval/tasks/cmmlu/_default_template_yaml'
2025-08-31T08:28:47,668   adding 'lm_eval/tasks/cmmlu/_generate_configs.py'
2025-08-31T08:28:47,669   adding 'lm_eval/tasks/cmmlu/cmmlu_agronomy.yaml'
2025-08-31T08:28:47,670   adding 'lm_eval/tasks/cmmlu/cmmlu_anatomy.yaml'
2025-08-31T08:28:47,671   adding 'lm_eval/tasks/cmmlu/cmmlu_ancient_chinese.yaml'
2025-08-31T08:28:47,672   adding 'lm_eval/tasks/cmmlu/cmmlu_arts.yaml'
2025-08-31T08:28:47,673   adding 'lm_eval/tasks/cmmlu/cmmlu_astronomy.yaml'
2025-08-31T08:28:47,675   adding 'lm_eval/tasks/cmmlu/cmmlu_business_ethics.yaml'
2025-08-31T08:28:47,676   adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_civil_service_exam.yaml'
2025-08-31T08:28:47,677   adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_driving_rule.yaml'
2025-08-31T08:28:47,678   adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_food_culture.yaml'
2025-08-31T08:28:47,679   adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_foreign_policy.yaml'
2025-08-31T08:28:47,681   adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_history.yaml'
2025-08-31T08:28:47,682   adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_literature.yaml'
2025-08-31T08:28:47,683   adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_teacher_qualification.yaml'
2025-08-31T08:28:47,684   adding 'lm_eval/tasks/cmmlu/cmmlu_clinical_knowledge.yaml'
2025-08-31T08:28:47,685   adding 'lm_eval/tasks/cmmlu/cmmlu_college_actuarial_science.yaml'
2025-08-31T08:28:47,686   adding 'lm_eval/tasks/cmmlu/cmmlu_college_education.yaml'
2025-08-31T08:28:47,688   adding 'lm_eval/tasks/cmmlu/cmmlu_college_engineering_hydrology.yaml'
2025-08-31T08:28:47,689   adding 'lm_eval/tasks/cmmlu/cmmlu_college_law.yaml'
2025-08-31T08:28:47,690   adding 'lm_eval/tasks/cmmlu/cmmlu_college_mathematics.yaml'
2025-08-31T08:28:47,691   adding 'lm_eval/tasks/cmmlu/cmmlu_college_medical_statistics.yaml'
2025-08-31T08:28:47,692   adding 'lm_eval/tasks/cmmlu/cmmlu_college_medicine.yaml'
2025-08-31T08:28:47,693   adding 'lm_eval/tasks/cmmlu/cmmlu_computer_science.yaml'
2025-08-31T08:28:47,695   adding 'lm_eval/tasks/cmmlu/cmmlu_computer_security.yaml'
2025-08-31T08:28:47,696   adding 'lm_eval/tasks/cmmlu/cmmlu_conceptual_physics.yaml'
2025-08-31T08:28:47,697   adding 'lm_eval/tasks/cmmlu/cmmlu_construction_project_management.yaml'
2025-08-31T08:28:47,698   adding 'lm_eval/tasks/cmmlu/cmmlu_default_agronomy.yaml'
2025-08-31T08:28:47,699   adding 'lm_eval/tasks/cmmlu/cmmlu_default_anatomy.yaml'
2025-08-31T08:28:47,700   adding 'lm_eval/tasks/cmmlu/cmmlu_default_ancient_chinese.yaml'
2025-08-31T08:28:47,702   adding 'lm_eval/tasks/cmmlu/cmmlu_default_arts.yaml'
2025-08-31T08:28:47,703   adding 'lm_eval/tasks/cmmlu/cmmlu_default_astronomy.yaml'
2025-08-31T08:28:47,704   adding 'lm_eval/tasks/cmmlu/cmmlu_default_business_ethics.yaml'
2025-08-31T08:28:47,705   adding 'lm_eval/tasks/cmmlu/cmmlu_default_chinese_civil_service_exam.yaml'
2025-08-31T08:28:47,706   adding 'lm_eval/tasks/cmmlu/cmmlu_default_chinese_driving_rule.yaml'
2025-08-31T08:28:47,707   adding 'lm_eval/tasks/cmmlu/cmmlu_default_chinese_food_culture.yaml'
2025-08-31T08:28:47,709   adding 'lm_eval/tasks/cmmlu/cmmlu_default_chinese_foreign_policy.yaml'
2025-08-31T08:28:47,710   adding 'lm_eval/tasks/cmmlu/cmmlu_default_chinese_history.yaml'
2025-08-31T08:28:47,711   adding 'lm_eval/tasks/cmmlu/cmmlu_default_chinese_literature.yaml'
2025-08-31T08:28:47,712   adding 'lm_eval/tasks/cmmlu/cmmlu_default_chinese_teacher_qualification.yaml'
2025-08-31T08:28:47,713   adding 'lm_eval/tasks/cmmlu/cmmlu_default_clinical_knowledge.yaml'
2025-08-31T08:28:47,714   adding 'lm_eval/tasks/cmmlu/cmmlu_default_college_actuarial_science.yaml'
2025-08-31T08:28:47,716   adding 'lm_eval/tasks/cmmlu/cmmlu_default_college_education.yaml'
2025-08-31T08:28:47,717   adding 'lm_eval/tasks/cmmlu/cmmlu_default_college_engineering_hydrology.yaml'
2025-08-31T08:28:47,718   adding 'lm_eval/tasks/cmmlu/cmmlu_default_college_law.yaml'
2025-08-31T08:28:47,719   adding 'lm_eval/tasks/cmmlu/cmmlu_default_college_mathematics.yaml'
2025-08-31T08:28:47,720   adding 'lm_eval/tasks/cmmlu/cmmlu_default_college_medical_statistics.yaml'
2025-08-31T08:28:47,722   adding 'lm_eval/tasks/cmmlu/cmmlu_default_college_medicine.yaml'
2025-08-31T08:28:47,723   adding 'lm_eval/tasks/cmmlu/cmmlu_default_computer_science.yaml'
2025-08-31T08:28:47,724   adding 'lm_eval/tasks/cmmlu/cmmlu_default_computer_security.yaml'
2025-08-31T08:28:47,725   adding 'lm_eval/tasks/cmmlu/cmmlu_default_conceptual_physics.yaml'
2025-08-31T08:28:47,726   adding 'lm_eval/tasks/cmmlu/cmmlu_default_construction_project_management.yaml'
2025-08-31T08:28:47,728   adding 'lm_eval/tasks/cmmlu/cmmlu_default_economics.yaml'
2025-08-31T08:28:47,729   adding 'lm_eval/tasks/cmmlu/cmmlu_default_education.yaml'
2025-08-31T08:28:47,730   adding 'lm_eval/tasks/cmmlu/cmmlu_default_electrical_engineering.yaml'
2025-08-31T08:28:47,731   adding 'lm_eval/tasks/cmmlu/cmmlu_default_elementary_chinese.yaml'
2025-08-31T08:28:47,732   adding 'lm_eval/tasks/cmmlu/cmmlu_default_elementary_commonsense.yaml'
2025-08-31T08:28:47,734   adding 'lm_eval/tasks/cmmlu/cmmlu_default_elementary_information_and_technology.yaml'
2025-08-31T08:28:47,735   adding 'lm_eval/tasks/cmmlu/cmmlu_default_elementary_mathematics.yaml'
2025-08-31T08:28:47,736   adding 'lm_eval/tasks/cmmlu/cmmlu_default_ethnology.yaml'
2025-08-31T08:28:47,737   adding 'lm_eval/tasks/cmmlu/cmmlu_default_food_science.yaml'
2025-08-31T08:28:47,739   adding 'lm_eval/tasks/cmmlu/cmmlu_default_genetics.yaml'
2025-08-31T08:28:47,740   adding 'lm_eval/tasks/cmmlu/cmmlu_default_global_facts.yaml'
2025-08-31T08:28:47,741   adding 'lm_eval/tasks/cmmlu/cmmlu_default_high_school_biology.yaml'
2025-08-31T08:28:47,742   adding 'lm_eval/tasks/cmmlu/cmmlu_default_high_school_chemistry.yaml'
2025-08-31T08:28:47,743   adding 'lm_eval/tasks/cmmlu/cmmlu_default_high_school_geography.yaml'
2025-08-31T08:28:47,744   adding 'lm_eval/tasks/cmmlu/cmmlu_default_high_school_mathematics.yaml'
2025-08-31T08:28:47,746   adding 'lm_eval/tasks/cmmlu/cmmlu_default_high_school_physics.yaml'
2025-08-31T08:28:47,747   adding 'lm_eval/tasks/cmmlu/cmmlu_default_high_school_politics.yaml'
2025-08-31T08:28:47,748   adding 'lm_eval/tasks/cmmlu/cmmlu_default_human_sexuality.yaml'
2025-08-31T08:28:47,749   adding 'lm_eval/tasks/cmmlu/cmmlu_default_international_law.yaml'
2025-08-31T08:28:47,750   adding 'lm_eval/tasks/cmmlu/cmmlu_default_journalism.yaml'
2025-08-31T08:28:47,751   adding 'lm_eval/tasks/cmmlu/cmmlu_default_jurisprudence.yaml'
2025-08-31T08:28:47,752   adding 'lm_eval/tasks/cmmlu/cmmlu_default_legal_and_moral_basis.yaml'
2025-08-31T08:28:47,753   adding 'lm_eval/tasks/cmmlu/cmmlu_default_logical.yaml'
2025-08-31T08:28:47,755   adding 'lm_eval/tasks/cmmlu/cmmlu_default_machine_learning.yaml'
2025-08-31T08:28:47,756   adding 'lm_eval/tasks/cmmlu/cmmlu_default_management.yaml'
2025-08-31T08:28:47,757   adding 'lm_eval/tasks/cmmlu/cmmlu_default_marketing.yaml'
2025-08-31T08:28:47,758   adding 'lm_eval/tasks/cmmlu/cmmlu_default_marxist_theory.yaml'
2025-08-31T08:28:47,760   adding 'lm_eval/tasks/cmmlu/cmmlu_default_modern_chinese.yaml'
2025-08-31T08:28:47,761   adding 'lm_eval/tasks/cmmlu/cmmlu_default_nutrition.yaml'
2025-08-31T08:28:47,762   adding 'lm_eval/tasks/cmmlu/cmmlu_default_philosophy.yaml'
2025-08-31T08:28:47,763   adding 'lm_eval/tasks/cmmlu/cmmlu_default_professional_accounting.yaml'
2025-08-31T08:28:47,764   adding 'lm_eval/tasks/cmmlu/cmmlu_default_professional_law.yaml'
2025-08-31T08:28:47,765   adding 'lm_eval/tasks/cmmlu/cmmlu_default_professional_medicine.yaml'
2025-08-31T08:28:47,767   adding 'lm_eval/tasks/cmmlu/cmmlu_default_professional_psychology.yaml'
2025-08-31T08:28:47,768   adding 'lm_eval/tasks/cmmlu/cmmlu_default_public_relations.yaml'
2025-08-31T08:28:47,769   adding 'lm_eval/tasks/cmmlu/cmmlu_default_security_study.yaml'
2025-08-31T08:28:47,770   adding 'lm_eval/tasks/cmmlu/cmmlu_default_sociology.yaml'
2025-08-31T08:28:47,771   adding 'lm_eval/tasks/cmmlu/cmmlu_default_sports_science.yaml'
2025-08-31T08:28:47,772   adding 'lm_eval/tasks/cmmlu/cmmlu_default_traditional_chinese_medicine.yaml'
2025-08-31T08:28:47,774   adding 'lm_eval/tasks/cmmlu/cmmlu_default_virology.yaml'
2025-08-31T08:28:47,775   adding 'lm_eval/tasks/cmmlu/cmmlu_default_world_history.yaml'
2025-08-31T08:28:47,776   adding 'lm_eval/tasks/cmmlu/cmmlu_default_world_religions.yaml'
2025-08-31T08:28:47,777   adding 'lm_eval/tasks/cmmlu/cmmlu_economics.yaml'
2025-08-31T08:28:47,778   adding 'lm_eval/tasks/cmmlu/cmmlu_education.yaml'
2025-08-31T08:28:47,780   adding 'lm_eval/tasks/cmmlu/cmmlu_electrical_engineering.yaml'
2025-08-31T08:28:47,781   adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_chinese.yaml'
2025-08-31T08:28:47,782   adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_commonsense.yaml'
2025-08-31T08:28:47,783   adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_information_and_technology.yaml'
2025-08-31T08:28:47,784   adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_mathematics.yaml'
2025-08-31T08:28:47,786   adding 'lm_eval/tasks/cmmlu/cmmlu_ethnology.yaml'
2025-08-31T08:28:47,787   adding 'lm_eval/tasks/cmmlu/cmmlu_food_science.yaml'
2025-08-31T08:28:47,788   adding 'lm_eval/tasks/cmmlu/cmmlu_genetics.yaml'
2025-08-31T08:28:47,789   adding 'lm_eval/tasks/cmmlu/cmmlu_global_facts.yaml'
2025-08-31T08:28:47,791   adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_biology.yaml'
2025-08-31T08:28:47,792   adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_chemistry.yaml'
2025-08-31T08:28:47,793   adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_geography.yaml'
2025-08-31T08:28:47,794   adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_mathematics.yaml'
2025-08-31T08:28:47,795   adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_physics.yaml'
2025-08-31T08:28:47,797   adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_politics.yaml'
2025-08-31T08:28:47,798   adding 'lm_eval/tasks/cmmlu/cmmlu_human_sexuality.yaml'
2025-08-31T08:28:47,799   adding 'lm_eval/tasks/cmmlu/cmmlu_international_law.yaml'
2025-08-31T08:28:47,800   adding 'lm_eval/tasks/cmmlu/cmmlu_journalism.yaml'
2025-08-31T08:28:47,801   adding 'lm_eval/tasks/cmmlu/cmmlu_jurisprudence.yaml'
2025-08-31T08:28:47,802   adding 'lm_eval/tasks/cmmlu/cmmlu_legal_and_moral_basis.yaml'
2025-08-31T08:28:47,804   adding 'lm_eval/tasks/cmmlu/cmmlu_logical.yaml'
2025-08-31T08:28:47,805   adding 'lm_eval/tasks/cmmlu/cmmlu_machine_learning.yaml'
2025-08-31T08:28:47,806   adding 'lm_eval/tasks/cmmlu/cmmlu_management.yaml'
2025-08-31T08:28:47,807   adding 'lm_eval/tasks/cmmlu/cmmlu_marketing.yaml'
2025-08-31T08:28:47,808   adding 'lm_eval/tasks/cmmlu/cmmlu_marxist_theory.yaml'
2025-08-31T08:28:47,809   adding 'lm_eval/tasks/cmmlu/cmmlu_modern_chinese.yaml'
2025-08-31T08:28:47,810   adding 'lm_eval/tasks/cmmlu/cmmlu_nutrition.yaml'
2025-08-31T08:28:47,811   adding 'lm_eval/tasks/cmmlu/cmmlu_philosophy.yaml'
2025-08-31T08:28:47,813   adding 'lm_eval/tasks/cmmlu/cmmlu_professional_accounting.yaml'
2025-08-31T08:28:47,814   adding 'lm_eval/tasks/cmmlu/cmmlu_professional_law.yaml'
2025-08-31T08:28:47,815   adding 'lm_eval/tasks/cmmlu/cmmlu_professional_medicine.yaml'
2025-08-31T08:28:47,816   adding 'lm_eval/tasks/cmmlu/cmmlu_professional_psychology.yaml'
2025-08-31T08:28:47,817   adding 'lm_eval/tasks/cmmlu/cmmlu_public_relations.yaml'
2025-08-31T08:28:47,818   adding 'lm_eval/tasks/cmmlu/cmmlu_security_study.yaml'
2025-08-31T08:28:47,820   adding 'lm_eval/tasks/cmmlu/cmmlu_sociology.yaml'
2025-08-31T08:28:47,821   adding 'lm_eval/tasks/cmmlu/cmmlu_sports_science.yaml'
2025-08-31T08:28:47,822   adding 'lm_eval/tasks/cmmlu/cmmlu_traditional_chinese_medicine.yaml'
2025-08-31T08:28:47,823   adding 'lm_eval/tasks/cmmlu/cmmlu_virology.yaml'
2025-08-31T08:28:47,824   adding 'lm_eval/tasks/cmmlu/cmmlu_world_history.yaml'
2025-08-31T08:28:47,825   adding 'lm_eval/tasks/cmmlu/cmmlu_world_religions.yaml'
2025-08-31T08:28:47,828   adding 'lm_eval/tasks/code_x_glue/code-text/bleu.py'
2025-08-31T08:28:47,830   adding 'lm_eval/tasks/code_x_glue/code-text/go.yaml'
2025-08-31T08:28:47,831   adding 'lm_eval/tasks/code_x_glue/code-text/java.yaml'
2025-08-31T08:28:47,832   adding 'lm_eval/tasks/code_x_glue/code-text/javascript.yaml'
2025-08-31T08:28:47,833   adding 'lm_eval/tasks/code_x_glue/code-text/php.yaml'
2025-08-31T08:28:47,834   adding 'lm_eval/tasks/code_x_glue/code-text/python.yaml'
2025-08-31T08:28:47,835   adding 'lm_eval/tasks/code_x_glue/code-text/ruby.yaml'
2025-08-31T08:28:47,837   adding 'lm_eval/tasks/code_x_glue/code-text/utils.py'
2025-08-31T08:28:47,838   adding 'lm_eval/tasks/common_voice/common_voice_en.yaml'
2025-08-31T08:28:47,839   adding 'lm_eval/tasks/common_voice/utils.py'
2025-08-31T08:28:47,841   adding 'lm_eval/tasks/commonsense_qa/README.md'
2025-08-31T08:28:47,842   adding 'lm_eval/tasks/commonsense_qa/default.yaml'
2025-08-31T08:28:47,844   adding 'lm_eval/tasks/copal_id/README.md'
2025-08-31T08:28:47,846   adding 'lm_eval/tasks/copal_id/colloquial.yaml'
2025-08-31T08:28:47,847   adding 'lm_eval/tasks/copal_id/standard.yaml'
2025-08-31T08:28:47,848   adding 'lm_eval/tasks/copal_id/utils.py'
2025-08-31T08:28:47,850   adding 'lm_eval/tasks/coqa/README.md'
2025-08-31T08:28:47,851   adding 'lm_eval/tasks/coqa/default.yaml'
2025-08-31T08:28:47,853   adding 'lm_eval/tasks/coqa/utils.py'
2025-08-31T08:28:47,855   adding 'lm_eval/tasks/crows_pairs/README.md'
2025-08-31T08:28:47,856   adding 'lm_eval/tasks/crows_pairs/crows_pairs_english.yaml'
2025-08-31T08:28:47,857   adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_age.yaml'
2025-08-31T08:28:47,859   adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_autre.yaml'
2025-08-31T08:28:47,860   adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_disability.yaml'
2025-08-31T08:28:47,861   adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_gender.yaml'
2025-08-31T08:28:47,862   adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_nationality.yaml'
2025-08-31T08:28:47,864   adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_physical_appearance.yaml'
2025-08-31T08:28:47,865   adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_race_color.yaml'
2025-08-31T08:28:47,866   adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_religion.yaml'
2025-08-31T08:28:47,867   adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_sexual_orientation.yaml'
2025-08-31T08:28:47,868   adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_socioeconomic.yaml'
2025-08-31T08:28:47,869   adding 'lm_eval/tasks/crows_pairs/crows_pairs_french.yaml'
2025-08-31T08:28:47,870   adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_age.yaml'
2025-08-31T08:28:47,871   adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_autre.yaml'
2025-08-31T08:28:47,872   adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_disability.yaml'
2025-08-31T08:28:47,873   adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_gender.yaml'
2025-08-31T08:28:47,875   adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_nationality.yaml'
2025-08-31T08:28:47,876   adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_physical_appearance.yaml'
2025-08-31T08:28:47,877   adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_race_color.yaml'
2025-08-31T08:28:47,878   adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_religion.yaml'
2025-08-31T08:28:47,879   adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_sexual_orientation.yaml'
2025-08-31T08:28:47,880   adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_socioeconomic.yaml'
2025-08-31T08:28:47,881   adding 'lm_eval/tasks/crows_pairs/utils.py'
2025-08-31T08:28:47,883   adding 'lm_eval/tasks/csatqa/_csatqa.yaml'
2025-08-31T08:28:47,884   adding 'lm_eval/tasks/csatqa/_default_csatqa_yaml'
2025-08-31T08:28:47,886   adding 'lm_eval/tasks/csatqa/_generate_configs.py'
2025-08-31T08:28:47,887   adding 'lm_eval/tasks/csatqa/csatqa_gr.yaml'
2025-08-31T08:28:47,888   adding 'lm_eval/tasks/csatqa/csatqa_li.yaml'
2025-08-31T08:28:47,889   adding 'lm_eval/tasks/csatqa/csatqa_rch.yaml'
2025-08-31T08:28:47,890   adding 'lm_eval/tasks/csatqa/csatqa_rcs.yaml'
2025-08-31T08:28:47,892   adding 'lm_eval/tasks/csatqa/csatqa_rcss.yaml'
2025-08-31T08:28:47,893   adding 'lm_eval/tasks/csatqa/csatqa_wr.yaml'
2025-08-31T08:28:47,894   adding 'lm_eval/tasks/csatqa/utils.py'
2025-08-31T08:28:47,896   adding 'lm_eval/tasks/darija_bench/README.md'
2025-08-31T08:28:47,898   adding 'lm_eval/tasks/darija_bench/darija_sentiment/README.md'
2025-08-31T08:28:47,899   adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment.yaml'
2025-08-31T08:28:47,901   adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_electrom.yaml'
2025-08-31T08:28:47,902   adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_mac.yaml'
2025-08-31T08:28:47,903   adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msac.yaml'
2025-08-31T08:28:47,904   adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msda.yaml'
2025-08-31T08:28:47,905   adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_myc.yaml'
2025-08-31T08:28:47,906   adding 'lm_eval/tasks/darija_bench/darija_sentiment/default_darija_sentiment_template_yaml'
2025-08-31T08:28:47,908   adding 'lm_eval/tasks/darija_bench/darija_sentiment/utils.py'
2025-08-31T08:28:47,910   adding 'lm_eval/tasks/darija_bench/darija_summarization/README.md'
2025-08-31T08:28:47,911   adding 'lm_eval/tasks/darija_bench/darija_summarization/summarization.yaml'
2025-08-31T08:28:47,912   adding 'lm_eval/tasks/darija_bench/darija_summarization/summarization_common_yaml'
2025-08-31T08:28:47,914   adding 'lm_eval/tasks/darija_bench/darija_summarization/summarization_darija.yaml'
2025-08-31T08:28:47,915   adding 'lm_eval/tasks/darija_bench/darija_summarization/utils.py'
2025-08-31T08:28:47,917   adding 'lm_eval/tasks/darija_bench/darija_translation/README.md'
2025-08-31T08:28:47,919   adding 'lm_eval/tasks/darija_bench/darija_translation/doda_common_yaml'
2025-08-31T08:28:47,920   adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_all.yaml'
2025-08-31T08:28:47,921   adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_darija.yaml'
2025-08-31T08:28:47,922   adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_en.yaml'
2025-08-31T08:28:47,923   adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_fr.yaml'
2025-08-31T08:28:47,925   adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_msa.yaml'
2025-08-31T08:28:47,926   adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_en_dr.yaml'
2025-08-31T08:28:47,927   adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_fr_dr.yaml'
2025-08-31T08:28:47,928   adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_msa_dr.yaml'
2025-08-31T08:28:47,929   adding 'lm_eval/tasks/darija_bench/darija_translation/flores_common_yaml'
2025-08-31T08:28:47,930   adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_all.yaml'
2025-08-31T08:28:47,931   adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_darija.yaml'
2025-08-31T08:28:47,932   adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_en.yaml'
2025-08-31T08:28:47,934   adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_fr.yaml'
2025-08-31T08:28:47,935   adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_msa.yaml'
2025-08-31T08:28:47,936   adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_en_dr.yaml'
2025-08-31T08:28:47,937   adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_fr_dr.yaml'
2025-08-31T08:28:47,938   adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_msa_dr.yaml'
2025-08-31T08:28:47,939   adding 'lm_eval/tasks/darija_bench/darija_translation/madar_common_yaml'
2025-08-31T08:28:47,941   adding 'lm_eval/tasks/darija_bench/darija_translation/madar_translation_all.yaml'
2025-08-31T08:28:47,942   adding 'lm_eval/tasks/darija_bench/darija_translation/madar_translation_darija.yaml'
2025-08-31T08:28:47,943   adding 'lm_eval/tasks/darija_bench/darija_translation/madar_translation_dr_msa.yaml'
2025-08-31T08:28:47,944   adding 'lm_eval/tasks/darija_bench/darija_translation/madar_translation_msa_dr.yaml'
2025-08-31T08:28:47,945   adding 'lm_eval/tasks/darija_bench/darija_translation/seed_common_yaml'
2025-08-31T08:28:47,947   adding 'lm_eval/tasks/darija_bench/darija_translation/seed_translation_all.yaml'
2025-08-31T08:28:47,948   adding 'lm_eval/tasks/darija_bench/darija_translation/seed_translation_darija.yaml'
2025-08-31T08:28:47,949   adding 'lm_eval/tasks/darija_bench/darija_translation/seed_translation_dr_en.yaml'
2025-08-31T08:28:47,950   adding 'lm_eval/tasks/darija_bench/darija_translation/seed_translation_en_dr.yaml'
2025-08-31T08:28:47,951   adding 'lm_eval/tasks/darija_bench/darija_translation/translation_common_yaml'
2025-08-31T08:28:47,952   adding 'lm_eval/tasks/darija_bench/darija_translation/translation_darija.yaml'
2025-08-31T08:28:47,954   adding 'lm_eval/tasks/darija_bench/darija_translation/utils.py'
2025-08-31T08:28:47,956   adding 'lm_eval/tasks/darija_bench/darija_transliteration/README.md'
2025-08-31T08:28:47,957   adding 'lm_eval/tasks/darija_bench/darija_transliteration/translation_ar_dr.yaml'
2025-08-31T08:28:47,958   adding 'lm_eval/tasks/darija_bench/darija_transliteration/translation_dr_ar.yaml'
2025-08-31T08:28:47,959   adding 'lm_eval/tasks/darija_bench/darija_transliteration/transliteration_all.yaml'
2025-08-31T08:28:47,960   adding 'lm_eval/tasks/darija_bench/darija_transliteration/transliteration_common_yaml'
2025-08-31T08:28:47,962   adding 'lm_eval/tasks/darija_bench/darija_transliteration/transliteration_darija.yaml'
2025-08-31T08:28:47,963   adding 'lm_eval/tasks/darija_bench/darija_transliteration/utils.py'
2025-08-31T08:28:47,965   adding 'lm_eval/tasks/darijahellaswag/README.md'
2025-08-31T08:28:47,966   adding 'lm_eval/tasks/darijahellaswag/darijahellaswag.yaml'
2025-08-31T08:28:47,967   adding 'lm_eval/tasks/darijahellaswag/utils.py'
2025-08-31T08:28:47,970   adding 'lm_eval/tasks/darijammlu/README.md'
2025-08-31T08:28:47,971   adding 'lm_eval/tasks/darijammlu/_darijammlu.yaml'
2025-08-31T08:28:47,972   adding 'lm_eval/tasks/darijammlu/_darijammlu_ar_mmlu.yaml'
2025-08-31T08:28:47,973   adding 'lm_eval/tasks/darijammlu/_darijammlu_mmlu.yaml'
2025-08-31T08:28:47,974   adding 'lm_eval/tasks/darijammlu/_default_darijammlu_template_yaml'
2025-08-31T08:28:47,976   adding 'lm_eval/tasks/darijammlu/_generate_configs.py'
2025-08-31T08:28:47,977   adding 'lm_eval/tasks/darijammlu/darijammlu_accounting.yaml'
2025-08-31T08:28:47,978   adding 'lm_eval/tasks/darijammlu/darijammlu_arabic_language.yaml'
2025-08-31T08:28:47,979   adding 'lm_eval/tasks/darijammlu/darijammlu_arabic_language_(general).yaml'
2025-08-31T08:28:47,980   adding 'lm_eval/tasks/darijammlu/darijammlu_arabic_language_(grammar).yaml'
2025-08-31T08:28:47,981   adding 'lm_eval/tasks/darijammlu/darijammlu_biology.yaml'
2025-08-31T08:28:47,982   adding 'lm_eval/tasks/darijammlu/darijammlu_civics.yaml'
2025-08-31T08:28:47,983   adding 'lm_eval/tasks/darijammlu/darijammlu_computer_science.yaml'
2025-08-31T08:28:47,984   adding 'lm_eval/tasks/darijammlu/darijammlu_driving_test.yaml'
2025-08-31T08:28:47,986   adding 'lm_eval/tasks/darijammlu/darijammlu_economics.yaml'
2025-08-31T08:28:47,987   adding 'lm_eval/tasks/darijammlu/darijammlu_general_knowledge.yaml'
2025-08-31T08:28:47,988   adding 'lm_eval/tasks/darijammlu/darijammlu_geography.yaml'
2025-08-31T08:28:47,989   adding 'lm_eval/tasks/darijammlu/darijammlu_global_facts.yaml'
2025-08-31T08:28:47,990   adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_european_history.yaml'
2025-08-31T08:28:47,991   adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_geography.yaml'
2025-08-31T08:28:47,992   adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_government_and_politics.yaml'
2025-08-31T08:28:47,993   adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_psychology.yaml'
2025-08-31T08:28:47,994   adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_statistics.yaml'
2025-08-31T08:28:47,995   adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_world_history.yaml'
2025-08-31T08:28:47,997   adding 'lm_eval/tasks/darijammlu/darijammlu_history.yaml'
2025-08-31T08:28:47,998   adding 'lm_eval/tasks/darijammlu/darijammlu_human_aging.yaml'
2025-08-31T08:28:47,999   adding 'lm_eval/tasks/darijammlu/darijammlu_international_law.yaml'
2025-08-31T08:28:48,000   adding 'lm_eval/tasks/darijammlu/darijammlu_islamic_studies.yaml'
2025-08-31T08:28:48,001   adding 'lm_eval/tasks/darijammlu/darijammlu_jurisprudence.yaml'
2025-08-31T08:28:48,002   adding 'lm_eval/tasks/darijammlu/darijammlu_law.yaml'
2025-08-31T08:28:48,003   adding 'lm_eval/tasks/darijammlu/darijammlu_logical_fallacies.yaml'
2025-08-31T08:28:48,004   adding 'lm_eval/tasks/darijammlu/darijammlu_management.yaml'
2025-08-31T08:28:48,006   adding 'lm_eval/tasks/darijammlu/darijammlu_management_ar.yaml'
2025-08-31T08:28:48,007   adding 'lm_eval/tasks/darijammlu/darijammlu_marketing.yaml'
2025-08-31T08:28:48,008   adding 'lm_eval/tasks/darijammlu/darijammlu_math.yaml'
2025-08-31T08:28:48,009   adding 'lm_eval/tasks/darijammlu/darijammlu_moral_disputes.yaml'
2025-08-31T08:28:48,010   adding 'lm_eval/tasks/darijammlu/darijammlu_moral_scenarios.yaml'
2025-08-31T08:28:48,011   adding 'lm_eval/tasks/darijammlu/darijammlu_natural_science.yaml'
2025-08-31T08:28:48,013   adding 'lm_eval/tasks/darijammlu/darijammlu_nutrition.yaml'
2025-08-31T08:28:48,014   adding 'lm_eval/tasks/darijammlu/darijammlu_philosophy.yaml'
2025-08-31T08:28:48,015   adding 'lm_eval/tasks/darijammlu/darijammlu_philosophy_ar.yaml'
2025-08-31T08:28:48,016   adding 'lm_eval/tasks/darijammlu/darijammlu_physics.yaml'
2025-08-31T08:28:48,017   adding 'lm_eval/tasks/darijammlu/darijammlu_political_science.yaml'
2025-08-31T08:28:48,018   adding 'lm_eval/tasks/darijammlu/darijammlu_professional_law.yaml'
2025-08-31T08:28:48,019   adding 'lm_eval/tasks/darijammlu/darijammlu_professional_psychology.yaml'
2025-08-31T08:28:48,021   adding 'lm_eval/tasks/darijammlu/darijammlu_public_relations.yaml'
2025-08-31T08:28:48,022   adding 'lm_eval/tasks/darijammlu/darijammlu_security_studies.yaml'
2025-08-31T08:28:48,023   adding 'lm_eval/tasks/darijammlu/darijammlu_social_science.yaml'
2025-08-31T08:28:48,024   adding 'lm_eval/tasks/darijammlu/darijammlu_sociology.yaml'
2025-08-31T08:28:48,025   adding 'lm_eval/tasks/darijammlu/darijammlu_world_religions.yaml'
2025-08-31T08:28:48,026   adding 'lm_eval/tasks/darijammlu/utils.py'
2025-08-31T08:28:48,028   adding 'lm_eval/tasks/drop/README.md'
2025-08-31T08:28:48,029   adding 'lm_eval/tasks/drop/default.yaml'
2025-08-31T08:28:48,030   adding 'lm_eval/tasks/drop/utils.py'
2025-08-31T08:28:48,032   adding 'lm_eval/tasks/egyhellaswag/README.md'
2025-08-31T08:28:48,033   adding 'lm_eval/tasks/egyhellaswag/egyhellaswag.yaml'
2025-08-31T08:28:48,034   adding 'lm_eval/tasks/egyhellaswag/utils.py'
2025-08-31T08:28:48,037   adding 'lm_eval/tasks/egymmlu/README.md'
2025-08-31T08:28:48,038   adding 'lm_eval/tasks/egymmlu/_default_egymmlu_template_yaml'
2025-08-31T08:28:48,039   adding 'lm_eval/tasks/egymmlu/_egymmlu.yaml'
2025-08-31T08:28:48,040   adding 'lm_eval/tasks/egymmlu/_egymmlu_ar_mmlu.yaml'
2025-08-31T08:28:48,041   adding 'lm_eval/tasks/egymmlu/_egymmlu_mmlu.yaml'
2025-08-31T08:28:48,042   adding 'lm_eval/tasks/egymmlu/_generate_configs.py'
2025-08-31T08:28:48,044   adding 'lm_eval/tasks/egymmlu/egymmlu_accounting.yaml'
2025-08-31T08:28:48,045   adding 'lm_eval/tasks/egymmlu/egymmlu_arabic_language.yaml'
2025-08-31T08:28:48,046   adding 'lm_eval/tasks/egymmlu/egymmlu_arabic_language_(general).yaml'
2025-08-31T08:28:48,047   adding 'lm_eval/tasks/egymmlu/egymmlu_arabic_language_(grammar).yaml'
2025-08-31T08:28:48,048   adding 'lm_eval/tasks/egymmlu/egymmlu_biology.yaml'
2025-08-31T08:28:48,049   adding 'lm_eval/tasks/egymmlu/egymmlu_civics.yaml'
2025-08-31T08:28:48,050   adding 'lm_eval/tasks/egymmlu/egymmlu_computer_science.yaml'
2025-08-31T08:28:48,052   adding 'lm_eval/tasks/egymmlu/egymmlu_driving_test.yaml'
2025-08-31T08:28:48,053   adding 'lm_eval/tasks/egymmlu/egymmlu_economics.yaml'
2025-08-31T08:28:48,054   adding 'lm_eval/tasks/egymmlu/egymmlu_general_knowledge.yaml'
2025-08-31T08:28:48,055   adding 'lm_eval/tasks/egymmlu/egymmlu_geography.yaml'
2025-08-31T08:28:48,056   adding 'lm_eval/tasks/egymmlu/egymmlu_global_facts.yaml'
2025-08-31T08:28:48,057   adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_european_history.yaml'
2025-08-31T08:28:48,058   adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_geography.yaml'
2025-08-31T08:28:48,059   adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_government_and_politics.yaml'
2025-08-31T08:28:48,061   adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_psychology.yaml'
2025-08-31T08:28:48,062   adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_statistics.yaml'
2025-08-31T08:28:48,063   adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_world_history.yaml'
2025-08-31T08:28:48,064   adding 'lm_eval/tasks/egymmlu/egymmlu_history.yaml'
2025-08-31T08:28:48,065   adding 'lm_eval/tasks/egymmlu/egymmlu_human_aging.yaml'
2025-08-31T08:28:48,066   adding 'lm_eval/tasks/egymmlu/egymmlu_international_law.yaml'
2025-08-31T08:28:48,067   adding 'lm_eval/tasks/egymmlu/egymmlu_islamic_studies.yaml'
2025-08-31T08:28:48,068   adding 'lm_eval/tasks/egymmlu/egymmlu_jurisprudence.yaml'
2025-08-31T08:28:48,070   adding 'lm_eval/tasks/egymmlu/egymmlu_law.yaml'
2025-08-31T08:28:48,071   adding 'lm_eval/tasks/egymmlu/egymmlu_logical_fallacies.yaml'
2025-08-31T08:28:48,072   adding 'lm_eval/tasks/egymmlu/egymmlu_management.yaml'
2025-08-31T08:28:48,073   adding 'lm_eval/tasks/egymmlu/egymmlu_management_ar.yaml'
2025-08-31T08:28:48,074   adding 'lm_eval/tasks/egymmlu/egymmlu_marketing.yaml'
2025-08-31T08:28:48,075   adding 'lm_eval/tasks/egymmlu/egymmlu_math.yaml'
2025-08-31T08:28:48,076   adding 'lm_eval/tasks/egymmlu/egymmlu_moral_disputes.yaml'
2025-08-31T08:28:48,078   adding 'lm_eval/tasks/egymmlu/egymmlu_moral_scenarios.yaml'
2025-08-31T08:28:48,079   adding 'lm_eval/tasks/egymmlu/egymmlu_natural_science.yaml'
2025-08-31T08:28:48,080   adding 'lm_eval/tasks/egymmlu/egymmlu_nutrition.yaml'
2025-08-31T08:28:48,081   adding 'lm_eval/tasks/egymmlu/egymmlu_philosophy.yaml'
2025-08-31T08:28:48,082   adding 'lm_eval/tasks/egymmlu/egymmlu_philosophy_ar.yaml'
2025-08-31T08:28:48,083   adding 'lm_eval/tasks/egymmlu/egymmlu_physics.yaml'
2025-08-31T08:28:48,084   adding 'lm_eval/tasks/egymmlu/egymmlu_political_science.yaml'
2025-08-31T08:28:48,085   adding 'lm_eval/tasks/egymmlu/egymmlu_professional_law.yaml'
2025-08-31T08:28:48,086   adding 'lm_eval/tasks/egymmlu/egymmlu_professional_psychology.yaml'
2025-08-31T08:28:48,087   adding 'lm_eval/tasks/egymmlu/egymmlu_public_relations.yaml'
2025-08-31T08:28:48,088   adding 'lm_eval/tasks/egymmlu/egymmlu_security_studies.yaml'
2025-08-31T08:28:48,089   adding 'lm_eval/tasks/egymmlu/egymmlu_social_science.yaml'
2025-08-31T08:28:48,090   adding 'lm_eval/tasks/egymmlu/egymmlu_sociology.yaml'
2025-08-31T08:28:48,091   adding 'lm_eval/tasks/egymmlu/egymmlu_world_religions.yaml'
2025-08-31T08:28:48,092   adding 'lm_eval/tasks/egymmlu/utils.py'
2025-08-31T08:28:48,094   adding 'lm_eval/tasks/eq_bench/README.md'
2025-08-31T08:28:48,095   adding 'lm_eval/tasks/eq_bench/default.yaml'
2025-08-31T08:28:48,096   adding 'lm_eval/tasks/eq_bench/utils.py'
2025-08-31T08:28:48,099   adding 'lm_eval/tasks/eus_exams/README.md'
2025-08-31T08:28:48,101   adding 'lm_eval/tasks/eus_exams/configs.py'
2025-08-31T08:28:48,102   adding 'lm_eval/tasks/eus_exams/eus_exams'
2025-08-31T08:28:48,103   adding 'lm_eval/tasks/eus_exams/eus_exams_es'
2025-08-31T08:28:48,104   adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejadministrativo.yaml'
2025-08-31T08:28:48,105   adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejauxiliar.yaml'
2025-08-31T08:28:48,106   adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejsubalterno.yaml'
2025-08-31T08:28:48,107   adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejtecnico.yaml'
2025-08-31T08:28:48,109   adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeayuntamientovitoria.yaml'
2025-08-31T08:28:48,110   adding 'lm_eval/tasks/eus_exams/eus_exams_es_opebilbao.yaml'
2025-08-31T08:28:48,111   adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuadmin.yaml'
2025-08-31T08:28:48,112   adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuaux.yaml'
2025-08-31T08:28:48,113   adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehubiblio.yaml'
2025-08-31T08:28:48,114   adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuderecho.yaml'
2025-08-31T08:28:48,115   adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehueconomicas.yaml'
2025-08-31T08:28:48,116   adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuempresariales.yaml'
2025-08-31T08:28:48,117   adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehusubalterno.yaml'
2025-08-31T08:28:48,118   adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnico.yaml'
2025-08-31T08:28:48,120   adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnicob.yaml'
2025-08-31T08:28:48,121   adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakiadmin.yaml'
2025-08-31T08:28:48,122   adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakiaux.yaml'
2025-08-31T08:28:48,123   adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakiauxenf.yaml'
2025-08-31T08:28:48,124   adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakicelador.yaml'
2025-08-31T08:28:48,125   adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakienf.yaml'
2025-08-31T08:28:48,126   adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakijuridico.yaml'
2025-08-31T08:28:48,127   adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakioperario.yaml'
2025-08-31T08:28:48,128   adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakitecnico.yaml'
2025-08-31T08:28:48,130   adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakivarios.yaml'
2025-08-31T08:28:48,131   adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza1c.yaml'
2025-08-31T08:28:48,132   adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza2c.yaml'
2025-08-31T08:28:48,133   adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza3c.yaml'
2025-08-31T08:28:48,134   adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza4c.yaml'
2025-08-31T08:28:48,135   adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza5c.yaml'
2025-08-31T08:28:48,136   adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza6c.yaml'
2025-08-31T08:28:48,137   adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza7c.yaml'
2025-08-31T08:28:48,138   adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza8c.yaml'
2025-08-31T08:28:48,139   adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza9c.yaml'
2025-08-31T08:28:48,140   adding 'lm_eval/tasks/eus_exams/eus_exams_eu'
2025-08-31T08:28:48,141   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejadministrari.yaml'
2025-08-31T08:28:48,142   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntza.yaml'
2025-08-31T08:28:48,143   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntzaile.yaml'
2025-08-31T08:28:48,144   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejteknikari.yaml'
2025-08-31T08:28:48,145   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opebilbaoeu.yaml'
2025-08-31T08:28:48,146   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuadmineu.yaml'
2025-08-31T08:28:48,147   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuauxeu.yaml'
2025-08-31T08:28:48,149   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehubiblioeu.yaml'
2025-08-31T08:28:48,150   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuderechoeu.yaml'
2025-08-31T08:28:48,151   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehueconomicaseu.yaml'
2025-08-31T08:28:48,152   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuempresarialeseu.yaml'
2025-08-31T08:28:48,153   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehusubalternoeu.yaml'
2025-08-31T08:28:48,154   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehutecnicoeu.yaml'
2025-08-31T08:28:48,155   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuteknikarib.yaml'
2025-08-31T08:28:48,156   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opegasteizkoudala.yaml'
2025-08-31T08:28:48,157   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiadmineu.yaml'
2025-08-31T08:28:48,158   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxenfeu.yaml'
2025-08-31T08:28:48,159   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxeu.yaml'
2025-08-31T08:28:48,160   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiceladoreu.yaml'
2025-08-31T08:28:48,162   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakienfeu.yaml'
2025-08-31T08:28:48,163   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakioperarioeu.yaml'
2025-08-31T08:28:48,164   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakitecnicoeu.yaml'
2025-08-31T08:28:48,165   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakivarioseu.yaml'
2025-08-31T08:28:48,166   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza1e.yaml'
2025-08-31T08:28:48,167   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza2e.yaml'
2025-08-31T08:28:48,168   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza3e.yaml'
2025-08-31T08:28:48,170   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza5e.yaml'
2025-08-31T08:28:48,171   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza6e.yaml'
2025-08-31T08:28:48,172   adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza7e.yaml'
2025-08-31T08:28:48,173   adding 'lm_eval/tasks/eus_exams/utils.py'
2025-08-31T08:28:48,175   adding 'lm_eval/tasks/eus_proficiency/README.md'
2025-08-31T08:28:48,176   adding 'lm_eval/tasks/eus_proficiency/eus_proficiency.yaml'
2025-08-31T08:28:48,178   adding 'lm_eval/tasks/eus_reading/README.md'
2025-08-31T08:28:48,179   adding 'lm_eval/tasks/eus_reading/eus_reading.yaml'
2025-08-31T08:28:48,180   adding 'lm_eval/tasks/eus_reading/utils.py'
2025-08-31T08:28:48,182   adding 'lm_eval/tasks/eus_trivia/README.md'
2025-08-31T08:28:48,183   adding 'lm_eval/tasks/eus_trivia/eus_trivia.yaml'
2025-08-31T08:28:48,185   adding 'lm_eval/tasks/eus_trivia/utils.py'
2025-08-31T08:28:48,188   adding 'lm_eval/tasks/evalita_llm/README.md'
2025-08-31T08:28:48,189   adding 'lm_eval/tasks/evalita_llm/_at_template_yaml'
2025-08-31T08:28:48,190   adding 'lm_eval/tasks/evalita_llm/_evalita-mp.yaml'
2025-08-31T08:28:48,191   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p1.yaml'
2025-08-31T08:28:48,193   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p2.yaml'
2025-08-31T08:28:48,194   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p3.yaml'
2025-08-31T08:28:48,195   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p4.yaml'
2025-08-31T08:28:48,196   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p5.yaml'
2025-08-31T08:28:48,198   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p6.yaml'
2025-08-31T08:28:48,199   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_tasks.yaml'
2025-08-31T08:28:48,200   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p1.yaml'
2025-08-31T08:28:48,201   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p2.yaml'
2025-08-31T08:28:48,202   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p3.yaml'
2025-08-31T08:28:48,203   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p4.yaml'
2025-08-31T08:28:48,205   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p5.yaml'
2025-08-31T08:28:48,206   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p6.yaml'
2025-08-31T08:28:48,207   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_tasks.yaml'
2025-08-31T08:28:48,208   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_gen.yaml'
2025-08-31T08:28:48,209   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p1.yaml'
2025-08-31T08:28:48,210   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p2.yaml'
2025-08-31T08:28:48,211   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p3.yaml'
2025-08-31T08:28:48,212   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p4.yaml'
2025-08-31T08:28:48,214   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p5.yaml'
2025-08-31T08:28:48,215   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p6.yaml'
2025-08-31T08:28:48,216   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_task.yaml'
2025-08-31T08:28:48,217   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ls_p1.yaml'
2025-08-31T08:28:48,218   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ls_p2.yaml'
2025-08-31T08:28:48,219   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ls_task.yaml'
2025-08-31T08:28:48,220   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_mc.yaml'
2025-08-31T08:28:48,222   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group.yaml'
2025-08-31T08:28:48,223   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p1.yaml'
2025-08-31T08:28:48,224   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p2.yaml'
2025-08-31T08:28:48,225   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group.yaml'
2025-08-31T08:28:48,227   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p1.yaml'
2025-08-31T08:28:48,228   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p2.yaml'
2025-08-31T08:28:48,229   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group.yaml'
2025-08-31T08:28:48,230   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p1.yaml'
2025-08-31T08:28:48,231   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p2.yaml'
2025-08-31T08:28:48,232   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg'
2025-08-31T08:28:48,234   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p1.yaml'
2025-08-31T08:28:48,235   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p2.yaml'
2025-08-31T08:28:48,236   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic'
2025-08-31T08:28:48,237   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p1.yaml'
2025-08-31T08:28:48,238   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p2.yaml'
2025-08-31T08:28:48,239   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_group.yaml'
2025-08-31T08:28:48,241   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn'
2025-08-31T08:28:48,242   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p1.yaml'
2025-08-31T08:28:48,243   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p2.yaml'
2025-08-31T08:28:48,244   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_re_p1.yaml'
2025-08-31T08:28:48,246   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_re_p2.yaml'
2025-08-31T08:28:48,247   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_re_task.yaml'
2025-08-31T08:28:48,248   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p1.yaml'
2025-08-31T08:28:48,249   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p2.yaml'
2025-08-31T08:28:48,250   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p3.yaml'
2025-08-31T08:28:48,251   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p4.yaml'
2025-08-31T08:28:48,252   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p5.yaml'
2025-08-31T08:28:48,253   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p6.yaml'
2025-08-31T08:28:48,254   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_tasks.yaml'
2025-08-31T08:28:48,255   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p1.yaml'
2025-08-31T08:28:48,256   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p2.yaml'
2025-08-31T08:28:48,257   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_task.yaml'
2025-08-31T08:28:48,259   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p1.yaml'
2025-08-31T08:28:48,260   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p2.yaml'
2025-08-31T08:28:48,261   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_task.yaml'
2025-08-31T08:28:48,262   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p1.yaml'
2025-08-31T08:28:48,263   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p2.yaml'
2025-08-31T08:28:48,264   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p3.yaml'
2025-08-31T08:28:48,265   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p4.yaml'
2025-08-31T08:28:48,266   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p5.yaml'
2025-08-31T08:28:48,267   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p6.yaml'
2025-08-31T08:28:48,268   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_tasks.yaml'
2025-08-31T08:28:48,270   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p1.yaml'
2025-08-31T08:28:48,271   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p2.yaml'
2025-08-31T08:28:48,272   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p3.yaml'
2025-08-31T08:28:48,273   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p4.yaml'
2025-08-31T08:28:48,274   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p5.yaml'
2025-08-31T08:28:48,275   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p6.yaml'
2025-08-31T08:28:48,276   adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_tasks.yaml'
2025-08-31T08:28:48,278   adding 'lm_eval/tasks/evalita_llm/_faq_template_yaml'
2025-08-31T08:28:48,279   adding 'lm_eval/tasks/evalita_llm/_hs_template_yaml'
2025-08-31T08:28:48,280   adding 'lm_eval/tasks/evalita_llm/_ls_template_yaml'
2025-08-31T08:28:48,281   adding 'lm_eval/tasks/evalita_llm/_ner_template_yaml'
2025-08-31T08:28:48,282   adding 'lm_eval/tasks/evalita_llm/_re_template_yaml'
2025-08-31T08:28:48,283   adding 'lm_eval/tasks/evalita_llm/_sa_template_v2_yaml'
2025-08-31T08:28:48,284   adding 'lm_eval/tasks/evalita_llm/_sa_template_yaml'
2025-08-31T08:28:48,286   adding 'lm_eval/tasks/evalita_llm/_sum_template_fp-small_yaml'
2025-08-31T08:28:48,287   adding 'lm_eval/tasks/evalita_llm/_sum_template_fp_yaml'
2025-08-31T08:28:48,288   adding 'lm_eval/tasks/evalita_llm/_sum_template_yaml'
2025-08-31T08:28:48,289   adding 'lm_eval/tasks/evalita_llm/_te_template_yaml'
2025-08-31T08:28:48,290   adding 'lm_eval/tasks/evalita_llm/_wic_template_yaml'
2025-08-31T08:28:48,292   adding 'lm_eval/tasks/evalita_llm/metrics.py'
2025-08-31T08:28:48,293   adding 'lm_eval/tasks/evalita_llm/sum_utils.py'
2025-08-31T08:28:48,295   adding 'lm_eval/tasks/evalita_llm/utils.py'
2025-08-31T08:28:48,297   adding 'lm_eval/tasks/fda/README.md'
2025-08-31T08:28:48,298   adding 'lm_eval/tasks/fda/fda.yaml'
2025-08-31T08:28:48,300   adding 'lm_eval/tasks/fda/task.py'
2025-08-31T08:28:48,302   adding 'lm_eval/tasks/fld/README.md'
2025-08-31T08:28:48,303   adding 'lm_eval/tasks/fld/fld_default.yaml'
2025-08-31T08:28:48,304   adding 'lm_eval/tasks/fld/fld_logical_formula_default.yaml'
2025-08-31T08:28:48,305   adding 'lm_eval/tasks/fld/fld_logical_formula_star.yaml'
2025-08-31T08:28:48,306   adding 'lm_eval/tasks/fld/fld_star.yaml'
2025-08-31T08:28:48,308   adding 'lm_eval/tasks/french_bench/README.md'
2025-08-31T08:28:48,309   adding 'lm_eval/tasks/french_bench/_default_template_yaml'
2025-08-31T08:28:48,310   adding 'lm_eval/tasks/french_bench/french_bench_arc_challenge.yaml'
2025-08-31T08:28:48,312   adding 'lm_eval/tasks/french_bench/french_bench_boolqa.yaml'
2025-08-31T08:28:48,313   adding 'lm_eval/tasks/french_bench/french_bench_fquadv2.yaml'
2025-08-31T08:28:48,314   adding 'lm_eval/tasks/french_bench/french_bench_fquadv2_bool.yaml'
2025-08-31T08:28:48,315   adding 'lm_eval/tasks/french_bench/french_bench_fquadv2_genq.yaml'
2025-08-31T08:28:48,316   adding 'lm_eval/tasks/french_bench/french_bench_fquadv2_hasAns.yaml'
2025-08-31T08:28:48,318   adding 'lm_eval/tasks/french_bench/french_bench_grammar.yaml'
2025-08-31T08:28:48,319   adding 'lm_eval/tasks/french_bench/french_bench_hellaswag.yaml'
2025-08-31T08:28:48,320   adding 'lm_eval/tasks/french_bench/french_bench_multifquad.yaml'
2025-08-31T08:28:48,321   adding 'lm_eval/tasks/french_bench/french_bench_opus_perplexity.yaml'
2025-08-31T08:28:48,322   adding 'lm_eval/tasks/french_bench/french_bench_orangesum_abstract.yaml'
2025-08-31T08:28:48,323   adding 'lm_eval/tasks/french_bench/french_bench_orangesum_title.yaml'
2025-08-31T08:28:48,325   adding 'lm_eval/tasks/french_bench/french_bench_reading_comp.yaml'
2025-08-31T08:28:48,326   adding 'lm_eval/tasks/french_bench/french_bench_topic_based_nli.yaml'
2025-08-31T08:28:48,327   adding 'lm_eval/tasks/french_bench/french_bench_trivia.yaml'
2025-08-31T08:28:48,328   adding 'lm_eval/tasks/french_bench/french_bench_vocab.yaml'
2025-08-31T08:28:48,329   adding 'lm_eval/tasks/french_bench/french_bench_wikitext_fr.yaml'
2025-08-31T08:28:48,331   adding 'lm_eval/tasks/french_bench/french_bench_xnli.yaml'
2025-08-31T08:28:48,332   adding 'lm_eval/tasks/french_bench/preprocess_wikitext.py'
2025-08-31T08:28:48,333   adding 'lm_eval/tasks/french_bench/utils.py'
2025-08-31T08:28:48,335   adding 'lm_eval/tasks/galician_bench/README.md'
2025-08-31T08:28:48,336   adding 'lm_eval/tasks/galician_bench/belebele_glg_Latn.yaml'
2025-08-31T08:28:48,338   adding 'lm_eval/tasks/galician_bench/galcola.yaml'
2025-08-31T08:28:48,339   adding 'lm_eval/tasks/galician_bench/galician_bench.yaml'
2025-08-31T08:28:48,340   adding 'lm_eval/tasks/galician_bench/mgsm_direct_gl.yaml'
2025-08-31T08:28:48,341   adding 'lm_eval/tasks/galician_bench/openbookqa_gl.yaml'
2025-08-31T08:28:48,342   adding 'lm_eval/tasks/galician_bench/parafrases_gl.yaml'
2025-08-31T08:28:48,343   adding 'lm_eval/tasks/galician_bench/paws_gl.yaml'
2025-08-31T08:28:48,344   adding 'lm_eval/tasks/galician_bench/summarization_gl.yaml'
2025-08-31T08:28:48,346   adding 'lm_eval/tasks/galician_bench/truthfulqa_gl_gen.yaml'
2025-08-31T08:28:48,347   adding 'lm_eval/tasks/galician_bench/truthfulqa_gl_mc1.yaml'
2025-08-31T08:28:48,348   adding 'lm_eval/tasks/galician_bench/truthfulqa_gl_mc2.yaml'
2025-08-31T08:28:48,350   adding 'lm_eval/tasks/galician_bench/utils.py'
2025-08-31T08:28:48,351   adding 'lm_eval/tasks/galician_bench/xnli_gl.yaml'
2025-08-31T08:28:48,353   adding 'lm_eval/tasks/galician_bench/xstorycloze_gl.yaml'
2025-08-31T08:28:48,355   adding 'lm_eval/tasks/galician_bench/flores_gl/_flores_common_yaml'
2025-08-31T08:28:48,356   adding 'lm_eval/tasks/galician_bench/flores_gl/create_yamls_flores_gl.py'
2025-08-31T08:28:48,357   adding 'lm_eval/tasks/galician_bench/flores_gl/flores_ca-gl.yaml'
2025-08-31T08:28:48,359   adding 'lm_eval/tasks/galician_bench/flores_gl/flores_de-gl.yaml'
2025-08-31T08:28:48,360   adding 'lm_eval/tasks/galician_bench/flores_gl/flores_en-gl.yaml'
2025-08-31T08:28:48,361   adding 'lm_eval/tasks/galician_bench/flores_gl/flores_es-gl.yaml'
2025-08-31T08:28:48,362   adding 'lm_eval/tasks/galician_bench/flores_gl/flores_eu-gl.yaml'
2025-08-31T08:28:48,363   adding 'lm_eval/tasks/galician_bench/flores_gl/flores_fr-gl.yaml'
2025-08-31T08:28:48,364   adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-ca.yaml'
2025-08-31T08:28:48,365   adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-de.yaml'
2025-08-31T08:28:48,366   adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-en.yaml'
2025-08-31T08:28:48,367   adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-es.yaml'
2025-08-31T08:28:48,368   adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-eu.yaml'
2025-08-31T08:28:48,370   adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-fr.yaml'
2025-08-31T08:28:48,371   adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-it.yaml'
2025-08-31T08:28:48,372   adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-pt.yaml'
2025-08-31T08:28:48,373   adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl.yaml'
2025-08-31T08:28:48,374   adding 'lm_eval/tasks/galician_bench/flores_gl/flores_it-gl.yaml'
2025-08-31T08:28:48,375   adding 'lm_eval/tasks/galician_bench/flores_gl/flores_pt-gl.yaml'
2025-08-31T08:28:48,377   adding 'lm_eval/tasks/glianorex/README.md'
2025-08-31T08:28:48,378   adding 'lm_eval/tasks/glianorex/glianorex.yaml'
2025-08-31T08:28:48,379   adding 'lm_eval/tasks/glianorex/glianorex_en.yaml'
2025-08-31T08:28:48,380   adding 'lm_eval/tasks/glianorex/glianorex_fr.yaml'
2025-08-31T08:28:48,381   adding 'lm_eval/tasks/glianorex/preprocess_glianorex.py'
2025-08-31T08:28:48,383   adding 'lm_eval/tasks/global_mmlu/README.md'
2025-08-31T08:28:48,385   adding 'lm_eval/tasks/global_mmlu/default/ar/_ar_template_yaml'
2025-08-31T08:28:48,387   adding 'lm_eval/tasks/global_mmlu/default/ar/_global_mmlu_ar.yaml'
2025-08-31T08:28:48,388   adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_business.yaml'
2025-08-31T08:28:48,389   adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_humanities.yaml'
2025-08-31T08:28:48,390   adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_medical.yaml'
2025-08-31T08:28:48,391   adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_other.yaml'
2025-08-31T08:28:48,392   adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_social_sciences.yaml'
2025-08-31T08:28:48,393   adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_stem.yaml'
2025-08-31T08:28:48,394   adding 'lm_eval/tasks/global_mmlu/default/ar/utils.py'
2025-08-31T08:28:48,396   adding 'lm_eval/tasks/global_mmlu/default/bn/_bn_template_yaml'
2025-08-31T08:28:48,397   adding 'lm_eval/tasks/global_mmlu/default/bn/_global_mmlu_bn.yaml'
2025-08-31T08:28:48,398   adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_business.yaml'
2025-08-31T08:28:48,399   adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_humanities.yaml'
2025-08-31T08:28:48,400   adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_medical.yaml'
2025-08-31T08:28:48,402   adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_other.yaml'
2025-08-31T08:28:48,403   adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_social_sciences.yaml'
2025-08-31T08:28:48,404   adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_stem.yaml'
2025-08-31T08:28:48,405   adding 'lm_eval/tasks/global_mmlu/default/bn/utils.py'
2025-08-31T08:28:48,407   adding 'lm_eval/tasks/global_mmlu/default/de/_de_template_yaml'
2025-08-31T08:28:48,408   adding 'lm_eval/tasks/global_mmlu/default/de/_global_mmlu_de.yaml'
2025-08-31T08:28:48,409   adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_business.yaml'
2025-08-31T08:28:48,410   adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_humanities.yaml'
2025-08-31T08:28:48,411   adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_medical.yaml'
2025-08-31T08:28:48,412   adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_other.yaml'
2025-08-31T08:28:48,413   adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_social_sciences.yaml'
2025-08-31T08:28:48,414   adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_stem.yaml'
2025-08-31T08:28:48,416   adding 'lm_eval/tasks/global_mmlu/default/de/utils.py'
2025-08-31T08:28:48,417   adding 'lm_eval/tasks/global_mmlu/default/en/_en_template_yaml'
2025-08-31T08:28:48,418   adding 'lm_eval/tasks/global_mmlu/default/en/_global_mmlu_en.yaml'
2025-08-31T08:28:48,420   adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_business.yaml'
2025-08-31T08:28:48,421   adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_humanities.yaml'
2025-08-31T08:28:48,421   adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_medical.yaml'
2025-08-31T08:28:48,422   adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_other.yaml'
2025-08-31T08:28:48,423   adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_social_sciences.yaml'
2025-08-31T08:28:48,425   adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_stem.yaml'
2025-08-31T08:28:48,426   adding 'lm_eval/tasks/global_mmlu/default/en/utils.py'
2025-08-31T08:28:48,427   adding 'lm_eval/tasks/global_mmlu/default/es/_es_template_yaml'
2025-08-31T08:28:48,428   adding 'lm_eval/tasks/global_mmlu/default/es/_global_mmlu_es.yaml'
2025-08-31T08:28:48,429   adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_business.yaml'
2025-08-31T08:28:48,431   adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_humanities.yaml'
2025-08-31T08:28:48,432   adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_medical.yaml'
2025-08-31T08:28:48,433   adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_other.yaml'
2025-08-31T08:28:48,434   adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_social_sciences.yaml'
2025-08-31T08:28:48,435   adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_stem.yaml'
2025-08-31T08:28:48,436   adding 'lm_eval/tasks/global_mmlu/default/es/utils.py'
2025-08-31T08:28:48,438   adding 'lm_eval/tasks/global_mmlu/default/fr/_fr_template_yaml'
2025-08-31T08:28:48,439   adding 'lm_eval/tasks/global_mmlu/default/fr/_global_mmlu_fr.yaml'
2025-08-31T08:28:48,440   adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_business.yaml'
2025-08-31T08:28:48,441   adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_humanities.yaml'
2025-08-31T08:28:48,443   adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_medical.yaml'
2025-08-31T08:28:48,444   adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_other.yaml'
2025-08-31T08:28:48,445   adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_social_sciences.yaml'
2025-08-31T08:28:48,446   adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_stem.yaml'
2025-08-31T08:28:48,447   adding 'lm_eval/tasks/global_mmlu/default/fr/utils.py'
2025-08-31T08:28:48,449   adding 'lm_eval/tasks/global_mmlu/default/hi/_global_mmlu_hi.yaml'
2025-08-31T08:28:48,450   adding 'lm_eval/tasks/global_mmlu/default/hi/_hi_template_yaml'
2025-08-31T08:28:48,451   adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_business.yaml'
2025-08-31T08:28:48,452   adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_humanities.yaml'
2025-08-31T08:28:48,453   adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_medical.yaml'
2025-08-31T08:28:48,454   adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_other.yaml'
2025-08-31T08:28:48,456   adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_social_sciences.yaml'
2025-08-31T08:28:48,457   adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_stem.yaml'
2025-08-31T08:28:48,458   adding 'lm_eval/tasks/global_mmlu/default/hi/utils.py'
2025-08-31T08:28:48,460   adding 'lm_eval/tasks/global_mmlu/default/id/_global_mmlu_id.yaml'
2025-08-31T08:28:48,461   adding 'lm_eval/tasks/global_mmlu/default/id/_id_template_yaml'
2025-08-31T08:28:48,462   adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_business.yaml'
2025-08-31T08:28:48,463   adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_humanities.yaml'
2025-08-31T08:28:48,464   adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_medical.yaml'
2025-08-31T08:28:48,465   adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_other.yaml'
2025-08-31T08:28:48,467   adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_social_sciences.yaml'
2025-08-31T08:28:48,468   adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_stem.yaml'
2025-08-31T08:28:48,469   adding 'lm_eval/tasks/global_mmlu/default/id/utils.py'
2025-08-31T08:28:48,470   adding 'lm_eval/tasks/global_mmlu/default/it/_global_mmlu_it.yaml'
2025-08-31T08:28:48,471   adding 'lm_eval/tasks/global_mmlu/default/it/_it_template_yaml'
2025-08-31T08:28:48,472   adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_business.yaml'
2025-08-31T08:28:48,473   adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_humanities.yaml'
2025-08-31T08:28:48,474   adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_medical.yaml'
2025-08-31T08:28:48,475   adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_other.yaml'
2025-08-31T08:28:48,476   adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_social_sciences.yaml'
2025-08-31T08:28:48,477   adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_stem.yaml'
2025-08-31T08:28:48,479   adding 'lm_eval/tasks/global_mmlu/default/it/utils.py'
2025-08-31T08:28:48,480   adding 'lm_eval/tasks/global_mmlu/default/ja/_global_mmlu_ja.yaml'
2025-08-31T08:28:48,481   adding 'lm_eval/tasks/global_mmlu/default/ja/_ja_template_yaml'
2025-08-31T08:28:48,483   adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_business.yaml'
2025-08-31T08:28:48,484   adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_humanities.yaml'
2025-08-31T08:28:48,485   adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_medical.yaml'
2025-08-31T08:28:48,486   adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_other.yaml'
2025-08-31T08:28:48,487   adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_social_sciences.yaml'
2025-08-31T08:28:48,488   adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_stem.yaml'
2025-08-31T08:28:48,489   adding 'lm_eval/tasks/global_mmlu/default/ja/utils.py'
2025-08-31T08:28:48,491   adding 'lm_eval/tasks/global_mmlu/default/ko/_global_mmlu_ko.yaml'
2025-08-31T08:28:48,492   adding 'lm_eval/tasks/global_mmlu/default/ko/_ko_template_yaml'
2025-08-31T08:28:48,493   adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_business.yaml'
2025-08-31T08:28:48,494   adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_humanities.yaml'
2025-08-31T08:28:48,495   adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_medical.yaml'
2025-08-31T08:28:48,496   adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_other.yaml'
2025-08-31T08:28:48,498   adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_social_sciences.yaml'
2025-08-31T08:28:48,499   adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_stem.yaml'
2025-08-31T08:28:48,500   adding 'lm_eval/tasks/global_mmlu/default/ko/utils.py'
2025-08-31T08:28:48,502   adding 'lm_eval/tasks/global_mmlu/default/pt/_global_mmlu_pt.yaml'
2025-08-31T08:28:48,503   adding 'lm_eval/tasks/global_mmlu/default/pt/_pt_template_yaml'
2025-08-31T08:28:48,504   adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_business.yaml'
2025-08-31T08:28:48,505   adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_humanities.yaml'
2025-08-31T08:28:48,506   adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_medical.yaml'
2025-08-31T08:28:48,507   adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_other.yaml'
2025-08-31T08:28:48,508   adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_social_sciences.yaml'
2025-08-31T08:28:48,510   adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_stem.yaml'
2025-08-31T08:28:48,511   adding 'lm_eval/tasks/global_mmlu/default/pt/utils.py'
2025-08-31T08:28:48,513   adding 'lm_eval/tasks/global_mmlu/default/sw/_global_mmlu_sw.yaml'
2025-08-31T08:28:48,514   adding 'lm_eval/tasks/global_mmlu/default/sw/_sw_template_yaml'
2025-08-31T08:28:48,515   adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_business.yaml'
2025-08-31T08:28:48,516   adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_humanities.yaml'
2025-08-31T08:28:48,517   adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_medical.yaml'
2025-08-31T08:28:48,518   adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_other.yaml'
2025-08-31T08:28:48,519   adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_social_sciences.yaml'
2025-08-31T08:28:48,521   adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_stem.yaml'
2025-08-31T08:28:48,522   adding 'lm_eval/tasks/global_mmlu/default/sw/utils.py'
2025-08-31T08:28:48,523   adding 'lm_eval/tasks/global_mmlu/default/yo/_global_mmlu_yo.yaml'
2025-08-31T08:28:48,524   adding 'lm_eval/tasks/global_mmlu/default/yo/_yo_template_yaml'
2025-08-31T08:28:48,525   adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_business.yaml'
2025-08-31T08:28:48,526   adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_humanities.yaml'
2025-08-31T08:28:48,527   adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_medical.yaml'
2025-08-31T08:28:48,529   adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_other.yaml'
2025-08-31T08:28:48,530   adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_social_sciences.yaml'
2025-08-31T08:28:48,531   adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_stem.yaml'
2025-08-31T08:28:48,532   adding 'lm_eval/tasks/global_mmlu/default/yo/utils.py'
2025-08-31T08:28:48,534   adding 'lm_eval/tasks/global_mmlu/default/zh/_global_mmlu_zh.yaml'
2025-08-31T08:28:48,535   adding 'lm_eval/tasks/global_mmlu/default/zh/_zh_template_yaml'
2025-08-31T08:28:48,536   adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_business.yaml'
2025-08-31T08:28:48,537   adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_humanities.yaml'
2025-08-31T08:28:48,538   adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_medical.yaml'
2025-08-31T08:28:48,539   adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_other.yaml'
2025-08-31T08:28:48,540   adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_social_sciences.yaml'
2025-08-31T08:28:48,541   adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_stem.yaml'
2025-08-31T08:28:48,542   adding 'lm_eval/tasks/global_mmlu/default/zh/utils.py'
2025-08-31T08:28:48,546   adding 'lm_eval/tasks/global_mmlu/full/am/_am_template_yaml'
2025-08-31T08:28:48,548   adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am.yaml'
2025-08-31T08:28:48,549   adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_humanities.yaml'
2025-08-31T08:28:48,550   adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_other.yaml'
2025-08-31T08:28:48,551   adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_social_sciences.yaml'
2025-08-31T08:28:48,552   adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_stem.yaml'
2025-08-31T08:28:48,553   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_abstract_algebra.yaml'
2025-08-31T08:28:48,554   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_anatomy.yaml'
2025-08-31T08:28:48,555   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_astronomy.yaml'
2025-08-31T08:28:48,557   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_business_ethics.yaml'
2025-08-31T08:28:48,558   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_clinical_knowledge.yaml'
2025-08-31T08:28:48,559   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_biology.yaml'
2025-08-31T08:28:48,560   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_chemistry.yaml'
2025-08-31T08:28:48,561   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_computer_science.yaml'
2025-08-31T08:28:48,562   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_mathematics.yaml'
2025-08-31T08:28:48,563   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_medicine.yaml'
2025-08-31T08:28:48,564   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_physics.yaml'
2025-08-31T08:28:48,566   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_computer_security.yaml'
2025-08-31T08:28:48,567   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_conceptual_physics.yaml'
2025-08-31T08:28:48,568   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_econometrics.yaml'
2025-08-31T08:28:48,569   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_electrical_engineering.yaml'
2025-08-31T08:28:48,570   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_elementary_mathematics.yaml'
2025-08-31T08:28:48,571   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_formal_logic.yaml'
2025-08-31T08:28:48,572   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_global_facts.yaml'
2025-08-31T08:28:48,573   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_biology.yaml'
2025-08-31T08:28:48,574   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_chemistry.yaml'
2025-08-31T08:28:48,575   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_computer_science.yaml'
2025-08-31T08:28:48,577   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_european_history.yaml'
2025-08-31T08:28:48,578   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_geography.yaml'
2025-08-31T08:28:48,579   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_government_and_politics.yaml'
2025-08-31T08:28:48,580   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_macroeconomics.yaml'
2025-08-31T08:28:48,581   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_mathematics.yaml'
2025-08-31T08:28:48,582   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_microeconomics.yaml'
2025-08-31T08:28:48,583   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_physics.yaml'
2025-08-31T08:28:48,584   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_psychology.yaml'
2025-08-31T08:28:48,585   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_statistics.yaml'
2025-08-31T08:28:48,587   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_us_history.yaml'
2025-08-31T08:28:48,588   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_world_history.yaml'
2025-08-31T08:28:48,589   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_aging.yaml'
2025-08-31T08:28:48,590   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_sexuality.yaml'
2025-08-31T08:28:48,591   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_international_law.yaml'
2025-08-31T08:28:48,592   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_jurisprudence.yaml'
2025-08-31T08:28:48,593   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_logical_fallacies.yaml'
2025-08-31T08:28:48,595   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_machine_learning.yaml'
2025-08-31T08:28:48,596   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_management.yaml'
2025-08-31T08:28:48,597   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_marketing.yaml'
2025-08-31T08:28:48,598   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_medical_genetics.yaml'
2025-08-31T08:28:48,599   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_miscellaneous.yaml'
2025-08-31T08:28:48,600   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_disputes.yaml'
2025-08-31T08:28:48,602   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_scenarios.yaml'
2025-08-31T08:28:48,603   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_nutrition.yaml'
2025-08-31T08:28:48,604   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_philosophy.yaml'
2025-08-31T08:28:48,605   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_prehistory.yaml'
2025-08-31T08:28:48,606   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_accounting.yaml'
2025-08-31T08:28:48,607   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_law.yaml'
2025-08-31T08:28:48,608   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_medicine.yaml'
2025-08-31T08:28:48,609   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_psychology.yaml'
2025-08-31T08:28:48,610   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_public_relations.yaml'
2025-08-31T08:28:48,611   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_security_studies.yaml'
2025-08-31T08:28:48,612   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_sociology.yaml'
2025-08-31T08:28:48,613   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_us_foreign_policy.yaml'
2025-08-31T08:28:48,614   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_virology.yaml'
2025-08-31T08:28:48,615   adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_world_religions.yaml'
2025-08-31T08:28:48,617   adding 'lm_eval/tasks/global_mmlu/full/am/utils.py'
2025-08-31T08:28:48,620   adding 'lm_eval/tasks/global_mmlu/full/ar/_ar_template_yaml'
2025-08-31T08:28:48,621   adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar.yaml'
2025-08-31T08:28:48,622   adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_humanities.yaml'
2025-08-31T08:28:48,623   adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_other.yaml'
2025-08-31T08:28:48,624   adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_social_sciences.yaml'
2025-08-31T08:28:48,626   adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_stem.yaml'
2025-08-31T08:28:48,627   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_abstract_algebra.yaml'
2025-08-31T08:28:48,628   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_anatomy.yaml'
2025-08-31T08:28:48,629   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_astronomy.yaml'
2025-08-31T08:28:48,630   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_business_ethics.yaml'
2025-08-31T08:28:48,631   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_clinical_knowledge.yaml'
2025-08-31T08:28:48,632   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_biology.yaml'
2025-08-31T08:28:48,633   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_chemistry.yaml'
2025-08-31T08:28:48,634   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_computer_science.yaml'
2025-08-31T08:28:48,636   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_mathematics.yaml'
2025-08-31T08:28:48,637   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_medicine.yaml'
2025-08-31T08:28:48,638   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_physics.yaml'
2025-08-31T08:28:48,639   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_computer_security.yaml'
2025-08-31T08:28:48,640   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_conceptual_physics.yaml'
2025-08-31T08:28:48,641   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_econometrics.yaml'
2025-08-31T08:28:48,642   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_electrical_engineering.yaml'
2025-08-31T08:28:48,643   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_elementary_mathematics.yaml'
2025-08-31T08:28:48,644   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_formal_logic.yaml'
2025-08-31T08:28:48,646   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_global_facts.yaml'
2025-08-31T08:28:48,647   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_biology.yaml'
2025-08-31T08:28:48,648   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_chemistry.yaml'
2025-08-31T08:28:48,649   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_computer_science.yaml'
2025-08-31T08:28:48,650   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_european_history.yaml'
2025-08-31T08:28:48,651   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_geography.yaml'
2025-08-31T08:28:48,652   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_government_and_politics.yaml'
2025-08-31T08:28:48,653   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_macroeconomics.yaml'
2025-08-31T08:28:48,654   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_mathematics.yaml'
2025-08-31T08:28:48,655   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_microeconomics.yaml'
2025-08-31T08:28:48,656   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_physics.yaml'
2025-08-31T08:28:48,657   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_psychology.yaml'
2025-08-31T08:28:48,659   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_statistics.yaml'
2025-08-31T08:28:48,660   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_us_history.yaml'
2025-08-31T08:28:48,661   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_world_history.yaml'
2025-08-31T08:28:48,662   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_aging.yaml'
2025-08-31T08:28:48,663   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_sexuality.yaml'
2025-08-31T08:28:48,664   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_international_law.yaml'
2025-08-31T08:28:48,665   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_jurisprudence.yaml'
2025-08-31T08:28:48,666   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_logical_fallacies.yaml'
2025-08-31T08:28:48,667   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_machine_learning.yaml'
2025-08-31T08:28:48,669   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_management.yaml'
2025-08-31T08:28:48,670   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_marketing.yaml'
2025-08-31T08:28:48,671   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_medical_genetics.yaml'
2025-08-31T08:28:48,672   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_miscellaneous.yaml'
2025-08-31T08:28:48,673   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_disputes.yaml'
2025-08-31T08:28:48,674   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_scenarios.yaml'
2025-08-31T08:28:48,676   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_nutrition.yaml'
2025-08-31T08:28:48,677   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_philosophy.yaml'
2025-08-31T08:28:48,678   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_prehistory.yaml'
2025-08-31T08:28:48,679   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_accounting.yaml'
2025-08-31T08:28:48,680   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_law.yaml'
2025-08-31T08:28:48,681   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_medicine.yaml'
2025-08-31T08:28:48,682   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_psychology.yaml'
2025-08-31T08:28:48,684   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_public_relations.yaml'
2025-08-31T08:28:48,685   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_security_studies.yaml'
2025-08-31T08:28:48,686   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_sociology.yaml'
2025-08-31T08:28:48,687   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_us_foreign_policy.yaml'
2025-08-31T08:28:48,688   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_virology.yaml'
2025-08-31T08:28:48,689   adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_world_religions.yaml'
2025-08-31T08:28:48,691   adding 'lm_eval/tasks/global_mmlu/full/ar/utils.py'
2025-08-31T08:28:48,694   adding 'lm_eval/tasks/global_mmlu/full/bn/_bn_template_yaml'
2025-08-31T08:28:48,695   adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn.yaml'
2025-08-31T08:28:48,696   adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_humanities.yaml'
2025-08-31T08:28:48,697   adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_other.yaml'
2025-08-31T08:28:48,698   adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_social_sciences.yaml'
2025-08-31T08:28:48,699   adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_stem.yaml'
2025-08-31T08:28:48,700   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_abstract_algebra.yaml'
2025-08-31T08:28:48,701   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_anatomy.yaml'
2025-08-31T08:28:48,702   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_astronomy.yaml'
2025-08-31T08:28:48,703   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_business_ethics.yaml'
2025-08-31T08:28:48,705   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_clinical_knowledge.yaml'
2025-08-31T08:28:48,706   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_biology.yaml'
2025-08-31T08:28:48,707   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_chemistry.yaml'
2025-08-31T08:28:48,708   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_computer_science.yaml'
2025-08-31T08:28:48,709   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_mathematics.yaml'
2025-08-31T08:28:48,711   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_medicine.yaml'
2025-08-31T08:28:48,712   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_physics.yaml'
2025-08-31T08:28:48,713   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_computer_security.yaml'
2025-08-31T08:28:48,714   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_conceptual_physics.yaml'
2025-08-31T08:28:48,715   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_econometrics.yaml'
2025-08-31T08:28:48,717   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_electrical_engineering.yaml'
2025-08-31T08:28:48,718   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_elementary_mathematics.yaml'
2025-08-31T08:28:48,719   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_formal_logic.yaml'
2025-08-31T08:28:48,720   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_global_facts.yaml'
2025-08-31T08:28:48,721   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_biology.yaml'
2025-08-31T08:28:48,722   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_chemistry.yaml'
2025-08-31T08:28:48,723   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_computer_science.yaml'
2025-08-31T08:28:48,725   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_european_history.yaml'
2025-08-31T08:28:48,726   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_geography.yaml'
2025-08-31T08:28:48,727   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_government_and_politics.yaml'
2025-08-31T08:28:48,728   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_macroeconomics.yaml'
2025-08-31T08:28:48,729   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_mathematics.yaml'
2025-08-31T08:28:48,730   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_microeconomics.yaml'
2025-08-31T08:28:48,731   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_physics.yaml'
2025-08-31T08:28:48,733   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_psychology.yaml'
2025-08-31T08:28:48,734   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_statistics.yaml'
2025-08-31T08:28:48,735   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_us_history.yaml'
2025-08-31T08:28:48,736   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_world_history.yaml'
2025-08-31T08:28:48,737   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_aging.yaml'
2025-08-31T08:28:48,739   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_sexuality.yaml'
2025-08-31T08:28:48,740   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_international_law.yaml'
2025-08-31T08:28:48,741   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_jurisprudence.yaml'
2025-08-31T08:28:48,742   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_logical_fallacies.yaml'
2025-08-31T08:28:48,743   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_machine_learning.yaml'
2025-08-31T08:28:48,744   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_management.yaml'
2025-08-31T08:28:48,745   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_marketing.yaml'
2025-08-31T08:28:48,746   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_medical_genetics.yaml'
2025-08-31T08:28:48,748   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_miscellaneous.yaml'
2025-08-31T08:28:48,749   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_disputes.yaml'
2025-08-31T08:28:48,750   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_scenarios.yaml'
2025-08-31T08:28:48,751   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_nutrition.yaml'
2025-08-31T08:28:48,752   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_philosophy.yaml'
2025-08-31T08:28:48,753   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_prehistory.yaml'
2025-08-31T08:28:48,754   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_accounting.yaml'
2025-08-31T08:28:48,756   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_law.yaml'
2025-08-31T08:28:48,757   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_medicine.yaml'
2025-08-31T08:28:48,758   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_psychology.yaml'
2025-08-31T08:28:48,759   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_public_relations.yaml'
2025-08-31T08:28:48,760   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_security_studies.yaml'
2025-08-31T08:28:48,761   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_sociology.yaml'
2025-08-31T08:28:48,763   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_us_foreign_policy.yaml'
2025-08-31T08:28:48,764   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_virology.yaml'
2025-08-31T08:28:48,765   adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_world_religions.yaml'
2025-08-31T08:28:48,766   adding 'lm_eval/tasks/global_mmlu/full/bn/utils.py'
2025-08-31T08:28:48,769   adding 'lm_eval/tasks/global_mmlu/full/cs/_cs_template_yaml'
2025-08-31T08:28:48,770   adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs.yaml'
2025-08-31T08:28:48,771   adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_humanities.yaml'
2025-08-31T08:28:48,773   adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_other.yaml'
2025-08-31T08:28:48,774   adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_social_sciences.yaml'
2025-08-31T08:28:48,775   adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_stem.yaml'
2025-08-31T08:28:48,776   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_abstract_algebra.yaml'
2025-08-31T08:28:48,777   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_anatomy.yaml'
2025-08-31T08:28:48,778   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_astronomy.yaml'
2025-08-31T08:28:48,780   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_business_ethics.yaml'
2025-08-31T08:28:48,781   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_clinical_knowledge.yaml'
2025-08-31T08:28:48,782   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_biology.yaml'
2025-08-31T08:28:48,784   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_chemistry.yaml'
2025-08-31T08:28:48,785   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_computer_science.yaml'
2025-08-31T08:28:48,786   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_mathematics.yaml'
2025-08-31T08:28:48,787   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_medicine.yaml'
2025-08-31T08:28:48,788   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_physics.yaml'
2025-08-31T08:28:48,789   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_computer_security.yaml'
2025-08-31T08:28:48,790   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_conceptual_physics.yaml'
2025-08-31T08:28:48,792   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_econometrics.yaml'
2025-08-31T08:28:48,793   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_electrical_engineering.yaml'
2025-08-31T08:28:48,794   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_elementary_mathematics.yaml'
2025-08-31T08:28:48,795   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_formal_logic.yaml'
2025-08-31T08:28:48,796   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_global_facts.yaml'
2025-08-31T08:28:48,797   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_biology.yaml'
2025-08-31T08:28:48,798   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_chemistry.yaml'
2025-08-31T08:28:48,800   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_computer_science.yaml'
2025-08-31T08:28:48,801   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_european_history.yaml'
2025-08-31T08:28:48,802   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_geography.yaml'
2025-08-31T08:28:48,803   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_government_and_politics.yaml'
2025-08-31T08:28:48,804   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_macroeconomics.yaml'
2025-08-31T08:28:48,805   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_mathematics.yaml'
2025-08-31T08:28:48,806   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_microeconomics.yaml'
2025-08-31T08:28:48,808   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_physics.yaml'
2025-08-31T08:28:48,809   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_psychology.yaml'
2025-08-31T08:28:48,810   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_statistics.yaml'
2025-08-31T08:28:48,811   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_us_history.yaml'
2025-08-31T08:28:48,812   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_world_history.yaml'
2025-08-31T08:28:48,813   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_aging.yaml'
2025-08-31T08:28:48,815   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_sexuality.yaml'
2025-08-31T08:28:48,816   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_international_law.yaml'
2025-08-31T08:28:48,817   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_jurisprudence.yaml'
2025-08-31T08:28:48,818   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_logical_fallacies.yaml'
2025-08-31T08:28:48,819   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_machine_learning.yaml'
2025-08-31T08:28:48,821   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_management.yaml'
2025-08-31T08:28:48,822   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_marketing.yaml'
2025-08-31T08:28:48,823   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_medical_genetics.yaml'
2025-08-31T08:28:48,824   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_miscellaneous.yaml'
2025-08-31T08:28:48,825   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_disputes.yaml'
2025-08-31T08:28:48,826   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_scenarios.yaml'
2025-08-31T08:28:48,828   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_nutrition.yaml'
2025-08-31T08:28:48,829   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_philosophy.yaml'
2025-08-31T08:28:48,830   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_prehistory.yaml'
2025-08-31T08:28:48,831   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_accounting.yaml'
2025-08-31T08:28:48,832   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_law.yaml'
2025-08-31T08:28:48,833   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_medicine.yaml'
2025-08-31T08:28:48,834   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_psychology.yaml'
2025-08-31T08:28:48,835   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_public_relations.yaml'
2025-08-31T08:28:48,837   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_security_studies.yaml'
2025-08-31T08:28:48,838   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_sociology.yaml'
2025-08-31T08:28:48,839   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_us_foreign_policy.yaml'
2025-08-31T08:28:48,840   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_virology.yaml'
2025-08-31T08:28:48,841   adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_world_religions.yaml'
2025-08-31T08:28:48,842   adding 'lm_eval/tasks/global_mmlu/full/cs/utils.py'
2025-08-31T08:28:48,845   adding 'lm_eval/tasks/global_mmlu/full/de/_de_template_yaml'
2025-08-31T08:28:48,846   adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de.yaml'
2025-08-31T08:28:48,847   adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_humanities.yaml'
2025-08-31T08:28:48,849   adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_other.yaml'
2025-08-31T08:28:48,850   adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_social_sciences.yaml'
2025-08-31T08:28:48,851   adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_stem.yaml'
2025-08-31T08:28:48,852   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_abstract_algebra.yaml'
2025-08-31T08:28:48,853   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_anatomy.yaml'
2025-08-31T08:28:48,854   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_astronomy.yaml'
2025-08-31T08:28:48,856   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_business_ethics.yaml'
2025-08-31T08:28:48,857   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_clinical_knowledge.yaml'
2025-08-31T08:28:48,859   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_biology.yaml'
2025-08-31T08:28:48,861   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_chemistry.yaml'
2025-08-31T08:28:48,862   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_computer_science.yaml'
2025-08-31T08:28:48,863   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_mathematics.yaml'
2025-08-31T08:28:48,864   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_medicine.yaml'
2025-08-31T08:28:48,865   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_physics.yaml'
2025-08-31T08:28:48,866   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_computer_security.yaml'
2025-08-31T08:28:48,868   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_conceptual_physics.yaml'
2025-08-31T08:28:48,869   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_econometrics.yaml'
2025-08-31T08:28:48,870   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_electrical_engineering.yaml'
2025-08-31T08:28:48,871   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_elementary_mathematics.yaml'
2025-08-31T08:28:48,872   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_formal_logic.yaml'
2025-08-31T08:28:48,873   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_global_facts.yaml'
2025-08-31T08:28:48,874   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_biology.yaml'
2025-08-31T08:28:48,876   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_chemistry.yaml'
2025-08-31T08:28:48,877   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_computer_science.yaml'
2025-08-31T08:28:48,878   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_european_history.yaml'
2025-08-31T08:28:48,879   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_geography.yaml'
2025-08-31T08:28:48,880   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_government_and_politics.yaml'
2025-08-31T08:28:48,881   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_macroeconomics.yaml'
2025-08-31T08:28:48,882   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_mathematics.yaml'
2025-08-31T08:28:48,884   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_microeconomics.yaml'
2025-08-31T08:28:48,885   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_physics.yaml'
2025-08-31T08:28:48,886   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_psychology.yaml'
2025-08-31T08:28:48,887   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_statistics.yaml'
2025-08-31T08:28:48,889   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_us_history.yaml'
2025-08-31T08:28:48,890   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_world_history.yaml'
2025-08-31T08:28:48,891   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_aging.yaml'
2025-08-31T08:28:48,892   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_sexuality.yaml'
2025-08-31T08:28:48,893   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_international_law.yaml'
2025-08-31T08:28:48,894   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_jurisprudence.yaml'
2025-08-31T08:28:48,895   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_logical_fallacies.yaml'
2025-08-31T08:28:48,897   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_machine_learning.yaml'
2025-08-31T08:28:48,898   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_management.yaml'
2025-08-31T08:28:48,899   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_marketing.yaml'
2025-08-31T08:28:48,900   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_medical_genetics.yaml'
2025-08-31T08:28:48,901   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_miscellaneous.yaml'
2025-08-31T08:28:48,902   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_disputes.yaml'
2025-08-31T08:28:48,904   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_scenarios.yaml'
2025-08-31T08:28:48,905   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_nutrition.yaml'
2025-08-31T08:28:48,906   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_philosophy.yaml'
2025-08-31T08:28:48,907   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_prehistory.yaml'
2025-08-31T08:28:48,908   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_accounting.yaml'
2025-08-31T08:28:48,909   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_law.yaml'
2025-08-31T08:28:48,910   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_medicine.yaml'
2025-08-31T08:28:48,912   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_psychology.yaml'
2025-08-31T08:28:48,913   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_public_relations.yaml'
2025-08-31T08:28:48,914   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_security_studies.yaml'
2025-08-31T08:28:48,915   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_sociology.yaml'
2025-08-31T08:28:48,916   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_us_foreign_policy.yaml'
2025-08-31T08:28:48,918   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_virology.yaml'
2025-08-31T08:28:48,919   adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_world_religions.yaml'
2025-08-31T08:28:48,920   adding 'lm_eval/tasks/global_mmlu/full/de/utils.py'
2025-08-31T08:28:48,923   adding 'lm_eval/tasks/global_mmlu/full/el/_el_template_yaml'
2025-08-31T08:28:48,924   adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el.yaml'
2025-08-31T08:28:48,925   adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_humanities.yaml'
2025-08-31T08:28:48,926   adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_other.yaml'
2025-08-31T08:28:48,928   adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_social_sciences.yaml'
2025-08-31T08:28:48,929   adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_stem.yaml'
2025-08-31T08:28:48,930   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_abstract_algebra.yaml'
2025-08-31T08:28:48,931   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_anatomy.yaml'
2025-08-31T08:28:48,932   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_astronomy.yaml'
2025-08-31T08:28:48,933   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_business_ethics.yaml'
2025-08-31T08:28:48,934   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_clinical_knowledge.yaml'
2025-08-31T08:28:48,935   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_biology.yaml'
2025-08-31T08:28:48,936   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_chemistry.yaml'
2025-08-31T08:28:48,938   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_computer_science.yaml'
2025-08-31T08:28:48,939   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_mathematics.yaml'
2025-08-31T08:28:48,940   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_medicine.yaml'
2025-08-31T08:28:48,941   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_physics.yaml'
2025-08-31T08:28:48,942   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_computer_security.yaml'
2025-08-31T08:28:48,943   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_conceptual_physics.yaml'
2025-08-31T08:28:48,944   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_econometrics.yaml'
2025-08-31T08:28:48,946   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_electrical_engineering.yaml'
2025-08-31T08:28:48,947   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_elementary_mathematics.yaml'
2025-08-31T08:28:48,948   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_formal_logic.yaml'
2025-08-31T08:28:48,949   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_global_facts.yaml'
2025-08-31T08:28:48,950   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_biology.yaml'
2025-08-31T08:28:48,951   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_chemistry.yaml'
2025-08-31T08:28:48,953   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_computer_science.yaml'
2025-08-31T08:28:48,954   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_european_history.yaml'
2025-08-31T08:28:48,955   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_geography.yaml'
2025-08-31T08:28:48,956   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_government_and_politics.yaml'
2025-08-31T08:28:48,957   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_macroeconomics.yaml'
2025-08-31T08:28:48,959   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_mathematics.yaml'
2025-08-31T08:28:48,960   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_microeconomics.yaml'
2025-08-31T08:28:48,961   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_physics.yaml'
2025-08-31T08:28:48,962   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_psychology.yaml'
2025-08-31T08:28:48,963   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_statistics.yaml'
2025-08-31T08:28:48,964   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_us_history.yaml'
2025-08-31T08:28:48,965   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_world_history.yaml'
2025-08-31T08:28:48,966   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_aging.yaml'
2025-08-31T08:28:48,967   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_sexuality.yaml'
2025-08-31T08:28:48,968   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_international_law.yaml'
2025-08-31T08:28:48,970   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_jurisprudence.yaml'
2025-08-31T08:28:48,971   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_logical_fallacies.yaml'
2025-08-31T08:28:48,972   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_machine_learning.yaml'
2025-08-31T08:28:48,973   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_management.yaml'
2025-08-31T08:28:48,974   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_marketing.yaml'
2025-08-31T08:28:48,975   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_medical_genetics.yaml'
2025-08-31T08:28:48,977   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_miscellaneous.yaml'
2025-08-31T08:28:48,978   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_disputes.yaml'
2025-08-31T08:28:48,979   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_scenarios.yaml'
2025-08-31T08:28:48,980   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_nutrition.yaml'
2025-08-31T08:28:48,981   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_philosophy.yaml'
2025-08-31T08:28:48,982   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_prehistory.yaml'
2025-08-31T08:28:48,983   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_accounting.yaml'
2025-08-31T08:28:48,985   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_law.yaml'
2025-08-31T08:28:48,986   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_medicine.yaml'
2025-08-31T08:28:48,987   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_psychology.yaml'
2025-08-31T08:28:48,988   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_public_relations.yaml'
2025-08-31T08:28:48,989   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_security_studies.yaml'
2025-08-31T08:28:48,991   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_sociology.yaml'
2025-08-31T08:28:48,992   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_us_foreign_policy.yaml'
2025-08-31T08:28:48,993   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_virology.yaml'
2025-08-31T08:28:48,994   adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_world_religions.yaml'
2025-08-31T08:28:48,996   adding 'lm_eval/tasks/global_mmlu/full/el/utils.py'
2025-08-31T08:28:48,999   adding 'lm_eval/tasks/global_mmlu/full/en/_en_template_yaml'
2025-08-31T08:28:49,000   adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en.yaml'
2025-08-31T08:28:49,001   adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_humanities.yaml'
2025-08-31T08:28:49,002   adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_other.yaml'
2025-08-31T08:28:49,004   adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_social_sciences.yaml'
2025-08-31T08:28:49,005   adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_stem.yaml'
2025-08-31T08:28:49,006   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_abstract_algebra.yaml'
2025-08-31T08:28:49,007   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_anatomy.yaml'
2025-08-31T08:28:49,008   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_astronomy.yaml'
2025-08-31T08:28:49,009   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_business_ethics.yaml'
2025-08-31T08:28:49,010   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_clinical_knowledge.yaml'
2025-08-31T08:28:49,012   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_biology.yaml'
2025-08-31T08:28:49,013   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_chemistry.yaml'
2025-08-31T08:28:49,014   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_computer_science.yaml'
2025-08-31T08:28:49,015   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_mathematics.yaml'
2025-08-31T08:28:49,016   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_medicine.yaml'
2025-08-31T08:28:49,017   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_physics.yaml'
2025-08-31T08:28:49,019   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_computer_security.yaml'
2025-08-31T08:28:49,020   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_conceptual_physics.yaml'
2025-08-31T08:28:49,021   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_econometrics.yaml'
2025-08-31T08:28:49,022   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_electrical_engineering.yaml'
2025-08-31T08:28:49,023   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_elementary_mathematics.yaml'
2025-08-31T08:28:49,024   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_formal_logic.yaml'
2025-08-31T08:28:49,025   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_global_facts.yaml'
2025-08-31T08:28:49,027   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_biology.yaml'
2025-08-31T08:28:49,028   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_chemistry.yaml'
2025-08-31T08:28:49,029   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_computer_science.yaml'
2025-08-31T08:28:49,030   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_european_history.yaml'
2025-08-31T08:28:49,031   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_geography.yaml'
2025-08-31T08:28:49,032   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_government_and_politics.yaml'
2025-08-31T08:28:49,033   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_macroeconomics.yaml'
2025-08-31T08:28:49,035   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_mathematics.yaml'
2025-08-31T08:28:49,036   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_microeconomics.yaml'
2025-08-31T08:28:49,037   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_physics.yaml'
2025-08-31T08:28:49,038   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_psychology.yaml'
2025-08-31T08:28:49,039   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_statistics.yaml'
2025-08-31T08:28:49,041   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_us_history.yaml'
2025-08-31T08:28:49,042   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_world_history.yaml'
2025-08-31T08:28:49,043   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_aging.yaml'
2025-08-31T08:28:49,044   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_sexuality.yaml'
2025-08-31T08:28:49,045   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_international_law.yaml'
2025-08-31T08:28:49,046   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_jurisprudence.yaml'
2025-08-31T08:28:49,047   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_logical_fallacies.yaml'
2025-08-31T08:28:49,048   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_machine_learning.yaml'
2025-08-31T08:28:49,049   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_management.yaml'
2025-08-31T08:28:49,050   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_marketing.yaml'
2025-08-31T08:28:49,051   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_medical_genetics.yaml'
2025-08-31T08:28:49,053   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_miscellaneous.yaml'
2025-08-31T08:28:49,054   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_disputes.yaml'
2025-08-31T08:28:49,055   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_scenarios.yaml'
2025-08-31T08:28:49,056   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_nutrition.yaml'
2025-08-31T08:28:49,057   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_philosophy.yaml'
2025-08-31T08:28:49,059   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_prehistory.yaml'
2025-08-31T08:28:49,060   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_accounting.yaml'
2025-08-31T08:28:49,061   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_law.yaml'
2025-08-31T08:28:49,062   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_medicine.yaml'
2025-08-31T08:28:49,063   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_psychology.yaml'
2025-08-31T08:28:49,064   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_public_relations.yaml'
2025-08-31T08:28:49,065   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_security_studies.yaml'
2025-08-31T08:28:49,066   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_sociology.yaml'
2025-08-31T08:28:49,068   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_us_foreign_policy.yaml'
2025-08-31T08:28:49,069   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_virology.yaml'
2025-08-31T08:28:49,070   adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_world_religions.yaml'
2025-08-31T08:28:49,071   adding 'lm_eval/tasks/global_mmlu/full/en/utils.py'
2025-08-31T08:28:49,074   adding 'lm_eval/tasks/global_mmlu/full/es/_es_template_yaml'
2025-08-31T08:28:49,075   adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es.yaml'
2025-08-31T08:28:49,076   adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_humanities.yaml'
2025-08-31T08:28:49,077   adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_other.yaml'
2025-08-31T08:28:49,078   adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_social_sciences.yaml'
2025-08-31T08:28:49,080   adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_stem.yaml'
2025-08-31T08:28:49,081   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_abstract_algebra.yaml'
2025-08-31T08:28:49,082   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_anatomy.yaml'
2025-08-31T08:28:49,083   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_astronomy.yaml'
2025-08-31T08:28:49,084   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_business_ethics.yaml'
2025-08-31T08:28:49,085   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_clinical_knowledge.yaml'
2025-08-31T08:28:49,087   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_biology.yaml'
2025-08-31T08:28:49,088   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_chemistry.yaml'
2025-08-31T08:28:49,089   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_computer_science.yaml'
2025-08-31T08:28:49,090   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_mathematics.yaml'
2025-08-31T08:28:49,092   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_medicine.yaml'
2025-08-31T08:28:49,092   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_physics.yaml'
2025-08-31T08:28:49,093   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_computer_security.yaml'
2025-08-31T08:28:49,095   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_conceptual_physics.yaml'
2025-08-31T08:28:49,096   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_econometrics.yaml'
2025-08-31T08:28:49,097   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_electrical_engineering.yaml'
2025-08-31T08:28:49,098   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_elementary_mathematics.yaml'
2025-08-31T08:28:49,099   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_formal_logic.yaml'
2025-08-31T08:28:49,100   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_global_facts.yaml'
2025-08-31T08:28:49,101   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_biology.yaml'
2025-08-31T08:28:49,102   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_chemistry.yaml'
2025-08-31T08:28:49,103   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_computer_science.yaml'
2025-08-31T08:28:49,104   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_european_history.yaml'
2025-08-31T08:28:49,106   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_geography.yaml'
2025-08-31T08:28:49,107   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_government_and_politics.yaml'
2025-08-31T08:28:49,108   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_macroeconomics.yaml'
2025-08-31T08:28:49,109   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_mathematics.yaml'
2025-08-31T08:28:49,110   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_microeconomics.yaml'
2025-08-31T08:28:49,111   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_physics.yaml'
2025-08-31T08:28:49,113   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_psychology.yaml'
2025-08-31T08:28:49,114   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_statistics.yaml'
2025-08-31T08:28:49,115   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_us_history.yaml'
2025-08-31T08:28:49,116   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_world_history.yaml'
2025-08-31T08:28:49,117   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_aging.yaml'
2025-08-31T08:28:49,118   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_sexuality.yaml'
2025-08-31T08:28:49,120   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_international_law.yaml'
2025-08-31T08:28:49,121   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_jurisprudence.yaml'
2025-08-31T08:28:49,122   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_logical_fallacies.yaml'
2025-08-31T08:28:49,123   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_machine_learning.yaml'
2025-08-31T08:28:49,124   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_management.yaml'
2025-08-31T08:28:49,125   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_marketing.yaml'
2025-08-31T08:28:49,127   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_medical_genetics.yaml'
2025-08-31T08:28:49,128   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_miscellaneous.yaml'
2025-08-31T08:28:49,129   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_disputes.yaml'
2025-08-31T08:28:49,130   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_scenarios.yaml'
2025-08-31T08:28:49,132   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_nutrition.yaml'
2025-08-31T08:28:49,133   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_philosophy.yaml'
2025-08-31T08:28:49,134   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_prehistory.yaml'
2025-08-31T08:28:49,135   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_accounting.yaml'
2025-08-31T08:28:49,136   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_law.yaml'
2025-08-31T08:28:49,137   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_medicine.yaml'
2025-08-31T08:28:49,138   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_psychology.yaml'
2025-08-31T08:28:49,139   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_public_relations.yaml'
2025-08-31T08:28:49,140   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_security_studies.yaml'
2025-08-31T08:28:49,142   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_sociology.yaml'
2025-08-31T08:28:49,143   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_us_foreign_policy.yaml'
2025-08-31T08:28:49,144   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_virology.yaml'
2025-08-31T08:28:49,145   adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_world_religions.yaml'
2025-08-31T08:28:49,146   adding 'lm_eval/tasks/global_mmlu/full/es/utils.py'
2025-08-31T08:28:49,149   adding 'lm_eval/tasks/global_mmlu/full/fa/_fa_template_yaml'
2025-08-31T08:28:49,150   adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa.yaml'
2025-08-31T08:28:49,152   adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_humanities.yaml'
2025-08-31T08:28:49,153   adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_other.yaml'
2025-08-31T08:28:49,154   adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_social_sciences.yaml'
2025-08-31T08:28:49,155   adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_stem.yaml'
2025-08-31T08:28:49,156   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_abstract_algebra.yaml'
2025-08-31T08:28:49,157   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_anatomy.yaml'
2025-08-31T08:28:49,158   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_astronomy.yaml'
2025-08-31T08:28:49,160   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_business_ethics.yaml'
2025-08-31T08:28:49,161   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_clinical_knowledge.yaml'
2025-08-31T08:28:49,162   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_biology.yaml'
2025-08-31T08:28:49,163   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_chemistry.yaml'
2025-08-31T08:28:49,164   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_computer_science.yaml'
2025-08-31T08:28:49,166   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_mathematics.yaml'
2025-08-31T08:28:49,167   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_medicine.yaml'
2025-08-31T08:28:49,168   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_physics.yaml'
2025-08-31T08:28:49,169   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_computer_security.yaml'
2025-08-31T08:28:49,170   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_conceptual_physics.yaml'
2025-08-31T08:28:49,171   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_econometrics.yaml'
2025-08-31T08:28:49,173   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_electrical_engineering.yaml'
2025-08-31T08:28:49,174   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_elementary_mathematics.yaml'
2025-08-31T08:28:49,175   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_formal_logic.yaml'
2025-08-31T08:28:49,176   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_global_facts.yaml'
2025-08-31T08:28:49,177   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_biology.yaml'
2025-08-31T08:28:49,178   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_chemistry.yaml'
2025-08-31T08:28:49,179   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_computer_science.yaml'
2025-08-31T08:28:49,180   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_european_history.yaml'
2025-08-31T08:28:49,181   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_geography.yaml'
2025-08-31T08:28:49,182   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_government_and_politics.yaml'
2025-08-31T08:28:49,183   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_macroeconomics.yaml'
2025-08-31T08:28:49,185   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_mathematics.yaml'
2025-08-31T08:28:49,186   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_microeconomics.yaml'
2025-08-31T08:28:49,187   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_physics.yaml'
2025-08-31T08:28:49,188   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_psychology.yaml'
2025-08-31T08:28:49,189   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_statistics.yaml'
2025-08-31T08:28:49,190   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_us_history.yaml'
2025-08-31T08:28:49,191   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_world_history.yaml'
2025-08-31T08:28:49,192   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_aging.yaml'
2025-08-31T08:28:49,193   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_sexuality.yaml'
2025-08-31T08:28:49,195   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_international_law.yaml'
2025-08-31T08:28:49,196   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_jurisprudence.yaml'
2025-08-31T08:28:49,197   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_logical_fallacies.yaml'
2025-08-31T08:28:49,198   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_machine_learning.yaml'
2025-08-31T08:28:49,199   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_management.yaml'
2025-08-31T08:28:49,200   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_marketing.yaml'
2025-08-31T08:28:49,202   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_medical_genetics.yaml'
2025-08-31T08:28:49,203   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_miscellaneous.yaml'
2025-08-31T08:28:49,205   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_disputes.yaml'
2025-08-31T08:28:49,206   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_scenarios.yaml'
2025-08-31T08:28:49,207   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_nutrition.yaml'
2025-08-31T08:28:49,208   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_philosophy.yaml'
2025-08-31T08:28:49,209   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_prehistory.yaml'
2025-08-31T08:28:49,210   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_accounting.yaml'
2025-08-31T08:28:49,212   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_law.yaml'
2025-08-31T08:28:49,213   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_medicine.yaml'
2025-08-31T08:28:49,214   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_psychology.yaml'
2025-08-31T08:28:49,215   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_public_relations.yaml'
2025-08-31T08:28:49,216   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_security_studies.yaml'
2025-08-31T08:28:49,217   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_sociology.yaml'
2025-08-31T08:28:49,219   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_us_foreign_policy.yaml'
2025-08-31T08:28:49,220   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_virology.yaml'
2025-08-31T08:28:49,221   adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_world_religions.yaml'
2025-08-31T08:28:49,222   adding 'lm_eval/tasks/global_mmlu/full/fa/utils.py'
2025-08-31T08:28:49,225   adding 'lm_eval/tasks/global_mmlu/full/fil/_fil_template_yaml'
2025-08-31T08:28:49,226   adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil.yaml'
2025-08-31T08:28:49,227   adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_humanities.yaml'
2025-08-31T08:28:49,228   adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_other.yaml'
2025-08-31T08:28:49,229   adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_social_sciences.yaml'
2025-08-31T08:28:49,230   adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_stem.yaml'
2025-08-31T08:28:49,231   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_abstract_algebra.yaml'
2025-08-31T08:28:49,233   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_anatomy.yaml'
2025-08-31T08:28:49,234   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_astronomy.yaml'
2025-08-31T08:28:49,235   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_business_ethics.yaml'
2025-08-31T08:28:49,236   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_clinical_knowledge.yaml'
2025-08-31T08:28:49,237   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_biology.yaml'
2025-08-31T08:28:49,238   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_chemistry.yaml'
2025-08-31T08:28:49,239   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_computer_science.yaml'
2025-08-31T08:28:49,240   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_mathematics.yaml'
2025-08-31T08:28:49,242   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_medicine.yaml'
2025-08-31T08:28:49,243   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_physics.yaml'
2025-08-31T08:28:49,244   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_computer_security.yaml'
2025-08-31T08:28:49,245   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_conceptual_physics.yaml'
2025-08-31T08:28:49,246   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_econometrics.yaml'
2025-08-31T08:28:49,247   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_electrical_engineering.yaml'
2025-08-31T08:28:49,248   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_elementary_mathematics.yaml'
2025-08-31T08:28:49,250   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_formal_logic.yaml'
2025-08-31T08:28:49,251   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_global_facts.yaml'
2025-08-31T08:28:49,252   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_biology.yaml'
2025-08-31T08:28:49,253   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_chemistry.yaml'
2025-08-31T08:28:49,254   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_computer_science.yaml'
2025-08-31T08:28:49,255   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_european_history.yaml'
2025-08-31T08:28:49,257   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_geography.yaml'
2025-08-31T08:28:49,258   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_government_and_politics.yaml'
2025-08-31T08:28:49,259   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_macroeconomics.yaml'
2025-08-31T08:28:49,260   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_mathematics.yaml'
2025-08-31T08:28:49,261   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_microeconomics.yaml'
2025-08-31T08:28:49,263   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_physics.yaml'
2025-08-31T08:28:49,264   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_psychology.yaml'
2025-08-31T08:28:49,265   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_statistics.yaml'
2025-08-31T08:28:49,266   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_us_history.yaml'
2025-08-31T08:28:49,267   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_world_history.yaml'
2025-08-31T08:28:49,268   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_aging.yaml'
2025-08-31T08:28:49,269   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_sexuality.yaml'
2025-08-31T08:28:49,270   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_international_law.yaml'
2025-08-31T08:28:49,271   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_jurisprudence.yaml'
2025-08-31T08:28:49,272   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_logical_fallacies.yaml'
2025-08-31T08:28:49,273   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_machine_learning.yaml'
2025-08-31T08:28:49,274   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_management.yaml'
2025-08-31T08:28:49,275   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_marketing.yaml'
2025-08-31T08:28:49,276   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_medical_genetics.yaml'
2025-08-31T08:28:49,278   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_miscellaneous.yaml'
2025-08-31T08:28:49,279   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_disputes.yaml'
2025-08-31T08:28:49,280   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_scenarios.yaml'
2025-08-31T08:28:49,281   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_nutrition.yaml'
2025-08-31T08:28:49,282   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_philosophy.yaml'
2025-08-31T08:28:49,283   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_prehistory.yaml'
2025-08-31T08:28:49,284   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_accounting.yaml'
2025-08-31T08:28:49,286   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_law.yaml'
2025-08-31T08:28:49,287   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_medicine.yaml'
2025-08-31T08:28:49,288   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_psychology.yaml'
2025-08-31T08:28:49,289   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_public_relations.yaml'
2025-08-31T08:28:49,290   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_security_studies.yaml'
2025-08-31T08:28:49,291   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_sociology.yaml'
2025-08-31T08:28:49,292   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_us_foreign_policy.yaml'
2025-08-31T08:28:49,294   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_virology.yaml'
2025-08-31T08:28:49,295   adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_world_religions.yaml'
2025-08-31T08:28:49,296   adding 'lm_eval/tasks/global_mmlu/full/fil/utils.py'
2025-08-31T08:28:49,299   adding 'lm_eval/tasks/global_mmlu/full/fr/_fr_template_yaml'
2025-08-31T08:28:49,300   adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr.yaml'
2025-08-31T08:28:49,301   adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_humanities.yaml'
2025-08-31T08:28:49,302   adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_other.yaml'
2025-08-31T08:28:49,303   adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_social_sciences.yaml'
2025-08-31T08:28:49,305   adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_stem.yaml'
2025-08-31T08:28:49,306   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_abstract_algebra.yaml'
2025-08-31T08:28:49,307   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_anatomy.yaml'
2025-08-31T08:28:49,308   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_astronomy.yaml'
2025-08-31T08:28:49,309   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_business_ethics.yaml'
2025-08-31T08:28:49,310   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_clinical_knowledge.yaml'
2025-08-31T08:28:49,311   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_biology.yaml'
2025-08-31T08:28:49,312   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_chemistry.yaml'
2025-08-31T08:28:49,313   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_computer_science.yaml'
2025-08-31T08:28:49,314   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_mathematics.yaml'
2025-08-31T08:28:49,315   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_medicine.yaml'
2025-08-31T08:28:49,316   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_physics.yaml'
2025-08-31T08:28:49,318   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_computer_security.yaml'
2025-08-31T08:28:49,319   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_conceptual_physics.yaml'
2025-08-31T08:28:49,320   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_econometrics.yaml'
2025-08-31T08:28:49,321   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_electrical_engineering.yaml'
2025-08-31T08:28:49,322   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_elementary_mathematics.yaml'
2025-08-31T08:28:49,323   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_formal_logic.yaml'
2025-08-31T08:28:49,324   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_global_facts.yaml'
2025-08-31T08:28:49,325   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_biology.yaml'
2025-08-31T08:28:49,326   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_chemistry.yaml'
2025-08-31T08:28:49,328   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_computer_science.yaml'
2025-08-31T08:28:49,329   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_european_history.yaml'
2025-08-31T08:28:49,330   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_geography.yaml'
2025-08-31T08:28:49,331   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_government_and_politics.yaml'
2025-08-31T08:28:49,332   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_macroeconomics.yaml'
2025-08-31T08:28:49,333   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_mathematics.yaml'
2025-08-31T08:28:49,335   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_microeconomics.yaml'
2025-08-31T08:28:49,336   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_physics.yaml'
2025-08-31T08:28:49,337   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_psychology.yaml'
2025-08-31T08:28:49,338   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_statistics.yaml'
2025-08-31T08:28:49,339   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_us_history.yaml'
2025-08-31T08:28:49,340   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_world_history.yaml'
2025-08-31T08:28:49,342   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_aging.yaml'
2025-08-31T08:28:49,343   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_sexuality.yaml'
2025-08-31T08:28:49,344   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_international_law.yaml'
2025-08-31T08:28:49,345   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_jurisprudence.yaml'
2025-08-31T08:28:49,346   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_logical_fallacies.yaml'
2025-08-31T08:28:49,347   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_machine_learning.yaml'
2025-08-31T08:28:49,348   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_management.yaml'
2025-08-31T08:28:49,349   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_marketing.yaml'
2025-08-31T08:28:49,350   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_medical_genetics.yaml'
2025-08-31T08:28:49,351   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_miscellaneous.yaml'
2025-08-31T08:28:49,353   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_disputes.yaml'
2025-08-31T08:28:49,354   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_scenarios.yaml'
2025-08-31T08:28:49,355   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_nutrition.yaml'
2025-08-31T08:28:49,356   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_philosophy.yaml'
2025-08-31T08:28:49,357   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_prehistory.yaml'
2025-08-31T08:28:49,358   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_accounting.yaml'
2025-08-31T08:28:49,359   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_law.yaml'
2025-08-31T08:28:49,360   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_medicine.yaml'
2025-08-31T08:28:49,362   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_psychology.yaml'
2025-08-31T08:28:49,363   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_public_relations.yaml'
2025-08-31T08:28:49,364   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_security_studies.yaml'
2025-08-31T08:28:49,365   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_sociology.yaml'
2025-08-31T08:28:49,366   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_us_foreign_policy.yaml'
2025-08-31T08:28:49,367   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_virology.yaml'
2025-08-31T08:28:49,368   adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_world_religions.yaml'
2025-08-31T08:28:49,370   adding 'lm_eval/tasks/global_mmlu/full/fr/utils.py'
2025-08-31T08:28:49,373   adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha.yaml'
2025-08-31T08:28:49,374   adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_humanities.yaml'
2025-08-31T08:28:49,375   adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_other.yaml'
2025-08-31T08:28:49,376   adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_social_sciences.yaml'
2025-08-31T08:28:49,377   adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_stem.yaml'
2025-08-31T08:28:49,378   adding 'lm_eval/tasks/global_mmlu/full/ha/_ha_template_yaml'
2025-08-31T08:28:49,380   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_abstract_algebra.yaml'
2025-08-31T08:28:49,381   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_anatomy.yaml'
2025-08-31T08:28:49,382   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_astronomy.yaml'
2025-08-31T08:28:49,383   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_business_ethics.yaml'
2025-08-31T08:28:49,384   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_clinical_knowledge.yaml'
2025-08-31T08:28:49,385   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_biology.yaml'
2025-08-31T08:28:49,386   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_chemistry.yaml'
2025-08-31T08:28:49,388   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_computer_science.yaml'
2025-08-31T08:28:49,389   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_mathematics.yaml'
2025-08-31T08:28:49,390   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_medicine.yaml'
2025-08-31T08:28:49,391   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_physics.yaml'
2025-08-31T08:28:49,392   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_computer_security.yaml'
2025-08-31T08:28:49,393   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_conceptual_physics.yaml'
2025-08-31T08:28:49,394   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_econometrics.yaml'
2025-08-31T08:28:49,395   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_electrical_engineering.yaml'
2025-08-31T08:28:49,396   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_elementary_mathematics.yaml'
2025-08-31T08:28:49,400   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_formal_logic.yaml'
2025-08-31T08:28:49,401   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_global_facts.yaml'
2025-08-31T08:28:49,402   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_biology.yaml'
2025-08-31T08:28:49,403   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_chemistry.yaml'
2025-08-31T08:28:49,404   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_computer_science.yaml'
2025-08-31T08:28:49,405   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_european_history.yaml'
2025-08-31T08:28:49,407   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_geography.yaml'
2025-08-31T08:28:49,408   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_government_and_politics.yaml'
2025-08-31T08:28:49,409   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_macroeconomics.yaml'
2025-08-31T08:28:49,410   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_mathematics.yaml'
2025-08-31T08:28:49,411   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_microeconomics.yaml'
2025-08-31T08:28:49,412   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_physics.yaml'
2025-08-31T08:28:49,413   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_psychology.yaml'
2025-08-31T08:28:49,414   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_statistics.yaml'
2025-08-31T08:28:49,415   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_us_history.yaml'
2025-08-31T08:28:49,417   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_world_history.yaml'
2025-08-31T08:28:49,418   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_aging.yaml'
2025-08-31T08:28:49,419   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_sexuality.yaml'
2025-08-31T08:28:49,420   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_international_law.yaml'
2025-08-31T08:28:49,421   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_jurisprudence.yaml'
2025-08-31T08:28:49,422   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_logical_fallacies.yaml'
2025-08-31T08:28:49,423   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_machine_learning.yaml'
2025-08-31T08:28:49,424   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_management.yaml'
2025-08-31T08:28:49,425   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_marketing.yaml'
2025-08-31T08:28:49,427   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_medical_genetics.yaml'
2025-08-31T08:28:49,428   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_miscellaneous.yaml'
2025-08-31T08:28:49,429   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_disputes.yaml'
2025-08-31T08:28:49,430   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_scenarios.yaml'
2025-08-31T08:28:49,431   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_nutrition.yaml'
2025-08-31T08:28:49,432   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_philosophy.yaml'
2025-08-31T08:28:49,434   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_prehistory.yaml'
2025-08-31T08:28:49,435   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_accounting.yaml'
2025-08-31T08:28:49,436   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_law.yaml'
2025-08-31T08:28:49,437   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_medicine.yaml'
2025-08-31T08:28:49,438   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_psychology.yaml'
2025-08-31T08:28:49,439   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_public_relations.yaml'
2025-08-31T08:28:49,440   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_security_studies.yaml'
2025-08-31T08:28:49,441   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_sociology.yaml'
2025-08-31T08:28:49,442   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_us_foreign_policy.yaml'
2025-08-31T08:28:49,443   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_virology.yaml'
2025-08-31T08:28:49,444   adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_world_religions.yaml'
2025-08-31T08:28:49,446   adding 'lm_eval/tasks/global_mmlu/full/ha/utils.py'
2025-08-31T08:28:49,448   adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he.yaml'
2025-08-31T08:28:49,450   adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_humanities.yaml'
2025-08-31T08:28:49,451   adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_other.yaml'
2025-08-31T08:28:49,452   adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_social_sciences.yaml'
2025-08-31T08:28:49,453   adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_stem.yaml'
2025-08-31T08:28:49,454   adding 'lm_eval/tasks/global_mmlu/full/he/_he_template_yaml'
2025-08-31T08:28:49,455   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_abstract_algebra.yaml'
2025-08-31T08:28:49,456   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_anatomy.yaml'
2025-08-31T08:28:49,457   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_astronomy.yaml'
2025-08-31T08:28:49,458   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_business_ethics.yaml'
2025-08-31T08:28:49,460   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_clinical_knowledge.yaml'
2025-08-31T08:28:49,461   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_biology.yaml'
2025-08-31T08:28:49,462   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_chemistry.yaml'
2025-08-31T08:28:49,463   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_computer_science.yaml'
2025-08-31T08:28:49,464   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_mathematics.yaml'
2025-08-31T08:28:49,465   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_medicine.yaml'
2025-08-31T08:28:49,466   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_physics.yaml'
2025-08-31T08:28:49,468   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_computer_security.yaml'
2025-08-31T08:28:49,469   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_conceptual_physics.yaml'
2025-08-31T08:28:49,470   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_econometrics.yaml'
2025-08-31T08:28:49,471   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_electrical_engineering.yaml'
2025-08-31T08:28:49,472   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_elementary_mathematics.yaml'
2025-08-31T08:28:49,473   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_formal_logic.yaml'
2025-08-31T08:28:49,474   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_global_facts.yaml'
2025-08-31T08:28:49,476   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_biology.yaml'
2025-08-31T08:28:49,477   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_chemistry.yaml'
2025-08-31T08:28:49,478   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_computer_science.yaml'
2025-08-31T08:28:49,479   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_european_history.yaml'
2025-08-31T08:28:49,480   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_geography.yaml'
2025-08-31T08:28:49,481   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_government_and_politics.yaml'
2025-08-31T08:28:49,483   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_macroeconomics.yaml'
2025-08-31T08:28:49,484   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_mathematics.yaml'
2025-08-31T08:28:49,485   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_microeconomics.yaml'
2025-08-31T08:28:49,486   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_physics.yaml'
2025-08-31T08:28:49,487   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_psychology.yaml'
2025-08-31T08:28:49,488   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_statistics.yaml'
2025-08-31T08:28:49,489   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_us_history.yaml'
2025-08-31T08:28:49,490   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_world_history.yaml'
2025-08-31T08:28:49,491   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_aging.yaml'
2025-08-31T08:28:49,493   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_sexuality.yaml'
2025-08-31T08:28:49,494   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_international_law.yaml'
2025-08-31T08:28:49,495   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_jurisprudence.yaml'
2025-08-31T08:28:49,496   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_logical_fallacies.yaml'
2025-08-31T08:28:49,497   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_machine_learning.yaml'
2025-08-31T08:28:49,498   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_management.yaml'
2025-08-31T08:28:49,500   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_marketing.yaml'
2025-08-31T08:28:49,501   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_medical_genetics.yaml'
2025-08-31T08:28:49,502   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_miscellaneous.yaml'
2025-08-31T08:28:49,503   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_disputes.yaml'
2025-08-31T08:28:49,504   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_scenarios.yaml'
2025-08-31T08:28:49,505   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_nutrition.yaml'
2025-08-31T08:28:49,507   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_philosophy.yaml'
2025-08-31T08:28:49,508   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_prehistory.yaml'
2025-08-31T08:28:49,509   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_accounting.yaml'
2025-08-31T08:28:49,510   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_law.yaml'
2025-08-31T08:28:49,511   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_medicine.yaml'
2025-08-31T08:28:49,512   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_psychology.yaml'
2025-08-31T08:28:49,513   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_public_relations.yaml'
2025-08-31T08:28:49,515   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_security_studies.yaml'
2025-08-31T08:28:49,516   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_sociology.yaml'
2025-08-31T08:28:49,517   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_us_foreign_policy.yaml'
2025-08-31T08:28:49,518   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_virology.yaml'
2025-08-31T08:28:49,519   adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_world_religions.yaml'
2025-08-31T08:28:49,521   adding 'lm_eval/tasks/global_mmlu/full/he/utils.py'
2025-08-31T08:28:49,523   adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi.yaml'
2025-08-31T08:28:49,524   adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_humanities.yaml'
2025-08-31T08:28:49,525   adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_other.yaml'
2025-08-31T08:28:49,527   adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_social_sciences.yaml'
2025-08-31T08:28:49,528   adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_stem.yaml'
2025-08-31T08:28:49,529   adding 'lm_eval/tasks/global_mmlu/full/hi/_hi_template_yaml'
2025-08-31T08:28:49,530   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_abstract_algebra.yaml'
2025-08-31T08:28:49,531   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_anatomy.yaml'
2025-08-31T08:28:49,532   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_astronomy.yaml'
2025-08-31T08:28:49,533   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_business_ethics.yaml'
2025-08-31T08:28:49,534   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_clinical_knowledge.yaml'
2025-08-31T08:28:49,535   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_biology.yaml'
2025-08-31T08:28:49,536   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_chemistry.yaml'
2025-08-31T08:28:49,537   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_computer_science.yaml'
2025-08-31T08:28:49,539   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_mathematics.yaml'
2025-08-31T08:28:49,540   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_medicine.yaml'
2025-08-31T08:28:49,541   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_physics.yaml'
2025-08-31T08:28:49,542   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_computer_security.yaml'
2025-08-31T08:28:49,543   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_conceptual_physics.yaml'
2025-08-31T08:28:49,544   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_econometrics.yaml'
2025-08-31T08:28:49,545   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_electrical_engineering.yaml'
2025-08-31T08:28:49,546   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_elementary_mathematics.yaml'
2025-08-31T08:28:49,548   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_formal_logic.yaml'
2025-08-31T08:28:49,549   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_global_facts.yaml'
2025-08-31T08:28:49,550   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_biology.yaml'
2025-08-31T08:28:49,551   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_chemistry.yaml'
2025-08-31T08:28:49,552   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_computer_science.yaml'
2025-08-31T08:28:49,553   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_european_history.yaml'
2025-08-31T08:28:49,555   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_geography.yaml'
2025-08-31T08:28:49,556   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_government_and_politics.yaml'
2025-08-31T08:28:49,557   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_macroeconomics.yaml'
2025-08-31T08:28:49,558   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_mathematics.yaml'
2025-08-31T08:28:49,559   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_microeconomics.yaml'
2025-08-31T08:28:49,560   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_physics.yaml'
2025-08-31T08:28:49,561   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_psychology.yaml'
2025-08-31T08:28:49,563   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_statistics.yaml'
2025-08-31T08:28:49,564   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_us_history.yaml'
2025-08-31T08:28:49,565   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_world_history.yaml'
2025-08-31T08:28:49,566   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_aging.yaml'
2025-08-31T08:28:49,567   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_sexuality.yaml'
2025-08-31T08:28:49,568   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_international_law.yaml'
2025-08-31T08:28:49,569   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_jurisprudence.yaml'
2025-08-31T08:28:49,570   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_logical_fallacies.yaml'
2025-08-31T08:28:49,571   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_machine_learning.yaml'
2025-08-31T08:28:49,572   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_management.yaml'
2025-08-31T08:28:49,573   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_marketing.yaml'
2025-08-31T08:28:49,574   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_medical_genetics.yaml'
2025-08-31T08:28:49,576   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_miscellaneous.yaml'
2025-08-31T08:28:49,577   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_disputes.yaml'
2025-08-31T08:28:49,578   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_scenarios.yaml'
2025-08-31T08:28:49,579   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_nutrition.yaml'
2025-08-31T08:28:49,580   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_philosophy.yaml'
2025-08-31T08:28:49,581   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_prehistory.yaml'
2025-08-31T08:28:49,582   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_accounting.yaml'
2025-08-31T08:28:49,583   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_law.yaml'
2025-08-31T08:28:49,585   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_medicine.yaml'
2025-08-31T08:28:49,586   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_psychology.yaml'
2025-08-31T08:28:49,587   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_public_relations.yaml'
2025-08-31T08:28:49,588   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_security_studies.yaml'
2025-08-31T08:28:49,589   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_sociology.yaml'
2025-08-31T08:28:49,590   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_us_foreign_policy.yaml'
2025-08-31T08:28:49,592   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_virology.yaml'
2025-08-31T08:28:49,593   adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_world_religions.yaml'
2025-08-31T08:28:49,594   adding 'lm_eval/tasks/global_mmlu/full/hi/utils.py'
2025-08-31T08:28:49,597   adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id.yaml'
2025-08-31T08:28:49,598   adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_humanities.yaml'
2025-08-31T08:28:49,599   adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_other.yaml'
2025-08-31T08:28:49,600   adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_social_sciences.yaml'
2025-08-31T08:28:49,602   adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_stem.yaml'
2025-08-31T08:28:49,603   adding 'lm_eval/tasks/global_mmlu/full/id/_id_template_yaml'
2025-08-31T08:28:49,604   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_abstract_algebra.yaml'
2025-08-31T08:28:49,605   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_anatomy.yaml'
2025-08-31T08:28:49,606   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_astronomy.yaml'
2025-08-31T08:28:49,607   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_business_ethics.yaml'
2025-08-31T08:28:49,609   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_clinical_knowledge.yaml'
2025-08-31T08:28:49,610   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_biology.yaml'
2025-08-31T08:28:49,611   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_chemistry.yaml'
2025-08-31T08:28:49,612   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_computer_science.yaml'
2025-08-31T08:28:49,613   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_mathematics.yaml'
2025-08-31T08:28:49,614   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_medicine.yaml'
2025-08-31T08:28:49,615   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_physics.yaml'
2025-08-31T08:28:49,616   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_computer_security.yaml'
2025-08-31T08:28:49,617   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_conceptual_physics.yaml'
2025-08-31T08:28:49,618   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_econometrics.yaml'
2025-08-31T08:28:49,619   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_electrical_engineering.yaml'
2025-08-31T08:28:49,620   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_elementary_mathematics.yaml'
2025-08-31T08:28:49,621   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_formal_logic.yaml'
2025-08-31T08:28:49,622   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_global_facts.yaml'
2025-08-31T08:28:49,624   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_biology.yaml'
2025-08-31T08:28:49,625   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_chemistry.yaml'
2025-08-31T08:28:49,626   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_computer_science.yaml'
2025-08-31T08:28:49,627   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_european_history.yaml'
2025-08-31T08:28:49,628   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_geography.yaml'
2025-08-31T08:28:49,629   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_government_and_politics.yaml'
2025-08-31T08:28:49,631   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_macroeconomics.yaml'
2025-08-31T08:28:49,632   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_mathematics.yaml'
2025-08-31T08:28:49,633   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_microeconomics.yaml'
2025-08-31T08:28:49,634   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_physics.yaml'
2025-08-31T08:28:49,635   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_psychology.yaml'
2025-08-31T08:28:49,636   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_statistics.yaml'
2025-08-31T08:28:49,637   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_us_history.yaml'
2025-08-31T08:28:49,639   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_world_history.yaml'
2025-08-31T08:28:49,640   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_aging.yaml'
2025-08-31T08:28:49,641   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_sexuality.yaml'
2025-08-31T08:28:49,642   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_international_law.yaml'
2025-08-31T08:28:49,643   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_jurisprudence.yaml'
2025-08-31T08:28:49,644   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_logical_fallacies.yaml'
2025-08-31T08:28:49,645   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_machine_learning.yaml'
2025-08-31T08:28:49,647   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_management.yaml'
2025-08-31T08:28:49,648   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_marketing.yaml'
2025-08-31T08:28:49,649   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_medical_genetics.yaml'
2025-08-31T08:28:49,650   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_miscellaneous.yaml'
2025-08-31T08:28:49,651   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_disputes.yaml'
2025-08-31T08:28:49,652   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_scenarios.yaml'
2025-08-31T08:28:49,653   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_nutrition.yaml'
2025-08-31T08:28:49,654   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_philosophy.yaml'
2025-08-31T08:28:49,655   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_prehistory.yaml'
2025-08-31T08:28:49,656   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_accounting.yaml'
2025-08-31T08:28:49,658   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_law.yaml'
2025-08-31T08:28:49,659   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_medicine.yaml'
2025-08-31T08:28:49,660   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_psychology.yaml'
2025-08-31T08:28:49,661   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_public_relations.yaml'
2025-08-31T08:28:49,662   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_security_studies.yaml'
2025-08-31T08:28:49,663   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_sociology.yaml'
2025-08-31T08:28:49,664   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_us_foreign_policy.yaml'
2025-08-31T08:28:49,665   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_virology.yaml'
2025-08-31T08:28:49,666   adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_world_religions.yaml'
2025-08-31T08:28:49,668   adding 'lm_eval/tasks/global_mmlu/full/id/utils.py'
2025-08-31T08:28:49,671   adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig.yaml'
2025-08-31T08:28:49,672   adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_humanities.yaml'
2025-08-31T08:28:49,673   adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_other.yaml'
2025-08-31T08:28:49,674   adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_social_sciences.yaml'
2025-08-31T08:28:49,675   adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_stem.yaml'
2025-08-31T08:28:49,676   adding 'lm_eval/tasks/global_mmlu/full/ig/_ig_template_yaml'
2025-08-31T08:28:49,678   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_abstract_algebra.yaml'
2025-08-31T08:28:49,679   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_anatomy.yaml'
2025-08-31T08:28:49,680   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_astronomy.yaml'
2025-08-31T08:28:49,681   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_business_ethics.yaml'
2025-08-31T08:28:49,682   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_clinical_knowledge.yaml'
2025-08-31T08:28:49,683   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_biology.yaml'
2025-08-31T08:28:49,684   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_chemistry.yaml'
2025-08-31T08:28:49,686   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_computer_science.yaml'
2025-08-31T08:28:49,687   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_mathematics.yaml'
2025-08-31T08:28:49,688   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_medicine.yaml'
2025-08-31T08:28:49,689   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_physics.yaml'
2025-08-31T08:28:49,690   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_computer_security.yaml'
2025-08-31T08:28:49,691   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_conceptual_physics.yaml'
2025-08-31T08:28:49,692   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_econometrics.yaml'
2025-08-31T08:28:49,694   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_electrical_engineering.yaml'
2025-08-31T08:28:49,695   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_elementary_mathematics.yaml'
2025-08-31T08:28:49,696   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_formal_logic.yaml'
2025-08-31T08:28:49,697   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_global_facts.yaml'
2025-08-31T08:28:49,698   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_biology.yaml'
2025-08-31T08:28:49,699   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_chemistry.yaml'
2025-08-31T08:28:49,700   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_computer_science.yaml'
2025-08-31T08:28:49,702   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_european_history.yaml'
2025-08-31T08:28:49,703   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_geography.yaml'
2025-08-31T08:28:49,704   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_government_and_politics.yaml'
2025-08-31T08:28:49,705   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_macroeconomics.yaml'
2025-08-31T08:28:49,706   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_mathematics.yaml'
2025-08-31T08:28:49,707   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_microeconomics.yaml'
2025-08-31T08:28:49,709   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_physics.yaml'
2025-08-31T08:28:49,710   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_psychology.yaml'
2025-08-31T08:28:49,711   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_statistics.yaml'
2025-08-31T08:28:49,712   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_us_history.yaml'
2025-08-31T08:28:49,713   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_world_history.yaml'
2025-08-31T08:28:49,714   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_aging.yaml'
2025-08-31T08:28:49,715   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_sexuality.yaml'
2025-08-31T08:28:49,717   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_international_law.yaml'
2025-08-31T08:28:49,718   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_jurisprudence.yaml'
2025-08-31T08:28:49,719   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_logical_fallacies.yaml'
2025-08-31T08:28:49,720   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_machine_learning.yaml'
2025-08-31T08:28:49,721   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_management.yaml'
2025-08-31T08:28:49,722   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_marketing.yaml'
2025-08-31T08:28:49,724   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_medical_genetics.yaml'
2025-08-31T08:28:49,725   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_miscellaneous.yaml'
2025-08-31T08:28:49,726   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_disputes.yaml'
2025-08-31T08:28:49,727   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_scenarios.yaml'
2025-08-31T08:28:49,728   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_nutrition.yaml'
2025-08-31T08:28:49,730   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_philosophy.yaml'
2025-08-31T08:28:49,731   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_prehistory.yaml'
2025-08-31T08:28:49,732   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_accounting.yaml'
2025-08-31T08:28:49,733   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_law.yaml'
2025-08-31T08:28:49,734   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_medicine.yaml'
2025-08-31T08:28:49,736   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_psychology.yaml'
2025-08-31T08:28:49,737   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_public_relations.yaml'
2025-08-31T08:28:49,738   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_security_studies.yaml'
2025-08-31T08:28:49,739   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_sociology.yaml'
2025-08-31T08:28:49,740   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_us_foreign_policy.yaml'
2025-08-31T08:28:49,741   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_virology.yaml'
2025-08-31T08:28:49,742   adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_world_religions.yaml'
2025-08-31T08:28:49,743   adding 'lm_eval/tasks/global_mmlu/full/ig/utils.py'
2025-08-31T08:28:49,746   adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it.yaml'
2025-08-31T08:28:49,747   adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_humanities.yaml'
2025-08-31T08:28:49,748   adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_other.yaml'
2025-08-31T08:28:49,749   adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_social_sciences.yaml'
2025-08-31T08:28:49,751   adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_stem.yaml'
2025-08-31T08:28:49,752   adding 'lm_eval/tasks/global_mmlu/full/it/_it_template_yaml'
2025-08-31T08:28:49,753   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_abstract_algebra.yaml'
2025-08-31T08:28:49,754   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_anatomy.yaml'
2025-08-31T08:28:49,756   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_astronomy.yaml'
2025-08-31T08:28:49,757   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_business_ethics.yaml'
2025-08-31T08:28:49,758   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_clinical_knowledge.yaml'
2025-08-31T08:28:49,759   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_biology.yaml'
2025-08-31T08:28:49,761   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_chemistry.yaml'
2025-08-31T08:28:49,762   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_computer_science.yaml'
2025-08-31T08:28:49,763   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_mathematics.yaml'
2025-08-31T08:28:49,764   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_medicine.yaml'
2025-08-31T08:28:49,765   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_physics.yaml'
2025-08-31T08:28:49,767   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_computer_security.yaml'
2025-08-31T08:28:49,768   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_conceptual_physics.yaml'
2025-08-31T08:28:49,769   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_econometrics.yaml'
2025-08-31T08:28:49,770   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_electrical_engineering.yaml'
2025-08-31T08:28:49,771   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_elementary_mathematics.yaml'
2025-08-31T08:28:49,772   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_formal_logic.yaml'
2025-08-31T08:28:49,774   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_global_facts.yaml'
2025-08-31T08:28:49,775   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_biology.yaml'
2025-08-31T08:28:49,776   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_chemistry.yaml'
2025-08-31T08:28:49,777   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_computer_science.yaml'
2025-08-31T08:28:49,778   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_european_history.yaml'
2025-08-31T08:28:49,779   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_geography.yaml'
2025-08-31T08:28:49,780   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_government_and_politics.yaml'
2025-08-31T08:28:49,782   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_macroeconomics.yaml'
2025-08-31T08:28:49,783   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_mathematics.yaml'
2025-08-31T08:28:49,784   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_microeconomics.yaml'
2025-08-31T08:28:49,785   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_physics.yaml'
2025-08-31T08:28:49,786   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_psychology.yaml'
2025-08-31T08:28:49,787   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_statistics.yaml'
2025-08-31T08:28:49,788   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_us_history.yaml'
2025-08-31T08:28:49,789   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_world_history.yaml'
2025-08-31T08:28:49,790   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_aging.yaml'
2025-08-31T08:28:49,791   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_sexuality.yaml'
2025-08-31T08:28:49,793   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_international_law.yaml'
2025-08-31T08:28:49,794   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_jurisprudence.yaml'
2025-08-31T08:28:49,795   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_logical_fallacies.yaml'
2025-08-31T08:28:49,796   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_machine_learning.yaml'
2025-08-31T08:28:49,797   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_management.yaml'
2025-08-31T08:28:49,798   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_marketing.yaml'
2025-08-31T08:28:49,799   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_medical_genetics.yaml'
2025-08-31T08:28:49,801   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_miscellaneous.yaml'
2025-08-31T08:28:49,802   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_disputes.yaml'
2025-08-31T08:28:49,803   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_scenarios.yaml'
2025-08-31T08:28:49,804   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_nutrition.yaml'
2025-08-31T08:28:49,805   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_philosophy.yaml'
2025-08-31T08:28:49,806   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_prehistory.yaml'
2025-08-31T08:28:49,807   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_accounting.yaml'
2025-08-31T08:28:49,809   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_law.yaml'
2025-08-31T08:28:49,810   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_medicine.yaml'
2025-08-31T08:28:49,811   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_psychology.yaml'
2025-08-31T08:28:49,812   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_public_relations.yaml'
2025-08-31T08:28:49,813   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_security_studies.yaml'
2025-08-31T08:28:49,814   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_sociology.yaml'
2025-08-31T08:28:49,816   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_us_foreign_policy.yaml'
2025-08-31T08:28:49,817   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_virology.yaml'
2025-08-31T08:28:49,818   adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_world_religions.yaml'
2025-08-31T08:28:49,819   adding 'lm_eval/tasks/global_mmlu/full/it/utils.py'
2025-08-31T08:28:49,822   adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja.yaml'
2025-08-31T08:28:49,824   adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_humanities.yaml'
2025-08-31T08:28:49,825   adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_other.yaml'
2025-08-31T08:28:49,826   adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_social_sciences.yaml'
2025-08-31T08:28:49,828   adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_stem.yaml'
2025-08-31T08:28:49,829   adding 'lm_eval/tasks/global_mmlu/full/ja/_ja_template_yaml'
2025-08-31T08:28:49,830   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_abstract_algebra.yaml'
2025-08-31T08:28:49,831   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_anatomy.yaml'
2025-08-31T08:28:49,832   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_astronomy.yaml'
2025-08-31T08:28:49,833   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_business_ethics.yaml'
2025-08-31T08:28:49,834   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_clinical_knowledge.yaml'
2025-08-31T08:28:49,835   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_biology.yaml'
2025-08-31T08:28:49,836   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_chemistry.yaml'
2025-08-31T08:28:49,838   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_computer_science.yaml'
2025-08-31T08:28:49,839   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_mathematics.yaml'
2025-08-31T08:28:49,840   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_medicine.yaml'
2025-08-31T08:28:49,841   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_physics.yaml'
2025-08-31T08:28:49,842   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_computer_security.yaml'
2025-08-31T08:28:49,843   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_conceptual_physics.yaml'
2025-08-31T08:28:49,844   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_econometrics.yaml'
2025-08-31T08:28:49,845   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_electrical_engineering.yaml'
2025-08-31T08:28:49,847   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_elementary_mathematics.yaml'
2025-08-31T08:28:49,848   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_formal_logic.yaml'
2025-08-31T08:28:49,849   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_global_facts.yaml'
2025-08-31T08:28:49,850   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_biology.yaml'
2025-08-31T08:28:49,851   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_chemistry.yaml'
2025-08-31T08:28:49,852   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_computer_science.yaml'
2025-08-31T08:28:49,853   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_european_history.yaml'
2025-08-31T08:28:49,855   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_geography.yaml'
2025-08-31T08:28:49,856   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_government_and_politics.yaml'
2025-08-31T08:28:49,857   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_macroeconomics.yaml'
2025-08-31T08:28:49,858   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_mathematics.yaml'
2025-08-31T08:28:49,859   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_microeconomics.yaml'
2025-08-31T08:28:49,860   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_physics.yaml'
2025-08-31T08:28:49,862   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_psychology.yaml'
2025-08-31T08:28:49,863   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_statistics.yaml'
2025-08-31T08:28:49,864   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_us_history.yaml'
2025-08-31T08:28:49,865   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_world_history.yaml'
2025-08-31T08:28:49,866   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_aging.yaml'
2025-08-31T08:28:49,868   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_sexuality.yaml'
2025-08-31T08:28:49,869   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_international_law.yaml'
2025-08-31T08:28:49,870   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_jurisprudence.yaml'
2025-08-31T08:28:49,871   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_logical_fallacies.yaml'
2025-08-31T08:28:49,872   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_machine_learning.yaml'
2025-08-31T08:28:49,873   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_management.yaml'
2025-08-31T08:28:49,874   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_marketing.yaml'
2025-08-31T08:28:49,875   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_medical_genetics.yaml'
2025-08-31T08:28:49,877   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_miscellaneous.yaml'
2025-08-31T08:28:49,878   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_disputes.yaml'
2025-08-31T08:28:49,879   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_scenarios.yaml'
2025-08-31T08:28:49,880   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_nutrition.yaml'
2025-08-31T08:28:49,881   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_philosophy.yaml'
2025-08-31T08:28:49,882   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_prehistory.yaml'
2025-08-31T08:28:49,883   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_accounting.yaml'
2025-08-31T08:28:49,885   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_law.yaml'
2025-08-31T08:28:49,886   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_medicine.yaml'
2025-08-31T08:28:49,887   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_psychology.yaml'
2025-08-31T08:28:49,888   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_public_relations.yaml'
2025-08-31T08:28:49,890   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_security_studies.yaml'
2025-08-31T08:28:49,891   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_sociology.yaml'
2025-08-31T08:28:49,892   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_us_foreign_policy.yaml'
2025-08-31T08:28:49,893   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_virology.yaml'
2025-08-31T08:28:49,894   adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_world_religions.yaml'
2025-08-31T08:28:49,895   adding 'lm_eval/tasks/global_mmlu/full/ja/utils.py'
2025-08-31T08:28:49,898   adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko.yaml'
2025-08-31T08:28:49,899   adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_humanities.yaml'
2025-08-31T08:28:49,900   adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_other.yaml'
2025-08-31T08:28:49,902   adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_social_sciences.yaml'
2025-08-31T08:28:49,903   adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_stem.yaml'
2025-08-31T08:28:49,904   adding 'lm_eval/tasks/global_mmlu/full/ko/_ko_template_yaml'
2025-08-31T08:28:49,905   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_abstract_algebra.yaml'
2025-08-31T08:28:49,907   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_anatomy.yaml'
2025-08-31T08:28:49,908   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_astronomy.yaml'
2025-08-31T08:28:49,909   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_business_ethics.yaml'
2025-08-31T08:28:49,910   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_clinical_knowledge.yaml'
2025-08-31T08:28:49,911   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_biology.yaml'
2025-08-31T08:28:49,912   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_chemistry.yaml'
2025-08-31T08:28:49,913   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_computer_science.yaml'
2025-08-31T08:28:49,915   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_mathematics.yaml'
2025-08-31T08:28:49,916   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_medicine.yaml'
2025-08-31T08:28:49,917   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_physics.yaml'
2025-08-31T08:28:49,918   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_computer_security.yaml'
2025-08-31T08:28:49,919   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_conceptual_physics.yaml'
2025-08-31T08:28:49,920   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_econometrics.yaml'
2025-08-31T08:28:49,921   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_electrical_engineering.yaml'
2025-08-31T08:28:49,922   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_elementary_mathematics.yaml'
2025-08-31T08:28:49,923   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_formal_logic.yaml'
2025-08-31T08:28:49,924   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_global_facts.yaml'
2025-08-31T08:28:49,925   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_biology.yaml'
2025-08-31T08:28:49,926   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_chemistry.yaml'
2025-08-31T08:28:49,928   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_computer_science.yaml'
2025-08-31T08:28:49,929   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_european_history.yaml'
2025-08-31T08:28:49,930   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_geography.yaml'
2025-08-31T08:28:49,931   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_government_and_politics.yaml'
2025-08-31T08:28:49,932   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_macroeconomics.yaml'
2025-08-31T08:28:49,934   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_mathematics.yaml'
2025-08-31T08:28:49,935   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_microeconomics.yaml'
2025-08-31T08:28:49,936   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_physics.yaml'
2025-08-31T08:28:49,937   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_psychology.yaml'
2025-08-31T08:28:49,938   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_statistics.yaml'
2025-08-31T08:28:49,939   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_us_history.yaml'
2025-08-31T08:28:49,941   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_world_history.yaml'
2025-08-31T08:28:49,942   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_aging.yaml'
2025-08-31T08:28:49,943   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_sexuality.yaml'
2025-08-31T08:28:49,944   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_international_law.yaml'
2025-08-31T08:28:49,945   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_jurisprudence.yaml'
2025-08-31T08:28:49,946   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_logical_fallacies.yaml'
2025-08-31T08:28:49,948   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_machine_learning.yaml'
2025-08-31T08:28:49,949   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_management.yaml'
2025-08-31T08:28:49,950   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_marketing.yaml'
2025-08-31T08:28:49,951   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_medical_genetics.yaml'
2025-08-31T08:28:49,952   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_miscellaneous.yaml'
2025-08-31T08:28:49,954   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_disputes.yaml'
2025-08-31T08:28:49,955   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_scenarios.yaml'
2025-08-31T08:28:49,956   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_nutrition.yaml'
2025-08-31T08:28:49,957   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_philosophy.yaml'
2025-08-31T08:28:49,958   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_prehistory.yaml'
2025-08-31T08:28:49,959   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_accounting.yaml'
2025-08-31T08:28:49,960   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_law.yaml'
2025-08-31T08:28:49,961   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_medicine.yaml'
2025-08-31T08:28:49,962   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_psychology.yaml'
2025-08-31T08:28:49,963   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_public_relations.yaml'
2025-08-31T08:28:49,964   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_security_studies.yaml'
2025-08-31T08:28:49,965   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_sociology.yaml'
2025-08-31T08:28:49,966   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_us_foreign_policy.yaml'
2025-08-31T08:28:49,968   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_virology.yaml'
2025-08-31T08:28:49,969   adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_world_religions.yaml'
2025-08-31T08:28:49,970   adding 'lm_eval/tasks/global_mmlu/full/ko/utils.py'
2025-08-31T08:28:49,973   adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky.yaml'
2025-08-31T08:28:49,974   adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_humanities.yaml'
2025-08-31T08:28:49,975   adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_other.yaml'
2025-08-31T08:28:49,976   adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_social_sciences.yaml'
2025-08-31T08:28:49,977   adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_stem.yaml'
2025-08-31T08:28:49,979   adding 'lm_eval/tasks/global_mmlu/full/ky/_ky_template_yaml'
2025-08-31T08:28:49,980   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_abstract_algebra.yaml'
2025-08-31T08:28:49,981   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_anatomy.yaml'
2025-08-31T08:28:49,982   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_astronomy.yaml'
2025-08-31T08:28:49,983   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_business_ethics.yaml'
2025-08-31T08:28:49,984   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_clinical_knowledge.yaml'
2025-08-31T08:28:49,985   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_biology.yaml'
2025-08-31T08:28:49,987   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_chemistry.yaml'
2025-08-31T08:28:49,988   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_computer_science.yaml'
2025-08-31T08:28:49,989   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_mathematics.yaml'
2025-08-31T08:28:49,990   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_medicine.yaml'
2025-08-31T08:28:49,991   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_physics.yaml'
2025-08-31T08:28:49,992   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_computer_security.yaml'
2025-08-31T08:28:49,993   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_conceptual_physics.yaml'
2025-08-31T08:28:49,995   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_econometrics.yaml'
2025-08-31T08:28:49,996   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_electrical_engineering.yaml'
2025-08-31T08:28:49,997   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_elementary_mathematics.yaml'
2025-08-31T08:28:49,998   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_formal_logic.yaml'
2025-08-31T08:28:49,999   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_global_facts.yaml'
2025-08-31T08:28:50,000   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_biology.yaml'
2025-08-31T08:28:50,001   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_chemistry.yaml'
2025-08-31T08:28:50,002   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_computer_science.yaml'
2025-08-31T08:28:50,003   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_european_history.yaml'
2025-08-31T08:28:50,004   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_geography.yaml'
2025-08-31T08:28:50,006   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_government_and_politics.yaml'
2025-08-31T08:28:50,007   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_macroeconomics.yaml'
2025-08-31T08:28:50,008   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_mathematics.yaml'
2025-08-31T08:28:50,009   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_microeconomics.yaml'
2025-08-31T08:28:50,010   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_physics.yaml'
2025-08-31T08:28:50,011   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_psychology.yaml'
2025-08-31T08:28:50,012   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_statistics.yaml'
2025-08-31T08:28:50,013   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_us_history.yaml'
2025-08-31T08:28:50,014   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_world_history.yaml'
2025-08-31T08:28:50,015   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_aging.yaml'
2025-08-31T08:28:50,016   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_sexuality.yaml'
2025-08-31T08:28:50,018   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_international_law.yaml'
2025-08-31T08:28:50,019   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_jurisprudence.yaml'
2025-08-31T08:28:50,020   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_logical_fallacies.yaml'
2025-08-31T08:28:50,021   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_machine_learning.yaml'
2025-08-31T08:28:50,022   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_management.yaml'
2025-08-31T08:28:50,023   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_marketing.yaml'
2025-08-31T08:28:50,024   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_medical_genetics.yaml'
2025-08-31T08:28:50,025   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_miscellaneous.yaml'
2025-08-31T08:28:50,027   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_disputes.yaml'
2025-08-31T08:28:50,028   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_scenarios.yaml'
2025-08-31T08:28:50,029   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_nutrition.yaml'
2025-08-31T08:28:50,030   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_philosophy.yaml'
2025-08-31T08:28:50,031   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_prehistory.yaml'
2025-08-31T08:28:50,032   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_accounting.yaml'
2025-08-31T08:28:50,033   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_law.yaml'
2025-08-31T08:28:50,034   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_medicine.yaml'
2025-08-31T08:28:50,035   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_psychology.yaml'
2025-08-31T08:28:50,037   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_public_relations.yaml'
2025-08-31T08:28:50,038   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_security_studies.yaml'
2025-08-31T08:28:50,039   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_sociology.yaml'
2025-08-31T08:28:50,040   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_us_foreign_policy.yaml'
2025-08-31T08:28:50,041   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_virology.yaml'
2025-08-31T08:28:50,042   adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_world_religions.yaml'
2025-08-31T08:28:50,043   adding 'lm_eval/tasks/global_mmlu/full/ky/utils.py'
2025-08-31T08:28:50,046   adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt.yaml'
2025-08-31T08:28:50,047   adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_humanities.yaml'
2025-08-31T08:28:50,048   adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_other.yaml'
2025-08-31T08:28:50,049   adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_social_sciences.yaml'
2025-08-31T08:28:50,051   adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_stem.yaml'
2025-08-31T08:28:50,052   adding 'lm_eval/tasks/global_mmlu/full/lt/_lt_template_yaml'
2025-08-31T08:28:50,053   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_abstract_algebra.yaml'
2025-08-31T08:28:50,054   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_anatomy.yaml'
2025-08-31T08:28:50,055   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_astronomy.yaml'
2025-08-31T08:28:50,056   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_business_ethics.yaml'
2025-08-31T08:28:50,057   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_clinical_knowledge.yaml'
2025-08-31T08:28:50,058   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_biology.yaml'
2025-08-31T08:28:50,059   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_chemistry.yaml'
2025-08-31T08:28:50,060   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_computer_science.yaml'
2025-08-31T08:28:50,062   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_mathematics.yaml'
2025-08-31T08:28:50,063   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_medicine.yaml'
2025-08-31T08:28:50,064   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_physics.yaml'
2025-08-31T08:28:50,065   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_computer_security.yaml'
2025-08-31T08:28:50,066   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_conceptual_physics.yaml'
2025-08-31T08:28:50,067   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_econometrics.yaml'
2025-08-31T08:28:50,068   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_electrical_engineering.yaml'
2025-08-31T08:28:50,070   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_elementary_mathematics.yaml'
2025-08-31T08:28:50,071   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_formal_logic.yaml'
2025-08-31T08:28:50,072   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_global_facts.yaml'
2025-08-31T08:28:50,073   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_biology.yaml'
2025-08-31T08:28:50,074   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_chemistry.yaml'
2025-08-31T08:28:50,075   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_computer_science.yaml'
2025-08-31T08:28:50,076   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_european_history.yaml'
2025-08-31T08:28:50,077   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_geography.yaml'
2025-08-31T08:28:50,079   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_government_and_politics.yaml'
2025-08-31T08:28:50,080   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_macroeconomics.yaml'
2025-08-31T08:28:50,081   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_mathematics.yaml'
2025-08-31T08:28:50,082   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_microeconomics.yaml'
2025-08-31T08:28:50,083   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_physics.yaml'
2025-08-31T08:28:50,084   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_psychology.yaml'
2025-08-31T08:28:50,085   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_statistics.yaml'
2025-08-31T08:28:50,086   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_us_history.yaml'
2025-08-31T08:28:50,087   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_world_history.yaml'
2025-08-31T08:28:50,088   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_aging.yaml'
2025-08-31T08:28:50,089   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_sexuality.yaml'
2025-08-31T08:28:50,090   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_international_law.yaml'
2025-08-31T08:28:50,091   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_jurisprudence.yaml'
2025-08-31T08:28:50,093   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_logical_fallacies.yaml'
2025-08-31T08:28:50,094   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_machine_learning.yaml'
2025-08-31T08:28:50,095   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_management.yaml'
2025-08-31T08:28:50,096   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_marketing.yaml'
2025-08-31T08:28:50,097   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_medical_genetics.yaml'
2025-08-31T08:28:50,098   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_miscellaneous.yaml'
2025-08-31T08:28:50,099   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_disputes.yaml'
2025-08-31T08:28:50,101   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_scenarios.yaml'
2025-08-31T08:28:50,102   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_nutrition.yaml'
2025-08-31T08:28:50,103   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_philosophy.yaml'
2025-08-31T08:28:50,104   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_prehistory.yaml'
2025-08-31T08:28:50,105   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_accounting.yaml'
2025-08-31T08:28:50,106   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_law.yaml'
2025-08-31T08:28:50,107   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_medicine.yaml'
2025-08-31T08:28:50,108   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_psychology.yaml'
2025-08-31T08:28:50,110   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_public_relations.yaml'
2025-08-31T08:28:50,111   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_security_studies.yaml'
2025-08-31T08:28:50,112   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_sociology.yaml'
2025-08-31T08:28:50,113   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_us_foreign_policy.yaml'
2025-08-31T08:28:50,114   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_virology.yaml'
2025-08-31T08:28:50,115   adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_world_religions.yaml'
2025-08-31T08:28:50,116   adding 'lm_eval/tasks/global_mmlu/full/lt/utils.py'
2025-08-31T08:28:50,119   adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg.yaml'
2025-08-31T08:28:50,120   adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_humanities.yaml'
2025-08-31T08:28:50,122   adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_other.yaml'
2025-08-31T08:28:50,123   adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_social_sciences.yaml'
2025-08-31T08:28:50,124   adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_stem.yaml'
2025-08-31T08:28:50,125   adding 'lm_eval/tasks/global_mmlu/full/mg/_mg_template_yaml'
2025-08-31T08:28:50,126   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_abstract_algebra.yaml'
2025-08-31T08:28:50,127   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_anatomy.yaml'
2025-08-31T08:28:50,128   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_astronomy.yaml'
2025-08-31T08:28:50,129   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_business_ethics.yaml'
2025-08-31T08:28:50,131   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_clinical_knowledge.yaml'
2025-08-31T08:28:50,132   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_biology.yaml'
2025-08-31T08:28:50,133   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_chemistry.yaml'
2025-08-31T08:28:50,134   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_computer_science.yaml'
2025-08-31T08:28:50,135   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_mathematics.yaml'
2025-08-31T08:28:50,136   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_medicine.yaml'
2025-08-31T08:28:50,137   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_physics.yaml'
2025-08-31T08:28:50,138   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_computer_security.yaml'
2025-08-31T08:28:50,140   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_conceptual_physics.yaml'
2025-08-31T08:28:50,141   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_econometrics.yaml'
2025-08-31T08:28:50,142   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_electrical_engineering.yaml'
2025-08-31T08:28:50,143   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_elementary_mathematics.yaml'
2025-08-31T08:28:50,144   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_formal_logic.yaml'
2025-08-31T08:28:50,145   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_global_facts.yaml'
2025-08-31T08:28:50,146   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_biology.yaml'
2025-08-31T08:28:50,147   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_chemistry.yaml'
2025-08-31T08:28:50,148   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_computer_science.yaml'
2025-08-31T08:28:50,149   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_european_history.yaml'
2025-08-31T08:28:50,151   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_geography.yaml'
2025-08-31T08:28:50,152   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_government_and_politics.yaml'
2025-08-31T08:28:50,153   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_macroeconomics.yaml'
2025-08-31T08:28:50,154   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_mathematics.yaml'
2025-08-31T08:28:50,155   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_microeconomics.yaml'
2025-08-31T08:28:50,156   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_physics.yaml'
2025-08-31T08:28:50,157   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_psychology.yaml'
2025-08-31T08:28:50,159   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_statistics.yaml'
2025-08-31T08:28:50,160   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_us_history.yaml'
2025-08-31T08:28:50,161   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_world_history.yaml'
2025-08-31T08:28:50,162   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_aging.yaml'
2025-08-31T08:28:50,163   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_sexuality.yaml'
2025-08-31T08:28:50,164   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_international_law.yaml'
2025-08-31T08:28:50,165   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_jurisprudence.yaml'
2025-08-31T08:28:50,167   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_logical_fallacies.yaml'
2025-08-31T08:28:50,168   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_machine_learning.yaml'
2025-08-31T08:28:50,169   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_management.yaml'
2025-08-31T08:28:50,170   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_marketing.yaml'
2025-08-31T08:28:50,171   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_medical_genetics.yaml'
2025-08-31T08:28:50,172   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_miscellaneous.yaml'
2025-08-31T08:28:50,173   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_disputes.yaml'
2025-08-31T08:28:50,174   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_scenarios.yaml'
2025-08-31T08:28:50,175   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_nutrition.yaml'
2025-08-31T08:28:50,176   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_philosophy.yaml'
2025-08-31T08:28:50,177   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_prehistory.yaml'
2025-08-31T08:28:50,178   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_accounting.yaml'
2025-08-31T08:28:50,179   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_law.yaml'
2025-08-31T08:28:50,180   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_medicine.yaml'
2025-08-31T08:28:50,181   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_psychology.yaml'
2025-08-31T08:28:50,182   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_public_relations.yaml'
2025-08-31T08:28:50,184   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_security_studies.yaml'
2025-08-31T08:28:50,185   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_sociology.yaml'
2025-08-31T08:28:50,186   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_us_foreign_policy.yaml'
2025-08-31T08:28:50,187   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_virology.yaml'
2025-08-31T08:28:50,188   adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_world_religions.yaml'
2025-08-31T08:28:50,190   adding 'lm_eval/tasks/global_mmlu/full/mg/utils.py'
2025-08-31T08:28:50,192   adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms.yaml'
2025-08-31T08:28:50,194   adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_humanities.yaml'
2025-08-31T08:28:50,195   adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_other.yaml'
2025-08-31T08:28:50,196   adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_social_sciences.yaml'
2025-08-31T08:28:50,197   adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_stem.yaml'
2025-08-31T08:28:50,198   adding 'lm_eval/tasks/global_mmlu/full/ms/_ms_template_yaml'
2025-08-31T08:28:50,199   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_abstract_algebra.yaml'
2025-08-31T08:28:50,200   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_anatomy.yaml'
2025-08-31T08:28:50,202   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_astronomy.yaml'
2025-08-31T08:28:50,203   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_business_ethics.yaml'
2025-08-31T08:28:50,204   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_clinical_knowledge.yaml'
2025-08-31T08:28:50,205   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_biology.yaml'
2025-08-31T08:28:50,206   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_chemistry.yaml'
2025-08-31T08:28:50,208   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_computer_science.yaml'
2025-08-31T08:28:50,209   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_mathematics.yaml'
2025-08-31T08:28:50,210   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_medicine.yaml'
2025-08-31T08:28:50,211   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_physics.yaml'
2025-08-31T08:28:50,212   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_computer_security.yaml'
2025-08-31T08:28:50,213   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_conceptual_physics.yaml'
2025-08-31T08:28:50,214   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_econometrics.yaml'
2025-08-31T08:28:50,215   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_electrical_engineering.yaml'
2025-08-31T08:28:50,216   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_elementary_mathematics.yaml'
2025-08-31T08:28:50,217   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_formal_logic.yaml'
2025-08-31T08:28:50,218   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_global_facts.yaml'
2025-08-31T08:28:50,219   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_biology.yaml'
2025-08-31T08:28:50,221   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_chemistry.yaml'
2025-08-31T08:28:50,222   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_computer_science.yaml'
2025-08-31T08:28:50,223   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_european_history.yaml'
2025-08-31T08:28:50,224   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_geography.yaml'
2025-08-31T08:28:50,225   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_government_and_politics.yaml'
2025-08-31T08:28:50,226   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_macroeconomics.yaml'
2025-08-31T08:28:50,227   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_mathematics.yaml'
2025-08-31T08:28:50,228   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_microeconomics.yaml'
2025-08-31T08:28:50,229   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_physics.yaml'
2025-08-31T08:28:50,231   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_psychology.yaml'
2025-08-31T08:28:50,232   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_statistics.yaml'
2025-08-31T08:28:50,233   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_us_history.yaml'
2025-08-31T08:28:50,234   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_world_history.yaml'
2025-08-31T08:28:50,235   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_aging.yaml'
2025-08-31T08:28:50,236   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_sexuality.yaml'
2025-08-31T08:28:50,237   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_international_law.yaml'
2025-08-31T08:28:50,238   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_jurisprudence.yaml'
2025-08-31T08:28:50,240   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_logical_fallacies.yaml'
2025-08-31T08:28:50,241   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_machine_learning.yaml'
2025-08-31T08:28:50,242   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_management.yaml'
2025-08-31T08:28:50,243   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_marketing.yaml'
2025-08-31T08:28:50,244   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_medical_genetics.yaml'
2025-08-31T08:28:50,245   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_miscellaneous.yaml'
2025-08-31T08:28:50,246   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_disputes.yaml'
2025-08-31T08:28:50,248   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_scenarios.yaml'
2025-08-31T08:28:50,249   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_nutrition.yaml'
2025-08-31T08:28:50,250   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_philosophy.yaml'
2025-08-31T08:28:50,251   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_prehistory.yaml'
2025-08-31T08:28:50,252   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_accounting.yaml'
2025-08-31T08:28:50,253   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_law.yaml'
2025-08-31T08:28:50,254   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_medicine.yaml'
2025-08-31T08:28:50,255   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_psychology.yaml'
2025-08-31T08:28:50,256   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_public_relations.yaml'
2025-08-31T08:28:50,257   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_security_studies.yaml'
2025-08-31T08:28:50,258   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_sociology.yaml'
2025-08-31T08:28:50,259   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_us_foreign_policy.yaml'
2025-08-31T08:28:50,260   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_virology.yaml'
2025-08-31T08:28:50,261   adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_world_religions.yaml'
2025-08-31T08:28:50,263   adding 'lm_eval/tasks/global_mmlu/full/ms/utils.py'
2025-08-31T08:28:50,265   adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne.yaml'
2025-08-31T08:28:50,266   adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_humanities.yaml'
2025-08-31T08:28:50,268   adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_other.yaml'
2025-08-31T08:28:50,269   adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_social_sciences.yaml'
2025-08-31T08:28:50,270   adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_stem.yaml'
2025-08-31T08:28:50,271   adding 'lm_eval/tasks/global_mmlu/full/ne/_ne_template_yaml'
2025-08-31T08:28:50,272   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_abstract_algebra.yaml'
2025-08-31T08:28:50,273   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_anatomy.yaml'
2025-08-31T08:28:50,274   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_astronomy.yaml'
2025-08-31T08:28:50,275   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_business_ethics.yaml'
2025-08-31T08:28:50,276   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_clinical_knowledge.yaml'
2025-08-31T08:28:50,278   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_biology.yaml'
2025-08-31T08:28:50,279   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_chemistry.yaml'
2025-08-31T08:28:50,280   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_computer_science.yaml'
2025-08-31T08:28:50,281   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_mathematics.yaml'
2025-08-31T08:28:50,282   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_medicine.yaml'
2025-08-31T08:28:50,283   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_physics.yaml'
2025-08-31T08:28:50,284   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_computer_security.yaml'
2025-08-31T08:28:50,285   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_conceptual_physics.yaml'
2025-08-31T08:28:50,286   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_econometrics.yaml'
2025-08-31T08:28:50,288   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_electrical_engineering.yaml'
2025-08-31T08:28:50,289   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_elementary_mathematics.yaml'
2025-08-31T08:28:50,290   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_formal_logic.yaml'
2025-08-31T08:28:50,291   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_global_facts.yaml'
2025-08-31T08:28:50,292   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_biology.yaml'
2025-08-31T08:28:50,293   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_chemistry.yaml'
2025-08-31T08:28:50,294   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_computer_science.yaml'
2025-08-31T08:28:50,296   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_european_history.yaml'
2025-08-31T08:28:50,297   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_geography.yaml'
2025-08-31T08:28:50,298   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_government_and_politics.yaml'
2025-08-31T08:28:50,299   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_macroeconomics.yaml'
2025-08-31T08:28:50,300   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_mathematics.yaml'
2025-08-31T08:28:50,301   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_microeconomics.yaml'
2025-08-31T08:28:50,302   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_physics.yaml'
2025-08-31T08:28:50,303   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_psychology.yaml'
2025-08-31T08:28:50,304   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_statistics.yaml'
2025-08-31T08:28:50,305   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_us_history.yaml'
2025-08-31T08:28:50,306   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_world_history.yaml'
2025-08-31T08:28:50,307   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_aging.yaml'
2025-08-31T08:28:50,309   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_sexuality.yaml'
2025-08-31T08:28:50,310   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_international_law.yaml'
2025-08-31T08:28:50,311   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_jurisprudence.yaml'
2025-08-31T08:28:50,312   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_logical_fallacies.yaml'
2025-08-31T08:28:50,313   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_machine_learning.yaml'
2025-08-31T08:28:50,314   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_management.yaml'
2025-08-31T08:28:50,315   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_marketing.yaml'
2025-08-31T08:28:50,316   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_medical_genetics.yaml'
2025-08-31T08:28:50,318   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_miscellaneous.yaml'
2025-08-31T08:28:50,319   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_disputes.yaml'
2025-08-31T08:28:50,320   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_scenarios.yaml'
2025-08-31T08:28:50,321   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_nutrition.yaml'
2025-08-31T08:28:50,322   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_philosophy.yaml'
2025-08-31T08:28:50,323   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_prehistory.yaml'
2025-08-31T08:28:50,324   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_accounting.yaml'
2025-08-31T08:28:50,325   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_law.yaml'
2025-08-31T08:28:50,327   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_medicine.yaml'
2025-08-31T08:28:50,328   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_psychology.yaml'
2025-08-31T08:28:50,329   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_public_relations.yaml'
2025-08-31T08:28:50,330   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_security_studies.yaml'
2025-08-31T08:28:50,331   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_sociology.yaml'
2025-08-31T08:28:50,332   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_us_foreign_policy.yaml'
2025-08-31T08:28:50,333   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_virology.yaml'
2025-08-31T08:28:50,334   adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_world_religions.yaml'
2025-08-31T08:28:50,336   adding 'lm_eval/tasks/global_mmlu/full/ne/utils.py'
2025-08-31T08:28:50,338   adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl.yaml'
2025-08-31T08:28:50,340   adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_humanities.yaml'
2025-08-31T08:28:50,341   adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_other.yaml'
2025-08-31T08:28:50,342   adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_social_sciences.yaml'
2025-08-31T08:28:50,343   adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_stem.yaml'
2025-08-31T08:28:50,344   adding 'lm_eval/tasks/global_mmlu/full/nl/_nl_template_yaml'
2025-08-31T08:28:50,345   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_abstract_algebra.yaml'
2025-08-31T08:28:50,346   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_anatomy.yaml'
2025-08-31T08:28:50,347   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_astronomy.yaml'
2025-08-31T08:28:50,348   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_business_ethics.yaml'
2025-08-31T08:28:50,350   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_clinical_knowledge.yaml'
2025-08-31T08:28:50,351   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_biology.yaml'
2025-08-31T08:28:50,352   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_chemistry.yaml'
2025-08-31T08:28:50,353   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_computer_science.yaml'
2025-08-31T08:28:50,354   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_mathematics.yaml'
2025-08-31T08:28:50,355   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_medicine.yaml'
2025-08-31T08:28:50,356   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_physics.yaml'
2025-08-31T08:28:50,358   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_computer_security.yaml'
2025-08-31T08:28:50,359   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_conceptual_physics.yaml'
2025-08-31T08:28:50,360   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_econometrics.yaml'
2025-08-31T08:28:50,361   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_electrical_engineering.yaml'
2025-08-31T08:28:50,362   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_elementary_mathematics.yaml'
2025-08-31T08:28:50,363   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_formal_logic.yaml'
2025-08-31T08:28:50,364   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_global_facts.yaml'
2025-08-31T08:28:50,366   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_biology.yaml'
2025-08-31T08:28:50,367   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_chemistry.yaml'
2025-08-31T08:28:50,368   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_computer_science.yaml'
2025-08-31T08:28:50,369   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_european_history.yaml'
2025-08-31T08:28:50,370   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_geography.yaml'
2025-08-31T08:28:50,371   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_government_and_politics.yaml'
2025-08-31T08:28:50,372   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_macroeconomics.yaml'
2025-08-31T08:28:50,374   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_mathematics.yaml'
2025-08-31T08:28:50,375   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_microeconomics.yaml'
2025-08-31T08:28:50,376   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_physics.yaml'
2025-08-31T08:28:50,377   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_psychology.yaml'
2025-08-31T08:28:50,378   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_statistics.yaml'
2025-08-31T08:28:50,380   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_us_history.yaml'
2025-08-31T08:28:50,381   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_world_history.yaml'
2025-08-31T08:28:50,382   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_aging.yaml'
2025-08-31T08:28:50,383   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_sexuality.yaml'
2025-08-31T08:28:50,384   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_international_law.yaml'
2025-08-31T08:28:50,385   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_jurisprudence.yaml'
2025-08-31T08:28:50,386   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_logical_fallacies.yaml'
2025-08-31T08:28:50,387   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_machine_learning.yaml'
2025-08-31T08:28:50,388   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_management.yaml'
2025-08-31T08:28:50,390   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_marketing.yaml'
2025-08-31T08:28:50,391   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_medical_genetics.yaml'
2025-08-31T08:28:50,392   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_miscellaneous.yaml'
2025-08-31T08:28:50,393   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_disputes.yaml'
2025-08-31T08:28:50,394   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_scenarios.yaml'
2025-08-31T08:28:50,395   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_nutrition.yaml'
2025-08-31T08:28:50,396   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_philosophy.yaml'
2025-08-31T08:28:50,398   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_prehistory.yaml'
2025-08-31T08:28:50,399   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_accounting.yaml'
2025-08-31T08:28:50,400   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_law.yaml'
2025-08-31T08:28:50,401   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_medicine.yaml'
2025-08-31T08:28:50,402   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_psychology.yaml'
2025-08-31T08:28:50,403   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_public_relations.yaml'
2025-08-31T08:28:50,404   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_security_studies.yaml'
2025-08-31T08:28:50,405   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_sociology.yaml'
2025-08-31T08:28:50,407   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_us_foreign_policy.yaml'
2025-08-31T08:28:50,408   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_virology.yaml'
2025-08-31T08:28:50,409   adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_world_religions.yaml'
2025-08-31T08:28:50,410   adding 'lm_eval/tasks/global_mmlu/full/nl/utils.py'
2025-08-31T08:28:50,413   adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny.yaml'
2025-08-31T08:28:50,414   adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_humanities.yaml'
2025-08-31T08:28:50,415   adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_other.yaml'
2025-08-31T08:28:50,417   adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_social_sciences.yaml'
2025-08-31T08:28:50,418   adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_stem.yaml'
2025-08-31T08:28:50,419   adding 'lm_eval/tasks/global_mmlu/full/ny/_ny_template_yaml'
2025-08-31T08:28:50,420   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_abstract_algebra.yaml'
2025-08-31T08:28:50,421   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_anatomy.yaml'
2025-08-31T08:28:50,422   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_astronomy.yaml'
2025-08-31T08:28:50,423   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_business_ethics.yaml'
2025-08-31T08:28:50,425   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_clinical_knowledge.yaml'
2025-08-31T08:28:50,426   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_biology.yaml'
2025-08-31T08:28:50,427   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_chemistry.yaml'
2025-08-31T08:28:50,428   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_computer_science.yaml'
2025-08-31T08:28:50,429   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_mathematics.yaml'
2025-08-31T08:28:50,430   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_medicine.yaml'
2025-08-31T08:28:50,431   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_physics.yaml'
2025-08-31T08:28:50,432   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_computer_security.yaml'
2025-08-31T08:28:50,433   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_conceptual_physics.yaml'
2025-08-31T08:28:50,434   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_econometrics.yaml'
2025-08-31T08:28:50,436   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_electrical_engineering.yaml'
2025-08-31T08:28:50,437   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_elementary_mathematics.yaml'
2025-08-31T08:28:50,438   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_formal_logic.yaml'
2025-08-31T08:28:50,439   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_global_facts.yaml'
2025-08-31T08:28:50,440   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_biology.yaml'
2025-08-31T08:28:50,441   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_chemistry.yaml'
2025-08-31T08:28:50,443   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_computer_science.yaml'
2025-08-31T08:28:50,444   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_european_history.yaml'
2025-08-31T08:28:50,445   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_geography.yaml'
2025-08-31T08:28:50,446   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_government_and_politics.yaml'
2025-08-31T08:28:50,447   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_macroeconomics.yaml'
2025-08-31T08:28:50,448   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_mathematics.yaml'
2025-08-31T08:28:50,449   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_microeconomics.yaml'
2025-08-31T08:28:50,450   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_physics.yaml'
2025-08-31T08:28:50,452   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_psychology.yaml'
2025-08-31T08:28:50,453   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_statistics.yaml'
2025-08-31T08:28:50,454   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_us_history.yaml'
2025-08-31T08:28:50,455   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_world_history.yaml'
2025-08-31T08:28:50,456   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_aging.yaml'
2025-08-31T08:28:50,458   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_sexuality.yaml'
2025-08-31T08:28:50,459   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_international_law.yaml'
2025-08-31T08:28:50,460   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_jurisprudence.yaml'
2025-08-31T08:28:50,461   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_logical_fallacies.yaml'
2025-08-31T08:28:50,462   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_machine_learning.yaml'
2025-08-31T08:28:50,463   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_management.yaml'
2025-08-31T08:28:50,464   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_marketing.yaml'
2025-08-31T08:28:50,466   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_medical_genetics.yaml'
2025-08-31T08:28:50,467   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_miscellaneous.yaml'
2025-08-31T08:28:50,468   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_disputes.yaml'
2025-08-31T08:28:50,469   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_scenarios.yaml'
2025-08-31T08:28:50,470   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_nutrition.yaml'
2025-08-31T08:28:50,471   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_philosophy.yaml'
2025-08-31T08:28:50,472   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_prehistory.yaml'
2025-08-31T08:28:50,473   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_accounting.yaml'
2025-08-31T08:28:50,475   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_law.yaml'
2025-08-31T08:28:50,476   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_medicine.yaml'
2025-08-31T08:28:50,477   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_psychology.yaml'
2025-08-31T08:28:50,478   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_public_relations.yaml'
2025-08-31T08:28:50,479   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_security_studies.yaml'
2025-08-31T08:28:50,480   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_sociology.yaml'
2025-08-31T08:28:50,481   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_us_foreign_policy.yaml'
2025-08-31T08:28:50,482   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_virology.yaml'
2025-08-31T08:28:50,483   adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_world_religions.yaml'
2025-08-31T08:28:50,484   adding 'lm_eval/tasks/global_mmlu/full/ny/utils.py'
2025-08-31T08:28:50,487   adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl.yaml'
2025-08-31T08:28:50,488   adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_humanities.yaml'
2025-08-31T08:28:50,489   adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_other.yaml'
2025-08-31T08:28:50,491   adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_social_sciences.yaml'
2025-08-31T08:28:50,492   adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_stem.yaml'
2025-08-31T08:28:50,493   adding 'lm_eval/tasks/global_mmlu/full/pl/_pl_template_yaml'
2025-08-31T08:28:50,494   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_abstract_algebra.yaml'
2025-08-31T08:28:50,495   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_anatomy.yaml'
2025-08-31T08:28:50,497   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_astronomy.yaml'
2025-08-31T08:28:50,498   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_business_ethics.yaml'
2025-08-31T08:28:50,499   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_clinical_knowledge.yaml'
2025-08-31T08:28:50,500   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_biology.yaml'
2025-08-31T08:28:50,501   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_chemistry.yaml'
2025-08-31T08:28:50,503   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_computer_science.yaml'
2025-08-31T08:28:50,504   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_mathematics.yaml'
2025-08-31T08:28:50,505   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_medicine.yaml'
2025-08-31T08:28:50,506   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_physics.yaml'
2025-08-31T08:28:50,507   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_computer_security.yaml'
2025-08-31T08:28:50,508   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_conceptual_physics.yaml'
2025-08-31T08:28:50,510   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_econometrics.yaml'
2025-08-31T08:28:50,511   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_electrical_engineering.yaml'
2025-08-31T08:28:50,512   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_elementary_mathematics.yaml'
2025-08-31T08:28:50,513   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_formal_logic.yaml'
2025-08-31T08:28:50,514   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_global_facts.yaml'
2025-08-31T08:28:50,515   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_biology.yaml'
2025-08-31T08:28:50,516   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_chemistry.yaml'
2025-08-31T08:28:50,517   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_computer_science.yaml'
2025-08-31T08:28:50,519   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_european_history.yaml'
2025-08-31T08:28:50,520   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_geography.yaml'
2025-08-31T08:28:50,521   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_government_and_politics.yaml'
2025-08-31T08:28:50,522   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_macroeconomics.yaml'
2025-08-31T08:28:50,523   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_mathematics.yaml'
2025-08-31T08:28:50,524   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_microeconomics.yaml'
2025-08-31T08:28:50,525   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_physics.yaml'
2025-08-31T08:28:50,526   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_psychology.yaml'
2025-08-31T08:28:50,527   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_statistics.yaml'
2025-08-31T08:28:50,529   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_us_history.yaml'
2025-08-31T08:28:50,530   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_world_history.yaml'
2025-08-31T08:28:50,531   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_aging.yaml'
2025-08-31T08:28:50,532   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_sexuality.yaml'
2025-08-31T08:28:50,533   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_international_law.yaml'
2025-08-31T08:28:50,534   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_jurisprudence.yaml'
2025-08-31T08:28:50,535   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_logical_fallacies.yaml'
2025-08-31T08:28:50,537   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_machine_learning.yaml'
2025-08-31T08:28:50,538   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_management.yaml'
2025-08-31T08:28:50,539   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_marketing.yaml'
2025-08-31T08:28:50,540   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_medical_genetics.yaml'
2025-08-31T08:28:50,541   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_miscellaneous.yaml'
2025-08-31T08:28:50,542   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_disputes.yaml'
2025-08-31T08:28:50,543   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_scenarios.yaml'
2025-08-31T08:28:50,545   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_nutrition.yaml'
2025-08-31T08:28:50,546   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_philosophy.yaml'
2025-08-31T08:28:50,547   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_prehistory.yaml'
2025-08-31T08:28:50,548   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_accounting.yaml'
2025-08-31T08:28:50,549   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_law.yaml'
2025-08-31T08:28:50,551   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_medicine.yaml'
2025-08-31T08:28:50,552   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_psychology.yaml'
2025-08-31T08:28:50,553   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_public_relations.yaml'
2025-08-31T08:28:50,554   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_security_studies.yaml'
2025-08-31T08:28:50,556   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_sociology.yaml'
2025-08-31T08:28:50,557   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_us_foreign_policy.yaml'
2025-08-31T08:28:50,558   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_virology.yaml'
2025-08-31T08:28:50,559   adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_world_religions.yaml'
2025-08-31T08:28:50,560   adding 'lm_eval/tasks/global_mmlu/full/pl/utils.py'
2025-08-31T08:28:50,563   adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt.yaml'
2025-08-31T08:28:50,564   adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_humanities.yaml'
2025-08-31T08:28:50,565   adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_other.yaml'
2025-08-31T08:28:50,566   adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_social_sciences.yaml'
2025-08-31T08:28:50,568   adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_stem.yaml'
2025-08-31T08:28:50,569   adding 'lm_eval/tasks/global_mmlu/full/pt/_pt_template_yaml'
2025-08-31T08:28:50,570   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_abstract_algebra.yaml'
2025-08-31T08:28:50,571   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_anatomy.yaml'
2025-08-31T08:28:50,572   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_astronomy.yaml'
2025-08-31T08:28:50,573   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_business_ethics.yaml'
2025-08-31T08:28:50,574   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_clinical_knowledge.yaml'
2025-08-31T08:28:50,576   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_biology.yaml'
2025-08-31T08:28:50,577   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_chemistry.yaml'
2025-08-31T08:28:50,578   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_computer_science.yaml'
2025-08-31T08:28:50,579   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_mathematics.yaml'
2025-08-31T08:28:50,580   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_medicine.yaml'
2025-08-31T08:28:50,581   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_physics.yaml'
2025-08-31T08:28:50,582   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_computer_security.yaml'
2025-08-31T08:28:50,583   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_conceptual_physics.yaml'
2025-08-31T08:28:50,585   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_econometrics.yaml'
2025-08-31T08:28:50,586   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_electrical_engineering.yaml'
2025-08-31T08:28:50,587   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_elementary_mathematics.yaml'
2025-08-31T08:28:50,588   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_formal_logic.yaml'
2025-08-31T08:28:50,589   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_global_facts.yaml'
2025-08-31T08:28:50,590   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_biology.yaml'
2025-08-31T08:28:50,591   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_chemistry.yaml'
2025-08-31T08:28:50,593   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_computer_science.yaml'
2025-08-31T08:28:50,594   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_european_history.yaml'
2025-08-31T08:28:50,595   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_geography.yaml'
2025-08-31T08:28:50,596   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_government_and_politics.yaml'
2025-08-31T08:28:50,598   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_macroeconomics.yaml'
2025-08-31T08:28:50,599   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_mathematics.yaml'
2025-08-31T08:28:50,600   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_microeconomics.yaml'
2025-08-31T08:28:50,601   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_physics.yaml'
2025-08-31T08:28:50,602   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_psychology.yaml'
2025-08-31T08:28:50,603   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_statistics.yaml'
2025-08-31T08:28:50,604   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_us_history.yaml'
2025-08-31T08:28:50,605   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_world_history.yaml'
2025-08-31T08:28:50,607   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_aging.yaml'
2025-08-31T08:28:50,608   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_sexuality.yaml'
2025-08-31T08:28:50,609   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_international_law.yaml'
2025-08-31T08:28:50,610   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_jurisprudence.yaml'
2025-08-31T08:28:50,611   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_logical_fallacies.yaml'
2025-08-31T08:28:50,612   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_machine_learning.yaml'
2025-08-31T08:28:50,614   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_management.yaml'
2025-08-31T08:28:50,615   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_marketing.yaml'
2025-08-31T08:28:50,616   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_medical_genetics.yaml'
2025-08-31T08:28:50,617   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_miscellaneous.yaml'
2025-08-31T08:28:50,618   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_disputes.yaml'
2025-08-31T08:28:50,619   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_scenarios.yaml'
2025-08-31T08:28:50,620   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_nutrition.yaml'
2025-08-31T08:28:50,621   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_philosophy.yaml'
2025-08-31T08:28:50,623   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_prehistory.yaml'
2025-08-31T08:28:50,624   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_accounting.yaml'
2025-08-31T08:28:50,625   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_law.yaml'
2025-08-31T08:28:50,626   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_medicine.yaml'
2025-08-31T08:28:50,627   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_psychology.yaml'
2025-08-31T08:28:50,628   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_public_relations.yaml'
2025-08-31T08:28:50,629   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_security_studies.yaml'
2025-08-31T08:28:50,631   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_sociology.yaml'
2025-08-31T08:28:50,632   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_us_foreign_policy.yaml'
2025-08-31T08:28:50,633   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_virology.yaml'
2025-08-31T08:28:50,634   adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_world_religions.yaml'
2025-08-31T08:28:50,635   adding 'lm_eval/tasks/global_mmlu/full/pt/utils.py'
2025-08-31T08:28:50,638   adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro.yaml'
2025-08-31T08:28:50,639   adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_humanities.yaml'
2025-08-31T08:28:50,641   adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_other.yaml'
2025-08-31T08:28:50,642   adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_social_sciences.yaml'
2025-08-31T08:28:50,643   adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_stem.yaml'
2025-08-31T08:28:50,644   adding 'lm_eval/tasks/global_mmlu/full/ro/_ro_template_yaml'
2025-08-31T08:28:50,645   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_abstract_algebra.yaml'
2025-08-31T08:28:50,646   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_anatomy.yaml'
2025-08-31T08:28:50,647   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_astronomy.yaml'
2025-08-31T08:28:50,648   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_business_ethics.yaml'
2025-08-31T08:28:50,649   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_clinical_knowledge.yaml'
2025-08-31T08:28:50,650   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_biology.yaml'
2025-08-31T08:28:50,651   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_chemistry.yaml'
2025-08-31T08:28:50,653   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_computer_science.yaml'
2025-08-31T08:28:50,654   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_mathematics.yaml'
2025-08-31T08:28:50,655   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_medicine.yaml'
2025-08-31T08:28:50,656   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_physics.yaml'
2025-08-31T08:28:50,657   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_computer_security.yaml'
2025-08-31T08:28:50,658   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_conceptual_physics.yaml'
2025-08-31T08:28:50,659   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_econometrics.yaml'
2025-08-31T08:28:50,661   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_electrical_engineering.yaml'
2025-08-31T08:28:50,662   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_elementary_mathematics.yaml'
2025-08-31T08:28:50,663   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_formal_logic.yaml'
2025-08-31T08:28:50,664   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_global_facts.yaml'
2025-08-31T08:28:50,665   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_biology.yaml'
2025-08-31T08:28:50,666   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_chemistry.yaml'
2025-08-31T08:28:50,667   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_computer_science.yaml'
2025-08-31T08:28:50,669   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_european_history.yaml'
2025-08-31T08:28:50,670   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_geography.yaml'
2025-08-31T08:28:50,671   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_government_and_politics.yaml'
2025-08-31T08:28:50,672   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_macroeconomics.yaml'
2025-08-31T08:28:50,673   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_mathematics.yaml'
2025-08-31T08:28:50,675   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_microeconomics.yaml'
2025-08-31T08:28:50,676   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_physics.yaml'
2025-08-31T08:28:50,677   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_psychology.yaml'
2025-08-31T08:28:50,678   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_statistics.yaml'
2025-08-31T08:28:50,680   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_us_history.yaml'
2025-08-31T08:28:50,681   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_world_history.yaml'
2025-08-31T08:28:50,682   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_aging.yaml'
2025-08-31T08:28:50,683   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_sexuality.yaml'
2025-08-31T08:28:50,684   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_international_law.yaml'
2025-08-31T08:28:50,685   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_jurisprudence.yaml'
2025-08-31T08:28:50,686   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_logical_fallacies.yaml'
2025-08-31T08:28:50,687   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_machine_learning.yaml'
2025-08-31T08:28:50,689   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_management.yaml'
2025-08-31T08:28:50,690   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_marketing.yaml'
2025-08-31T08:28:50,691   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_medical_genetics.yaml'
2025-08-31T08:28:50,692   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_miscellaneous.yaml'
2025-08-31T08:28:50,693   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_disputes.yaml'
2025-08-31T08:28:50,694   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_scenarios.yaml'
2025-08-31T08:28:50,695   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_nutrition.yaml'
2025-08-31T08:28:50,697   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_philosophy.yaml'
2025-08-31T08:28:50,698   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_prehistory.yaml'
2025-08-31T08:28:50,699   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_accounting.yaml'
2025-08-31T08:28:50,700   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_law.yaml'
2025-08-31T08:28:50,701   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_medicine.yaml'
2025-08-31T08:28:50,702   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_psychology.yaml'
2025-08-31T08:28:50,703   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_public_relations.yaml'
2025-08-31T08:28:50,705   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_security_studies.yaml'
2025-08-31T08:28:50,706   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_sociology.yaml'
2025-08-31T08:28:50,707   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_us_foreign_policy.yaml'
2025-08-31T08:28:50,708   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_virology.yaml'
2025-08-31T08:28:50,709   adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_world_religions.yaml'
2025-08-31T08:28:50,710   adding 'lm_eval/tasks/global_mmlu/full/ro/utils.py'
2025-08-31T08:28:50,713   adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru.yaml'
2025-08-31T08:28:50,714   adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_humanities.yaml'
2025-08-31T08:28:50,715   adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_other.yaml'
2025-08-31T08:28:50,717   adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_social_sciences.yaml'
2025-08-31T08:28:50,718   adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_stem.yaml'
2025-08-31T08:28:50,719   adding 'lm_eval/tasks/global_mmlu/full/ru/_ru_template_yaml'
2025-08-31T08:28:50,720   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_abstract_algebra.yaml'
2025-08-31T08:28:50,721   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_anatomy.yaml'
2025-08-31T08:28:50,722   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_astronomy.yaml'
2025-08-31T08:28:50,724   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_business_ethics.yaml'
2025-08-31T08:28:50,725   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_clinical_knowledge.yaml'
2025-08-31T08:28:50,726   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_biology.yaml'
2025-08-31T08:28:50,727   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_chemistry.yaml'
2025-08-31T08:28:50,728   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_computer_science.yaml'
2025-08-31T08:28:50,729   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_mathematics.yaml'
2025-08-31T08:28:50,731   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_medicine.yaml'
2025-08-31T08:28:50,732   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_physics.yaml'
2025-08-31T08:28:50,733   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_computer_security.yaml'
2025-08-31T08:28:50,734   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_conceptual_physics.yaml'
2025-08-31T08:28:50,735   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_econometrics.yaml'
2025-08-31T08:28:50,736   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_electrical_engineering.yaml'
2025-08-31T08:28:50,737   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_elementary_mathematics.yaml'
2025-08-31T08:28:50,738   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_formal_logic.yaml'
2025-08-31T08:28:50,739   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_global_facts.yaml'
2025-08-31T08:28:50,741   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_biology.yaml'
2025-08-31T08:28:50,742   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_chemistry.yaml'
2025-08-31T08:28:50,743   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_computer_science.yaml'
2025-08-31T08:28:50,744   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_european_history.yaml'
2025-08-31T08:28:50,745   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_geography.yaml'
2025-08-31T08:28:50,746   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_government_and_politics.yaml'
2025-08-31T08:28:50,747   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_macroeconomics.yaml'
2025-08-31T08:28:50,749   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_mathematics.yaml'
2025-08-31T08:28:50,750   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_microeconomics.yaml'
2025-08-31T08:28:50,751   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_physics.yaml'
2025-08-31T08:28:50,752   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_psychology.yaml'
2025-08-31T08:28:50,753   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_statistics.yaml'
2025-08-31T08:28:50,754   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_us_history.yaml'
2025-08-31T08:28:50,755   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_world_history.yaml'
2025-08-31T08:28:50,757   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_aging.yaml'
2025-08-31T08:28:50,758   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_sexuality.yaml'
2025-08-31T08:28:50,759   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_international_law.yaml'
2025-08-31T08:28:50,760   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_jurisprudence.yaml'
2025-08-31T08:28:50,761   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_logical_fallacies.yaml'
2025-08-31T08:28:50,762   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_machine_learning.yaml'
2025-08-31T08:28:50,763   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_management.yaml'
2025-08-31T08:28:50,765   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_marketing.yaml'
2025-08-31T08:28:50,766   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_medical_genetics.yaml'
2025-08-31T08:28:50,767   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_miscellaneous.yaml'
2025-08-31T08:28:50,768   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_disputes.yaml'
2025-08-31T08:28:50,769   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_scenarios.yaml'
2025-08-31T08:28:50,770   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_nutrition.yaml'
2025-08-31T08:28:50,771   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_philosophy.yaml'
2025-08-31T08:28:50,772   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_prehistory.yaml'
2025-08-31T08:28:50,773   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_accounting.yaml'
2025-08-31T08:28:50,774   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_law.yaml'
2025-08-31T08:28:50,776   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_medicine.yaml'
2025-08-31T08:28:50,777   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_psychology.yaml'
2025-08-31T08:28:50,778   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_public_relations.yaml'
2025-08-31T08:28:50,779   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_security_studies.yaml'
2025-08-31T08:28:50,780   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_sociology.yaml'
2025-08-31T08:28:50,781   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_us_foreign_policy.yaml'
2025-08-31T08:28:50,782   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_virology.yaml'
2025-08-31T08:28:50,783   adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_world_religions.yaml'
2025-08-31T08:28:50,784   adding 'lm_eval/tasks/global_mmlu/full/ru/utils.py'
2025-08-31T08:28:50,787   adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si.yaml'
2025-08-31T08:28:50,788   adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_humanities.yaml'
2025-08-31T08:28:50,790   adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_other.yaml'
2025-08-31T08:28:50,791   adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_social_sciences.yaml'
2025-08-31T08:28:50,792   adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_stem.yaml'
2025-08-31T08:28:50,793   adding 'lm_eval/tasks/global_mmlu/full/si/_si_template_yaml'
2025-08-31T08:28:50,794   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_abstract_algebra.yaml'
2025-08-31T08:28:50,795   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_anatomy.yaml'
2025-08-31T08:28:50,796   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_astronomy.yaml'
2025-08-31T08:28:50,798   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_business_ethics.yaml'
2025-08-31T08:28:50,799   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_clinical_knowledge.yaml'
2025-08-31T08:28:50,800   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_biology.yaml'
2025-08-31T08:28:50,801   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_chemistry.yaml'
2025-08-31T08:28:50,802   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_computer_science.yaml'
2025-08-31T08:28:50,803   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_mathematics.yaml'
2025-08-31T08:28:50,805   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_medicine.yaml'
2025-08-31T08:28:50,806   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_physics.yaml'
2025-08-31T08:28:50,807   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_computer_security.yaml'
2025-08-31T08:28:50,808   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_conceptual_physics.yaml'
2025-08-31T08:28:50,809   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_econometrics.yaml'
2025-08-31T08:28:50,810   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_electrical_engineering.yaml'
2025-08-31T08:28:50,812   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_elementary_mathematics.yaml'
2025-08-31T08:28:50,813   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_formal_logic.yaml'
2025-08-31T08:28:50,814   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_global_facts.yaml'
2025-08-31T08:28:50,815   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_biology.yaml'
2025-08-31T08:28:50,816   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_chemistry.yaml'
2025-08-31T08:28:50,817   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_computer_science.yaml'
2025-08-31T08:28:50,818   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_european_history.yaml'
2025-08-31T08:28:50,820   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_geography.yaml'
2025-08-31T08:28:50,821   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_government_and_politics.yaml'
2025-08-31T08:28:50,822   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_macroeconomics.yaml'
2025-08-31T08:28:50,823   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_mathematics.yaml'
2025-08-31T08:28:50,824   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_microeconomics.yaml'
2025-08-31T08:28:50,825   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_physics.yaml'
2025-08-31T08:28:50,827   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_psychology.yaml'
2025-08-31T08:28:50,828   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_statistics.yaml'
2025-08-31T08:28:50,829   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_us_history.yaml'
2025-08-31T08:28:50,830   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_world_history.yaml'
2025-08-31T08:28:50,831   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_aging.yaml'
2025-08-31T08:28:50,832   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_sexuality.yaml'
2025-08-31T08:28:50,833   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_international_law.yaml'
2025-08-31T08:28:50,835   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_jurisprudence.yaml'
2025-08-31T08:28:50,836   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_logical_fallacies.yaml'
2025-08-31T08:28:50,837   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_machine_learning.yaml'
2025-08-31T08:28:50,838   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_management.yaml'
2025-08-31T08:28:50,839   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_marketing.yaml'
2025-08-31T08:28:50,840   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_medical_genetics.yaml'
2025-08-31T08:28:50,841   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_miscellaneous.yaml'
2025-08-31T08:28:50,843   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_disputes.yaml'
2025-08-31T08:28:50,844   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_scenarios.yaml'
2025-08-31T08:28:50,845   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_nutrition.yaml'
2025-08-31T08:28:50,846   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_philosophy.yaml'
2025-08-31T08:28:50,847   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_prehistory.yaml'
2025-08-31T08:28:50,848   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_accounting.yaml'
2025-08-31T08:28:50,849   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_law.yaml'
2025-08-31T08:28:50,851   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_medicine.yaml'
2025-08-31T08:28:50,852   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_psychology.yaml'
2025-08-31T08:28:50,853   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_public_relations.yaml'
2025-08-31T08:28:50,854   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_security_studies.yaml'
2025-08-31T08:28:50,855   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_sociology.yaml'
2025-08-31T08:28:50,856   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_us_foreign_policy.yaml'
2025-08-31T08:28:50,858   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_virology.yaml'
2025-08-31T08:28:50,859   adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_world_religions.yaml'
2025-08-31T08:28:50,860   adding 'lm_eval/tasks/global_mmlu/full/si/utils.py'
2025-08-31T08:28:50,863   adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn.yaml'
2025-08-31T08:28:50,864   adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_humanities.yaml'
2025-08-31T08:28:50,865   adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_other.yaml'
2025-08-31T08:28:50,866   adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_social_sciences.yaml'
2025-08-31T08:28:50,867   adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_stem.yaml'
2025-08-31T08:28:50,868   adding 'lm_eval/tasks/global_mmlu/full/sn/_sn_template_yaml'
2025-08-31T08:28:50,869   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_abstract_algebra.yaml'
2025-08-31T08:28:50,870   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_anatomy.yaml'
2025-08-31T08:28:50,871   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_astronomy.yaml'
2025-08-31T08:28:50,872   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_business_ethics.yaml'
2025-08-31T08:28:50,873   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_clinical_knowledge.yaml'
2025-08-31T08:28:50,874   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_biology.yaml'
2025-08-31T08:28:50,875   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_chemistry.yaml'
2025-08-31T08:28:50,877   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_computer_science.yaml'
2025-08-31T08:28:50,878   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_mathematics.yaml'
2025-08-31T08:28:50,879   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_medicine.yaml'
2025-08-31T08:28:50,880   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_physics.yaml'
2025-08-31T08:28:50,881   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_computer_security.yaml'
2025-08-31T08:28:50,882   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_conceptual_physics.yaml'
2025-08-31T08:28:50,883   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_econometrics.yaml'
2025-08-31T08:28:50,885   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_electrical_engineering.yaml'
2025-08-31T08:28:50,886   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_elementary_mathematics.yaml'
2025-08-31T08:28:50,887   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_formal_logic.yaml'
2025-08-31T08:28:50,888   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_global_facts.yaml'
2025-08-31T08:28:50,889   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_biology.yaml'
2025-08-31T08:28:50,891   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_chemistry.yaml'
2025-08-31T08:28:50,892   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_computer_science.yaml'
2025-08-31T08:28:50,893   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_european_history.yaml'
2025-08-31T08:28:50,894   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_geography.yaml'
2025-08-31T08:28:50,895   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_government_and_politics.yaml'
2025-08-31T08:28:50,897   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_macroeconomics.yaml'
2025-08-31T08:28:50,898   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_mathematics.yaml'
2025-08-31T08:28:50,899   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_microeconomics.yaml'
2025-08-31T08:28:50,900   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_physics.yaml'
2025-08-31T08:28:50,901   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_psychology.yaml'
2025-08-31T08:28:50,902   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_statistics.yaml'
2025-08-31T08:28:50,903   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_us_history.yaml'
2025-08-31T08:28:50,904   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_world_history.yaml'
2025-08-31T08:28:50,905   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_aging.yaml'
2025-08-31T08:28:50,906   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_sexuality.yaml'
2025-08-31T08:28:50,907   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_international_law.yaml'
2025-08-31T08:28:50,909   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_jurisprudence.yaml'
2025-08-31T08:28:50,910   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_logical_fallacies.yaml'
2025-08-31T08:28:50,911   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_machine_learning.yaml'
2025-08-31T08:28:50,912   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_management.yaml'
2025-08-31T08:28:50,913   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_marketing.yaml'
2025-08-31T08:28:50,914   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_medical_genetics.yaml'
2025-08-31T08:28:50,915   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_miscellaneous.yaml'
2025-08-31T08:28:50,916   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_disputes.yaml'
2025-08-31T08:28:50,917   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_scenarios.yaml'
2025-08-31T08:28:50,919   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_nutrition.yaml'
2025-08-31T08:28:50,920   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_philosophy.yaml'
2025-08-31T08:28:50,921   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_prehistory.yaml'
2025-08-31T08:28:50,922   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_accounting.yaml'
2025-08-31T08:28:50,923   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_law.yaml'
2025-08-31T08:28:50,924   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_medicine.yaml'
2025-08-31T08:28:50,925   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_psychology.yaml'
2025-08-31T08:28:50,926   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_public_relations.yaml'
2025-08-31T08:28:50,927   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_security_studies.yaml'
2025-08-31T08:28:50,929   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_sociology.yaml'
2025-08-31T08:28:50,930   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_us_foreign_policy.yaml'
2025-08-31T08:28:50,931   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_virology.yaml'
2025-08-31T08:28:50,932   adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_world_religions.yaml'
2025-08-31T08:28:50,933   adding 'lm_eval/tasks/global_mmlu/full/sn/utils.py'
2025-08-31T08:28:50,936   adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so.yaml'
2025-08-31T08:28:50,937   adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_humanities.yaml'
2025-08-31T08:28:50,938   adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_other.yaml'
2025-08-31T08:28:50,939   adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_social_sciences.yaml'
2025-08-31T08:28:50,941   adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_stem.yaml'
2025-08-31T08:28:50,942   adding 'lm_eval/tasks/global_mmlu/full/so/_so_template_yaml'
2025-08-31T08:28:50,943   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_abstract_algebra.yaml'
2025-08-31T08:28:50,944   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_anatomy.yaml'
2025-08-31T08:28:50,945   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_astronomy.yaml'
2025-08-31T08:28:50,946   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_business_ethics.yaml'
2025-08-31T08:28:50,947   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_clinical_knowledge.yaml'
2025-08-31T08:28:50,948   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_biology.yaml'
2025-08-31T08:28:50,949   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_chemistry.yaml'
2025-08-31T08:28:50,950   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_computer_science.yaml'
2025-08-31T08:28:50,951   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_mathematics.yaml'
2025-08-31T08:28:50,952   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_medicine.yaml'
2025-08-31T08:28:50,954   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_physics.yaml'
2025-08-31T08:28:50,955   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_computer_security.yaml'
2025-08-31T08:28:50,956   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_conceptual_physics.yaml'
2025-08-31T08:28:50,957   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_econometrics.yaml'
2025-08-31T08:28:50,958   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_electrical_engineering.yaml'
2025-08-31T08:28:50,959   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_elementary_mathematics.yaml'
2025-08-31T08:28:50,960   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_formal_logic.yaml'
2025-08-31T08:28:50,961   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_global_facts.yaml'
2025-08-31T08:28:50,962   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_biology.yaml'
2025-08-31T08:28:50,963   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_chemistry.yaml'
2025-08-31T08:28:50,964   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_computer_science.yaml'
2025-08-31T08:28:50,966   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_european_history.yaml'
2025-08-31T08:28:50,967   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_geography.yaml'
2025-08-31T08:28:50,968   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_government_and_politics.yaml'
2025-08-31T08:28:50,969   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_macroeconomics.yaml'
2025-08-31T08:28:50,970   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_mathematics.yaml'
2025-08-31T08:28:50,971   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_microeconomics.yaml'
2025-08-31T08:28:50,972   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_physics.yaml'
2025-08-31T08:28:50,974   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_psychology.yaml'
2025-08-31T08:28:50,975   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_statistics.yaml'
2025-08-31T08:28:50,976   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_us_history.yaml'
2025-08-31T08:28:50,977   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_world_history.yaml'
2025-08-31T08:28:50,978   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_aging.yaml'
2025-08-31T08:28:50,980   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_sexuality.yaml'
2025-08-31T08:28:50,981   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_international_law.yaml'
2025-08-31T08:28:50,982   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_jurisprudence.yaml'
2025-08-31T08:28:50,983   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_logical_fallacies.yaml'
2025-08-31T08:28:50,984   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_machine_learning.yaml'
2025-08-31T08:28:50,985   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_management.yaml'
2025-08-31T08:28:50,986   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_marketing.yaml'
2025-08-31T08:28:50,987   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_medical_genetics.yaml'
2025-08-31T08:28:50,988   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_miscellaneous.yaml'
2025-08-31T08:28:50,989   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_disputes.yaml'
2025-08-31T08:28:50,990   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_scenarios.yaml'
2025-08-31T08:28:50,991   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_nutrition.yaml'
2025-08-31T08:28:50,992   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_philosophy.yaml'
2025-08-31T08:28:50,993   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_prehistory.yaml'
2025-08-31T08:28:50,994   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_accounting.yaml'
2025-08-31T08:28:50,996   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_law.yaml'
2025-08-31T08:28:50,997   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_medicine.yaml'
2025-08-31T08:28:50,998   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_psychology.yaml'
2025-08-31T08:28:50,999   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_public_relations.yaml'
2025-08-31T08:28:51,000   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_security_studies.yaml'
2025-08-31T08:28:51,001   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_sociology.yaml'
2025-08-31T08:28:51,002   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_us_foreign_policy.yaml'
2025-08-31T08:28:51,003   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_virology.yaml'
2025-08-31T08:28:51,005   adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_world_religions.yaml'
2025-08-31T08:28:51,006   adding 'lm_eval/tasks/global_mmlu/full/so/utils.py'
2025-08-31T08:28:51,009   adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr.yaml'
2025-08-31T08:28:51,010   adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_humanities.yaml'
2025-08-31T08:28:51,011   adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_other.yaml'
2025-08-31T08:28:51,012   adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_social_sciences.yaml'
2025-08-31T08:28:51,013   adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_stem.yaml'
2025-08-31T08:28:51,015   adding 'lm_eval/tasks/global_mmlu/full/sr/_sr_template_yaml'
2025-08-31T08:28:51,016   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_abstract_algebra.yaml'
2025-08-31T08:28:51,017   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_anatomy.yaml'
2025-08-31T08:28:51,018   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_astronomy.yaml'
2025-08-31T08:28:51,019   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_business_ethics.yaml'
2025-08-31T08:28:51,020   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_clinical_knowledge.yaml'
2025-08-31T08:28:51,021   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_biology.yaml'
2025-08-31T08:28:51,023   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_chemistry.yaml'
2025-08-31T08:28:51,024   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_computer_science.yaml'
2025-08-31T08:28:51,025   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_mathematics.yaml'
2025-08-31T08:28:51,026   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_medicine.yaml'
2025-08-31T08:28:51,027   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_physics.yaml'
2025-08-31T08:28:51,028   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_computer_security.yaml'
2025-08-31T08:28:51,029   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_conceptual_physics.yaml'
2025-08-31T08:28:51,030   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_econometrics.yaml'
2025-08-31T08:28:51,031   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_electrical_engineering.yaml'
2025-08-31T08:28:51,032   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_elementary_mathematics.yaml'
2025-08-31T08:28:51,033   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_formal_logic.yaml'
2025-08-31T08:28:51,034   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_global_facts.yaml'
2025-08-31T08:28:51,035   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_biology.yaml'
2025-08-31T08:28:51,036   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_chemistry.yaml'
2025-08-31T08:28:51,038   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_computer_science.yaml'
2025-08-31T08:28:51,039   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_european_history.yaml'
2025-08-31T08:28:51,040   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_geography.yaml'
2025-08-31T08:28:51,041   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_government_and_politics.yaml'
2025-08-31T08:28:51,042   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_macroeconomics.yaml'
2025-08-31T08:28:51,043   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_mathematics.yaml'
2025-08-31T08:28:51,044   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_microeconomics.yaml'
2025-08-31T08:28:51,045   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_physics.yaml'
2025-08-31T08:28:51,046   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_psychology.yaml'
2025-08-31T08:28:51,047   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_statistics.yaml'
2025-08-31T08:28:51,048   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_us_history.yaml'
2025-08-31T08:28:51,050   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_world_history.yaml'
2025-08-31T08:28:51,051   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_aging.yaml'
2025-08-31T08:28:51,052   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_sexuality.yaml'
2025-08-31T08:28:51,053   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_international_law.yaml'
2025-08-31T08:28:51,054   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_jurisprudence.yaml'
2025-08-31T08:28:51,055   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_logical_fallacies.yaml'
2025-08-31T08:28:51,057   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_machine_learning.yaml'
2025-08-31T08:28:51,058   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_management.yaml'
2025-08-31T08:28:51,059   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_marketing.yaml'
2025-08-31T08:28:51,060   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_medical_genetics.yaml'
2025-08-31T08:28:51,061   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_miscellaneous.yaml'
2025-08-31T08:28:51,062   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_disputes.yaml'
2025-08-31T08:28:51,064   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_scenarios.yaml'
2025-08-31T08:28:51,065   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_nutrition.yaml'
2025-08-31T08:28:51,066   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_philosophy.yaml'
2025-08-31T08:28:51,067   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_prehistory.yaml'
2025-08-31T08:28:51,068   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_accounting.yaml'
2025-08-31T08:28:51,069   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_law.yaml'
2025-08-31T08:28:51,070   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_medicine.yaml'
2025-08-31T08:28:51,072   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_psychology.yaml'
2025-08-31T08:28:51,073   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_public_relations.yaml'
2025-08-31T08:28:51,074   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_security_studies.yaml'
2025-08-31T08:28:51,075   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_sociology.yaml'
2025-08-31T08:28:51,076   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_us_foreign_policy.yaml'
2025-08-31T08:28:51,077   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_virology.yaml'
2025-08-31T08:28:51,078   adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_world_religions.yaml'
2025-08-31T08:28:51,079   adding 'lm_eval/tasks/global_mmlu/full/sr/utils.py'
2025-08-31T08:28:51,082   adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv.yaml'
2025-08-31T08:28:51,083   adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_humanities.yaml'
2025-08-31T08:28:51,084   adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_other.yaml'
2025-08-31T08:28:51,086   adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_social_sciences.yaml'
2025-08-31T08:28:51,087   adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_stem.yaml'
2025-08-31T08:28:51,088   adding 'lm_eval/tasks/global_mmlu/full/sv/_sv_template_yaml'
2025-08-31T08:28:51,089   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_abstract_algebra.yaml'
2025-08-31T08:28:51,090   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_anatomy.yaml'
2025-08-31T08:28:51,091   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_astronomy.yaml'
2025-08-31T08:28:51,092   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_business_ethics.yaml'
2025-08-31T08:28:51,094   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_clinical_knowledge.yaml'
2025-08-31T08:28:51,095   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_biology.yaml'
2025-08-31T08:28:51,096   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_chemistry.yaml'
2025-08-31T08:28:51,097   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_computer_science.yaml'
2025-08-31T08:28:51,098   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_mathematics.yaml'
2025-08-31T08:28:51,099   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_medicine.yaml'
2025-08-31T08:28:51,100   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_physics.yaml'
2025-08-31T08:28:51,102   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_computer_security.yaml'
2025-08-31T08:28:51,103   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_conceptual_physics.yaml'
2025-08-31T08:28:51,104   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_econometrics.yaml'
2025-08-31T08:28:51,105   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_electrical_engineering.yaml'
2025-08-31T08:28:51,106   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_elementary_mathematics.yaml'
2025-08-31T08:28:51,108   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_formal_logic.yaml'
2025-08-31T08:28:51,109   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_global_facts.yaml'
2025-08-31T08:28:51,110   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_biology.yaml'
2025-08-31T08:28:51,111   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_chemistry.yaml'
2025-08-31T08:28:51,112   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_computer_science.yaml'
2025-08-31T08:28:51,113   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_european_history.yaml'
2025-08-31T08:28:51,114   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_geography.yaml'
2025-08-31T08:28:51,116   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_government_and_politics.yaml'
2025-08-31T08:28:51,117   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_macroeconomics.yaml'
2025-08-31T08:28:51,118   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_mathematics.yaml'
2025-08-31T08:28:51,119   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_microeconomics.yaml'
2025-08-31T08:28:51,120   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_physics.yaml'
2025-08-31T08:28:51,121   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_psychology.yaml'
2025-08-31T08:28:51,122   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_statistics.yaml'
2025-08-31T08:28:51,124   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_us_history.yaml'
2025-08-31T08:28:51,125   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_world_history.yaml'
2025-08-31T08:28:51,126   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_aging.yaml'
2025-08-31T08:28:51,127   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_sexuality.yaml'
2025-08-31T08:28:51,128   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_international_law.yaml'
2025-08-31T08:28:51,129   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_jurisprudence.yaml'
2025-08-31T08:28:51,130   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_logical_fallacies.yaml'
2025-08-31T08:28:51,131   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_machine_learning.yaml'
2025-08-31T08:28:51,133   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_management.yaml'
2025-08-31T08:28:51,134   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_marketing.yaml'
2025-08-31T08:28:51,135   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_medical_genetics.yaml'
2025-08-31T08:28:51,136   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_miscellaneous.yaml'
2025-08-31T08:28:51,137   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_disputes.yaml'
2025-08-31T08:28:51,138   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_scenarios.yaml'
2025-08-31T08:28:51,139   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_nutrition.yaml'
2025-08-31T08:28:51,141   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_philosophy.yaml'
2025-08-31T08:28:51,142   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_prehistory.yaml'
2025-08-31T08:28:51,143   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_accounting.yaml'
2025-08-31T08:28:51,144   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_law.yaml'
2025-08-31T08:28:51,145   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_medicine.yaml'
2025-08-31T08:28:51,146   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_psychology.yaml'
2025-08-31T08:28:51,148   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_public_relations.yaml'
2025-08-31T08:28:51,149   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_security_studies.yaml'
2025-08-31T08:28:51,150   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_sociology.yaml'
2025-08-31T08:28:51,151   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_us_foreign_policy.yaml'
2025-08-31T08:28:51,152   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_virology.yaml'
2025-08-31T08:28:51,153   adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_world_religions.yaml'
2025-08-31T08:28:51,155   adding 'lm_eval/tasks/global_mmlu/full/sv/utils.py'
2025-08-31T08:28:51,157   adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw.yaml'
2025-08-31T08:28:51,159   adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_humanities.yaml'
2025-08-31T08:28:51,159   adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_other.yaml'
2025-08-31T08:28:51,161   adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_social_sciences.yaml'
2025-08-31T08:28:51,162   adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_stem.yaml'
2025-08-31T08:28:51,163   adding 'lm_eval/tasks/global_mmlu/full/sw/_sw_template_yaml'
2025-08-31T08:28:51,164   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_abstract_algebra.yaml'
2025-08-31T08:28:51,165   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_anatomy.yaml'
2025-08-31T08:28:51,166   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_astronomy.yaml'
2025-08-31T08:28:51,167   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_business_ethics.yaml'
2025-08-31T08:28:51,168   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_clinical_knowledge.yaml'
2025-08-31T08:28:51,169   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_biology.yaml'
2025-08-31T08:28:51,170   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_chemistry.yaml'
2025-08-31T08:28:51,171   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_computer_science.yaml'
2025-08-31T08:28:51,172   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_mathematics.yaml'
2025-08-31T08:28:51,173   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_medicine.yaml'
2025-08-31T08:28:51,175   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_physics.yaml'
2025-08-31T08:28:51,176   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_computer_security.yaml'
2025-08-31T08:28:51,177   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_conceptual_physics.yaml'
2025-08-31T08:28:51,178   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_econometrics.yaml'
2025-08-31T08:28:51,179   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_electrical_engineering.yaml'
2025-08-31T08:28:51,180   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_elementary_mathematics.yaml'
2025-08-31T08:28:51,181   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_formal_logic.yaml'
2025-08-31T08:28:51,183   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_global_facts.yaml'
2025-08-31T08:28:51,184   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_biology.yaml'
2025-08-31T08:28:51,185   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_chemistry.yaml'
2025-08-31T08:28:51,186   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_computer_science.yaml'
2025-08-31T08:28:51,187   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_european_history.yaml'
2025-08-31T08:28:51,189   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_geography.yaml'
2025-08-31T08:28:51,190   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_government_and_politics.yaml'
2025-08-31T08:28:51,191   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_macroeconomics.yaml'
2025-08-31T08:28:51,192   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_mathematics.yaml'
2025-08-31T08:28:51,193   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_microeconomics.yaml'
2025-08-31T08:28:51,195   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_physics.yaml'
2025-08-31T08:28:51,196   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_psychology.yaml'
2025-08-31T08:28:51,197   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_statistics.yaml'
2025-08-31T08:28:51,198   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_us_history.yaml'
2025-08-31T08:28:51,199   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_world_history.yaml'
2025-08-31T08:28:51,201   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_aging.yaml'
2025-08-31T08:28:51,202   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_sexuality.yaml'
2025-08-31T08:28:51,203   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_international_law.yaml'
2025-08-31T08:28:51,204   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_jurisprudence.yaml'
2025-08-31T08:28:51,205   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_logical_fallacies.yaml'
2025-08-31T08:28:51,206   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_machine_learning.yaml'
2025-08-31T08:28:51,208   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_management.yaml'
2025-08-31T08:28:51,209   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_marketing.yaml'
2025-08-31T08:28:51,210   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_medical_genetics.yaml'
2025-08-31T08:28:51,212   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_miscellaneous.yaml'
2025-08-31T08:28:51,213   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_disputes.yaml'
2025-08-31T08:28:51,214   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_scenarios.yaml'
2025-08-31T08:28:51,216   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_nutrition.yaml'
2025-08-31T08:28:51,217   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_philosophy.yaml'
2025-08-31T08:28:51,218   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_prehistory.yaml'
2025-08-31T08:28:51,219   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_accounting.yaml'
2025-08-31T08:28:51,220   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_law.yaml'
2025-08-31T08:28:51,222   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_medicine.yaml'
2025-08-31T08:28:51,223   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_psychology.yaml'
2025-08-31T08:28:51,224   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_public_relations.yaml'
2025-08-31T08:28:51,226   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_security_studies.yaml'
2025-08-31T08:28:51,227   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_sociology.yaml'
2025-08-31T08:28:51,229   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_us_foreign_policy.yaml'
2025-08-31T08:28:51,231   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_virology.yaml'
2025-08-31T08:28:51,233   adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_world_religions.yaml'
2025-08-31T08:28:51,234   adding 'lm_eval/tasks/global_mmlu/full/sw/utils.py'
2025-08-31T08:28:51,237   adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te.yaml'
2025-08-31T08:28:51,238   adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_humanities.yaml'
2025-08-31T08:28:51,239   adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_other.yaml'
2025-08-31T08:28:51,240   adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_social_sciences.yaml'
2025-08-31T08:28:51,242   adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_stem.yaml'
2025-08-31T08:28:51,243   adding 'lm_eval/tasks/global_mmlu/full/te/_te_template_yaml'
2025-08-31T08:28:51,244   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_abstract_algebra.yaml'
2025-08-31T08:28:51,245   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_anatomy.yaml'
2025-08-31T08:28:51,246   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_astronomy.yaml'
2025-08-31T08:28:51,247   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_business_ethics.yaml'
2025-08-31T08:28:51,249   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_clinical_knowledge.yaml'
2025-08-31T08:28:51,250   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_biology.yaml'
2025-08-31T08:28:51,251   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_chemistry.yaml'
2025-08-31T08:28:51,252   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_computer_science.yaml'
2025-08-31T08:28:51,253   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_mathematics.yaml'
2025-08-31T08:28:51,254   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_medicine.yaml'
2025-08-31T08:28:51,255   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_physics.yaml'
2025-08-31T08:28:51,256   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_computer_security.yaml'
2025-08-31T08:28:51,257   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_conceptual_physics.yaml'
2025-08-31T08:28:51,259   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_econometrics.yaml'
2025-08-31T08:28:51,260   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_electrical_engineering.yaml'
2025-08-31T08:28:51,261   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_elementary_mathematics.yaml'
2025-08-31T08:28:51,262   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_formal_logic.yaml'
2025-08-31T08:28:51,263   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_global_facts.yaml'
2025-08-31T08:28:51,264   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_biology.yaml'
2025-08-31T08:28:51,265   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_chemistry.yaml'
2025-08-31T08:28:51,267   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_computer_science.yaml'
2025-08-31T08:28:51,268   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_european_history.yaml'
2025-08-31T08:28:51,269   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_geography.yaml'
2025-08-31T08:28:51,270   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_government_and_politics.yaml'
2025-08-31T08:28:51,271   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_macroeconomics.yaml'
2025-08-31T08:28:51,272   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_mathematics.yaml'
2025-08-31T08:28:51,274   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_microeconomics.yaml'
2025-08-31T08:28:51,275   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_physics.yaml'
2025-08-31T08:28:51,276   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_psychology.yaml'
2025-08-31T08:28:51,277   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_statistics.yaml'
2025-08-31T08:28:51,279   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_us_history.yaml'
2025-08-31T08:28:51,280   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_world_history.yaml'
2025-08-31T08:28:51,281   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_aging.yaml'
2025-08-31T08:28:51,282   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_sexuality.yaml'
2025-08-31T08:28:51,283   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_international_law.yaml'
2025-08-31T08:28:51,284   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_jurisprudence.yaml'
2025-08-31T08:28:51,286   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_logical_fallacies.yaml'
2025-08-31T08:28:51,287   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_machine_learning.yaml'
2025-08-31T08:28:51,288   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_management.yaml'
2025-08-31T08:28:51,289   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_marketing.yaml'
2025-08-31T08:28:51,290   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_medical_genetics.yaml'
2025-08-31T08:28:51,292   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_miscellaneous.yaml'
2025-08-31T08:28:51,293   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_disputes.yaml'
2025-08-31T08:28:51,294   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_scenarios.yaml'
2025-08-31T08:28:51,295   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_nutrition.yaml'
2025-08-31T08:28:51,296   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_philosophy.yaml'
2025-08-31T08:28:51,297   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_prehistory.yaml'
2025-08-31T08:28:51,298   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_accounting.yaml'
2025-08-31T08:28:51,299   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_law.yaml'
2025-08-31T08:28:51,301   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_medicine.yaml'
2025-08-31T08:28:51,302   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_psychology.yaml'
2025-08-31T08:28:51,303   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_public_relations.yaml'
2025-08-31T08:28:51,304   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_security_studies.yaml'
2025-08-31T08:28:51,305   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_sociology.yaml'
2025-08-31T08:28:51,306   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_us_foreign_policy.yaml'
2025-08-31T08:28:51,307   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_virology.yaml'
2025-08-31T08:28:51,309   adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_world_religions.yaml'
2025-08-31T08:28:51,310   adding 'lm_eval/tasks/global_mmlu/full/te/utils.py'
2025-08-31T08:28:51,313   adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr.yaml'
2025-08-31T08:28:51,314   adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_humanities.yaml'
2025-08-31T08:28:51,315   adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_other.yaml'
2025-08-31T08:28:51,316   adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_social_sciences.yaml'
2025-08-31T08:28:51,318   adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_stem.yaml'
2025-08-31T08:28:51,319   adding 'lm_eval/tasks/global_mmlu/full/tr/_tr_template_yaml'
2025-08-31T08:28:51,320   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_abstract_algebra.yaml'
2025-08-31T08:28:51,321   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_anatomy.yaml'
2025-08-31T08:28:51,322   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_astronomy.yaml'
2025-08-31T08:28:51,323   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_business_ethics.yaml'
2025-08-31T08:28:51,324   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_clinical_knowledge.yaml'
2025-08-31T08:28:51,326   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_biology.yaml'
2025-08-31T08:28:51,327   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_chemistry.yaml'
2025-08-31T08:28:51,328   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_computer_science.yaml'
2025-08-31T08:28:51,329   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_mathematics.yaml'
2025-08-31T08:28:51,330   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_medicine.yaml'
2025-08-31T08:28:51,331   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_physics.yaml'
2025-08-31T08:28:51,333   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_computer_security.yaml'
2025-08-31T08:28:51,334   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_conceptual_physics.yaml'
2025-08-31T08:28:51,335   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_econometrics.yaml'
2025-08-31T08:28:51,336   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_electrical_engineering.yaml'
2025-08-31T08:28:51,337   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_elementary_mathematics.yaml'
2025-08-31T08:28:51,338   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_formal_logic.yaml'
2025-08-31T08:28:51,339   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_global_facts.yaml'
2025-08-31T08:28:51,341   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_biology.yaml'
2025-08-31T08:28:51,342   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_chemistry.yaml'
2025-08-31T08:28:51,343   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_computer_science.yaml'
2025-08-31T08:28:51,344   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_european_history.yaml'
2025-08-31T08:28:51,345   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_geography.yaml'
2025-08-31T08:28:51,346   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_government_and_politics.yaml'
2025-08-31T08:28:51,347   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_macroeconomics.yaml'
2025-08-31T08:28:51,348   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_mathematics.yaml'
2025-08-31T08:28:51,349   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_microeconomics.yaml'
2025-08-31T08:28:51,351   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_physics.yaml'
2025-08-31T08:28:51,352   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_psychology.yaml'
2025-08-31T08:28:51,353   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_statistics.yaml'
2025-08-31T08:28:51,354   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_us_history.yaml'
2025-08-31T08:28:51,355   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_world_history.yaml'
2025-08-31T08:28:51,356   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_aging.yaml'
2025-08-31T08:28:51,357   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_sexuality.yaml'
2025-08-31T08:28:51,359   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_international_law.yaml'
2025-08-31T08:28:51,360   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_jurisprudence.yaml'
2025-08-31T08:28:51,361   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_logical_fallacies.yaml'
2025-08-31T08:28:51,362   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_machine_learning.yaml'
2025-08-31T08:28:51,363   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_management.yaml'
2025-08-31T08:28:51,364   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_marketing.yaml'
2025-08-31T08:28:51,365   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_medical_genetics.yaml'
2025-08-31T08:28:51,367   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_miscellaneous.yaml'
2025-08-31T08:28:51,368   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_disputes.yaml'
2025-08-31T08:28:51,369   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_scenarios.yaml'
2025-08-31T08:28:51,370   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_nutrition.yaml'
2025-08-31T08:28:51,372   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_philosophy.yaml'
2025-08-31T08:28:51,373   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_prehistory.yaml'
2025-08-31T08:28:51,374   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_accounting.yaml'
2025-08-31T08:28:51,375   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_law.yaml'
2025-08-31T08:28:51,376   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_medicine.yaml'
2025-08-31T08:28:51,377   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_psychology.yaml'
2025-08-31T08:28:51,378   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_public_relations.yaml'
2025-08-31T08:28:51,379   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_security_studies.yaml'
2025-08-31T08:28:51,380   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_sociology.yaml'
2025-08-31T08:28:51,381   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_us_foreign_policy.yaml'
2025-08-31T08:28:51,382   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_virology.yaml'
2025-08-31T08:28:51,383   adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_world_religions.yaml'
2025-08-31T08:28:51,384   adding 'lm_eval/tasks/global_mmlu/full/tr/utils.py'
2025-08-31T08:28:51,387   adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk.yaml'
2025-08-31T08:28:51,388   adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_humanities.yaml'
2025-08-31T08:28:51,390   adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_other.yaml'
2025-08-31T08:28:51,391   adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_social_sciences.yaml'
2025-08-31T08:28:51,392   adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_stem.yaml'
2025-08-31T08:28:51,393   adding 'lm_eval/tasks/global_mmlu/full/uk/_uk_template_yaml'
2025-08-31T08:28:51,394   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_abstract_algebra.yaml'
2025-08-31T08:28:51,395   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_anatomy.yaml'
2025-08-31T08:28:51,397   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_astronomy.yaml'
2025-08-31T08:28:51,398   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_business_ethics.yaml'
2025-08-31T08:28:51,399   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_clinical_knowledge.yaml'
2025-08-31T08:28:51,400   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_biology.yaml'
2025-08-31T08:28:51,401   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_chemistry.yaml'
2025-08-31T08:28:51,402   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_computer_science.yaml'
2025-08-31T08:28:51,403   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_mathematics.yaml'
2025-08-31T08:28:51,404   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_medicine.yaml'
2025-08-31T08:28:51,405   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_physics.yaml'
2025-08-31T08:28:51,407   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_computer_security.yaml'
2025-08-31T08:28:51,408   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_conceptual_physics.yaml'
2025-08-31T08:28:51,409   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_econometrics.yaml'
2025-08-31T08:28:51,410   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_electrical_engineering.yaml'
2025-08-31T08:28:51,411   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_elementary_mathematics.yaml'
2025-08-31T08:28:51,413   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_formal_logic.yaml'
2025-08-31T08:28:51,414   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_global_facts.yaml'
2025-08-31T08:28:51,415   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_biology.yaml'
2025-08-31T08:28:51,416   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_chemistry.yaml'
2025-08-31T08:28:51,417   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_computer_science.yaml'
2025-08-31T08:28:51,418   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_european_history.yaml'
2025-08-31T08:28:51,419   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_geography.yaml'
2025-08-31T08:28:51,421   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_government_and_politics.yaml'
2025-08-31T08:28:51,422   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_macroeconomics.yaml'
2025-08-31T08:28:51,423   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_mathematics.yaml'
2025-08-31T08:28:51,424   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_microeconomics.yaml'
2025-08-31T08:28:51,425   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_physics.yaml'
2025-08-31T08:28:51,426   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_psychology.yaml'
2025-08-31T08:28:51,427   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_statistics.yaml'
2025-08-31T08:28:51,428   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_us_history.yaml'
2025-08-31T08:28:51,429   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_world_history.yaml'
2025-08-31T08:28:51,430   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_aging.yaml'
2025-08-31T08:28:51,431   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_sexuality.yaml'
2025-08-31T08:28:51,433   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_international_law.yaml'
2025-08-31T08:28:51,434   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_jurisprudence.yaml'
2025-08-31T08:28:51,435   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_logical_fallacies.yaml'
2025-08-31T08:28:51,436   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_machine_learning.yaml'
2025-08-31T08:28:51,437   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_management.yaml'
2025-08-31T08:28:51,438   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_marketing.yaml'
2025-08-31T08:28:51,440   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_medical_genetics.yaml'
2025-08-31T08:28:51,441   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_miscellaneous.yaml'
2025-08-31T08:28:51,442   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_disputes.yaml'
2025-08-31T08:28:51,443   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_scenarios.yaml'
2025-08-31T08:28:51,444   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_nutrition.yaml'
2025-08-31T08:28:51,445   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_philosophy.yaml'
2025-08-31T08:28:51,446   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_prehistory.yaml'
2025-08-31T08:28:51,448   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_accounting.yaml'
2025-08-31T08:28:51,449   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_law.yaml'
2025-08-31T08:28:51,450   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_medicine.yaml'
2025-08-31T08:28:51,451   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_psychology.yaml'
2025-08-31T08:28:51,452   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_public_relations.yaml'
2025-08-31T08:28:51,453   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_security_studies.yaml'
2025-08-31T08:28:51,455   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_sociology.yaml'
2025-08-31T08:28:51,456   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_us_foreign_policy.yaml'
2025-08-31T08:28:51,457   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_virology.yaml'
2025-08-31T08:28:51,458   adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_world_religions.yaml'
2025-08-31T08:28:51,459   adding 'lm_eval/tasks/global_mmlu/full/uk/utils.py'
2025-08-31T08:28:51,462   adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi.yaml'
2025-08-31T08:28:51,463   adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_humanities.yaml'
2025-08-31T08:28:51,464   adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_other.yaml'
2025-08-31T08:28:51,466   adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_social_sciences.yaml'
2025-08-31T08:28:51,467   adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_stem.yaml'
2025-08-31T08:28:51,468   adding 'lm_eval/tasks/global_mmlu/full/vi/_vi_template_yaml'
2025-08-31T08:28:51,469   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_abstract_algebra.yaml'
2025-08-31T08:28:51,470   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_anatomy.yaml'
2025-08-31T08:28:51,471   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_astronomy.yaml'
2025-08-31T08:28:51,472   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_business_ethics.yaml'
2025-08-31T08:28:51,473   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_clinical_knowledge.yaml'
2025-08-31T08:28:51,474   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_biology.yaml'
2025-08-31T08:28:51,475   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_chemistry.yaml'
2025-08-31T08:28:51,477   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_computer_science.yaml'
2025-08-31T08:28:51,478   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_mathematics.yaml'
2025-08-31T08:28:51,479   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_medicine.yaml'
2025-08-31T08:28:51,480   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_physics.yaml'
2025-08-31T08:28:51,481   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_computer_security.yaml'
2025-08-31T08:28:51,482   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_conceptual_physics.yaml'
2025-08-31T08:28:51,483   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_econometrics.yaml'
2025-08-31T08:28:51,484   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_electrical_engineering.yaml'
2025-08-31T08:28:51,486   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_elementary_mathematics.yaml'
2025-08-31T08:28:51,487   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_formal_logic.yaml'
2025-08-31T08:28:51,488   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_global_facts.yaml'
2025-08-31T08:28:51,489   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_biology.yaml'
2025-08-31T08:28:51,490   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_chemistry.yaml'
2025-08-31T08:28:51,491   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_computer_science.yaml'
2025-08-31T08:28:51,493   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_european_history.yaml'
2025-08-31T08:28:51,494   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_geography.yaml'
2025-08-31T08:28:51,495   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_government_and_politics.yaml'
2025-08-31T08:28:51,496   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_macroeconomics.yaml'
2025-08-31T08:28:51,497   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_mathematics.yaml'
2025-08-31T08:28:51,498   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_microeconomics.yaml'
2025-08-31T08:28:51,500   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_physics.yaml'
2025-08-31T08:28:51,501   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_psychology.yaml'
2025-08-31T08:28:51,502   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_statistics.yaml'
2025-08-31T08:28:51,503   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_us_history.yaml'
2025-08-31T08:28:51,504   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_world_history.yaml'
2025-08-31T08:28:51,505   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_aging.yaml'
2025-08-31T08:28:51,507   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_sexuality.yaml'
2025-08-31T08:28:51,508   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_international_law.yaml'
2025-08-31T08:28:51,509   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_jurisprudence.yaml'
2025-08-31T08:28:51,510   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_logical_fallacies.yaml'
2025-08-31T08:28:51,511   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_machine_learning.yaml'
2025-08-31T08:28:51,512   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_management.yaml'
2025-08-31T08:28:51,513   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_marketing.yaml'
2025-08-31T08:28:51,514   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_medical_genetics.yaml'
2025-08-31T08:28:51,515   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_miscellaneous.yaml'
2025-08-31T08:28:51,516   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_disputes.yaml'
2025-08-31T08:28:51,517   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_scenarios.yaml'
2025-08-31T08:28:51,518   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_nutrition.yaml'
2025-08-31T08:28:51,520   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_philosophy.yaml'
2025-08-31T08:28:51,521   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_prehistory.yaml'
2025-08-31T08:28:51,522   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_accounting.yaml'
2025-08-31T08:28:51,523   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_law.yaml'
2025-08-31T08:28:51,524   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_medicine.yaml'
2025-08-31T08:28:51,525   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_psychology.yaml'
2025-08-31T08:28:51,526   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_public_relations.yaml'
2025-08-31T08:28:51,527   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_security_studies.yaml'
2025-08-31T08:28:51,528   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_sociology.yaml'
2025-08-31T08:28:51,529   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_us_foreign_policy.yaml'
2025-08-31T08:28:51,531   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_virology.yaml'
2025-08-31T08:28:51,532   adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_world_religions.yaml'
2025-08-31T08:28:51,533   adding 'lm_eval/tasks/global_mmlu/full/vi/utils.py'
2025-08-31T08:28:51,536   adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo.yaml'
2025-08-31T08:28:51,537   adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_humanities.yaml'
2025-08-31T08:28:51,538   adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_other.yaml'
2025-08-31T08:28:51,539   adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_social_sciences.yaml'
2025-08-31T08:28:51,541   adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_stem.yaml'
2025-08-31T08:28:51,542   adding 'lm_eval/tasks/global_mmlu/full/yo/_yo_template_yaml'
2025-08-31T08:28:51,543   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_abstract_algebra.yaml'
2025-08-31T08:28:51,544   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_anatomy.yaml'
2025-08-31T08:28:51,546   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_astronomy.yaml'
2025-08-31T08:28:51,547   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_business_ethics.yaml'
2025-08-31T08:28:51,548   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_clinical_knowledge.yaml'
2025-08-31T08:28:51,549   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_biology.yaml'
2025-08-31T08:28:51,550   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_chemistry.yaml'
2025-08-31T08:28:51,551   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_computer_science.yaml'
2025-08-31T08:28:51,552   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_mathematics.yaml'
2025-08-31T08:28:51,553   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_medicine.yaml'
2025-08-31T08:28:51,554   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_physics.yaml'
2025-08-31T08:28:51,555   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_computer_security.yaml'
2025-08-31T08:28:51,557   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_conceptual_physics.yaml'
2025-08-31T08:28:51,558   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_econometrics.yaml'
2025-08-31T08:28:51,559   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_electrical_engineering.yaml'
2025-08-31T08:28:51,560   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_elementary_mathematics.yaml'
2025-08-31T08:28:51,561   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_formal_logic.yaml'
2025-08-31T08:28:51,562   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_global_facts.yaml'
2025-08-31T08:28:51,563   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_biology.yaml'
2025-08-31T08:28:51,564   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_chemistry.yaml'
2025-08-31T08:28:51,565   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_computer_science.yaml'
2025-08-31T08:28:51,566   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_european_history.yaml'
2025-08-31T08:28:51,567   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_geography.yaml'
2025-08-31T08:28:51,569   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_government_and_politics.yaml'
2025-08-31T08:28:51,570   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_macroeconomics.yaml'
2025-08-31T08:28:51,571   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_mathematics.yaml'
2025-08-31T08:28:51,572   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_microeconomics.yaml'
2025-08-31T08:28:51,573   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_physics.yaml'
2025-08-31T08:28:51,574   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_psychology.yaml'
2025-08-31T08:28:51,575   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_statistics.yaml'
2025-08-31T08:28:51,576   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_us_history.yaml'
2025-08-31T08:28:51,577   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_world_history.yaml'
2025-08-31T08:28:51,579   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_aging.yaml'
2025-08-31T08:28:51,580   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_sexuality.yaml'
2025-08-31T08:28:51,581   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_international_law.yaml'
2025-08-31T08:28:51,582   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_jurisprudence.yaml'
2025-08-31T08:28:51,583   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_logical_fallacies.yaml'
2025-08-31T08:28:51,584   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_machine_learning.yaml'
2025-08-31T08:28:51,585   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_management.yaml'
2025-08-31T08:28:51,587   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_marketing.yaml'
2025-08-31T08:28:51,588   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_medical_genetics.yaml'
2025-08-31T08:28:51,589   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_miscellaneous.yaml'
2025-08-31T08:28:51,590   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_disputes.yaml'
2025-08-31T08:28:51,591   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_scenarios.yaml'
2025-08-31T08:28:51,592   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_nutrition.yaml'
2025-08-31T08:28:51,594   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_philosophy.yaml'
2025-08-31T08:28:51,595   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_prehistory.yaml'
2025-08-31T08:28:51,596   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_accounting.yaml'
2025-08-31T08:28:51,597   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_law.yaml'
2025-08-31T08:28:51,598   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_medicine.yaml'
2025-08-31T08:28:51,599   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_psychology.yaml'
2025-08-31T08:28:51,600   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_public_relations.yaml'
2025-08-31T08:28:51,601   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_security_studies.yaml'
2025-08-31T08:28:51,603   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_sociology.yaml'
2025-08-31T08:28:51,604   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_us_foreign_policy.yaml'
2025-08-31T08:28:51,605   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_virology.yaml'
2025-08-31T08:28:51,606   adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_world_religions.yaml'
2025-08-31T08:28:51,607   adding 'lm_eval/tasks/global_mmlu/full/yo/utils.py'
2025-08-31T08:28:51,610   adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh.yaml'
2025-08-31T08:28:51,611   adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_humanities.yaml'
2025-08-31T08:28:51,613   adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_other.yaml'
2025-08-31T08:28:51,614   adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_social_sciences.yaml'
2025-08-31T08:28:51,615   adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_stem.yaml'
2025-08-31T08:28:51,616   adding 'lm_eval/tasks/global_mmlu/full/zh/_zh_template_yaml'
2025-08-31T08:28:51,617   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_abstract_algebra.yaml'
2025-08-31T08:28:51,618   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_anatomy.yaml'
2025-08-31T08:28:51,619   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_astronomy.yaml'
2025-08-31T08:28:51,621   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_business_ethics.yaml'
2025-08-31T08:28:51,622   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_clinical_knowledge.yaml'
2025-08-31T08:28:51,623   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_biology.yaml'
2025-08-31T08:28:51,624   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_chemistry.yaml'
2025-08-31T08:28:51,625   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_computer_science.yaml'
2025-08-31T08:28:51,626   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_mathematics.yaml'
2025-08-31T08:28:51,627   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_medicine.yaml'
2025-08-31T08:28:51,629   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_physics.yaml'
2025-08-31T08:28:51,630   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_computer_security.yaml'
2025-08-31T08:28:51,631   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_conceptual_physics.yaml'
2025-08-31T08:28:51,632   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_econometrics.yaml'
2025-08-31T08:28:51,633   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_electrical_engineering.yaml'
2025-08-31T08:28:51,634   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_elementary_mathematics.yaml'
2025-08-31T08:28:51,636   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_formal_logic.yaml'
2025-08-31T08:28:51,637   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_global_facts.yaml'
2025-08-31T08:28:51,638   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_biology.yaml'
2025-08-31T08:28:51,639   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_chemistry.yaml'
2025-08-31T08:28:51,640   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_computer_science.yaml'
2025-08-31T08:28:51,641   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_european_history.yaml'
2025-08-31T08:28:51,642   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_geography.yaml'
2025-08-31T08:28:51,643   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_government_and_politics.yaml'
2025-08-31T08:28:51,644   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_macroeconomics.yaml'
2025-08-31T08:28:51,646   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_mathematics.yaml'
2025-08-31T08:28:51,647   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_microeconomics.yaml'
2025-08-31T08:28:51,648   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_physics.yaml'
2025-08-31T08:28:51,649   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_psychology.yaml'
2025-08-31T08:28:51,650   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_statistics.yaml'
2025-08-31T08:28:51,651   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_us_history.yaml'
2025-08-31T08:28:51,652   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_world_history.yaml'
2025-08-31T08:28:51,653   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_aging.yaml'
2025-08-31T08:28:51,655   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_sexuality.yaml'
2025-08-31T08:28:51,656   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_international_law.yaml'
2025-08-31T08:28:51,657   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_jurisprudence.yaml'
2025-08-31T08:28:51,658   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_logical_fallacies.yaml'
2025-08-31T08:28:51,659   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_machine_learning.yaml'
2025-08-31T08:28:51,660   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_management.yaml'
2025-08-31T08:28:51,662   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_marketing.yaml'
2025-08-31T08:28:51,663   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_medical_genetics.yaml'
2025-08-31T08:28:51,664   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_miscellaneous.yaml'
2025-08-31T08:28:51,665   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_disputes.yaml'
2025-08-31T08:28:51,666   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_scenarios.yaml'
2025-08-31T08:28:51,667   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_nutrition.yaml'
2025-08-31T08:28:51,668   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_philosophy.yaml'
2025-08-31T08:28:51,670   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_prehistory.yaml'
2025-08-31T08:28:51,671   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_accounting.yaml'
2025-08-31T08:28:51,673   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_law.yaml'
2025-08-31T08:28:51,674   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_medicine.yaml'
2025-08-31T08:28:51,675   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_psychology.yaml'
2025-08-31T08:28:51,676   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_public_relations.yaml'
2025-08-31T08:28:51,678   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_security_studies.yaml'
2025-08-31T08:28:51,679   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_sociology.yaml'
2025-08-31T08:28:51,680   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_us_foreign_policy.yaml'
2025-08-31T08:28:51,681   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_virology.yaml'
2025-08-31T08:28:51,682   adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_world_religions.yaml'
2025-08-31T08:28:51,683   adding 'lm_eval/tasks/global_mmlu/full/zh/utils.py'
2025-08-31T08:28:51,685   adding 'lm_eval/tasks/glue/README.md'
2025-08-31T08:28:51,687   adding 'lm_eval/tasks/glue/cola/default.yaml'
2025-08-31T08:28:51,689   adding 'lm_eval/tasks/glue/mnli/default.yaml'
2025-08-31T08:28:51,690   adding 'lm_eval/tasks/glue/mnli/mismatch.yaml'
2025-08-31T08:28:51,691   adding 'lm_eval/tasks/glue/mnli/utils.py'
2025-08-31T08:28:51,692   adding 'lm_eval/tasks/glue/mrpc/default.yaml'
2025-08-31T08:28:51,694   adding 'lm_eval/tasks/glue/qnli/default.yaml'
2025-08-31T08:28:51,696   adding 'lm_eval/tasks/glue/qqp/default.yaml'
2025-08-31T08:28:51,697   adding 'lm_eval/tasks/glue/rte/default.yaml'
2025-08-31T08:28:51,699   adding 'lm_eval/tasks/glue/sst2/default.yaml'
2025-08-31T08:28:51,701   adding 'lm_eval/tasks/glue/wnli/default.yaml'
2025-08-31T08:28:51,703   adding 'lm_eval/tasks/gpqa/README.md'
2025-08-31T08:28:51,705   adding 'lm_eval/tasks/gpqa/cot_n_shot/_generate_configs.py'
2025-08-31T08:28:51,706   adding 'lm_eval/tasks/gpqa/cot_n_shot/_gpqa_cot_n_shot_yaml'
2025-08-31T08:28:51,707   adding 'lm_eval/tasks/gpqa/cot_n_shot/gpqa_diamond_cot_n_shot.yaml'
2025-08-31T08:28:51,708   adding 'lm_eval/tasks/gpqa/cot_n_shot/gpqa_extended_cot_n_shot.yaml'
2025-08-31T08:28:51,709   adding 'lm_eval/tasks/gpqa/cot_n_shot/gpqa_main_cot_n_shot.yaml'
2025-08-31T08:28:51,710   adding 'lm_eval/tasks/gpqa/cot_n_shot/utils.py'
2025-08-31T08:28:51,712   adding 'lm_eval/tasks/gpqa/cot_zeroshot/_generate_configs.py'
2025-08-31T08:28:51,713   adding 'lm_eval/tasks/gpqa/cot_zeroshot/_gpqa_cot_zeroshot_yaml'
2025-08-31T08:28:51,715   adding 'lm_eval/tasks/gpqa/cot_zeroshot/gpqa_diamond_cot_zeroshot.yaml'
2025-08-31T08:28:51,716   adding 'lm_eval/tasks/gpqa/cot_zeroshot/gpqa_extended_cot_zeroshot.yaml'
2025-08-31T08:28:51,717   adding 'lm_eval/tasks/gpqa/cot_zeroshot/gpqa_main_cot_zeroshot.yaml'
2025-08-31T08:28:51,718   adding 'lm_eval/tasks/gpqa/cot_zeroshot/utils.py'
2025-08-31T08:28:51,720   adding 'lm_eval/tasks/gpqa/generative/_generate_configs.py'
2025-08-31T08:28:51,721   adding 'lm_eval/tasks/gpqa/generative/_gpqa_generative_n_shot_yaml'
2025-08-31T08:28:51,722   adding 'lm_eval/tasks/gpqa/generative/gpqa_diamond_generative_n_shot.yaml'
2025-08-31T08:28:51,723   adding 'lm_eval/tasks/gpqa/generative/gpqa_extended_generative_n_shot.yaml'
2025-08-31T08:28:51,725   adding 'lm_eval/tasks/gpqa/generative/gpqa_main_generative_n_shot.yaml'
2025-08-31T08:28:51,726   adding 'lm_eval/tasks/gpqa/generative/utils.py'
2025-08-31T08:28:51,728   adding 'lm_eval/tasks/gpqa/n_shot/_generate_configs.py'
2025-08-31T08:28:51,729   adding 'lm_eval/tasks/gpqa/n_shot/_gpqa_n_shot_yaml'
2025-08-31T08:28:51,730   adding 'lm_eval/tasks/gpqa/n_shot/gpqa_diamond_n_shot.yaml'
2025-08-31T08:28:51,731   adding 'lm_eval/tasks/gpqa/n_shot/gpqa_extended_n_shot.yaml'
2025-08-31T08:28:51,732   adding 'lm_eval/tasks/gpqa/n_shot/gpqa_main_n_shot.yaml'
2025-08-31T08:28:51,733   adding 'lm_eval/tasks/gpqa/n_shot/utils.py'
2025-08-31T08:28:51,735   adding 'lm_eval/tasks/gpqa/zeroshot/_generate_configs.py'
2025-08-31T08:28:51,737   adding 'lm_eval/tasks/gpqa/zeroshot/_gpqa_zeroshot_yaml'
2025-08-31T08:28:51,738   adding 'lm_eval/tasks/gpqa/zeroshot/gpqa_diamond_zeroshot.yaml'
2025-08-31T08:28:51,739   adding 'lm_eval/tasks/gpqa/zeroshot/gpqa_extended_zeroshot.yaml'
2025-08-31T08:28:51,740   adding 'lm_eval/tasks/gpqa/zeroshot/gpqa_main_zeroshot.yaml'
2025-08-31T08:28:51,741   adding 'lm_eval/tasks/gpqa/zeroshot/utils.py'
2025-08-31T08:28:51,743   adding 'lm_eval/tasks/groundcocoa/README.md'
2025-08-31T08:28:51,744   adding 'lm_eval/tasks/groundcocoa/groundcocoa.yaml'
2025-08-31T08:28:51,746   adding 'lm_eval/tasks/groundcocoa/utils.py'
2025-08-31T08:28:51,747   adding 'lm_eval/tasks/gsm8k/README.md'
2025-08-31T08:28:51,749   adding 'lm_eval/tasks/gsm8k/gsm8k-cot-llama.yaml'
2025-08-31T08:28:51,750   adding 'lm_eval/tasks/gsm8k/gsm8k-cot-self-consistency.yaml'
2025-08-31T08:28:51,751   adding 'lm_eval/tasks/gsm8k/gsm8k-cot-zeroshot.yaml'
2025-08-31T08:28:51,752   adding 'lm_eval/tasks/gsm8k/gsm8k-cot.yaml'
2025-08-31T08:28:51,753   adding 'lm_eval/tasks/gsm8k/gsm8k.yaml'
2025-08-31T08:28:51,755   adding 'lm_eval/tasks/gsm8k_platinum/README.md'
2025-08-31T08:28:51,757   adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-llama.yaml'
2025-08-31T08:28:51,758   adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-self-consistency.yaml'
2025-08-31T08:28:51,759   adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-zeroshot.yaml'
2025-08-31T08:28:51,761   adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot.yaml'
2025-08-31T08:28:51,762   adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum.yaml'
2025-08-31T08:28:51,764   adding 'lm_eval/tasks/gsm_plus/README.md'
2025-08-31T08:28:51,765   adding 'lm_eval/tasks/gsm_plus/gsm_plus.yaml'
2025-08-31T08:28:51,766   adding 'lm_eval/tasks/gsm_plus/gsm_plus_mini.yaml'
2025-08-31T08:28:51,768   adding 'lm_eval/tasks/haerae/README.md'
2025-08-31T08:28:51,769   adding 'lm_eval/tasks/haerae/_default_haerae_yaml'
2025-08-31T08:28:51,770   adding 'lm_eval/tasks/haerae/_haerae.yaml'
2025-08-31T08:28:51,771   adding 'lm_eval/tasks/haerae/haerae_gk.yaml'
2025-08-31T08:28:51,772   adding 'lm_eval/tasks/haerae/haerae_hi.yaml'
2025-08-31T08:28:51,773   adding 'lm_eval/tasks/haerae/haerae_lw.yaml'
2025-08-31T08:28:51,774   adding 'lm_eval/tasks/haerae/haerae_rw.yaml'
2025-08-31T08:28:51,775   adding 'lm_eval/tasks/haerae/haerae_sn.yaml'
2025-08-31T08:28:51,777   adding 'lm_eval/tasks/headqa/README.md'
2025-08-31T08:28:51,778   adding 'lm_eval/tasks/headqa/headqa_en.yaml'
2025-08-31T08:28:51,780   adding 'lm_eval/tasks/headqa/headqa_es.yaml'
2025-08-31T08:28:51,781   adding 'lm_eval/tasks/hellaswag/README.md'
2025-08-31T08:28:51,783   adding 'lm_eval/tasks/hellaswag/hellaswag.yaml'
2025-08-31T08:28:51,784   adding 'lm_eval/tasks/hellaswag/utils.py'
2025-08-31T08:28:51,786   adding 'lm_eval/tasks/hendrycks_ethics/README.md'
2025-08-31T08:28:51,787   adding 'lm_eval/tasks/hendrycks_ethics/commonsense.yaml'
2025-08-31T08:28:51,788   adding 'lm_eval/tasks/hendrycks_ethics/deontology.yaml'
2025-08-31T08:28:51,789   adding 'lm_eval/tasks/hendrycks_ethics/justice.yaml'
2025-08-31T08:28:51,790   adding 'lm_eval/tasks/hendrycks_ethics/utilitarianism.yaml'
2025-08-31T08:28:51,792   adding 'lm_eval/tasks/hendrycks_ethics/utilitarianism_original_yaml'
2025-08-31T08:28:51,793   adding 'lm_eval/tasks/hendrycks_ethics/utils.py'
2025-08-31T08:28:51,794   adding 'lm_eval/tasks/hendrycks_ethics/virtue.yaml'
2025-08-31T08:28:51,796   adding 'lm_eval/tasks/hendrycks_math/README.md'
2025-08-31T08:28:51,797   adding 'lm_eval/tasks/hendrycks_math/hendrycks_math.yaml'
2025-08-31T08:28:51,798   adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_algebra.yaml'
2025-08-31T08:28:51,799   adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_counting_and_prob.yaml'
2025-08-31T08:28:51,800   adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_geometry.yaml'
2025-08-31T08:28:51,802   adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_intermediate_algebra.yaml'
2025-08-31T08:28:51,803   adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_num_theory.yaml'
2025-08-31T08:28:51,804   adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_prealgebra.yaml'
2025-08-31T08:28:51,805   adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_precalc.yaml'
2025-08-31T08:28:51,807   adding 'lm_eval/tasks/hendrycks_math/utils.py'
2025-08-31T08:28:51,809   adding 'lm_eval/tasks/histoires_morales/README.md'
2025-08-31T08:28:51,810   adding 'lm_eval/tasks/histoires_morales/histoires_morales.yaml'
2025-08-31T08:28:51,811   adding 'lm_eval/tasks/histoires_morales/utils.py'
2025-08-31T08:28:51,813   adding 'lm_eval/tasks/hrm8k/README.md'
2025-08-31T08:28:51,815   adding 'lm_eval/tasks/hrm8k/default/_hrm8k_yaml'
2025-08-31T08:28:51,816   adding 'lm_eval/tasks/hrm8k/default/hrm8k.yaml'
2025-08-31T08:28:51,817   adding 'lm_eval/tasks/hrm8k/default/hrm8k_gsm8k.yaml'
2025-08-31T08:28:51,818   adding 'lm_eval/tasks/hrm8k/default/hrm8k_ksm.yaml'
2025-08-31T08:28:51,819   adding 'lm_eval/tasks/hrm8k/default/hrm8k_math.yaml'
2025-08-31T08:28:51,820   adding 'lm_eval/tasks/hrm8k/default/hrm8k_mmmlu.yaml'
2025-08-31T08:28:51,821   adding 'lm_eval/tasks/hrm8k/default/hrm8k_omni_math.yaml'
2025-08-31T08:28:51,823   adding 'lm_eval/tasks/hrm8k/default/utils.py'
2025-08-31T08:28:51,824   adding 'lm_eval/tasks/hrm8k/en/_hrm8k_en_yaml'
2025-08-31T08:28:51,825   adding 'lm_eval/tasks/hrm8k/en/hrm8k_en.yaml'
2025-08-31T08:28:51,827   adding 'lm_eval/tasks/hrm8k/en/hrm8k_gsm8k_en.yaml'
2025-08-31T08:28:51,828   adding 'lm_eval/tasks/hrm8k/en/hrm8k_ksm_en.yaml'
2025-08-31T08:28:51,829   adding 'lm_eval/tasks/hrm8k/en/hrm8k_math_en.yaml'
2025-08-31T08:28:51,830   adding 'lm_eval/tasks/hrm8k/en/hrm8k_mmmlu_en.yaml'
2025-08-31T08:28:51,831   adding 'lm_eval/tasks/hrm8k/en/hrm8k_omni_math_en.yaml'
2025-08-31T08:28:51,833   adding 'lm_eval/tasks/hrm8k/en/utils.py'
2025-08-31T08:28:51,835   adding 'lm_eval/tasks/humaneval/README.md'
2025-08-31T08:28:51,836   adding 'lm_eval/tasks/humaneval/humaneval.yaml'
2025-08-31T08:28:51,838   adding 'lm_eval/tasks/humaneval/humaneval_64.yaml'
2025-08-31T08:28:51,839   adding 'lm_eval/tasks/humaneval/humaneval_64_instruct.yaml'
2025-08-31T08:28:51,840   adding 'lm_eval/tasks/humaneval/humaneval_instruct.yaml'
2025-08-31T08:28:51,841   adding 'lm_eval/tasks/humaneval/humaneval_plus.yaml'
2025-08-31T08:28:51,842   adding 'lm_eval/tasks/humaneval/utils.py'
2025-08-31T08:28:51,844   adding 'lm_eval/tasks/ifeval/README.md'
2025-08-31T08:28:51,845   adding 'lm_eval/tasks/ifeval/ifeval.yaml'
2025-08-31T08:28:51,851   adding 'lm_eval/tasks/ifeval/instructions.py'
2025-08-31T08:28:51,853   adding 'lm_eval/tasks/ifeval/instructions_registry.py'
2025-08-31T08:28:51,856   adding 'lm_eval/tasks/ifeval/instructions_util.py'
2025-08-31T08:28:51,857   adding 'lm_eval/tasks/ifeval/utils.py'
2025-08-31T08:28:51,860   adding 'lm_eval/tasks/include/README.md'
2025-08-31T08:28:51,862   adding 'lm_eval/tasks/include/default/Albanian/_albanian_template_yaml'
2025-08-31T08:28:51,863   adding 'lm_eval/tasks/include/default/Albanian/_include_base_44_albanian.yaml'
2025-08-31T08:28:51,865   adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_arts_humanities.yaml'
2025-08-31T08:28:51,866   adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_business_commerce.yaml'
2025-08-31T08:28:51,867   adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_health_oriented_education.yaml'
2025-08-31T08:28:51,868   adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_social_science.yaml'
2025-08-31T08:28:51,869   adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_stem.yaml'
2025-08-31T08:28:51,870   adding 'lm_eval/tasks/include/default/Albanian/utils.py'
2025-08-31T08:28:51,872   adding 'lm_eval/tasks/include/default/Arabic/_arabic_template_yaml'
2025-08-31T08:28:51,873   adding 'lm_eval/tasks/include/default/Arabic/_include_base_44_arabic.yaml'
2025-08-31T08:28:51,874   adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_arts_humanities.yaml'
2025-08-31T08:28:51,875   adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_business_commerce.yaml'
2025-08-31T08:28:51,876   adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_driving_license.yaml'
2025-08-31T08:28:51,878   adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_general_knowledge.yaml'
2025-08-31T08:28:51,879   adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_social_science.yaml'
2025-08-31T08:28:51,880   adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_stem.yaml'
2025-08-31T08:28:51,881   adding 'lm_eval/tasks/include/default/Arabic/utils.py'
2025-08-31T08:28:51,883   adding 'lm_eval/tasks/include/default/Armenian/_armenian_template_yaml'
2025-08-31T08:28:51,884   adding 'lm_eval/tasks/include/default/Armenian/_include_base_44_armenian.yaml'
2025-08-31T08:28:51,885   adding 'lm_eval/tasks/include/default/Armenian/include_base_44_armenian_arts_humanities.yaml'
2025-08-31T08:28:51,886   adding 'lm_eval/tasks/include/default/Armenian/include_base_44_armenian_driving_license.yaml'
2025-08-31T08:28:51,887   adding 'lm_eval/tasks/include/default/Armenian/include_base_44_armenian_social_science.yaml'
2025-08-31T08:28:51,888   adding 'lm_eval/tasks/include/default/Armenian/include_base_44_armenian_stem.yaml'
2025-08-31T08:28:51,889   adding 'lm_eval/tasks/include/default/Armenian/utils.py'
2025-08-31T08:28:51,891   adding 'lm_eval/tasks/include/default/Azerbaijani/_azerbaijani_template_yaml'
2025-08-31T08:28:51,892   adding 'lm_eval/tasks/include/default/Azerbaijani/_include_base_44_azerbaijani.yaml'
2025-08-31T08:28:51,893   adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml'
2025-08-31T08:28:51,894   adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml'
2025-08-31T08:28:51,895   adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml'
2025-08-31T08:28:51,896   adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml'
2025-08-31T08:28:51,898   adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_social_science.yaml'
2025-08-31T08:28:51,899   adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_stem.yaml'
2025-08-31T08:28:51,900   adding 'lm_eval/tasks/include/default/Azerbaijani/utils.py'
2025-08-31T08:28:51,902   adding 'lm_eval/tasks/include/default/Basque/_basque_template_yaml'
2025-08-31T08:28:51,903   adding 'lm_eval/tasks/include/default/Basque/_include_base_44_basque.yaml'
2025-08-31T08:28:51,904   adding 'lm_eval/tasks/include/default/Basque/include_base_44_basque_professional_certification.yaml'
2025-08-31T08:28:51,905   adding 'lm_eval/tasks/include/default/Basque/utils.py'
2025-08-31T08:28:51,907   adding 'lm_eval/tasks/include/default/Belarusian/_belarusian_template_yaml'
2025-08-31T08:28:51,908   adding 'lm_eval/tasks/include/default/Belarusian/_include_base_44_belarusian.yaml'
2025-08-31T08:28:51,909   adding 'lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_arts_humanities.yaml'
2025-08-31T08:28:51,910   adding 'lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_social_science.yaml'
2025-08-31T08:28:51,911   adding 'lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_stem.yaml'
2025-08-31T08:28:51,912   adding 'lm_eval/tasks/include/default/Belarusian/utils.py'
2025-08-31T08:28:51,914   adding 'lm_eval/tasks/include/default/Bengali/_bengali_template_yaml'
2025-08-31T08:28:51,915   adding 'lm_eval/tasks/include/default/Bengali/_include_base_44_bengali.yaml'
2025-08-31T08:28:51,916   adding 'lm_eval/tasks/include/default/Bengali/include_base_44_bengali_arts_humanities.yaml'
2025-08-31T08:28:51,918   adding 'lm_eval/tasks/include/default/Bengali/include_base_44_bengali_general_knowledge.yaml'
2025-08-31T08:28:51,919   adding 'lm_eval/tasks/include/default/Bengali/include_base_44_bengali_professional_certification.yaml'
2025-08-31T08:28:51,920   adding 'lm_eval/tasks/include/default/Bengali/include_base_44_bengali_stem.yaml'
2025-08-31T08:28:51,921   adding 'lm_eval/tasks/include/default/Bengali/utils.py'
2025-08-31T08:28:51,923   adding 'lm_eval/tasks/include/default/Bulgarian/_bulgarian_template_yaml'
2025-08-31T08:28:51,924   adding 'lm_eval/tasks/include/default/Bulgarian/_include_base_44_bulgarian.yaml'
2025-08-31T08:28:51,925   adding 'lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml'
2025-08-31T08:28:51,926   adding 'lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_social_science.yaml'
2025-08-31T08:28:51,927   adding 'lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_stem.yaml'
2025-08-31T08:28:51,928   adding 'lm_eval/tasks/include/default/Bulgarian/utils.py'
2025-08-31T08:28:51,930   adding 'lm_eval/tasks/include/default/Chinese/_chinese_template_yaml'
2025-08-31T08:28:51,931   adding 'lm_eval/tasks/include/default/Chinese/_include_base_44_chinese.yaml'
2025-08-31T08:28:51,933   adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_applied_science.yaml'
2025-08-31T08:28:51,934   adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_arts_humanities.yaml'
2025-08-31T08:28:51,935   adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_business_commerce.yaml'
2025-08-31T08:28:51,936   adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_driving_license.yaml'
2025-08-31T08:28:51,937   adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_health_oriented_education.yaml'
2025-08-31T08:28:51,938   adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_professional_certification.yaml'
2025-08-31T08:28:51,940   adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_social_science.yaml'
2025-08-31T08:28:51,941   adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_stem.yaml'
2025-08-31T08:28:51,942   adding 'lm_eval/tasks/include/default/Chinese/utils.py'
2025-08-31T08:28:51,943   adding 'lm_eval/tasks/include/default/Croatian/_croatian_template_yaml'
2025-08-31T08:28:51,945   adding 'lm_eval/tasks/include/default/Croatian/_include_base_44_croatian.yaml'
2025-08-31T08:28:51,946   adding 'lm_eval/tasks/include/default/Croatian/include_base_44_croatian_arts_humanities.yaml'
2025-08-31T08:28:51,947   adding 'lm_eval/tasks/include/default/Croatian/include_base_44_croatian_social_science.yaml'
2025-08-31T08:28:51,948   adding 'lm_eval/tasks/include/default/Croatian/include_base_44_croatian_stem.yaml'
2025-08-31T08:28:51,949   adding 'lm_eval/tasks/include/default/Croatian/utils.py'
2025-08-31T08:28:51,951   adding 'lm_eval/tasks/include/default/Dutch/_dutch_template_yaml'
2025-08-31T08:28:51,952   adding 'lm_eval/tasks/include/default/Dutch/_include_base_44_dutch.yaml'
2025-08-31T08:28:51,953   adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_applied_science.yaml'
2025-08-31T08:28:51,955   adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_arts_humanities.yaml'
2025-08-31T08:28:51,956   adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_health_oriented_education.yaml'
2025-08-31T08:28:51,957   adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_social_science.yaml'
2025-08-31T08:28:51,958   adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_stem.yaml'
2025-08-31T08:28:51,959   adding 'lm_eval/tasks/include/default/Dutch/utils.py'
2025-08-31T08:28:51,961   adding 'lm_eval/tasks/include/default/Estonian/_estonian_template_yaml'
2025-08-31T08:28:51,962   adding 'lm_eval/tasks/include/default/Estonian/_include_base_44_estonian.yaml'
2025-08-31T08:28:51,964   adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_applied_science.yaml'
2025-08-31T08:28:51,965   adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_arts_humanities.yaml'
2025-08-31T08:28:51,966   adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_health_oriented_education.yaml'
2025-08-31T08:28:51,967   adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_social_science.yaml'
2025-08-31T08:28:51,968   adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_stem.yaml'
2025-08-31T08:28:51,970   adding 'lm_eval/tasks/include/default/Estonian/utils.py'
2025-08-31T08:28:51,971   adding 'lm_eval/tasks/include/default/Finnish/_finnish_template_yaml'
2025-08-31T08:28:51,973   adding 'lm_eval/tasks/include/default/Finnish/_include_base_44_finnish.yaml'
2025-08-31T08:28:51,974   adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_applied_science.yaml'
2025-08-31T08:28:51,975   adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_arts_humanities.yaml'
2025-08-31T08:28:51,976   adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_health_oriented_education.yaml'
2025-08-31T08:28:51,977   adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_social_science.yaml'
2025-08-31T08:28:51,978   adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_stem.yaml'
2025-08-31T08:28:51,979   adding 'lm_eval/tasks/include/default/Finnish/utils.py'
2025-08-31T08:28:51,981   adding 'lm_eval/tasks/include/default/French/_french_template_yaml'
2025-08-31T08:28:51,982   adding 'lm_eval/tasks/include/default/French/_include_base_44_french.yaml'
2025-08-31T08:28:51,983   adding 'lm_eval/tasks/include/default/French/include_base_44_french_arts_humanities.yaml'
2025-08-31T08:28:51,984   adding 'lm_eval/tasks/include/default/French/include_base_44_french_driving_license.yaml'
2025-08-31T08:28:51,985   adding 'lm_eval/tasks/include/default/French/include_base_44_french_health_oriented_education.yaml'
2025-08-31T08:28:51,986   adding 'lm_eval/tasks/include/default/French/include_base_44_french_social_science.yaml'
2025-08-31T08:28:51,987   adding 'lm_eval/tasks/include/default/French/include_base_44_french_stem.yaml'
2025-08-31T08:28:51,988   adding 'lm_eval/tasks/include/default/French/utils.py'
2025-08-31T08:28:51,990   adding 'lm_eval/tasks/include/default/Georgian/_georgian_template_yaml'
2025-08-31T08:28:51,991   adding 'lm_eval/tasks/include/default/Georgian/_include_base_44_georgian.yaml'
2025-08-31T08:28:51,992   adding 'lm_eval/tasks/include/default/Georgian/include_base_44_georgian_arts_humanities.yaml'
2025-08-31T08:28:51,993   adding 'lm_eval/tasks/include/default/Georgian/utils.py'
2025-08-31T08:28:51,995   adding 'lm_eval/tasks/include/default/German/_german_template_yaml'
2025-08-31T08:28:51,996   adding 'lm_eval/tasks/include/default/German/_include_base_44_german.yaml'
2025-08-31T08:28:51,997   adding 'lm_eval/tasks/include/default/German/include_base_44_german_driving_license.yaml'
2025-08-31T08:28:51,998   adding 'lm_eval/tasks/include/default/German/include_base_44_german_social_science.yaml'
2025-08-31T08:28:52,000   adding 'lm_eval/tasks/include/default/German/include_base_44_german_stem.yaml'
2025-08-31T08:28:52,001   adding 'lm_eval/tasks/include/default/German/utils.py'
2025-08-31T08:28:52,003   adding 'lm_eval/tasks/include/default/Greek/_greek_template_yaml'
2025-08-31T08:28:52,004   adding 'lm_eval/tasks/include/default/Greek/_include_base_44_greek.yaml'
2025-08-31T08:28:52,005   adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_arts_humanities.yaml'
2025-08-31T08:28:52,006   adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_business_commerce.yaml'
2025-08-31T08:28:52,007   adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_health_oriented_education.yaml'
2025-08-31T08:28:52,008   adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_medical_license.yaml'
2025-08-31T08:28:52,010   adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_professional_certification.yaml'
2025-08-31T08:28:52,011   adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_social_science.yaml'
2025-08-31T08:28:52,012   adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_stem.yaml'
2025-08-31T08:28:52,013   adding 'lm_eval/tasks/include/default/Greek/utils.py'
2025-08-31T08:28:52,015   adding 'lm_eval/tasks/include/default/Hebrew/_hebrew_template_yaml'
2025-08-31T08:28:52,016   adding 'lm_eval/tasks/include/default/Hebrew/_include_base_44_hebrew.yaml'
2025-08-31T08:28:52,017   adding 'lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_arts_humanities.yaml'
2025-08-31T08:28:52,018   adding 'lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_driving_license.yaml'
2025-08-31T08:28:52,020   adding 'lm_eval/tasks/include/default/Hebrew/utils.py'
2025-08-31T08:28:52,021   adding 'lm_eval/tasks/include/default/Hindi/_hindi_template_yaml'
2025-08-31T08:28:52,022   adding 'lm_eval/tasks/include/default/Hindi/_include_base_44_hindi.yaml'
2025-08-31T08:28:52,023   adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_applied_science.yaml'
2025-08-31T08:28:52,024   adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_arts_humanities.yaml'
2025-08-31T08:28:52,026   adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_driving_license.yaml'
2025-08-31T08:28:52,027   adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_general_knowledge.yaml'
2025-08-31T08:28:52,028   adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_health_oriented_education.yaml'
2025-08-31T08:28:52,029   adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_professional_certification.yaml'
2025-08-31T08:28:52,030   adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_social_science.yaml'
2025-08-31T08:28:52,031   adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_stem.yaml'
2025-08-31T08:28:52,032   adding 'lm_eval/tasks/include/default/Hindi/utils.py'
2025-08-31T08:28:52,034   adding 'lm_eval/tasks/include/default/Hungarian/_hungarian_template_yaml'
2025-08-31T08:28:52,035   adding 'lm_eval/tasks/include/default/Hungarian/_include_base_44_hungarian.yaml'
2025-08-31T08:28:52,036   adding 'lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_applied_science.yaml'
2025-08-31T08:28:52,037   adding 'lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_social_science.yaml'
2025-08-31T08:28:52,038   adding 'lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_stem.yaml'
2025-08-31T08:28:52,039   adding 'lm_eval/tasks/include/default/Hungarian/utils.py'
2025-08-31T08:28:52,041   adding 'lm_eval/tasks/include/default/Indonesian/_include_base_44_indonesian.yaml'
2025-08-31T08:28:52,042   adding 'lm_eval/tasks/include/default/Indonesian/_indonesian_template_yaml'
2025-08-31T08:28:52,043   adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_applied_science.yaml'
2025-08-31T08:28:52,045   adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_arts_humanities.yaml'
2025-08-31T08:28:52,046   adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_professional_certification.yaml'
2025-08-31T08:28:52,047   adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_social_science.yaml'
2025-08-31T08:28:52,048   adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_stem.yaml'
2025-08-31T08:28:52,049   adding 'lm_eval/tasks/include/default/Indonesian/utils.py'
2025-08-31T08:28:52,051   adding 'lm_eval/tasks/include/default/Italian/_include_base_44_italian.yaml'
2025-08-31T08:28:52,052   adding 'lm_eval/tasks/include/default/Italian/_italian_template_yaml'
2025-08-31T08:28:52,053   adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_applied_science.yaml'
2025-08-31T08:28:52,054   adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_arts_humanities.yaml'
2025-08-31T08:28:52,056   adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_health_oriented_education.yaml'
2025-08-31T08:28:52,057   adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_professional_certification.yaml'
2025-08-31T08:28:52,058   adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_social_science.yaml'
2025-08-31T08:28:52,059   adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_stem.yaml'
2025-08-31T08:28:52,060   adding 'lm_eval/tasks/include/default/Italian/utils.py'
2025-08-31T08:28:52,062   adding 'lm_eval/tasks/include/default/Japanese/_include_base_44_japanese.yaml'
2025-08-31T08:28:52,063   adding 'lm_eval/tasks/include/default/Japanese/_japanese_template_yaml'
2025-08-31T08:28:52,064   adding 'lm_eval/tasks/include/default/Japanese/include_base_44_japanese_driving_license.yaml'
2025-08-31T08:28:52,065   adding 'lm_eval/tasks/include/default/Japanese/include_base_44_japanese_medical_license.yaml'
2025-08-31T08:28:52,067   adding 'lm_eval/tasks/include/default/Japanese/include_base_44_japanese_professional_certification.yaml'
2025-08-31T08:28:52,068   adding 'lm_eval/tasks/include/default/Japanese/utils.py'
2025-08-31T08:28:52,069   adding 'lm_eval/tasks/include/default/Kazakh/_include_base_44_kazakh.yaml'
2025-08-31T08:28:52,070   adding 'lm_eval/tasks/include/default/Kazakh/_kazakh_template_yaml'
2025-08-31T08:28:52,071   adding 'lm_eval/tasks/include/default/Kazakh/include_base_44_kazakh_arts_humanities.yaml'
2025-08-31T08:28:52,072   adding 'lm_eval/tasks/include/default/Kazakh/utils.py'
2025-08-31T08:28:52,074   adding 'lm_eval/tasks/include/default/Korean/_include_base_44_korean.yaml'
2025-08-31T08:28:52,075   adding 'lm_eval/tasks/include/default/Korean/_korean_template_yaml'
2025-08-31T08:28:52,076   adding 'lm_eval/tasks/include/default/Korean/include_base_44_korean_professional_certification.yaml'
2025-08-31T08:28:52,077   adding 'lm_eval/tasks/include/default/Korean/include_base_44_korean_social_science.yaml'
2025-08-31T08:28:52,078   adding 'lm_eval/tasks/include/default/Korean/utils.py'
2025-08-31T08:28:52,080   adding 'lm_eval/tasks/include/default/Lithuanian/_include_base_44_lithuanian.yaml'
2025-08-31T08:28:52,081   adding 'lm_eval/tasks/include/default/Lithuanian/_lithuanian_template_yaml'
2025-08-31T08:28:52,082   adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml'
2025-08-31T08:28:52,083   adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_business_commerce.yaml'
2025-08-31T08:28:52,084   adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_professional_certification.yaml'
2025-08-31T08:28:52,085   adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_social_science.yaml'
2025-08-31T08:28:52,087   adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_stem.yaml'
2025-08-31T08:28:52,088   adding 'lm_eval/tasks/include/default/Lithuanian/utils.py'
2025-08-31T08:28:52,090   adding 'lm_eval/tasks/include/default/Malay/_include_base_44_malay.yaml'
2025-08-31T08:28:52,091   adding 'lm_eval/tasks/include/default/Malay/_malay_template_yaml'
2025-08-31T08:28:52,092   adding 'lm_eval/tasks/include/default/Malay/include_base_44_malay_arts_humanities.yaml'
2025-08-31T08:28:52,093   adding 'lm_eval/tasks/include/default/Malay/include_base_44_malay_business_commerce.yaml'
2025-08-31T08:28:52,094   adding 'lm_eval/tasks/include/default/Malay/include_base_44_malay_social_science.yaml'
2025-08-31T08:28:52,095   adding 'lm_eval/tasks/include/default/Malay/utils.py'
2025-08-31T08:28:52,097   adding 'lm_eval/tasks/include/default/Malayalam/_include_base_44_malayalam.yaml'
2025-08-31T08:28:52,098   adding 'lm_eval/tasks/include/default/Malayalam/_malayalam_template_yaml'
2025-08-31T08:28:52,099   adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_arts_humanities.yaml'
2025-08-31T08:28:52,101   adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_general_knowledge.yaml'
2025-08-31T08:28:52,102   adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_health_oriented_education.yaml'
2025-08-31T08:28:52,103   adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_marine_license.yaml'
2025-08-31T08:28:52,104   adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_social_science.yaml'
2025-08-31T08:28:52,105   adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_stem.yaml'
2025-08-31T08:28:52,106   adding 'lm_eval/tasks/include/default/Malayalam/utils.py'
2025-08-31T08:28:52,108   adding 'lm_eval/tasks/include/default/Nepali/_include_base_44_nepali.yaml'
2025-08-31T08:28:52,109   adding 'lm_eval/tasks/include/default/Nepali/_nepali_template_yaml'
2025-08-31T08:28:52,110   adding 'lm_eval/tasks/include/default/Nepali/include_base_44_nepali_driving_license.yaml'
2025-08-31T08:28:52,111   adding 'lm_eval/tasks/include/default/Nepali/include_base_44_nepali_professional_certification.yaml'
2025-08-31T08:28:52,113   adding 'lm_eval/tasks/include/default/Nepali/utils.py'
2025-08-31T08:28:52,114   adding 'lm_eval/tasks/include/default/North Macedonian/_include_base_44_north macedonian.yaml'
2025-08-31T08:28:52,116   adding 'lm_eval/tasks/include/default/North Macedonian/_north macedonian_template_yaml'
2025-08-31T08:28:52,117   adding 'lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml'
2025-08-31T08:28:52,118   adding 'lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_business_commerce.yaml'
2025-08-31T08:28:52,119   adding 'lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_social_science.yaml'
2025-08-31T08:28:52,120   adding 'lm_eval/tasks/include/default/North Macedonian/include_base_44_north macedonian_stem.yaml'
2025-08-31T08:28:52,121   adding 'lm_eval/tasks/include/default/North Macedonian/utils.py'
2025-08-31T08:28:52,123   adding 'lm_eval/tasks/include/default/Persian/_include_base_44_persian.yaml'
2025-08-31T08:28:52,124   adding 'lm_eval/tasks/include/default/Persian/_persian_template_yaml'
2025-08-31T08:28:52,125   adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_arts_humanities.yaml'
2025-08-31T08:28:52,126   adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_driving_license.yaml'
2025-08-31T08:28:52,127   adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_professional_certification.yaml'
2025-08-31T08:28:52,128   adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_social_science.yaml'
2025-08-31T08:28:52,129   adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_stem.yaml'
2025-08-31T08:28:52,131   adding 'lm_eval/tasks/include/default/Persian/utils.py'
2025-08-31T08:28:52,132   adding 'lm_eval/tasks/include/default/Polish/_include_base_44_polish.yaml'
2025-08-31T08:28:52,133   adding 'lm_eval/tasks/include/default/Polish/_polish_template_yaml'
2025-08-31T08:28:52,135   adding 'lm_eval/tasks/include/default/Polish/include_base_44_polish_professional_certification.yaml'
2025-08-31T08:28:52,136   adding 'lm_eval/tasks/include/default/Polish/include_base_44_polish_social_science.yaml'
2025-08-31T08:28:52,137   adding 'lm_eval/tasks/include/default/Polish/include_base_44_polish_stem.yaml'
2025-08-31T08:28:52,138   adding 'lm_eval/tasks/include/default/Polish/utils.py'
2025-08-31T08:28:52,140   adding 'lm_eval/tasks/include/default/Portuguese/_include_base_44_portuguese.yaml'
2025-08-31T08:28:52,141   adding 'lm_eval/tasks/include/default/Portuguese/_portuguese_template_yaml'
2025-08-31T08:28:52,142   adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_applied_science.yaml'
2025-08-31T08:28:52,144   adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_arts_humanities.yaml'
2025-08-31T08:28:52,145   adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_business_commerce.yaml'
2025-08-31T08:28:52,146   adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_health_oriented_education.yaml'
2025-08-31T08:28:52,147   adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_social_science.yaml'
2025-08-31T08:28:52,148   adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_stem.yaml'
2025-08-31T08:28:52,149   adding 'lm_eval/tasks/include/default/Portuguese/utils.py'
2025-08-31T08:28:52,151   adding 'lm_eval/tasks/include/default/Russian/_include_base_44_russian.yaml'
2025-08-31T08:28:52,152   adding 'lm_eval/tasks/include/default/Russian/_russian_template_yaml'
2025-08-31T08:28:52,153   adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_applied_science.yaml'
2025-08-31T08:28:52,154   adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_arts_humanities.yaml'
2025-08-31T08:28:52,156   adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_business_commerce.yaml'
2025-08-31T08:28:52,157   adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_driving_license.yaml'
2025-08-31T08:28:52,158   adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_health_oriented_education.yaml'
2025-08-31T08:28:52,159   adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_marine_license.yaml'
2025-08-31T08:28:52,160   adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_social_science.yaml'
2025-08-31T08:28:52,161   adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_stem.yaml'
2025-08-31T08:28:52,162   adding 'lm_eval/tasks/include/default/Russian/utils.py'
2025-08-31T08:28:52,164   adding 'lm_eval/tasks/include/default/Serbian/_include_base_44_serbian.yaml'
2025-08-31T08:28:52,165   adding 'lm_eval/tasks/include/default/Serbian/_serbian_template_yaml'
2025-08-31T08:28:52,166   adding 'lm_eval/tasks/include/default/Serbian/include_base_44_serbian_arts_humanities.yaml'
2025-08-31T08:28:52,167   adding 'lm_eval/tasks/include/default/Serbian/include_base_44_serbian_social_science.yaml'
2025-08-31T08:28:52,168   adding 'lm_eval/tasks/include/default/Serbian/include_base_44_serbian_stem.yaml'
2025-08-31T08:28:52,169   adding 'lm_eval/tasks/include/default/Serbian/utils.py'
2025-08-31T08:28:52,171   adding 'lm_eval/tasks/include/default/Spanish/_include_base_44_spanish.yaml'
2025-08-31T08:28:52,172   adding 'lm_eval/tasks/include/default/Spanish/_spanish_template_yaml'
2025-08-31T08:28:52,173   adding 'lm_eval/tasks/include/default/Spanish/include_base_44_spanish_arts_humanities.yaml'
2025-08-31T08:28:52,174   adding 'lm_eval/tasks/include/default/Spanish/include_base_44_spanish_health_oriented_education.yaml'
2025-08-31T08:28:52,175   adding 'lm_eval/tasks/include/default/Spanish/include_base_44_spanish_social_science.yaml'
2025-08-31T08:28:52,176   adding 'lm_eval/tasks/include/default/Spanish/include_base_44_spanish_stem.yaml'
2025-08-31T08:28:52,178   adding 'lm_eval/tasks/include/default/Spanish/utils.py'
2025-08-31T08:28:52,179   adding 'lm_eval/tasks/include/default/Tagalog/_include_base_44_tagalog.yaml'
2025-08-31T08:28:52,180   adding 'lm_eval/tasks/include/default/Tagalog/_tagalog_template_yaml'
2025-08-31T08:28:52,182   adding 'lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_arts_humanities.yaml'
2025-08-31T08:28:52,183   adding 'lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_driving_license.yaml'
2025-08-31T08:28:52,184   adding 'lm_eval/tasks/include/default/Tagalog/utils.py'
2025-08-31T08:28:52,186   adding 'lm_eval/tasks/include/default/Tamil/_include_base_44_tamil.yaml'
2025-08-31T08:28:52,187   adding 'lm_eval/tasks/include/default/Tamil/_tamil_template_yaml'
2025-08-31T08:28:52,188   adding 'lm_eval/tasks/include/default/Tamil/include_base_44_tamil_general_knowledge.yaml'
2025-08-31T08:28:52,189   adding 'lm_eval/tasks/include/default/Tamil/include_base_44_tamil_stem.yaml'
2025-08-31T08:28:52,191   adding 'lm_eval/tasks/include/default/Tamil/utils.py'
2025-08-31T08:28:52,192   adding 'lm_eval/tasks/include/default/Telugu/_include_base_44_telugu.yaml'
2025-08-31T08:28:52,193   adding 'lm_eval/tasks/include/default/Telugu/_telugu_template_yaml'
2025-08-31T08:28:52,195   adding 'lm_eval/tasks/include/default/Telugu/include_base_44_telugu_applied_science.yaml'
2025-08-31T08:28:52,196   adding 'lm_eval/tasks/include/default/Telugu/include_base_44_telugu_arts_humanities.yaml'
2025-08-31T08:28:52,197   adding 'lm_eval/tasks/include/default/Telugu/include_base_44_telugu_social_science.yaml'
2025-08-31T08:28:52,198   adding 'lm_eval/tasks/include/default/Telugu/include_base_44_telugu_stem.yaml'
2025-08-31T08:28:52,199   adding 'lm_eval/tasks/include/default/Telugu/utils.py'
2025-08-31T08:28:52,201   adding 'lm_eval/tasks/include/default/Turkish/_include_base_44_turkish.yaml'
2025-08-31T08:28:52,202   adding 'lm_eval/tasks/include/default/Turkish/_turkish_template_yaml'
2025-08-31T08:28:52,203   adding 'lm_eval/tasks/include/default/Turkish/include_base_44_turkish_arts_humanities.yaml'
2025-08-31T08:28:52,204   adding 'lm_eval/tasks/include/default/Turkish/include_base_44_turkish_business_commerce.yaml'
2025-08-31T08:28:52,206   adding 'lm_eval/tasks/include/default/Turkish/include_base_44_turkish_social_science.yaml'
2025-08-31T08:28:52,207   adding 'lm_eval/tasks/include/default/Turkish/include_base_44_turkish_stem.yaml'
2025-08-31T08:28:52,208   adding 'lm_eval/tasks/include/default/Turkish/utils.py'
2025-08-31T08:28:52,209   adding 'lm_eval/tasks/include/default/Ukrainian/_include_base_44_ukrainian.yaml'
2025-08-31T08:28:52,210   adding 'lm_eval/tasks/include/default/Ukrainian/_ukrainian_template_yaml'
2025-08-31T08:28:52,211   adding 'lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml'
2025-08-31T08:28:52,212   adding 'lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_social_science.yaml'
2025-08-31T08:28:52,214   adding 'lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_stem.yaml'
2025-08-31T08:28:52,215   adding 'lm_eval/tasks/include/default/Ukrainian/utils.py'
2025-08-31T08:28:52,217   adding 'lm_eval/tasks/include/default/Urdu/_include_base_44_urdu.yaml'
2025-08-31T08:28:52,218   adding 'lm_eval/tasks/include/default/Urdu/_urdu_template_yaml'
2025-08-31T08:28:52,219   adding 'lm_eval/tasks/include/default/Urdu/include_base_44_urdu_arts_humanities.yaml'
2025-08-31T08:28:52,220   adding 'lm_eval/tasks/include/default/Urdu/include_base_44_urdu_health_oriented_education.yaml'
2025-08-31T08:28:52,221   adding 'lm_eval/tasks/include/default/Urdu/include_base_44_urdu_stem.yaml'
2025-08-31T08:28:52,222   adding 'lm_eval/tasks/include/default/Urdu/utils.py'
2025-08-31T08:28:52,224   adding 'lm_eval/tasks/include/default/Uzbek/_include_base_44_uzbek.yaml'
2025-08-31T08:28:52,225   adding 'lm_eval/tasks/include/default/Uzbek/_uzbek_template_yaml'
2025-08-31T08:28:52,226   adding 'lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_arts_humanities.yaml'
2025-08-31T08:28:52,228   adding 'lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_medical_license.yaml'
2025-08-31T08:28:52,229   adding 'lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_social_science.yaml'
2025-08-31T08:28:52,230   adding 'lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_stem.yaml'
2025-08-31T08:28:52,231   adding 'lm_eval/tasks/include/default/Uzbek/utils.py'
2025-08-31T08:28:52,233   adding 'lm_eval/tasks/include/default/Vietnamese/_include_base_44_vietnamese.yaml'
2025-08-31T08:28:52,234   adding 'lm_eval/tasks/include/default/Vietnamese/_vietnamese_template_yaml'
2025-08-31T08:28:52,235   adding 'lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml'
2025-08-31T08:28:52,236   adding 'lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_social_science.yaml'
2025-08-31T08:28:52,238   adding 'lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_stem.yaml'
2025-08-31T08:28:52,239   adding 'lm_eval/tasks/include/default/Vietnamese/utils.py'
2025-08-31T08:28:52,242   adding 'lm_eval/tasks/include/few_shot_en/Albanian/_albanian_few_shot_en_template_yaml'
2025-08-31T08:28:52,243   adding 'lm_eval/tasks/include/few_shot_en/Albanian/_include_base_44_albanian.yaml'
2025-08-31T08:28:52,244   adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_arts_humanities.yaml'
2025-08-31T08:28:52,245   adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_business_commerce.yaml'
2025-08-31T08:28:52,246   adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_health_oriented_education.yaml'
2025-08-31T08:28:52,247   adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_social_science.yaml'
2025-08-31T08:28:52,249   adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_stem.yaml'
2025-08-31T08:28:52,250   adding 'lm_eval/tasks/include/few_shot_en/Albanian/utils.py'
2025-08-31T08:28:52,252   adding 'lm_eval/tasks/include/few_shot_en/Arabic/_arabic_few_shot_en_template_yaml'
2025-08-31T08:28:52,253   adding 'lm_eval/tasks/include/few_shot_en/Arabic/_include_base_44_arabic.yaml'
2025-08-31T08:28:52,254   adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_arts_humanities.yaml'
2025-08-31T08:28:52,255   adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_business_commerce.yaml'
2025-08-31T08:28:52,256   adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_driving_license.yaml'
2025-08-31T08:28:52,257   adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_general_knowledge.yaml'
2025-08-31T08:28:52,258   adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_social_science.yaml'
2025-08-31T08:28:52,260   adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_stem.yaml'
2025-08-31T08:28:52,261   adding 'lm_eval/tasks/include/few_shot_en/Arabic/utils.py'
2025-08-31T08:28:52,262   adding 'lm_eval/tasks/include/few_shot_en/Armenian/_armenian_few_shot_en_template_yaml'
2025-08-31T08:28:52,264   adding 'lm_eval/tasks/include/few_shot_en/Armenian/_include_base_44_armenian.yaml'
2025-08-31T08:28:52,265   adding 'lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_arts_humanities.yaml'
2025-08-31T08:28:52,266   adding 'lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_driving_license.yaml'
2025-08-31T08:28:52,267   adding 'lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_social_science.yaml'
2025-08-31T08:28:52,268   adding 'lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_stem.yaml'
2025-08-31T08:28:52,269   adding 'lm_eval/tasks/include/few_shot_en/Armenian/utils.py'
2025-08-31T08:28:52,271   adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/_azerbaijani_few_shot_en_template_yaml'
2025-08-31T08:28:52,272   adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/_include_base_44_azerbaijani.yaml'
2025-08-31T08:28:52,274   adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml'
2025-08-31T08:28:52,275   adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml'
2025-08-31T08:28:52,276   adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml'
2025-08-31T08:28:52,277   adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml'
2025-08-31T08:28:52,278   adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_social_science.yaml'
2025-08-31T08:28:52,280   adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_stem.yaml'
2025-08-31T08:28:52,281   adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/utils.py'
2025-08-31T08:28:52,283   adding 'lm_eval/tasks/include/few_shot_en/Basque/_basque_few_shot_en_template_yaml'
2025-08-31T08:28:52,284   adding 'lm_eval/tasks/include/few_shot_en/Basque/_include_base_44_basque.yaml'
2025-08-31T08:28:52,285   adding 'lm_eval/tasks/include/few_shot_en/Basque/include_base_44_basque_professional_certification.yaml'
2025-08-31T08:28:52,286   adding 'lm_eval/tasks/include/few_shot_en/Basque/utils.py'
2025-08-31T08:28:52,288   adding 'lm_eval/tasks/include/few_shot_en/Belarusian/_belarusian_few_shot_en_template_yaml'
2025-08-31T08:28:52,289   adding 'lm_eval/tasks/include/few_shot_en/Belarusian/_include_base_44_belarusian.yaml'
2025-08-31T08:28:52,291   adding 'lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_arts_humanities.yaml'
2025-08-31T08:28:52,292   adding 'lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_social_science.yaml'
2025-08-31T08:28:52,293   adding 'lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_stem.yaml'
2025-08-31T08:28:52,294   adding 'lm_eval/tasks/include/few_shot_en/Belarusian/utils.py'
2025-08-31T08:28:52,296   adding 'lm_eval/tasks/include/few_shot_en/Bengali/_bengali_few_shot_en_template_yaml'
2025-08-31T08:28:52,297   adding 'lm_eval/tasks/include/few_shot_en/Bengali/_include_base_44_bengali.yaml'
2025-08-31T08:28:52,298   adding 'lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_arts_humanities.yaml'
2025-08-31T08:28:52,299   adding 'lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_general_knowledge.yaml'
2025-08-31T08:28:52,300   adding 'lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_professional_certification.yaml'
2025-08-31T08:28:52,302   adding 'lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_stem.yaml'
2025-08-31T08:28:52,303   adding 'lm_eval/tasks/include/few_shot_en/Bengali/utils.py'
2025-08-31T08:28:52,304   adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/_bulgarian_few_shot_en_template_yaml'
2025-08-31T08:28:52,306   adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/_include_base_44_bulgarian.yaml'
2025-08-31T08:28:52,307   adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml'
2025-08-31T08:28:52,308   adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_social_science.yaml'
2025-08-31T08:28:52,309   adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_stem.yaml'
2025-08-31T08:28:52,310   adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/utils.py'
2025-08-31T08:28:52,312   adding 'lm_eval/tasks/include/few_shot_en/Chinese/_chinese_few_shot_en_template_yaml'
2025-08-31T08:28:52,313   adding 'lm_eval/tasks/include/few_shot_en/Chinese/_include_base_44_chinese.yaml'
2025-08-31T08:28:52,314   adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_applied_science.yaml'
2025-08-31T08:28:52,316   adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_arts_humanities.yaml'
2025-08-31T08:28:52,318   adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_business_commerce.yaml'
2025-08-31T08:28:52,319   adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_driving_license.yaml'
2025-08-31T08:28:52,320   adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_health_oriented_education.yaml'
2025-08-31T08:28:52,322   adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_professional_certification.yaml'
2025-08-31T08:28:52,323   adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_social_science.yaml'
2025-08-31T08:28:52,324   adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_stem.yaml'
2025-08-31T08:28:52,326   adding 'lm_eval/tasks/include/few_shot_en/Chinese/utils.py'
2025-08-31T08:28:52,327   adding 'lm_eval/tasks/include/few_shot_en/Croatian/_croatian_few_shot_en_template_yaml'
2025-08-31T08:28:52,329   adding 'lm_eval/tasks/include/few_shot_en/Croatian/_include_base_44_croatian.yaml'
2025-08-31T08:28:52,330   adding 'lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_arts_humanities.yaml'
2025-08-31T08:28:52,331   adding 'lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_social_science.yaml'
2025-08-31T08:28:52,332   adding 'lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_stem.yaml'
2025-08-31T08:28:52,333   adding 'lm_eval/tasks/include/few_shot_en/Croatian/utils.py'
2025-08-31T08:28:52,335   adding 'lm_eval/tasks/include/few_shot_en/Dutch/_dutch_few_shot_en_template_yaml'
2025-08-31T08:28:52,336   adding 'lm_eval/tasks/include/few_shot_en/Dutch/_include_base_44_dutch.yaml'
2025-08-31T08:28:52,337   adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_applied_science.yaml'
2025-08-31T08:28:52,339   adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_arts_humanities.yaml'
2025-08-31T08:28:52,340   adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_health_oriented_education.yaml'
2025-08-31T08:28:52,341   adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_social_science.yaml'
2025-08-31T08:28:52,342   adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_stem.yaml'
2025-08-31T08:28:52,343   adding 'lm_eval/tasks/include/few_shot_en/Dutch/utils.py'
2025-08-31T08:28:52,345   adding 'lm_eval/tasks/include/few_shot_en/Estonian/_estonian_few_shot_en_template_yaml'
2025-08-31T08:28:52,346   adding 'lm_eval/tasks/include/few_shot_en/Estonian/_include_base_44_estonian.yaml'
2025-08-31T08:28:52,347   adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_applied_science.yaml'
2025-08-31T08:28:52,348   adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_arts_humanities.yaml'
2025-08-31T08:28:52,350   adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_health_oriented_education.yaml'
2025-08-31T08:28:52,351   adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_social_science.yaml'
2025-08-31T08:28:52,352   adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_stem.yaml'
2025-08-31T08:28:52,353   adding 'lm_eval/tasks/include/few_shot_en/Estonian/utils.py'
2025-08-31T08:28:52,355   adding 'lm_eval/tasks/include/few_shot_en/Finnish/_finnish_few_shot_en_template_yaml'
2025-08-31T08:28:52,356   adding 'lm_eval/tasks/include/few_shot_en/Finnish/_include_base_44_finnish.yaml'
2025-08-31T08:28:52,357   adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_applied_science.yaml'
2025-08-31T08:28:52,358   adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_arts_humanities.yaml'
2025-08-31T08:28:52,359   adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_health_oriented_education.yaml'
2025-08-31T08:28:52,360   adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_social_science.yaml'
2025-08-31T08:28:52,362   adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_stem.yaml'
2025-08-31T08:28:52,363   adding 'lm_eval/tasks/include/few_shot_en/Finnish/utils.py'
2025-08-31T08:28:52,365   adding 'lm_eval/tasks/include/few_shot_en/French/_french_few_shot_en_template_yaml'
2025-08-31T08:28:52,366   adding 'lm_eval/tasks/include/few_shot_en/French/_include_base_44_french.yaml'
2025-08-31T08:28:52,367   adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_arts_humanities.yaml'
2025-08-31T08:28:52,368   adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_driving_license.yaml'
2025-08-31T08:28:52,369   adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_health_oriented_education.yaml'
2025-08-31T08:28:52,370   adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_social_science.yaml'
2025-08-31T08:28:52,372   adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_stem.yaml'
2025-08-31T08:28:52,373   adding 'lm_eval/tasks/include/few_shot_en/French/utils.py'
2025-08-31T08:28:52,375   adding 'lm_eval/tasks/include/few_shot_en/Georgian/_georgian_few_shot_en_template_yaml'
2025-08-31T08:28:52,376   adding 'lm_eval/tasks/include/few_shot_en/Georgian/_include_base_44_georgian.yaml'
2025-08-31T08:28:52,377   adding 'lm_eval/tasks/include/few_shot_en/Georgian/include_base_44_georgian_arts_humanities.yaml'
2025-08-31T08:28:52,379   adding 'lm_eval/tasks/include/few_shot_en/Georgian/utils.py'
2025-08-31T08:28:52,380   adding 'lm_eval/tasks/include/few_shot_en/German/_german_few_shot_en_template_yaml'
2025-08-31T08:28:52,382   adding 'lm_eval/tasks/include/few_shot_en/German/_include_base_44_german.yaml'
2025-08-31T08:28:52,383   adding 'lm_eval/tasks/include/few_shot_en/German/include_base_44_german_driving_license.yaml'
2025-08-31T08:28:52,384   adding 'lm_eval/tasks/include/few_shot_en/German/include_base_44_german_social_science.yaml'
2025-08-31T08:28:52,385   adding 'lm_eval/tasks/include/few_shot_en/German/include_base_44_german_stem.yaml'
2025-08-31T08:28:52,386   adding 'lm_eval/tasks/include/few_shot_en/German/utils.py'
2025-08-31T08:28:52,388   adding 'lm_eval/tasks/include/few_shot_en/Greek/_greek_few_shot_en_template_yaml'
2025-08-31T08:28:52,390   adding 'lm_eval/tasks/include/few_shot_en/Greek/_include_base_44_greek.yaml'
2025-08-31T08:28:52,391   adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_arts_humanities.yaml'
2025-08-31T08:28:52,392   adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_business_commerce.yaml'
2025-08-31T08:28:52,393   adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_health_oriented_education.yaml'
2025-08-31T08:28:52,394   adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_medical_license.yaml'
2025-08-31T08:28:52,395   adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_professional_certification.yaml'
2025-08-31T08:28:52,396   adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_social_science.yaml'
2025-08-31T08:28:52,397   adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_stem.yaml'
2025-08-31T08:28:52,398   adding 'lm_eval/tasks/include/few_shot_en/Greek/utils.py'
2025-08-31T08:28:52,400   adding 'lm_eval/tasks/include/few_shot_en/Hebrew/_hebrew_few_shot_en_template_yaml'
2025-08-31T08:28:52,401   adding 'lm_eval/tasks/include/few_shot_en/Hebrew/_include_base_44_hebrew.yaml'
2025-08-31T08:28:52,402   adding 'lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_arts_humanities.yaml'
2025-08-31T08:28:52,403   adding 'lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_driving_license.yaml'
2025-08-31T08:28:52,405   adding 'lm_eval/tasks/include/few_shot_en/Hebrew/utils.py'
2025-08-31T08:28:52,407   adding 'lm_eval/tasks/include/few_shot_en/Hindi/_hindi_few_shot_en_template_yaml'
2025-08-31T08:28:52,408   adding 'lm_eval/tasks/include/few_shot_en/Hindi/_include_base_44_hindi.yaml'
2025-08-31T08:28:52,409   adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_applied_science.yaml'
2025-08-31T08:28:52,410   adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_arts_humanities.yaml'
2025-08-31T08:28:52,411   adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_driving_license.yaml'
2025-08-31T08:28:52,413   adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_general_knowledge.yaml'
2025-08-31T08:28:52,414   adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_health_oriented_education.yaml'
2025-08-31T08:28:52,415   adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_professional_certification.yaml'
2025-08-31T08:28:52,416   adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_social_science.yaml'
2025-08-31T08:28:52,417   adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_stem.yaml'
2025-08-31T08:28:52,418   adding 'lm_eval/tasks/include/few_shot_en/Hindi/utils.py'
2025-08-31T08:28:52,420   adding 'lm_eval/tasks/include/few_shot_en/Hungarian/_hungarian_few_shot_en_template_yaml'
2025-08-31T08:28:52,421   adding 'lm_eval/tasks/include/few_shot_en/Hungarian/_include_base_44_hungarian.yaml'
2025-08-31T08:28:52,423   adding 'lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_applied_science.yaml'
2025-08-31T08:28:52,424   adding 'lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_social_science.yaml'
2025-08-31T08:28:52,425   adding 'lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_stem.yaml'
2025-08-31T08:28:52,426   adding 'lm_eval/tasks/include/few_shot_en/Hungarian/utils.py'
2025-08-31T08:28:52,428   adding 'lm_eval/tasks/include/few_shot_en/Indonesian/_include_base_44_indonesian.yaml'
2025-08-31T08:28:52,429   adding 'lm_eval/tasks/include/few_shot_en/Indonesian/_indonesian_few_shot_en_template_yaml'
2025-08-31T08:28:52,430   adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_applied_science.yaml'
2025-08-31T08:28:52,431   adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_arts_humanities.yaml'
2025-08-31T08:28:52,433   adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_professional_certification.yaml'
2025-08-31T08:28:52,434   adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_social_science.yaml'
2025-08-31T08:28:52,435   adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_stem.yaml'
2025-08-31T08:28:52,436   adding 'lm_eval/tasks/include/few_shot_en/Indonesian/utils.py'
2025-08-31T08:28:52,438   adding 'lm_eval/tasks/include/few_shot_en/Italian/_include_base_44_italian.yaml'
2025-08-31T08:28:52,439   adding 'lm_eval/tasks/include/few_shot_en/Italian/_italian_few_shot_en_template_yaml'
2025-08-31T08:28:52,440   adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_applied_science.yaml'
2025-08-31T08:28:52,441   adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_arts_humanities.yaml'
2025-08-31T08:28:52,442   adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_health_oriented_education.yaml'
2025-08-31T08:28:52,443   adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_professional_certification.yaml'
2025-08-31T08:28:52,444   adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_social_science.yaml'
2025-08-31T08:28:52,445   adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_stem.yaml'
2025-08-31T08:28:52,447   adding 'lm_eval/tasks/include/few_shot_en/Italian/utils.py'
2025-08-31T08:28:52,448   adding 'lm_eval/tasks/include/few_shot_en/Japanese/_include_base_44_japanese.yaml'
2025-08-31T08:28:52,449   adding 'lm_eval/tasks/include/few_shot_en/Japanese/_japanese_few_shot_en_template_yaml'
2025-08-31T08:28:52,450   adding 'lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_driving_license.yaml'
2025-08-31T08:28:52,452   adding 'lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_medical_license.yaml'
2025-08-31T08:28:52,453   adding 'lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_professional_certification.yaml'
2025-08-31T08:28:52,454   adding 'lm_eval/tasks/include/few_shot_en/Japanese/utils.py'
2025-08-31T08:28:52,455   adding 'lm_eval/tasks/include/few_shot_en/Kazakh/_include_base_44_kazakh.yaml'
2025-08-31T08:28:52,457   adding 'lm_eval/tasks/include/few_shot_en/Kazakh/_kazakh_few_shot_en_template_yaml'
2025-08-31T08:28:52,458   adding 'lm_eval/tasks/include/few_shot_en/Kazakh/include_base_44_kazakh_arts_humanities.yaml'
2025-08-31T08:28:52,459   adding 'lm_eval/tasks/include/few_shot_en/Kazakh/utils.py'
2025-08-31T08:28:52,461   adding 'lm_eval/tasks/include/few_shot_en/Korean/_include_base_44_korean.yaml'
2025-08-31T08:28:52,462   adding 'lm_eval/tasks/include/few_shot_en/Korean/_korean_few_shot_en_template_yaml'
2025-08-31T08:28:52,463   adding 'lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_professional_certification.yaml'
2025-08-31T08:28:52,464   adding 'lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_social_science.yaml'
2025-08-31T08:28:52,465   adding 'lm_eval/tasks/include/few_shot_en/Korean/utils.py'
2025-08-31T08:28:52,467   adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/_include_base_44_lithuanian.yaml'
2025-08-31T08:28:52,468   adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/_lithuanian_few_shot_en_template_yaml'
2025-08-31T08:28:52,469   adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml'
2025-08-31T08:28:52,471   adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_business_commerce.yaml'
2025-08-31T08:28:52,472   adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_professional_certification.yaml'
2025-08-31T08:28:52,473   adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_social_science.yaml'
2025-08-31T08:28:52,474   adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_stem.yaml'
2025-08-31T08:28:52,475   adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/utils.py'
2025-08-31T08:28:52,477   adding 'lm_eval/tasks/include/few_shot_en/Malay/_include_base_44_malay.yaml'
2025-08-31T08:28:52,478   adding 'lm_eval/tasks/include/few_shot_en/Malay/_malay_few_shot_en_template_yaml'
2025-08-31T08:28:52,480   adding 'lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_arts_humanities.yaml'
2025-08-31T08:28:52,481   adding 'lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_business_commerce.yaml'
2025-08-31T08:28:52,482   adding 'lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_social_science.yaml'
2025-08-31T08:28:52,483   adding 'lm_eval/tasks/include/few_shot_en/Malay/utils.py'
2025-08-31T08:28:52,484   adding 'lm_eval/tasks/include/few_shot_en/Malayalam/_include_base_44_malayalam.yaml'
2025-08-31T08:28:52,485   adding 'lm_eval/tasks/include/few_shot_en/Malayalam/_malayalam_few_shot_en_template_yaml'
2025-08-31T08:28:52,487   adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_arts_humanities.yaml'
2025-08-31T08:28:52,488   adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_general_knowledge.yaml'
2025-08-31T08:28:52,489   adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_health_oriented_education.yaml'
2025-08-31T08:28:52,490   adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_marine_license.yaml'
2025-08-31T08:28:52,491   adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_social_science.yaml'
2025-08-31T08:28:52,492   adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_stem.yaml'
2025-08-31T08:28:52,493   adding 'lm_eval/tasks/include/few_shot_en/Malayalam/utils.py'
2025-08-31T08:28:52,495   adding 'lm_eval/tasks/include/few_shot_en/Nepali/_include_base_44_nepali.yaml'
2025-08-31T08:28:52,496   adding 'lm_eval/tasks/include/few_shot_en/Nepali/_nepali_few_shot_en_template_yaml'
2025-08-31T08:28:52,497   adding 'lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_driving_license.yaml'
2025-08-31T08:28:52,498   adding 'lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_professional_certification.yaml'
2025-08-31T08:28:52,500   adding 'lm_eval/tasks/include/few_shot_en/Nepali/utils.py'
2025-08-31T08:28:52,501   adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/_include_base_44_north macedonian.yaml'
2025-08-31T08:28:52,503   adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/_north macedonian_few_shot_en_template_yaml'
2025-08-31T08:28:52,504   adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml'
2025-08-31T08:28:52,505   adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_business_commerce.yaml'
2025-08-31T08:28:52,506   adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_social_science.yaml'
2025-08-31T08:28:52,507   adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north macedonian_stem.yaml'
2025-08-31T08:28:52,508   adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/utils.py'
2025-08-31T08:28:52,510   adding 'lm_eval/tasks/include/few_shot_en/Persian/_include_base_44_persian.yaml'
2025-08-31T08:28:52,511   adding 'lm_eval/tasks/include/few_shot_en/Persian/_persian_few_shot_en_template_yaml'
2025-08-31T08:28:52,512   adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_arts_humanities.yaml'
2025-08-31T08:28:52,513   adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_driving_license.yaml'
2025-08-31T08:28:52,515   adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_professional_certification.yaml'
2025-08-31T08:28:52,516   adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_social_science.yaml'
2025-08-31T08:28:52,517   adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_stem.yaml'
2025-08-31T08:28:52,518   adding 'lm_eval/tasks/include/few_shot_en/Persian/utils.py'
2025-08-31T08:28:52,520   adding 'lm_eval/tasks/include/few_shot_en/Polish/_include_base_44_polish.yaml'
2025-08-31T08:28:52,521   adding 'lm_eval/tasks/include/few_shot_en/Polish/_polish_few_shot_en_template_yaml'
2025-08-31T08:28:52,522   adding 'lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_professional_certification.yaml'
2025-08-31T08:28:52,523   adding 'lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_social_science.yaml'
2025-08-31T08:28:52,524   adding 'lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_stem.yaml'
2025-08-31T08:28:52,526   adding 'lm_eval/tasks/include/few_shot_en/Polish/utils.py'
2025-08-31T08:28:52,527   adding 'lm_eval/tasks/include/few_shot_en/Portuguese/_include_base_44_portuguese.yaml'
2025-08-31T08:28:52,528   adding 'lm_eval/tasks/include/few_shot_en/Portuguese/_portuguese_few_shot_en_template_yaml'
2025-08-31T08:28:52,529   adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_applied_science.yaml'
2025-08-31T08:28:52,530   adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_arts_humanities.yaml'
2025-08-31T08:28:52,531   adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_business_commerce.yaml'
2025-08-31T08:28:52,532   adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_health_oriented_education.yaml'
2025-08-31T08:28:52,534   adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_social_science.yaml'
2025-08-31T08:28:52,535   adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_stem.yaml'
2025-08-31T08:28:52,536   adding 'lm_eval/tasks/include/few_shot_en/Portuguese/utils.py'
2025-08-31T08:28:52,538   adding 'lm_eval/tasks/include/few_shot_en/Russian/_include_base_44_russian.yaml'
2025-08-31T08:28:52,539   adding 'lm_eval/tasks/include/few_shot_en/Russian/_russian_few_shot_en_template_yaml'
2025-08-31T08:28:52,540   adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_applied_science.yaml'
2025-08-31T08:28:52,541   adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_arts_humanities.yaml'
2025-08-31T08:28:52,542   adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_business_commerce.yaml'
2025-08-31T08:28:52,543   adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_driving_license.yaml'
2025-08-31T08:28:52,545   adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_health_oriented_education.yaml'
2025-08-31T08:28:52,546   adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_marine_license.yaml'
2025-08-31T08:28:52,547   adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_social_science.yaml'
2025-08-31T08:28:52,548   adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_stem.yaml'
2025-08-31T08:28:52,549   adding 'lm_eval/tasks/include/few_shot_en/Russian/utils.py'
2025-08-31T08:28:52,551   adding 'lm_eval/tasks/include/few_shot_en/Serbian/_include_base_44_serbian.yaml'
2025-08-31T08:28:52,552   adding 'lm_eval/tasks/include/few_shot_en/Serbian/_serbian_few_shot_en_template_yaml'
2025-08-31T08:28:52,553   adding 'lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_arts_humanities.yaml'
2025-08-31T08:28:52,554   adding 'lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_social_science.yaml'
2025-08-31T08:28:52,555   adding 'lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_stem.yaml'
2025-08-31T08:28:52,557   adding 'lm_eval/tasks/include/few_shot_en/Serbian/utils.py'
2025-08-31T08:28:52,558   adding 'lm_eval/tasks/include/few_shot_en/Spanish/_include_base_44_spanish.yaml'
2025-08-31T08:28:52,560   adding 'lm_eval/tasks/include/few_shot_en/Spanish/_spanish_few_shot_en_template_yaml'
2025-08-31T08:28:52,561   adding 'lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_arts_humanities.yaml'
2025-08-31T08:28:52,562   adding 'lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_health_oriented_education.yaml'
2025-08-31T08:28:52,563   adding 'lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_social_science.yaml'
2025-08-31T08:28:52,564   adding 'lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_stem.yaml'
2025-08-31T08:28:52,566   adding 'lm_eval/tasks/include/few_shot_en/Spanish/utils.py'
2025-08-31T08:28:52,567   adding 'lm_eval/tasks/include/few_shot_en/Tagalog/_include_base_44_tagalog.yaml'
2025-08-31T08:28:52,568   adding 'lm_eval/tasks/include/few_shot_en/Tagalog/_tagalog_few_shot_en_template_yaml'
2025-08-31T08:28:52,569   adding 'lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_arts_humanities.yaml'
2025-08-31T08:28:52,570   adding 'lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_driving_license.yaml'
2025-08-31T08:28:52,571   adding 'lm_eval/tasks/include/few_shot_en/Tagalog/utils.py'
2025-08-31T08:28:52,573   adding 'lm_eval/tasks/include/few_shot_en/Tamil/_include_base_44_tamil.yaml'
2025-08-31T08:28:52,574   adding 'lm_eval/tasks/include/few_shot_en/Tamil/_tamil_few_shot_en_template_yaml'
2025-08-31T08:28:52,575   adding 'lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_general_knowledge.yaml'
2025-08-31T08:28:52,576   adding 'lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_stem.yaml'
2025-08-31T08:28:52,578   adding 'lm_eval/tasks/include/few_shot_en/Tamil/utils.py'
2025-08-31T08:28:52,579   adding 'lm_eval/tasks/include/few_shot_en/Telugu/_include_base_44_telugu.yaml'
2025-08-31T08:28:52,580   adding 'lm_eval/tasks/include/few_shot_en/Telugu/_telugu_few_shot_en_template_yaml'
2025-08-31T08:28:52,582   adding 'lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_applied_science.yaml'
2025-08-31T08:28:52,583   adding 'lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_arts_humanities.yaml'
2025-08-31T08:28:52,584   adding 'lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_social_science.yaml'
2025-08-31T08:28:52,585   adding 'lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_stem.yaml'
2025-08-31T08:28:52,586   adding 'lm_eval/tasks/include/few_shot_en/Telugu/utils.py'
2025-08-31T08:28:52,588   adding 'lm_eval/tasks/include/few_shot_en/Turkish/_include_base_44_turkish.yaml'
2025-08-31T08:28:52,589   adding 'lm_eval/tasks/include/few_shot_en/Turkish/_turkish_few_shot_en_template_yaml'
2025-08-31T08:28:52,590   adding 'lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_arts_humanities.yaml'
2025-08-31T08:28:52,591   adding 'lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_business_commerce.yaml'
2025-08-31T08:28:52,592   adding 'lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_social_science.yaml'
2025-08-31T08:28:52,593   adding 'lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_stem.yaml'
2025-08-31T08:28:52,595   adding 'lm_eval/tasks/include/few_shot_en/Turkish/utils.py'
2025-08-31T08:28:52,596   adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/_include_base_44_ukrainian.yaml'
2025-08-31T08:28:52,598   adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/_ukrainian_few_shot_en_template_yaml'
2025-08-31T08:28:52,599   adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml'
2025-08-31T08:28:52,600   adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_social_science.yaml'
2025-08-31T08:28:52,601   adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_stem.yaml'
2025-08-31T08:28:52,602   adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/utils.py'
2025-08-31T08:28:52,604   adding 'lm_eval/tasks/include/few_shot_en/Urdu/_include_base_44_urdu.yaml'
2025-08-31T08:28:52,605   adding 'lm_eval/tasks/include/few_shot_en/Urdu/_urdu_few_shot_en_template_yaml'
2025-08-31T08:28:52,606   adding 'lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_arts_humanities.yaml'
2025-08-31T08:28:52,608   adding 'lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_health_oriented_education.yaml'
2025-08-31T08:28:52,609   adding 'lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_stem.yaml'
2025-08-31T08:28:52,610   adding 'lm_eval/tasks/include/few_shot_en/Urdu/utils.py'
2025-08-31T08:28:52,612   adding 'lm_eval/tasks/include/few_shot_en/Uzbek/_include_base_44_uzbek.yaml'
2025-08-31T08:28:52,613   adding 'lm_eval/tasks/include/few_shot_en/Uzbek/_uzbek_few_shot_en_template_yaml'
2025-08-31T08:28:52,614   adding 'lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_arts_humanities.yaml'
2025-08-31T08:28:52,615   adding 'lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_medical_license.yaml'
2025-08-31T08:28:52,616   adding 'lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_social_science.yaml'
2025-08-31T08:28:52,617   adding 'lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_stem.yaml'
2025-08-31T08:28:52,618   adding 'lm_eval/tasks/include/few_shot_en/Uzbek/utils.py'
2025-08-31T08:28:52,620   adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/_include_base_44_vietnamese.yaml'
2025-08-31T08:28:52,621   adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/_vietnamese_few_shot_en_template_yaml'
2025-08-31T08:28:52,622   adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml'
2025-08-31T08:28:52,623   adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_social_science.yaml'
2025-08-31T08:28:52,624   adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_stem.yaml'
2025-08-31T08:28:52,625   adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/utils.py'
2025-08-31T08:28:52,628   adding 'lm_eval/tasks/include/few_shot_og/Albanian/_albanian_few_shot_og_template_yaml'
2025-08-31T08:28:52,629   adding 'lm_eval/tasks/include/few_shot_og/Albanian/_include_base_44_albanian.yaml'
2025-08-31T08:28:52,630   adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_arts_humanities.yaml'
2025-08-31T08:28:52,631   adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_business_commerce.yaml'
2025-08-31T08:28:52,632   adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_health_oriented_education.yaml'
2025-08-31T08:28:52,634   adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_social_science.yaml'
2025-08-31T08:28:52,635   adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_stem.yaml'
2025-08-31T08:28:52,636   adding 'lm_eval/tasks/include/few_shot_og/Albanian/utils.py'
2025-08-31T08:28:52,638   adding 'lm_eval/tasks/include/few_shot_og/Arabic/_arabic_few_shot_og_template_yaml'
2025-08-31T08:28:52,639   adding 'lm_eval/tasks/include/few_shot_og/Arabic/_include_base_44_arabic.yaml'
2025-08-31T08:28:52,640   adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_arts_humanities.yaml'
2025-08-31T08:28:52,641   adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_business_commerce.yaml'
2025-08-31T08:28:52,642   adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_driving_license.yaml'
2025-08-31T08:28:52,643   adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_general_knowledge.yaml'
2025-08-31T08:28:52,645   adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_social_science.yaml'
2025-08-31T08:28:52,646   adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_stem.yaml'
2025-08-31T08:28:52,647   adding 'lm_eval/tasks/include/few_shot_og/Arabic/utils.py'
2025-08-31T08:28:52,649   adding 'lm_eval/tasks/include/few_shot_og/Armenian/_armenian_few_shot_og_template_yaml'
2025-08-31T08:28:52,650   adding 'lm_eval/tasks/include/few_shot_og/Armenian/_include_base_44_armenian.yaml'
2025-08-31T08:28:52,651   adding 'lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_arts_humanities.yaml'
2025-08-31T08:28:52,652   adding 'lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_driving_license.yaml'
2025-08-31T08:28:52,653   adding 'lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_social_science.yaml'
2025-08-31T08:28:52,654   adding 'lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_stem.yaml'
2025-08-31T08:28:52,656   adding 'lm_eval/tasks/include/few_shot_og/Armenian/utils.py'
2025-08-31T08:28:52,657   adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/_azerbaijani_few_shot_og_template_yaml'
2025-08-31T08:28:52,658   adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/_include_base_44_azerbaijani.yaml'
2025-08-31T08:28:52,659   adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml'
2025-08-31T08:28:52,660   adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml'
2025-08-31T08:28:52,661   adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml'
2025-08-31T08:28:52,662   adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml'
2025-08-31T08:28:52,664   adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_social_science.yaml'
2025-08-31T08:28:52,665   adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_stem.yaml'
2025-08-31T08:28:52,666   adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/utils.py'
2025-08-31T08:28:52,667   adding 'lm_eval/tasks/include/few_shot_og/Basque/_basque_few_shot_og_template_yaml'
2025-08-31T08:28:52,669   adding 'lm_eval/tasks/include/few_shot_og/Basque/_include_base_44_basque.yaml'
2025-08-31T08:28:52,670   adding 'lm_eval/tasks/include/few_shot_og/Basque/include_base_44_basque_professional_certification.yaml'
2025-08-31T08:28:52,671   adding 'lm_eval/tasks/include/few_shot_og/Basque/utils.py'
2025-08-31T08:28:52,672   adding 'lm_eval/tasks/include/few_shot_og/Belarusian/_belarusian_few_shot_og_template_yaml'
2025-08-31T08:28:52,674   adding 'lm_eval/tasks/include/few_shot_og/Belarusian/_include_base_44_belarusian.yaml'
2025-08-31T08:28:52,675   adding 'lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_arts_humanities.yaml'
2025-08-31T08:28:52,676   adding 'lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_social_science.yaml'
2025-08-31T08:28:52,677   adding 'lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_stem.yaml'
2025-08-31T08:28:52,678   adding 'lm_eval/tasks/include/few_shot_og/Belarusian/utils.py'
2025-08-31T08:28:52,680   adding 'lm_eval/tasks/include/few_shot_og/Bengali/_bengali_few_shot_og_template_yaml'
2025-08-31T08:28:52,681   adding 'lm_eval/tasks/include/few_shot_og/Bengali/_include_base_44_bengali.yaml'
2025-08-31T08:28:52,682   adding 'lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_arts_humanities.yaml'
2025-08-31T08:28:52,683   adding 'lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_general_knowledge.yaml'
2025-08-31T08:28:52,684   adding 'lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_professional_certification.yaml'
2025-08-31T08:28:52,686   adding 'lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_stem.yaml'
2025-08-31T08:28:52,687   adding 'lm_eval/tasks/include/few_shot_og/Bengali/utils.py'
2025-08-31T08:28:52,689   adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/_bulgarian_few_shot_og_template_yaml'
2025-08-31T08:28:52,690   adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/_include_base_44_bulgarian.yaml'
2025-08-31T08:28:52,693   adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml'
2025-08-31T08:28:52,694   adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_social_science.yaml'
2025-08-31T08:28:52,695   adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_stem.yaml'
2025-08-31T08:28:52,696   adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/utils.py'
2025-08-31T08:28:52,698   adding 'lm_eval/tasks/include/few_shot_og/Chinese/_chinese_few_shot_og_template_yaml'
2025-08-31T08:28:52,699   adding 'lm_eval/tasks/include/few_shot_og/Chinese/_include_base_44_chinese.yaml'
2025-08-31T08:28:52,700   adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_applied_science.yaml'
2025-08-31T08:28:52,702   adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_arts_humanities.yaml'
2025-08-31T08:28:52,703   adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_business_commerce.yaml'
2025-08-31T08:28:52,704   adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_driving_license.yaml'
2025-08-31T08:28:52,705   adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_health_oriented_education.yaml'
2025-08-31T08:28:52,706   adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_professional_certification.yaml'
2025-08-31T08:28:52,707   adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_social_science.yaml'
2025-08-31T08:28:52,708   adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_stem.yaml'
2025-08-31T08:28:52,709   adding 'lm_eval/tasks/include/few_shot_og/Chinese/utils.py'
2025-08-31T08:28:52,711   adding 'lm_eval/tasks/include/few_shot_og/Croatian/_croatian_few_shot_og_template_yaml'
2025-08-31T08:28:52,712   adding 'lm_eval/tasks/include/few_shot_og/Croatian/_include_base_44_croatian.yaml'
2025-08-31T08:28:52,713   adding 'lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_arts_humanities.yaml'
2025-08-31T08:28:52,714   adding 'lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_social_science.yaml'
2025-08-31T08:28:52,715   adding 'lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_stem.yaml'
2025-08-31T08:28:52,716   adding 'lm_eval/tasks/include/few_shot_og/Croatian/utils.py'
2025-08-31T08:28:52,718   adding 'lm_eval/tasks/include/few_shot_og/Dutch/_dutch_few_shot_og_template_yaml'
2025-08-31T08:28:52,719   adding 'lm_eval/tasks/include/few_shot_og/Dutch/_include_base_44_dutch.yaml'
2025-08-31T08:28:52,720   adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_applied_science.yaml'
2025-08-31T08:28:52,722   adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_arts_humanities.yaml'
2025-08-31T08:28:52,723   adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_health_oriented_education.yaml'
2025-08-31T08:28:52,724   adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_social_science.yaml'
2025-08-31T08:28:52,725   adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_stem.yaml'
2025-08-31T08:28:52,726   adding 'lm_eval/tasks/include/few_shot_og/Dutch/utils.py'
2025-08-31T08:28:52,728   adding 'lm_eval/tasks/include/few_shot_og/Estonian/_estonian_few_shot_og_template_yaml'
2025-08-31T08:28:52,729   adding 'lm_eval/tasks/include/few_shot_og/Estonian/_include_base_44_estonian.yaml'
2025-08-31T08:28:52,730   adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_applied_science.yaml'
2025-08-31T08:28:52,732   adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_arts_humanities.yaml'
2025-08-31T08:28:52,733   adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_health_oriented_education.yaml'
2025-08-31T08:28:52,734   adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_social_science.yaml'
2025-08-31T08:28:52,735   adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_stem.yaml'
2025-08-31T08:28:52,737   adding 'lm_eval/tasks/include/few_shot_og/Estonian/utils.py'
2025-08-31T08:28:52,739   adding 'lm_eval/tasks/include/few_shot_og/Finnish/_finnish_few_shot_og_template_yaml'
2025-08-31T08:28:52,740   adding 'lm_eval/tasks/include/few_shot_og/Finnish/_include_base_44_finnish.yaml'
2025-08-31T08:28:52,741   adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_applied_science.yaml'
2025-08-31T08:28:52,742   adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_arts_humanities.yaml'
2025-08-31T08:28:52,743   adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_health_oriented_education.yaml'
2025-08-31T08:28:52,744   adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_social_science.yaml'
2025-08-31T08:28:52,746   adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_stem.yaml'
2025-08-31T08:28:52,747   adding 'lm_eval/tasks/include/few_shot_og/Finnish/utils.py'
2025-08-31T08:28:52,748   adding 'lm_eval/tasks/include/few_shot_og/French/_french_few_shot_og_template_yaml'
2025-08-31T08:28:52,749   adding 'lm_eval/tasks/include/few_shot_og/French/_include_base_44_french.yaml'
2025-08-31T08:28:52,751   adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_arts_humanities.yaml'
2025-08-31T08:28:52,752   adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_driving_license.yaml'
2025-08-31T08:28:52,753   adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_health_oriented_education.yaml'
2025-08-31T08:28:52,754   adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_social_science.yaml'
2025-08-31T08:28:52,755   adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_stem.yaml'
2025-08-31T08:28:52,756   adding 'lm_eval/tasks/include/few_shot_og/French/utils.py'
2025-08-31T08:28:52,758   adding 'lm_eval/tasks/include/few_shot_og/Georgian/_georgian_few_shot_og_template_yaml'
2025-08-31T08:28:52,759   adding 'lm_eval/tasks/include/few_shot_og/Georgian/_include_base_44_georgian.yaml'
2025-08-31T08:28:52,760   adding 'lm_eval/tasks/include/few_shot_og/Georgian/include_base_44_georgian_arts_humanities.yaml'
2025-08-31T08:28:52,761   adding 'lm_eval/tasks/include/few_shot_og/Georgian/utils.py'
2025-08-31T08:28:52,763   adding 'lm_eval/tasks/include/few_shot_og/German/_german_few_shot_og_template_yaml'
2025-08-31T08:28:52,764   adding 'lm_eval/tasks/include/few_shot_og/German/_include_base_44_german.yaml'
2025-08-31T08:28:52,765   adding 'lm_eval/tasks/include/few_shot_og/German/include_base_44_german_driving_license.yaml'
2025-08-31T08:28:52,766   adding 'lm_eval/tasks/include/few_shot_og/German/include_base_44_german_social_science.yaml'
2025-08-31T08:28:52,768   adding 'lm_eval/tasks/include/few_shot_og/German/include_base_44_german_stem.yaml'
2025-08-31T08:28:52,769   adding 'lm_eval/tasks/include/few_shot_og/German/utils.py'
2025-08-31T08:28:52,771   adding 'lm_eval/tasks/include/few_shot_og/Greek/_greek_few_shot_og_template_yaml'
2025-08-31T08:28:52,772   adding 'lm_eval/tasks/include/few_shot_og/Greek/_include_base_44_greek.yaml'
2025-08-31T08:28:52,773   adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_arts_humanities.yaml'
2025-08-31T08:28:52,774   adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_business_commerce.yaml'
2025-08-31T08:28:52,775   adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_health_oriented_education.yaml'
2025-08-31T08:28:52,776   adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_medical_license.yaml'
2025-08-31T08:28:52,778   adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_professional_certification.yaml'
2025-08-31T08:28:52,779   adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_social_science.yaml'
2025-08-31T08:28:52,780   adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_stem.yaml'
2025-08-31T08:28:52,781   adding 'lm_eval/tasks/include/few_shot_og/Greek/utils.py'
2025-08-31T08:28:52,783   adding 'lm_eval/tasks/include/few_shot_og/Hebrew/_hebrew_few_shot_og_template_yaml'
2025-08-31T08:28:52,784   adding 'lm_eval/tasks/include/few_shot_og/Hebrew/_include_base_44_hebrew.yaml'
2025-08-31T08:28:52,785   adding 'lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_arts_humanities.yaml'
2025-08-31T08:28:52,786   adding 'lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_driving_license.yaml'
2025-08-31T08:28:52,788   adding 'lm_eval/tasks/include/few_shot_og/Hebrew/utils.py'
2025-08-31T08:28:52,789   adding 'lm_eval/tasks/include/few_shot_og/Hindi/_hindi_few_shot_og_template_yaml'
2025-08-31T08:28:52,791   adding 'lm_eval/tasks/include/few_shot_og/Hindi/_include_base_44_hindi.yaml'
2025-08-31T08:28:52,792   adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_applied_science.yaml'
2025-08-31T08:28:52,793   adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_arts_humanities.yaml'
2025-08-31T08:28:52,794   adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_driving_license.yaml'
2025-08-31T08:28:52,795   adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_general_knowledge.yaml'
2025-08-31T08:28:52,796   adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_health_oriented_education.yaml'
2025-08-31T08:28:52,798   adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_professional_certification.yaml'
2025-08-31T08:28:52,799   adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_social_science.yaml'
2025-08-31T08:28:52,800   adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_stem.yaml'
2025-08-31T08:28:52,801   adding 'lm_eval/tasks/include/few_shot_og/Hindi/utils.py'
2025-08-31T08:28:52,803   adding 'lm_eval/tasks/include/few_shot_og/Hungarian/_hungarian_few_shot_og_template_yaml'
2025-08-31T08:28:52,804   adding 'lm_eval/tasks/include/few_shot_og/Hungarian/_include_base_44_hungarian.yaml'
2025-08-31T08:28:52,805   adding 'lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_applied_science.yaml'
2025-08-31T08:28:52,806   adding 'lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_social_science.yaml'
2025-08-31T08:28:52,807   adding 'lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_stem.yaml'
2025-08-31T08:28:52,808   adding 'lm_eval/tasks/include/few_shot_og/Hungarian/utils.py'
2025-08-31T08:28:52,810   adding 'lm_eval/tasks/include/few_shot_og/Indonesian/_include_base_44_indonesian.yaml'
2025-08-31T08:28:52,811   adding 'lm_eval/tasks/include/few_shot_og/Indonesian/_indonesian_few_shot_og_template_yaml'
2025-08-31T08:28:52,812   adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_applied_science.yaml'
2025-08-31T08:28:52,813   adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_arts_humanities.yaml'
2025-08-31T08:28:52,814   adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_professional_certification.yaml'
2025-08-31T08:28:52,816   adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_social_science.yaml'
2025-08-31T08:28:52,817   adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_stem.yaml'
2025-08-31T08:28:52,818   adding 'lm_eval/tasks/include/few_shot_og/Indonesian/utils.py'
2025-08-31T08:28:52,820   adding 'lm_eval/tasks/include/few_shot_og/Italian/_include_base_44_italian.yaml'
2025-08-31T08:28:52,821   adding 'lm_eval/tasks/include/few_shot_og/Italian/_italian_few_shot_og_template_yaml'
2025-08-31T08:28:52,822   adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_applied_science.yaml'
2025-08-31T08:28:52,823   adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_arts_humanities.yaml'
2025-08-31T08:28:52,824   adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_health_oriented_education.yaml'
2025-08-31T08:28:52,826   adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_professional_certification.yaml'
2025-08-31T08:28:52,827   adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_social_science.yaml'
2025-08-31T08:28:52,828   adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_stem.yaml'
2025-08-31T08:28:52,829   adding 'lm_eval/tasks/include/few_shot_og/Italian/utils.py'
2025-08-31T08:28:52,831   adding 'lm_eval/tasks/include/few_shot_og/Japanese/_include_base_44_japanese.yaml'
2025-08-31T08:28:52,832   adding 'lm_eval/tasks/include/few_shot_og/Japanese/_japanese_few_shot_og_template_yaml'
2025-08-31T08:28:52,833   adding 'lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_driving_license.yaml'
2025-08-31T08:28:52,834   adding 'lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_medical_license.yaml'
2025-08-31T08:28:52,835   adding 'lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_professional_certification.yaml'
2025-08-31T08:28:52,837   adding 'lm_eval/tasks/include/few_shot_og/Japanese/utils.py'
2025-08-31T08:28:52,838   adding 'lm_eval/tasks/include/few_shot_og/Kazakh/_include_base_44_kazakh.yaml'
2025-08-31T08:28:52,839   adding 'lm_eval/tasks/include/few_shot_og/Kazakh/_kazakh_few_shot_og_template_yaml'
2025-08-31T08:28:52,840   adding 'lm_eval/tasks/include/few_shot_og/Kazakh/include_base_44_kazakh_arts_humanities.yaml'
2025-08-31T08:28:52,841   adding 'lm_eval/tasks/include/few_shot_og/Kazakh/utils.py'
2025-08-31T08:28:52,843   adding 'lm_eval/tasks/include/few_shot_og/Korean/_include_base_44_korean.yaml'
2025-08-31T08:28:52,844   adding 'lm_eval/tasks/include/few_shot_og/Korean/_korean_few_shot_og_template_yaml'
2025-08-31T08:28:52,845   adding 'lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_professional_certification.yaml'
2025-08-31T08:28:52,847   adding 'lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_social_science.yaml'
2025-08-31T08:28:52,848   adding 'lm_eval/tasks/include/few_shot_og/Korean/utils.py'
2025-08-31T08:28:52,849   adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/_include_base_44_lithuanian.yaml'
2025-08-31T08:28:52,850   adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/_lithuanian_few_shot_og_template_yaml'
2025-08-31T08:28:52,852   adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml'
2025-08-31T08:28:52,853   adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_business_commerce.yaml'
2025-08-31T08:28:52,854   adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_professional_certification.yaml'
2025-08-31T08:28:52,855   adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_social_science.yaml'
2025-08-31T08:28:52,856   adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_stem.yaml'
2025-08-31T08:28:52,857   adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/utils.py'
2025-08-31T08:28:52,859   adding 'lm_eval/tasks/include/few_shot_og/Malay/_include_base_44_malay.yaml'
2025-08-31T08:28:52,860   adding 'lm_eval/tasks/include/few_shot_og/Malay/_malay_few_shot_og_template_yaml'
2025-08-31T08:28:52,862   adding 'lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_arts_humanities.yaml'
2025-08-31T08:28:52,863   adding 'lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_business_commerce.yaml'
2025-08-31T08:28:52,864   adding 'lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_social_science.yaml'
2025-08-31T08:28:52,865   adding 'lm_eval/tasks/include/few_shot_og/Malay/utils.py'
2025-08-31T08:28:52,867   adding 'lm_eval/tasks/include/few_shot_og/Malayalam/_include_base_44_malayalam.yaml'
2025-08-31T08:28:52,868   adding 'lm_eval/tasks/include/few_shot_og/Malayalam/_malayalam_few_shot_og_template_yaml'
2025-08-31T08:28:52,869   adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_arts_humanities.yaml'
2025-08-31T08:28:52,870   adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_general_knowledge.yaml'
2025-08-31T08:28:52,872   adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_health_oriented_education.yaml'
2025-08-31T08:28:52,873   adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_marine_license.yaml'
2025-08-31T08:28:52,874   adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_social_science.yaml'
2025-08-31T08:28:52,875   adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_stem.yaml'
2025-08-31T08:28:52,876   adding 'lm_eval/tasks/include/few_shot_og/Malayalam/utils.py'
2025-08-31T08:28:52,878   adding 'lm_eval/tasks/include/few_shot_og/Nepali/_include_base_44_nepali.yaml'
2025-08-31T08:28:52,879   adding 'lm_eval/tasks/include/few_shot_og/Nepali/_nepali_few_shot_og_template_yaml'
2025-08-31T08:28:52,880   adding 'lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_driving_license.yaml'
2025-08-31T08:28:52,882   adding 'lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_professional_certification.yaml'
2025-08-31T08:28:52,883   adding 'lm_eval/tasks/include/few_shot_og/Nepali/utils.py'
2025-08-31T08:28:52,884   adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/_include_base_44_north macedonian.yaml'
2025-08-31T08:28:52,886   adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/_north macedonian_few_shot_og_template_yaml'
2025-08-31T08:28:52,887   adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_arts_humanities.yaml'
2025-08-31T08:28:52,888   adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_business_commerce.yaml'
2025-08-31T08:28:52,889   adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_social_science.yaml'
2025-08-31T08:28:52,890   adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north macedonian_stem.yaml'
2025-08-31T08:28:52,891   adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/utils.py'
2025-08-31T08:28:52,893   adding 'lm_eval/tasks/include/few_shot_og/Persian/_include_base_44_persian.yaml'
2025-08-31T08:28:52,894   adding 'lm_eval/tasks/include/few_shot_og/Persian/_persian_few_shot_og_template_yaml'
2025-08-31T08:28:52,895   adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_arts_humanities.yaml'
2025-08-31T08:28:52,896   adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_driving_license.yaml'
2025-08-31T08:28:52,898   adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_professional_certification.yaml'
2025-08-31T08:28:52,899   adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_social_science.yaml'
2025-08-31T08:28:52,900   adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_stem.yaml'
2025-08-31T08:28:52,901   adding 'lm_eval/tasks/include/few_shot_og/Persian/utils.py'
2025-08-31T08:28:52,903   adding 'lm_eval/tasks/include/few_shot_og/Polish/_include_base_44_polish.yaml'
2025-08-31T08:28:52,904   adding 'lm_eval/tasks/include/few_shot_og/Polish/_polish_few_shot_og_template_yaml'
2025-08-31T08:28:52,905   adding 'lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_professional_certification.yaml'
2025-08-31T08:28:52,906   adding 'lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_social_science.yaml'
2025-08-31T08:28:52,908   adding 'lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_stem.yaml'
2025-08-31T08:28:52,909   adding 'lm_eval/tasks/include/few_shot_og/Polish/utils.py'
2025-08-31T08:28:52,911   adding 'lm_eval/tasks/include/few_shot_og/Portuguese/_include_base_44_portuguese.yaml'
2025-08-31T08:28:52,912   adding 'lm_eval/tasks/include/few_shot_og/Portuguese/_portuguese_few_shot_og_template_yaml'
2025-08-31T08:28:52,913   adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_applied_science.yaml'
2025-08-31T08:28:52,914   adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_arts_humanities.yaml'
2025-08-31T08:28:52,915   adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_business_commerce.yaml'
2025-08-31T08:28:52,917   adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_health_oriented_education.yaml'
2025-08-31T08:28:52,918   adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_social_science.yaml'
2025-08-31T08:28:52,919   adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_stem.yaml'
2025-08-31T08:28:52,920   adding 'lm_eval/tasks/include/few_shot_og/Portuguese/utils.py'
2025-08-31T08:28:52,922   adding 'lm_eval/tasks/include/few_shot_og/Russian/_include_base_44_russian.yaml'
2025-08-31T08:28:52,923   adding 'lm_eval/tasks/include/few_shot_og/Russian/_russian_few_shot_og_template_yaml'
2025-08-31T08:28:52,924   adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_applied_science.yaml'
2025-08-31T08:28:52,925   adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_arts_humanities.yaml'
2025-08-31T08:28:52,926   adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_business_commerce.yaml'
2025-08-31T08:28:52,927   adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_driving_license.yaml'
2025-08-31T08:28:52,928   adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_health_oriented_education.yaml'
2025-08-31T08:28:52,929   adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_marine_license.yaml'
2025-08-31T08:28:52,930   adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_social_science.yaml'
2025-08-31T08:28:52,932   adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_stem.yaml'
2025-08-31T08:28:52,933   adding 'lm_eval/tasks/include/few_shot_og/Russian/utils.py'
2025-08-31T08:28:52,935   adding 'lm_eval/tasks/include/few_shot_og/Serbian/_include_base_44_serbian.yaml'
2025-08-31T08:28:52,936   adding 'lm_eval/tasks/include/few_shot_og/Serbian/_serbian_few_shot_og_template_yaml'
2025-08-31T08:28:52,937   adding 'lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_arts_humanities.yaml'
2025-08-31T08:28:52,938   adding 'lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_social_science.yaml'
2025-08-31T08:28:52,939   adding 'lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_stem.yaml'
2025-08-31T08:28:52,941   adding 'lm_eval/tasks/include/few_shot_og/Serbian/utils.py'
2025-08-31T08:28:52,942   adding 'lm_eval/tasks/include/few_shot_og/Spanish/_include_base_44_spanish.yaml'
2025-08-31T08:28:52,943   adding 'lm_eval/tasks/include/few_shot_og/Spanish/_spanish_few_shot_og_template_yaml'
2025-08-31T08:28:52,945   adding 'lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_arts_humanities.yaml'
2025-08-31T08:28:52,946   adding 'lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_health_oriented_education.yaml'
2025-08-31T08:28:52,947   adding 'lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_social_science.yaml'
2025-08-31T08:28:52,948   adding 'lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_stem.yaml'
2025-08-31T08:28:52,949   adding 'lm_eval/tasks/include/few_shot_og/Spanish/utils.py'
2025-08-31T08:28:52,951   adding 'lm_eval/tasks/include/few_shot_og/Tagalog/_include_base_44_tagalog.yaml'
2025-08-31T08:28:52,952   adding 'lm_eval/tasks/include/few_shot_og/Tagalog/_tagalog_few_shot_og_template_yaml'
2025-08-31T08:28:52,953   adding 'lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_arts_humanities.yaml'
2025-08-31T08:28:52,954   adding 'lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_driving_license.yaml'
2025-08-31T08:28:52,956   adding 'lm_eval/tasks/include/few_shot_og/Tagalog/utils.py'
2025-08-31T08:28:52,958   adding 'lm_eval/tasks/include/few_shot_og/Tamil/_include_base_44_tamil.yaml'
2025-08-31T08:28:52,959   adding 'lm_eval/tasks/include/few_shot_og/Tamil/_tamil_few_shot_og_template_yaml'
2025-08-31T08:28:52,960   adding 'lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_general_knowledge.yaml'
2025-08-31T08:28:52,961   adding 'lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_stem.yaml'
2025-08-31T08:28:52,963   adding 'lm_eval/tasks/include/few_shot_og/Tamil/utils.py'
2025-08-31T08:28:52,964   adding 'lm_eval/tasks/include/few_shot_og/Telugu/_include_base_44_telugu.yaml'
2025-08-31T08:28:52,966   adding 'lm_eval/tasks/include/few_shot_og/Telugu/_telugu_few_shot_og_template_yaml'
2025-08-31T08:28:52,967   adding 'lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_applied_science.yaml'
2025-08-31T08:28:52,968   adding 'lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_arts_humanities.yaml'
2025-08-31T08:28:52,969   adding 'lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_social_science.yaml'
2025-08-31T08:28:52,970   adding 'lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_stem.yaml'
2025-08-31T08:28:52,972   adding 'lm_eval/tasks/include/few_shot_og/Telugu/utils.py'
2025-08-31T08:28:52,973   adding 'lm_eval/tasks/include/few_shot_og/Turkish/_include_base_44_turkish.yaml'
2025-08-31T08:28:52,974   adding 'lm_eval/tasks/include/few_shot_og/Turkish/_turkish_few_shot_og_template_yaml'
2025-08-31T08:28:52,975   adding 'lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_arts_humanities.yaml'
2025-08-31T08:28:52,976   adding 'lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_business_commerce.yaml'
2025-08-31T08:28:52,978   adding 'lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_social_science.yaml'
2025-08-31T08:28:52,979   adding 'lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_stem.yaml'
2025-08-31T08:28:52,980   adding 'lm_eval/tasks/include/few_shot_og/Turkish/utils.py'
2025-08-31T08:28:52,982   adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/_include_base_44_ukrainian.yaml'
2025-08-31T08:28:52,983   adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/_ukrainian_few_shot_og_template_yaml'
2025-08-31T08:28:52,984   adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml'
2025-08-31T08:28:52,985   adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_social_science.yaml'
2025-08-31T08:28:52,986   adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_stem.yaml'
2025-08-31T08:28:52,987   adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/utils.py'
2025-08-31T08:28:52,989   adding 'lm_eval/tasks/include/few_shot_og/Urdu/_include_base_44_urdu.yaml'
2025-08-31T08:28:52,990   adding 'lm_eval/tasks/include/few_shot_og/Urdu/_urdu_few_shot_og_template_yaml'
2025-08-31T08:28:52,992   adding 'lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_arts_humanities.yaml'
2025-08-31T08:28:52,993   adding 'lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_health_oriented_education.yaml'
2025-08-31T08:28:52,994   adding 'lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_stem.yaml'
2025-08-31T08:28:52,995   adding 'lm_eval/tasks/include/few_shot_og/Urdu/utils.py'
2025-08-31T08:28:52,997   adding 'lm_eval/tasks/include/few_shot_og/Uzbek/_include_base_44_uzbek.yaml'
2025-08-31T08:28:52,998   adding 'lm_eval/tasks/include/few_shot_og/Uzbek/_uzbek_few_shot_og_template_yaml'
2025-08-31T08:28:52,999   adding 'lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_arts_humanities.yaml'
2025-08-31T08:28:53,001   adding 'lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_medical_license.yaml'
2025-08-31T08:28:53,002   adding 'lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_social_science.yaml'
2025-08-31T08:28:53,003   adding 'lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_stem.yaml'
2025-08-31T08:28:53,004   adding 'lm_eval/tasks/include/few_shot_og/Uzbek/utils.py'
2025-08-31T08:28:53,006   adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/_include_base_44_vietnamese.yaml'
2025-08-31T08:28:53,007   adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/_vietnamese_few_shot_og_template_yaml'
2025-08-31T08:28:53,008   adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml'
2025-08-31T08:28:53,009   adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_social_science.yaml'
2025-08-31T08:28:53,011   adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_stem.yaml'
2025-08-31T08:28:53,012   adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/utils.py'
2025-08-31T08:28:53,014   adding 'lm_eval/tasks/inverse_scaling/README.md'
2025-08-31T08:28:53,015   adding 'lm_eval/tasks/inverse_scaling/_inverse_scaling_mc_yaml'
2025-08-31T08:28:53,017   adding 'lm_eval/tasks/inverse_scaling/_some_results'
2025-08-31T08:28:53,018   adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_hindsight_neglect.yaml'
2025-08-31T08:28:53,019   adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_into_the_unknown.yaml'
2025-08-31T08:28:53,020   adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_memo_trap.yaml'
2025-08-31T08:28:53,020   adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_modus_tollens.yaml'
2025-08-31T08:28:53,021   adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_neqa.yaml'
2025-08-31T08:28:53,022   adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_pattern_matching_suppression.yaml'
2025-08-31T08:28:53,023   adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_quote_repetition.yaml'
2025-08-31T08:28:53,025   adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_redefine_math.yaml'
2025-08-31T08:28:53,026   adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_repetitive_algebra.yaml'
2025-08-31T08:28:53,027   adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_sig_figs.yaml'
2025-08-31T08:28:53,028   adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_winobias_antistereotype.yaml'
2025-08-31T08:28:53,030   adding 'lm_eval/tasks/japanese_leaderboard/README.md'
2025-08-31T08:28:53,032   adding 'lm_eval/tasks/japanese_leaderboard/_ja_leaderboard.yaml'
2025-08-31T08:28:53,033   adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jaqket_v2.yaml'
2025-08-31T08:28:53,034   adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.py'
2025-08-31T08:28:53,035   adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.yaml'
2025-08-31T08:28:53,037   adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jnli.yaml'
2025-08-31T08:28:53,038   adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jsquad.yaml'
2025-08-31T08:28:53,039   adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_marc_ja.yaml'
2025-08-31T08:28:53,040   adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.py'
2025-08-31T08:28:53,041   adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.yaml'
2025-08-31T08:28:53,043   adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.py'
2025-08-31T08:28:53,044   adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.yaml'
2025-08-31T08:28:53,045   adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.py'
2025-08-31T08:28:53,046   adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.yaml'
2025-08-31T08:28:53,048   adding 'lm_eval/tasks/japanese_leaderboard/requirements.txt'
2025-08-31T08:28:53,050   adding 'lm_eval/tasks/jsonschema_bench/README.md'
2025-08-31T08:28:53,051   adding 'lm_eval/tasks/jsonschema_bench/jsonschema_bench_easy.yaml'
2025-08-31T08:28:53,052   adding 'lm_eval/tasks/jsonschema_bench/jsonschema_bench_hard.yaml'
2025-08-31T08:28:53,054   adding 'lm_eval/tasks/jsonschema_bench/jsonschema_bench_medium.yaml'
2025-08-31T08:28:53,055   adding 'lm_eval/tasks/jsonschema_bench/metrics.py'
2025-08-31T08:28:53,057   adding 'lm_eval/tasks/kbl/README.md'
2025-08-31T08:28:53,060   adding 'lm_eval/tasks/kbl/bar_exam/civil/_base_em_yaml'
2025-08-31T08:28:53,061   adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2012.yaml'
2025-08-31T08:28:53,062   adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2013.yaml'
2025-08-31T08:28:53,063   adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2014.yaml'
2025-08-31T08:28:53,064   adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2015.yaml'
2025-08-31T08:28:53,066   adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2016.yaml'
2025-08-31T08:28:53,067   adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2017.yaml'
2025-08-31T08:28:53,068   adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2018.yaml'
2025-08-31T08:28:53,069   adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2019.yaml'
2025-08-31T08:28:53,070   adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2020.yaml'
2025-08-31T08:28:53,071   adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2021.yaml'
2025-08-31T08:28:53,072   adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2022.yaml'
2025-08-31T08:28:53,073   adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2023.yaml'
2025-08-31T08:28:53,074   adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2024.yaml'
2025-08-31T08:28:53,075   adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2025.yaml'
2025-08-31T08:28:53,077   adding 'lm_eval/tasks/kbl/bar_exam/criminal/_base_em_yaml'
2025-08-31T08:28:53,078   adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2012.yaml'
2025-08-31T08:28:53,079   adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2013.yaml'
2025-08-31T08:28:53,080   adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2014.yaml'
2025-08-31T08:28:53,081   adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2015.yaml'
2025-08-31T08:28:53,082   adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2016.yaml'
2025-08-31T08:28:53,084   adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2017.yaml'
2025-08-31T08:28:53,085   adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2018.yaml'
2025-08-31T08:28:53,086   adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2019.yaml'
2025-08-31T08:28:53,087   adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2020.yaml'
2025-08-31T08:28:53,088   adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2021.yaml'
2025-08-31T08:28:53,089   adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2022.yaml'
2025-08-31T08:28:53,090   adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2023.yaml'
2025-08-31T08:28:53,091   adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2024.yaml'
2025-08-31T08:28:53,093   adding 'lm_eval/tasks/kbl/bar_exam/public/_base_em_yaml'
2025-08-31T08:28:53,094   adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2012.yaml'
2025-08-31T08:28:53,095   adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2013.yaml'
2025-08-31T08:28:53,096   adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2014.yaml'
2025-08-31T08:28:53,097   adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2015.yaml'
2025-08-31T08:28:53,099   adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2016.yaml'
2025-08-31T08:28:53,100   adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2017.yaml'
2025-08-31T08:28:53,101   adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2018.yaml'
2025-08-31T08:28:53,102   adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2019.yaml'
2025-08-31T08:28:53,103   adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2020.yaml'
2025-08-31T08:28:53,104   adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2021.yaml'
2025-08-31T08:28:53,105   adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2022.yaml'
2025-08-31T08:28:53,106   adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2023.yaml'
2025-08-31T08:28:53,107   adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2024.yaml'
2025-08-31T08:28:53,109   adding 'lm_eval/tasks/kbl/bar_exam/responsibility/_base_em_yaml'
2025-08-31T08:28:53,110   adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2010.yaml'
2025-08-31T08:28:53,111   adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2011.yaml'
2025-08-31T08:28:53,113   adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2012.yaml'
2025-08-31T08:28:53,114   adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2013.yaml'
2025-08-31T08:28:53,115   adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2014.yaml'
2025-08-31T08:28:53,116   adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2015.yaml'
2025-08-31T08:28:53,117   adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2016.yaml'
2025-08-31T08:28:53,118   adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2017.yaml'
2025-08-31T08:28:53,119   adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2018.yaml'
2025-08-31T08:28:53,120   adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2019.yaml'
2025-08-31T08:28:53,121   adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2020.yaml'
2025-08-31T08:28:53,122   adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2021.yaml'
2025-08-31T08:28:53,123   adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2022.yaml'
2025-08-31T08:28:53,124   adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2023.yaml'
2025-08-31T08:28:53,126   adding 'lm_eval/tasks/kbl/knowledge/_kbl_knowledge_yaml'
2025-08-31T08:28:53,127   adding 'lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_em.yaml'
2025-08-31T08:28:53,129   adding 'lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_reasoning_em.yaml'
2025-08-31T08:28:53,130   adding 'lm_eval/tasks/kbl/knowledge/kbl_legal_concept_qa_em.yaml'
2025-08-31T08:28:53,131   adding 'lm_eval/tasks/kbl/knowledge/kbl_offense_component_qa_em.yaml'
2025-08-31T08:28:53,132   adding 'lm_eval/tasks/kbl/knowledge/kbl_query_statute_matching_qa_em.yaml'
2025-08-31T08:28:53,133   adding 'lm_eval/tasks/kbl/knowledge/kbl_statute_hallucination_qa_em.yaml'
2025-08-31T08:28:53,134   adding 'lm_eval/tasks/kbl/knowledge/kbl_statute_number_and_content_matching_qa_em.yaml'
2025-08-31T08:28:53,136   adding 'lm_eval/tasks/kbl/reasoning/_kbl_reasoning_yaml'
2025-08-31T08:28:53,137   adding 'lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_p_em.yaml'
2025-08-31T08:28:53,138   adding 'lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_q_em.yaml'
2025-08-31T08:28:53,140   adding 'lm_eval/tasks/kbl/reasoning/kbl_causal_reasoning_em.yaml'
2025-08-31T08:28:53,141   adding 'lm_eval/tasks/kbl/reasoning/kbl_statement_consistency_qa_em.yaml'
2025-08-31T08:28:53,143   adding 'lm_eval/tasks/kmmlu/README.md'
2025-08-31T08:28:53,145   adding 'lm_eval/tasks/kmmlu/cot_hard/_cot_kmmlu_yaml'
2025-08-31T08:28:53,146   adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard.yaml'
2025-08-31T08:28:53,148   adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_applied_science.yaml'
2025-08-31T08:28:53,149   adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_humss.yaml'
2025-08-31T08:28:53,150   adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_other.yaml'
2025-08-31T08:28:53,151   adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_stem.yaml'
2025-08-31T08:28:53,153   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_accounting.yaml'
2025-08-31T08:28:53,155   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_agricultural_sciences.yaml'
2025-08-31T08:28:53,157   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_aviation_engineering_and_maintenance.yaml'
2025-08-31T08:28:53,158   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_biology.yaml'
2025-08-31T08:28:53,160   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemical_engineering.yaml'
2025-08-31T08:28:53,162   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemistry.yaml'
2025-08-31T08:28:53,164   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_civil_engineering.yaml'
2025-08-31T08:28:53,166   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_computer_science.yaml'
2025-08-31T08:28:53,168   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_construction.yaml'
2025-08-31T08:28:53,170   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_criminal_law.yaml'
2025-08-31T08:28:53,173   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_ecology.yaml'
2025-08-31T08:28:53,175   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_economics.yaml'
2025-08-31T08:28:53,176   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_education.yaml'
2025-08-31T08:28:53,178   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electrical_engineering.yaml'
2025-08-31T08:28:53,180   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electronics_engineering.yaml'
2025-08-31T08:28:53,182   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_energy_management.yaml'
2025-08-31T08:28:53,183   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_environmental_science.yaml'
2025-08-31T08:28:53,185   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_fashion.yaml'
2025-08-31T08:28:53,187   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_food_processing.yaml'
2025-08-31T08:28:53,189   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_gas_technology_and_engineering.yaml'
2025-08-31T08:28:53,190   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_geomatics.yaml'
2025-08-31T08:28:53,192   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_health.yaml'
2025-08-31T08:28:53,194   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_industrial_engineer.yaml'
2025-08-31T08:28:53,195   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_information_technology.yaml'
2025-08-31T08:28:53,198   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_interior_architecture_and_design.yaml'
2025-08-31T08:28:53,200   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_korean_history.yaml'
2025-08-31T08:28:53,201   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_law.yaml'
2025-08-31T08:28:53,203   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_machine_design_and_manufacturing.yaml'
2025-08-31T08:28:53,205   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_management.yaml'
2025-08-31T08:28:53,207   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_maritime_engineering.yaml'
2025-08-31T08:28:53,209   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_marketing.yaml'
2025-08-31T08:28:53,211   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_materials_engineering.yaml'
2025-08-31T08:28:53,213   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_math.yaml'
2025-08-31T08:28:53,214   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_mechanical_engineering.yaml'
2025-08-31T08:28:53,216   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_nondestructive_testing.yaml'
2025-08-31T08:28:53,218   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_patent.yaml'
2025-08-31T08:28:53,221   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_political_science_and_sociology.yaml'
2025-08-31T08:28:53,223   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_psychology.yaml'
2025-08-31T08:28:53,225   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_public_safety.yaml'
2025-08-31T08:28:53,227   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_railway_and_automotive_engineering.yaml'
2025-08-31T08:28:53,228   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_real_estate.yaml'
2025-08-31T08:28:53,230   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_refrigerating_machinery.yaml'
2025-08-31T08:28:53,232   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_social_welfare.yaml'
2025-08-31T08:28:53,234   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_taxation.yaml'
2025-08-31T08:28:53,236   adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_telecommunications_and_wireless_technology.yaml'
2025-08-31T08:28:53,239   adding 'lm_eval/tasks/kmmlu/default/_default_kmmlu_yaml'
2025-08-31T08:28:53,240   adding 'lm_eval/tasks/kmmlu/default/_kmmlu_applied_science.yaml'
2025-08-31T08:28:53,241   adding 'lm_eval/tasks/kmmlu/default/_kmmlu_default.yaml'
2025-08-31T08:28:53,242   adding 'lm_eval/tasks/kmmlu/default/_kmmlu_humss.yaml'
2025-08-31T08:28:53,243   adding 'lm_eval/tasks/kmmlu/default/_kmmlu_other.yaml'
2025-08-31T08:28:53,244   adding 'lm_eval/tasks/kmmlu/default/_kmmlu_stem.yaml'
2025-08-31T08:28:53,245   adding 'lm_eval/tasks/kmmlu/default/kmmlu_accounting.yaml'
2025-08-31T08:28:53,247   adding 'lm_eval/tasks/kmmlu/default/kmmlu_agricultural_sciences.yaml'
2025-08-31T08:28:53,248   adding 'lm_eval/tasks/kmmlu/default/kmmlu_aviation_engineering_and_maintenance.yaml'
2025-08-31T08:28:53,249   adding 'lm_eval/tasks/kmmlu/default/kmmlu_biology.yaml'
2025-08-31T08:28:53,250   adding 'lm_eval/tasks/kmmlu/default/kmmlu_chemical_engineering.yaml'
2025-08-31T08:28:53,251   adding 'lm_eval/tasks/kmmlu/default/kmmlu_chemistry.yaml'
2025-08-31T08:28:53,252   adding 'lm_eval/tasks/kmmlu/default/kmmlu_civil_engineering.yaml'
2025-08-31T08:28:53,253   adding 'lm_eval/tasks/kmmlu/default/kmmlu_computer_science.yaml'
2025-08-31T08:28:53,254   adding 'lm_eval/tasks/kmmlu/default/kmmlu_construction.yaml'
2025-08-31T08:28:53,255   adding 'lm_eval/tasks/kmmlu/default/kmmlu_criminal_law.yaml'
2025-08-31T08:28:53,256   adding 'lm_eval/tasks/kmmlu/default/kmmlu_ecology.yaml'
2025-08-31T08:28:53,257   adding 'lm_eval/tasks/kmmlu/default/kmmlu_economics.yaml'
2025-08-31T08:28:53,258   adding 'lm_eval/tasks/kmmlu/default/kmmlu_education.yaml'
2025-08-31T08:28:53,260   adding 'lm_eval/tasks/kmmlu/default/kmmlu_electrical_engineering.yaml'
2025-08-31T08:28:53,261   adding 'lm_eval/tasks/kmmlu/default/kmmlu_electronics_engineering.yaml'
2025-08-31T08:28:53,262   adding 'lm_eval/tasks/kmmlu/default/kmmlu_energy_management.yaml'
2025-08-31T08:28:53,263   adding 'lm_eval/tasks/kmmlu/default/kmmlu_environmental_science.yaml'
2025-08-31T08:28:53,264   adding 'lm_eval/tasks/kmmlu/default/kmmlu_fashion.yaml'
2025-08-31T08:28:53,265   adding 'lm_eval/tasks/kmmlu/default/kmmlu_food_processing.yaml'
2025-08-31T08:28:53,266   adding 'lm_eval/tasks/kmmlu/default/kmmlu_gas_technology_and_engineering.yaml'
2025-08-31T08:28:53,267   adding 'lm_eval/tasks/kmmlu/default/kmmlu_geomatics.yaml'
2025-08-31T08:28:53,268   adding 'lm_eval/tasks/kmmlu/default/kmmlu_health.yaml'
2025-08-31T08:28:53,269   adding 'lm_eval/tasks/kmmlu/default/kmmlu_industrial_engineer.yaml'
2025-08-31T08:28:53,270   adding 'lm_eval/tasks/kmmlu/default/kmmlu_information_technology.yaml'
2025-08-31T08:28:53,271   adding 'lm_eval/tasks/kmmlu/default/kmmlu_interior_architecture_and_design.yaml'
2025-08-31T08:28:53,272   adding 'lm_eval/tasks/kmmlu/default/kmmlu_korean_history.yaml'
2025-08-31T08:28:53,273   adding 'lm_eval/tasks/kmmlu/default/kmmlu_law.yaml'
2025-08-31T08:28:53,275   adding 'lm_eval/tasks/kmmlu/default/kmmlu_machine_design_and_manufacturing.yaml'
2025-08-31T08:28:53,276   adding 'lm_eval/tasks/kmmlu/default/kmmlu_management.yaml'
2025-08-31T08:28:53,277   adding 'lm_eval/tasks/kmmlu/default/kmmlu_maritime_engineering.yaml'
2025-08-31T08:28:53,278   adding 'lm_eval/tasks/kmmlu/default/kmmlu_marketing.yaml'
2025-08-31T08:28:53,279   adding 'lm_eval/tasks/kmmlu/default/kmmlu_materials_engineering.yaml'
2025-08-31T08:28:53,280   adding 'lm_eval/tasks/kmmlu/default/kmmlu_math.yaml'
2025-08-31T08:28:53,281   adding 'lm_eval/tasks/kmmlu/default/kmmlu_mechanical_engineering.yaml'
2025-08-31T08:28:53,282   adding 'lm_eval/tasks/kmmlu/default/kmmlu_nondestructive_testing.yaml'
2025-08-31T08:28:53,283   adding 'lm_eval/tasks/kmmlu/default/kmmlu_patent.yaml'
2025-08-31T08:28:53,285   adding 'lm_eval/tasks/kmmlu/default/kmmlu_political_science_and_sociology.yaml'
2025-08-31T08:28:53,286   adding 'lm_eval/tasks/kmmlu/default/kmmlu_psychology.yaml'
2025-08-31T08:28:53,287   adding 'lm_eval/tasks/kmmlu/default/kmmlu_public_safety.yaml'
2025-08-31T08:28:53,288   adding 'lm_eval/tasks/kmmlu/default/kmmlu_railway_and_automotive_engineering.yaml'
2025-08-31T08:28:53,289   adding 'lm_eval/tasks/kmmlu/default/kmmlu_real_estate.yaml'
2025-08-31T08:28:53,290   adding 'lm_eval/tasks/kmmlu/default/kmmlu_refrigerating_machinery.yaml'
2025-08-31T08:28:53,292   adding 'lm_eval/tasks/kmmlu/default/kmmlu_social_welfare.yaml'
2025-08-31T08:28:53,293   adding 'lm_eval/tasks/kmmlu/default/kmmlu_taxation.yaml'
2025-08-31T08:28:53,294   adding 'lm_eval/tasks/kmmlu/default/kmmlu_telecommunications_and_wireless_technology.yaml'
2025-08-31T08:28:53,296   adding 'lm_eval/tasks/kmmlu/direct/_direct_kmmlu_yaml'
2025-08-31T08:28:53,298   adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct.yaml'
2025-08-31T08:28:53,299   adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct_applied_science.yaml'
2025-08-31T08:28:53,300   adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct_humss.yaml'
2025-08-31T08:28:53,301   adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct_other.yaml'
2025-08-31T08:28:53,302   adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct_stem.yaml'
2025-08-31T08:28:53,303   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_accounting.yaml'
2025-08-31T08:28:53,304   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_agricultural_sciences.yaml'
2025-08-31T08:28:53,305   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_aviation_engineering_and_maintenance.yaml'
2025-08-31T08:28:53,306   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_biology.yaml'
2025-08-31T08:28:53,307   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemical_engineering.yaml'
2025-08-31T08:28:53,308   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemistry.yaml'
2025-08-31T08:28:53,310   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_civil_engineering.yaml'
2025-08-31T08:28:53,311   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_computer_science.yaml'
2025-08-31T08:28:53,312   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_construction.yaml'
2025-08-31T08:28:53,313   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_criminal_law.yaml'
2025-08-31T08:28:53,314   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_ecology.yaml'
2025-08-31T08:28:53,315   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_economics.yaml'
2025-08-31T08:28:53,316   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_education.yaml'
2025-08-31T08:28:53,318   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_electrical_engineering.yaml'
2025-08-31T08:28:53,319   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_electronics_engineering.yaml'
2025-08-31T08:28:53,320   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_energy_management.yaml'
2025-08-31T08:28:53,321   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_environmental_science.yaml'
2025-08-31T08:28:53,322   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_fashion.yaml'
2025-08-31T08:28:53,323   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_food_processing.yaml'
2025-08-31T08:28:53,324   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_gas_technology_and_engineering.yaml'
2025-08-31T08:28:53,326   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_geomatics.yaml'
2025-08-31T08:28:53,327   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_health.yaml'
2025-08-31T08:28:53,328   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_industrial_engineer.yaml'
2025-08-31T08:28:53,329   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_information_technology.yaml'
2025-08-31T08:28:53,330   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_interior_architecture_and_design.yaml'
2025-08-31T08:28:53,331   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_korean_history.yaml'
2025-08-31T08:28:53,332   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_law.yaml'
2025-08-31T08:28:53,333   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_machine_design_and_manufacturing.yaml'
2025-08-31T08:28:53,334   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_management.yaml'
2025-08-31T08:28:53,336   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_maritime_engineering.yaml'
2025-08-31T08:28:53,337   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_marketing.yaml'
2025-08-31T08:28:53,338   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_materials_engineering.yaml'
2025-08-31T08:28:53,339   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_math.yaml'
2025-08-31T08:28:53,340   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_mechanical_engineering.yaml'
2025-08-31T08:28:53,341   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_nondestructive_testing.yaml'
2025-08-31T08:28:53,343   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_patent.yaml'
2025-08-31T08:28:53,344   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_political_science_and_sociology.yaml'
2025-08-31T08:28:53,345   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_psychology.yaml'
2025-08-31T08:28:53,346   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_public_safety.yaml'
2025-08-31T08:28:53,347   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_railway_and_automotive_engineering.yaml'
2025-08-31T08:28:53,348   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_real_estate.yaml'
2025-08-31T08:28:53,349   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_refrigerating_machinery.yaml'
2025-08-31T08:28:53,350   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_social_welfare.yaml'
2025-08-31T08:28:53,351   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_taxation.yaml'
2025-08-31T08:28:53,352   adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_telecommunications_and_wireless_technology.yaml'
2025-08-31T08:28:53,355   adding 'lm_eval/tasks/kmmlu/direct_hard/_direct_hard_kmmlu_yaml'
2025-08-31T08:28:53,356   adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard.yaml'
2025-08-31T08:28:53,357   adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_applied_science.yaml'
2025-08-31T08:28:53,358   adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_humss.yaml'
2025-08-31T08:28:53,359   adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_other.yaml'
2025-08-31T08:28:53,360   adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_stem.yaml'
2025-08-31T08:28:53,361   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_accounting.yaml'
2025-08-31T08:28:53,362   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_agricultural_sciences.yaml'
2025-08-31T08:28:53,363   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_aviation_engineering_and_maintenance.yaml'
2025-08-31T08:28:53,364   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_biology.yaml'
2025-08-31T08:28:53,366   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemical_engineering.yaml'
2025-08-31T08:28:53,367   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemistry.yaml'
2025-08-31T08:28:53,368   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_civil_engineering.yaml'
2025-08-31T08:28:53,369   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_computer_science.yaml'
2025-08-31T08:28:53,371   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_construction.yaml'
2025-08-31T08:28:53,372   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_criminal_law.yaml'
2025-08-31T08:28:53,373   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_ecology.yaml'
2025-08-31T08:28:53,374   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_economics.yaml'
2025-08-31T08:28:53,376   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_education.yaml'
2025-08-31T08:28:53,377   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electrical_engineering.yaml'
2025-08-31T08:28:53,378   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electronics_engineering.yaml'
2025-08-31T08:28:53,379   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_energy_management.yaml'
2025-08-31T08:28:53,380   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_environmental_science.yaml'
2025-08-31T08:28:53,381   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_fashion.yaml'
2025-08-31T08:28:53,382   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_food_processing.yaml'
2025-08-31T08:28:53,384   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_gas_technology_and_engineering.yaml'
2025-08-31T08:28:53,385   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_geomatics.yaml'
2025-08-31T08:28:53,386   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_health.yaml'
2025-08-31T08:28:53,387   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_industrial_engineer.yaml'
2025-08-31T08:28:53,388   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_information_technology.yaml'
2025-08-31T08:28:53,389   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_interior_architecture_and_design.yaml'
2025-08-31T08:28:53,391   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_korean_history.yaml'
2025-08-31T08:28:53,392   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_law.yaml'
2025-08-31T08:28:53,393   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_machine_design_and_manufacturing.yaml'
2025-08-31T08:28:53,394   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_management.yaml'
2025-08-31T08:28:53,395   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_maritime_engineering.yaml'
2025-08-31T08:28:53,396   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_marketing.yaml'
2025-08-31T08:28:53,397   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_materials_engineering.yaml'
2025-08-31T08:28:53,398   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_math.yaml'
2025-08-31T08:28:53,399   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_mechanical_engineering.yaml'
2025-08-31T08:28:53,400   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_nondestructive_testing.yaml'
2025-08-31T08:28:53,401   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_patent.yaml'
2025-08-31T08:28:53,402   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_political_science_and_sociology.yaml'
2025-08-31T08:28:53,403   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_psychology.yaml'
2025-08-31T08:28:53,404   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_public_safety.yaml'
2025-08-31T08:28:53,405   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_railway_and_automotive_engineering.yaml'
2025-08-31T08:28:53,406   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_real_estate.yaml'
2025-08-31T08:28:53,408   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_refrigerating_machinery.yaml'
2025-08-31T08:28:53,409   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_social_welfare.yaml'
2025-08-31T08:28:53,410   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_taxation.yaml'
2025-08-31T08:28:53,411   adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_telecommunications_and_wireless_technology.yaml'
2025-08-31T08:28:53,414   adding 'lm_eval/tasks/kmmlu/hard/_hard_kmmlu_yaml'
2025-08-31T08:28:53,416   adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard.yaml'
2025-08-31T08:28:53,417   adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard_applied_science.yaml'
2025-08-31T08:28:53,418   adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard_humss.yaml'
2025-08-31T08:28:53,419   adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard_other.yaml'
2025-08-31T08:28:53,420   adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard_stem.yaml'
2025-08-31T08:28:53,421   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_accounting.yaml'
2025-08-31T08:28:53,423   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_agricultural_sciences.yaml'
2025-08-31T08:28:53,424   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_aviation_engineering_and_maintenance.yaml'
2025-08-31T08:28:53,425   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_biology.yaml'
2025-08-31T08:28:53,426   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemical_engineering.yaml'
2025-08-31T08:28:53,427   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemistry.yaml'
2025-08-31T08:28:53,428   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_civil_engineering.yaml'
2025-08-31T08:28:53,429   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_computer_science.yaml'
2025-08-31T08:28:53,431   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_construction.yaml'
2025-08-31T08:28:53,432   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_criminal_law.yaml'
2025-08-31T08:28:53,433   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_ecology.yaml'
2025-08-31T08:28:53,434   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_economics.yaml'
2025-08-31T08:28:53,435   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_education.yaml'
2025-08-31T08:28:53,437   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_electrical_engineering.yaml'
2025-08-31T08:28:53,439   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_electronics_engineering.yaml'
2025-08-31T08:28:53,441   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_energy_management.yaml'
2025-08-31T08:28:53,443   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_environmental_science.yaml'
2025-08-31T08:28:53,446   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_fashion.yaml'
2025-08-31T08:28:53,449   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_food_processing.yaml'
2025-08-31T08:28:53,452   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_gas_technology_and_engineering.yaml'
2025-08-31T08:28:53,455   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_geomatics.yaml'
2025-08-31T08:28:53,458   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_health.yaml'
2025-08-31T08:28:53,459   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_industrial_engineer.yaml'
2025-08-31T08:28:53,461   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_information_technology.yaml'
2025-08-31T08:28:53,463   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_interior_architecture_and_design.yaml'
2025-08-31T08:28:53,464   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_korean_history.yaml'
2025-08-31T08:28:53,465   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_law.yaml'
2025-08-31T08:28:53,467   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_machine_design_and_manufacturing.yaml'
2025-08-31T08:28:53,468   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_management.yaml'
2025-08-31T08:28:53,470   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_maritime_engineering.yaml'
2025-08-31T08:28:53,471   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_marketing.yaml'
2025-08-31T08:28:53,473   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_materials_engineering.yaml'
2025-08-31T08:28:53,475   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_math.yaml'
2025-08-31T08:28:53,476   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_mechanical_engineering.yaml'
2025-08-31T08:28:53,477   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_nondestructive_testing.yaml'
2025-08-31T08:28:53,479   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_patent.yaml'
2025-08-31T08:28:53,481   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_political_science_and_sociology.yaml'
2025-08-31T08:28:53,483   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_psychology.yaml'
2025-08-31T08:28:53,485   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_public_safety.yaml'
2025-08-31T08:28:53,486   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_railway_and_automotive_engineering.yaml'
2025-08-31T08:28:53,488   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_real_estate.yaml'
2025-08-31T08:28:53,489   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_refrigerating_machinery.yaml'
2025-08-31T08:28:53,490   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_social_welfare.yaml'
2025-08-31T08:28:53,492   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_taxation.yaml'
2025-08-31T08:28:53,493   adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_telecommunications_and_wireless_technology.yaml'
2025-08-31T08:28:53,495   adding 'lm_eval/tasks/kobest/README.md'
2025-08-31T08:28:53,497   adding 'lm_eval/tasks/kobest/_kobest.yaml'
2025-08-31T08:28:53,498   adding 'lm_eval/tasks/kobest/kobest_boolq.yaml'
2025-08-31T08:28:53,500   adding 'lm_eval/tasks/kobest/kobest_copa.yaml'
2025-08-31T08:28:53,501   adding 'lm_eval/tasks/kobest/kobest_hellaswag.yaml'
2025-08-31T08:28:53,502   adding 'lm_eval/tasks/kobest/kobest_sentineg.yaml'
2025-08-31T08:28:53,504   adding 'lm_eval/tasks/kobest/kobest_wic.yaml'
2025-08-31T08:28:53,505   adding 'lm_eval/tasks/kobest/utils.py'
2025-08-31T08:28:53,508   adding 'lm_eval/tasks/kormedmcqa/README.md'
2025-08-31T08:28:53,509   adding 'lm_eval/tasks/kormedmcqa/_kormedmcqa.yaml'
2025-08-31T08:28:53,511   adding 'lm_eval/tasks/kormedmcqa/_template_yaml'
2025-08-31T08:28:53,512   adding 'lm_eval/tasks/kormedmcqa/dentist.yaml'
2025-08-31T08:28:53,514   adding 'lm_eval/tasks/kormedmcqa/doctor.yaml'
2025-08-31T08:28:53,515   adding 'lm_eval/tasks/kormedmcqa/nurse.yaml'
2025-08-31T08:28:53,517   adding 'lm_eval/tasks/kormedmcqa/pharm.yaml'
2025-08-31T08:28:53,519   adding 'lm_eval/tasks/lambada/README.md'
2025-08-31T08:28:53,521   adding 'lm_eval/tasks/lambada/lambada_openai.yaml'
2025-08-31T08:28:53,522   adding 'lm_eval/tasks/lambada/lambada_standard.yaml'
2025-08-31T08:28:53,524   adding 'lm_eval/tasks/lambada_cloze/README.md'
2025-08-31T08:28:53,526   adding 'lm_eval/tasks/lambada_cloze/lambada_openai_cloze.yaml'
2025-08-31T08:28:53,528   adding 'lm_eval/tasks/lambada_cloze/lambada_standard_cloze.yaml'
2025-08-31T08:28:53,530   adding 'lm_eval/tasks/lambada_multilingual/README.md'
2025-08-31T08:28:53,531   adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_de.yaml'
2025-08-31T08:28:53,533   adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_en.yaml'
2025-08-31T08:28:53,534   adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_es.yaml'
2025-08-31T08:28:53,536   adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_fr.yaml'
2025-08-31T08:28:53,537   adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_it.yaml'
2025-08-31T08:28:53,539   adding 'lm_eval/tasks/lambada_multilingual_stablelm/README.md'
2025-08-31T08:28:53,540   adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_de.yaml'
2025-08-31T08:28:53,541   adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_en.yaml'
2025-08-31T08:28:53,542   adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_es.yaml'
2025-08-31T08:28:53,543   adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_fr.yaml'
2025-08-31T08:28:53,544   adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_it.yaml'
2025-08-31T08:28:53,546   adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_nl.yaml'
2025-08-31T08:28:53,547   adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_pt.yaml'
2025-08-31T08:28:53,550   adding 'lm_eval/tasks/leaderboard/README.md'
2025-08-31T08:28:53,551   adding 'lm_eval/tasks/leaderboard/leaderboard.yaml'
2025-08-31T08:28:53,553   adding 'lm_eval/tasks/leaderboard/bbh_mc/_fewshot_template_yaml'
2025-08-31T08:28:53,554   adding 'lm_eval/tasks/leaderboard/bbh_mc/_leaderboard_bbh.yaml'
2025-08-31T08:28:53,555   adding 'lm_eval/tasks/leaderboard/bbh_mc/boolean_expressions.yaml'
2025-08-31T08:28:53,556   adding 'lm_eval/tasks/leaderboard/bbh_mc/causal_judgement.yaml'
2025-08-31T08:28:53,558   adding 'lm_eval/tasks/leaderboard/bbh_mc/date_understanding.yaml'
2025-08-31T08:28:53,559   adding 'lm_eval/tasks/leaderboard/bbh_mc/disambiguation_qa.yaml'
2025-08-31T08:28:53,560   adding 'lm_eval/tasks/leaderboard/bbh_mc/formal_fallacies.yaml'
2025-08-31T08:28:53,561   adding 'lm_eval/tasks/leaderboard/bbh_mc/geometric_shapes.yaml'
2025-08-31T08:28:53,563   adding 'lm_eval/tasks/leaderboard/bbh_mc/hyperbaton.yaml'
2025-08-31T08:28:53,564   adding 'lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_five_objects.yaml'
2025-08-31T08:28:53,565   adding 'lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_seven_objects.yaml'
2025-08-31T08:28:53,566   adding 'lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_three_objects.yaml'
2025-08-31T08:28:53,568   adding 'lm_eval/tasks/leaderboard/bbh_mc/movie_recommendation.yaml'
2025-08-31T08:28:53,569   adding 'lm_eval/tasks/leaderboard/bbh_mc/navigate.yaml'
2025-08-31T08:28:53,570   adding 'lm_eval/tasks/leaderboard/bbh_mc/object_counting.yaml'
2025-08-31T08:28:53,571   adding 'lm_eval/tasks/leaderboard/bbh_mc/penguins_in_a_table.yaml'
2025-08-31T08:28:53,572   adding 'lm_eval/tasks/leaderboard/bbh_mc/reasoning_about_colored_objects.yaml'
2025-08-31T08:28:53,574   adding 'lm_eval/tasks/leaderboard/bbh_mc/ruin_names.yaml'
2025-08-31T08:28:53,575   adding 'lm_eval/tasks/leaderboard/bbh_mc/salient_translation_error_detection.yaml'
2025-08-31T08:28:53,576   adding 'lm_eval/tasks/leaderboard/bbh_mc/snarks.yaml'
2025-08-31T08:28:53,577   adding 'lm_eval/tasks/leaderboard/bbh_mc/sports_understanding.yaml'
2025-08-31T08:28:53,579   adding 'lm_eval/tasks/leaderboard/bbh_mc/temporal_sequences.yaml'
2025-08-31T08:28:53,580   adding 'lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_five_objects.yaml'
2025-08-31T08:28:53,581   adding 'lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_seven_objects.yaml'
2025-08-31T08:28:53,583   adding 'lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_three_objects.yaml'
2025-08-31T08:28:53,584   adding 'lm_eval/tasks/leaderboard/bbh_mc/web_of_lies.yaml'
2025-08-31T08:28:53,586   adding 'lm_eval/tasks/leaderboard/gpqa/_leaderboard_gpqa.yaml'
2025-08-31T08:28:53,587   adding 'lm_eval/tasks/leaderboard/gpqa/_template_yaml'
2025-08-31T08:28:53,588   adding 'lm_eval/tasks/leaderboard/gpqa/gpqa_diamond_zeroshot.yaml'
2025-08-31T08:28:53,589   adding 'lm_eval/tasks/leaderboard/gpqa/gpqa_extended_zeroshot.yaml'
2025-08-31T08:28:53,590   adding 'lm_eval/tasks/leaderboard/gpqa/gpqa_main_zeroshot.yaml'
2025-08-31T08:28:53,591   adding 'lm_eval/tasks/leaderboard/gpqa/utils.py'
2025-08-31T08:28:53,592   adding 'lm_eval/tasks/leaderboard/ifeval/_leaderboard_instruction_following.yaml'
2025-08-31T08:28:53,593   adding 'lm_eval/tasks/leaderboard/ifeval/ifeval.yaml'
2025-08-31T08:28:53,599   adding 'lm_eval/tasks/leaderboard/ifeval/instructions.py'
2025-08-31T08:28:53,600   adding 'lm_eval/tasks/leaderboard/ifeval/instructions_registry.py'
2025-08-31T08:28:53,604   adding 'lm_eval/tasks/leaderboard/ifeval/instructions_util.py'
2025-08-31T08:28:53,605   adding 'lm_eval/tasks/leaderboard/ifeval/utils.py'
2025-08-31T08:28:53,607   adding 'lm_eval/tasks/leaderboard/math/_leaderboard_math.yaml'
2025-08-31T08:28:53,608   adding 'lm_eval/tasks/leaderboard/math/_template_yaml'
2025-08-31T08:28:53,609   adding 'lm_eval/tasks/leaderboard/math/math_algebra.yaml'
2025-08-31T08:28:53,610   adding 'lm_eval/tasks/leaderboard/math/math_counting_and_prob.yaml'
2025-08-31T08:28:53,611   adding 'lm_eval/tasks/leaderboard/math/math_geometry.yaml'
2025-08-31T08:28:53,613   adding 'lm_eval/tasks/leaderboard/math/math_intermediate_algebra.yaml'
2025-08-31T08:28:53,614   adding 'lm_eval/tasks/leaderboard/math/math_num_theory.yaml'
2025-08-31T08:28:53,615   adding 'lm_eval/tasks/leaderboard/math/math_prealgebra.yaml'
2025-08-31T08:28:53,616   adding 'lm_eval/tasks/leaderboard/math/math_precalculus.yaml'
2025-08-31T08:28:53,618   adding 'lm_eval/tasks/leaderboard/math/utils.py'
2025-08-31T08:28:53,620   adding 'lm_eval/tasks/leaderboard/mmlu_pro/mmlu_pro.yaml'
2025-08-31T08:28:53,621   adding 'lm_eval/tasks/leaderboard/mmlu_pro/utils.py'
2025-08-31T08:28:53,622   adding 'lm_eval/tasks/leaderboard/musr/_musr.yaml'
2025-08-31T08:28:53,624   adding 'lm_eval/tasks/leaderboard/musr/_template_yaml'
2025-08-31T08:28:53,625   adding 'lm_eval/tasks/leaderboard/musr/musr_murder_mysteries.yaml'
2025-08-31T08:28:53,626   adding 'lm_eval/tasks/leaderboard/musr/musr_object_placements.yaml'
2025-08-31T08:28:53,627   adding 'lm_eval/tasks/leaderboard/musr/musr_team_allocation.yaml'
2025-08-31T08:28:53,628   adding 'lm_eval/tasks/leaderboard/musr/utils.py'
2025-08-31T08:28:53,630   adding 'lm_eval/tasks/libra/README.md'
2025-08-31T08:28:53,632   adding 'lm_eval/tasks/libra/_complex_reasoning_and_mathematical_problems.yaml'
2025-08-31T08:28:53,633   adding 'lm_eval/tasks/libra/_multi_hop_question_answering.yaml'
2025-08-31T08:28:53,634   adding 'lm_eval/tasks/libra/_question_answering_and_multiple_choice.yaml'
2025-08-31T08:28:53,635   adding 'lm_eval/tasks/libra/_simple_information_retrieval.yaml'
2025-08-31T08:28:53,636   adding 'lm_eval/tasks/libra/_template_yaml'
2025-08-31T08:28:53,637   adding 'lm_eval/tasks/libra/librusec_history.yaml'
2025-08-31T08:28:53,639   adding 'lm_eval/tasks/libra/librusec_mhqa.yaml'
2025-08-31T08:28:53,640   adding 'lm_eval/tasks/libra/long_context_multiq.yaml'
2025-08-31T08:28:53,641   adding 'lm_eval/tasks/libra/matreshka_names.yaml'
2025-08-31T08:28:53,642   adding 'lm_eval/tasks/libra/matreshka_yes_no.yaml'
2025-08-31T08:28:53,643   adding 'lm_eval/tasks/libra/passkey.yaml'
2025-08-31T08:28:53,645   adding 'lm_eval/tasks/libra/passkey_with_librusec.yaml'
2025-08-31T08:28:53,646   adding 'lm_eval/tasks/libra/ru_2wikimultihopqa.yaml'
2025-08-31T08:28:53,647   adding 'lm_eval/tasks/libra/ru_babilong_qa1.yaml'
2025-08-31T08:28:53,648   adding 'lm_eval/tasks/libra/ru_babilong_qa2.yaml'
2025-08-31T08:28:53,650   adding 'lm_eval/tasks/libra/ru_babilong_qa3.yaml'
2025-08-31T08:28:53,651   adding 'lm_eval/tasks/libra/ru_babilong_qa4.yaml'
2025-08-31T08:28:53,652   adding 'lm_eval/tasks/libra/ru_babilong_qa5.yaml'
2025-08-31T08:28:53,653   adding 'lm_eval/tasks/libra/ru_gsm100.yaml'
2025-08-31T08:28:53,655   adding 'lm_eval/tasks/libra/ru_qasper.yaml'
2025-08-31T08:28:53,656   adding 'lm_eval/tasks/libra/ru_quality.yaml'
2025-08-31T08:28:53,657   adding 'lm_eval/tasks/libra/ru_sci_abstract_retrieval.yaml'
2025-08-31T08:28:53,658   adding 'lm_eval/tasks/libra/ru_sci_passage_count.yaml'
2025-08-31T08:28:53,659   adding 'lm_eval/tasks/libra/utils.py'
2025-08-31T08:28:53,661   adding 'lm_eval/tasks/lingoly/README.md'
2025-08-31T08:28:53,662   adding 'lm_eval/tasks/lingoly/lingoly_context.yaml'
2025-08-31T08:28:53,663   adding 'lm_eval/tasks/lingoly/lingoly_group.yaml'
2025-08-31T08:28:53,664   adding 'lm_eval/tasks/lingoly/lingoly_nocontext.yaml'
2025-08-31T08:28:53,666   adding 'lm_eval/tasks/lingoly/script.py'
2025-08-31T08:28:53,667   adding 'lm_eval/tasks/lingoly/utils.py'
2025-08-31T08:28:53,669   adding 'lm_eval/tasks/llama3/README.md'
2025-08-31T08:28:53,671   adding 'lm_eval/tasks/llama3/instruct/arc_challenge/arc_challenge_llama.yaml'
2025-08-31T08:28:53,672   adding 'lm_eval/tasks/llama3/instruct/arc_challenge/utils.py'
2025-08-31T08:28:53,674   adding 'lm_eval/tasks/llama3/instruct/gsm8k/gsm8k.yaml'
2025-08-31T08:28:53,677   adding 'lm_eval/tasks/llama3/instruct/mmlu/_continuation_template_yaml'
2025-08-31T08:28:53,678   adding 'lm_eval/tasks/llama3/instruct/mmlu/_mmlu_humanities.yaml'
2025-08-31T08:28:53,679   adding 'lm_eval/tasks/llama3/instruct/mmlu/_mmlu_other.yaml'
2025-08-31T08:28:53,680   adding 'lm_eval/tasks/llama3/instruct/mmlu/_mmlu_social_sciences.yaml'
2025-08-31T08:28:53,681   adding 'lm_eval/tasks/llama3/instruct/mmlu/_mmlu_stem.yaml'
2025-08-31T08:28:53,682   adding 'lm_eval/tasks/llama3/instruct/mmlu/llama.yaml'
2025-08-31T08:28:53,683   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_abstract_algebra.yaml'
2025-08-31T08:28:53,684   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_anatomy.yaml'
2025-08-31T08:28:53,686   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_astronomy.yaml'
2025-08-31T08:28:53,687   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_business_ethics.yaml'
2025-08-31T08:28:53,688   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_clinical_knowledge.yaml'
2025-08-31T08:28:53,689   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_biology.yaml'
2025-08-31T08:28:53,690   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_chemistry.yaml'
2025-08-31T08:28:53,691   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_computer_science.yaml'
2025-08-31T08:28:53,692   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_mathematics.yaml'
2025-08-31T08:28:53,693   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_medicine.yaml'
2025-08-31T08:28:53,694   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_physics.yaml'
2025-08-31T08:28:53,696   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_computer_security.yaml'
2025-08-31T08:28:53,697   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_conceptual_physics.yaml'
2025-08-31T08:28:53,698   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_econometrics.yaml'
2025-08-31T08:28:53,699   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_electrical_engineering.yaml'
2025-08-31T08:28:53,700   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_elementary_mathematics.yaml'
2025-08-31T08:28:53,701   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_formal_logic.yaml'
2025-08-31T08:28:53,703   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_global_facts.yaml'
2025-08-31T08:28:53,704   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_biology.yaml'
2025-08-31T08:28:53,705   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_chemistry.yaml'
2025-08-31T08:28:53,706   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_computer_science.yaml'
2025-08-31T08:28:53,707   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_european_history.yaml'
2025-08-31T08:28:53,708   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_geography.yaml'
2025-08-31T08:28:53,709   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_government_and_politics.yaml'
2025-08-31T08:28:53,711   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_macroeconomics.yaml'
2025-08-31T08:28:53,712   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_mathematics.yaml'
2025-08-31T08:28:53,713   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_microeconomics.yaml'
2025-08-31T08:28:53,714   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_physics.yaml'
2025-08-31T08:28:53,715   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_psychology.yaml'
2025-08-31T08:28:53,716   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_statistics.yaml'
2025-08-31T08:28:53,717   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_us_history.yaml'
2025-08-31T08:28:53,718   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_world_history.yaml'
2025-08-31T08:28:53,719   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_aging.yaml'
2025-08-31T08:28:53,720   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_sexuality.yaml'
2025-08-31T08:28:53,721   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_international_law.yaml'
2025-08-31T08:28:53,722   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_jurisprudence.yaml'
2025-08-31T08:28:53,724   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_logical_fallacies.yaml'
2025-08-31T08:28:53,725   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_machine_learning.yaml'
2025-08-31T08:28:53,726   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_management.yaml'
2025-08-31T08:28:53,727   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_marketing.yaml'
2025-08-31T08:28:53,728   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_medical_genetics.yaml'
2025-08-31T08:28:53,729   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_miscellaneous.yaml'
2025-08-31T08:28:53,730   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_disputes.yaml'
2025-08-31T08:28:53,731   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_scenarios.yaml'
2025-08-31T08:28:53,732   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_nutrition.yaml'
2025-08-31T08:28:53,733   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_philosophy.yaml'
2025-08-31T08:28:53,734   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_prehistory.yaml'
2025-08-31T08:28:53,736   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_accounting.yaml'
2025-08-31T08:28:53,737   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_law.yaml'
2025-08-31T08:28:53,738   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_medicine.yaml'
2025-08-31T08:28:53,739   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_psychology.yaml'
2025-08-31T08:28:53,740   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_public_relations.yaml'
2025-08-31T08:28:53,741   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_security_studies.yaml'
2025-08-31T08:28:53,742   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_sociology.yaml'
2025-08-31T08:28:53,743   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_us_foreign_policy.yaml'
2025-08-31T08:28:53,745   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_virology.yaml'
2025-08-31T08:28:53,746   adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_world_religions.yaml'
2025-08-31T08:28:53,748   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama.yaml'
2025-08-31T08:28:53,750   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama_template_yaml'
2025-08-31T08:28:53,751   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_humanities.yaml'
2025-08-31T08:28:53,752   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_other.yaml'
2025-08-31T08:28:53,753   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_social_sciences.yaml'
2025-08-31T08:28:53,754   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_stem.yaml'
2025-08-31T08:28:53,755   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_abstract_algebra.yaml'
2025-08-31T08:28:53,756   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_anatomy.yaml'
2025-08-31T08:28:53,757   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_astronomy.yaml'
2025-08-31T08:28:53,759   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_business_ethics.yaml'
2025-08-31T08:28:53,760   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_clinical_knowledge.yaml'
2025-08-31T08:28:53,761   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_biology.yaml'
2025-08-31T08:28:53,762   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_chemistry.yaml'
2025-08-31T08:28:53,763   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_computer_science.yaml'
2025-08-31T08:28:53,764   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_mathematics.yaml'
2025-08-31T08:28:53,765   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_medicine.yaml'
2025-08-31T08:28:53,766   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_physics.yaml'
2025-08-31T08:28:53,767   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_computer_security.yaml'
2025-08-31T08:28:53,768   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_conceptual_physics.yaml'
2025-08-31T08:28:53,769   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_econometrics.yaml'
2025-08-31T08:28:53,770   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_electrical_engineering.yaml'
2025-08-31T08:28:53,771   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_elementary_mathematics.yaml'
2025-08-31T08:28:53,772   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_formal_logic.yaml'
2025-08-31T08:28:53,773   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_global_facts.yaml'
2025-08-31T08:28:53,774   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_biology.yaml'
2025-08-31T08:28:53,775   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_chemistry.yaml'
2025-08-31T08:28:53,777   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_computer_science.yaml'
2025-08-31T08:28:53,778   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_european_history.yaml'
2025-08-31T08:28:53,779   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_geography.yaml'
2025-08-31T08:28:53,780   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_government_and_politics.yaml'
2025-08-31T08:28:53,781   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_macroeconomics.yaml'
2025-08-31T08:28:53,782   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_mathematics.yaml'
2025-08-31T08:28:53,783   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_microeconomics.yaml'
2025-08-31T08:28:53,784   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_physics.yaml'
2025-08-31T08:28:53,785   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_psychology.yaml'
2025-08-31T08:28:53,787   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_statistics.yaml'
2025-08-31T08:28:53,788   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_us_history.yaml'
2025-08-31T08:28:53,789   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_world_history.yaml'
2025-08-31T08:28:53,790   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_aging.yaml'
2025-08-31T08:28:53,791   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_sexuality.yaml'
2025-08-31T08:28:53,792   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_international_law.yaml'
2025-08-31T08:28:53,793   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_jurisprudence.yaml'
2025-08-31T08:28:53,795   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_logical_fallacies.yaml'
2025-08-31T08:28:53,796   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_machine_learning.yaml'
2025-08-31T08:28:53,797   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_management.yaml'
2025-08-31T08:28:53,798   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_marketing.yaml'
2025-08-31T08:28:53,799   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_medical_genetics.yaml'
2025-08-31T08:28:53,800   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_miscellaneous.yaml'
2025-08-31T08:28:53,802   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_disputes.yaml'
2025-08-31T08:28:53,803   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_scenarios.yaml'
2025-08-31T08:28:53,804   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_nutrition.yaml'
2025-08-31T08:28:53,805   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_philosophy.yaml'
2025-08-31T08:28:53,806   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_prehistory.yaml'
2025-08-31T08:28:53,807   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_accounting.yaml'
2025-08-31T08:28:53,808   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_law.yaml'
2025-08-31T08:28:53,809   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_medicine.yaml'
2025-08-31T08:28:53,810   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_psychology.yaml'
2025-08-31T08:28:53,811   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_public_relations.yaml'
2025-08-31T08:28:53,812   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_security_studies.yaml'
2025-08-31T08:28:53,813   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_sociology.yaml'
2025-08-31T08:28:53,815   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_us_foreign_policy.yaml'
2025-08-31T08:28:53,816   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_virology.yaml'
2025-08-31T08:28:53,817   adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_world_religions.yaml'
2025-08-31T08:28:53,819   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_continuation_template_yaml'
2025-08-31T08:28:53,820   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_humanities.yaml'
2025-08-31T08:28:53,821   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_llama.yaml'
2025-08-31T08:28:53,823   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_other.yaml'
2025-08-31T08:28:53,824   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_social_sciences.yaml'
2025-08-31T08:28:53,825   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_stem.yaml'
2025-08-31T08:28:53,826   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_abstract_algebra.yaml'
2025-08-31T08:28:53,827   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_anatomy.yaml'
2025-08-31T08:28:53,829   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_astronomy.yaml'
2025-08-31T08:28:53,830   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_business_ethics.yaml'
2025-08-31T08:28:53,831   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_clinical_knowledge.yaml'
2025-08-31T08:28:53,833   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_biology.yaml'
2025-08-31T08:28:53,834   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_chemistry.yaml'
2025-08-31T08:28:53,836   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_computer_science.yaml'
2025-08-31T08:28:53,837   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_mathematics.yaml'
2025-08-31T08:28:53,838   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_medicine.yaml'
2025-08-31T08:28:53,839   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_physics.yaml'
2025-08-31T08:28:53,841   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_computer_security.yaml'
2025-08-31T08:28:53,842   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_conceptual_physics.yaml'
2025-08-31T08:28:53,843   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_econometrics.yaml'
2025-08-31T08:28:53,845   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_electrical_engineering.yaml'
2025-08-31T08:28:53,846   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_elementary_mathematics.yaml'
2025-08-31T08:28:53,847   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_formal_logic.yaml'
2025-08-31T08:28:53,849   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_global_facts.yaml'
2025-08-31T08:28:53,850   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_biology.yaml'
2025-08-31T08:28:53,851   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_chemistry.yaml'
2025-08-31T08:28:53,853   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_computer_science.yaml'
2025-08-31T08:28:53,856   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_european_history.yaml'
2025-08-31T08:28:53,857   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_geography.yaml'
2025-08-31T08:28:53,858   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_government_and_politics.yaml'
2025-08-31T08:28:53,859   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_macroeconomics.yaml'
2025-08-31T08:28:53,860   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_mathematics.yaml'
2025-08-31T08:28:53,862   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_microeconomics.yaml'
2025-08-31T08:28:53,863   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_physics.yaml'
2025-08-31T08:28:53,864   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_psychology.yaml'
2025-08-31T08:28:53,866   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_statistics.yaml'
2025-08-31T08:28:53,868   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_us_history.yaml'
2025-08-31T08:28:53,870   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_world_history.yaml'
2025-08-31T08:28:53,871   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_aging.yaml'
2025-08-31T08:28:53,872   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_sexuality.yaml'
2025-08-31T08:28:53,874   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_international_law.yaml'
2025-08-31T08:28:53,875   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_jurisprudence.yaml'
2025-08-31T08:28:53,876   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_logical_fallacies.yaml'
2025-08-31T08:28:53,878   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_machine_learning.yaml'
2025-08-31T08:28:53,879   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_management.yaml'
2025-08-31T08:28:53,880   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_marketing.yaml'
2025-08-31T08:28:53,882   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_medical_genetics.yaml'
2025-08-31T08:28:53,883   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_miscellaneous.yaml'
2025-08-31T08:28:53,884   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_disputes.yaml'
2025-08-31T08:28:53,886   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_scenarios.yaml'
2025-08-31T08:28:53,887   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_nutrition.yaml'
2025-08-31T08:28:53,889   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_philosophy.yaml'
2025-08-31T08:28:53,890   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_prehistory.yaml'
2025-08-31T08:28:53,891   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_accounting.yaml'
2025-08-31T08:28:53,893   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_law.yaml'
2025-08-31T08:28:53,895   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_medicine.yaml'
2025-08-31T08:28:53,896   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_psychology.yaml'
2025-08-31T08:28:53,898   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_public_relations.yaml'
2025-08-31T08:28:53,900   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_security_studies.yaml'
2025-08-31T08:28:53,901   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_sociology.yaml'
2025-08-31T08:28:53,902   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_us_foreign_policy.yaml'
2025-08-31T08:28:53,904   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_virology.yaml'
2025-08-31T08:28:53,905   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_world_religions.yaml'
2025-08-31T08:28:53,906   adding 'lm_eval/tasks/llama3/instruct/mmlu_de/utils.py'
2025-08-31T08:28:53,910   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_continuation_template_yaml'
2025-08-31T08:28:53,911   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_humanities.yaml'
2025-08-31T08:28:53,912   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_llama.yaml'
2025-08-31T08:28:53,914   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_other.yaml'
2025-08-31T08:28:53,915   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_social_sciences.yaml'
2025-08-31T08:28:53,916   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_stem.yaml'
2025-08-31T08:28:53,917   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_abstract_algebra.yaml'
2025-08-31T08:28:53,919   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_anatomy.yaml'
2025-08-31T08:28:53,920   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_astronomy.yaml'
2025-08-31T08:28:53,921   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_business_ethics.yaml'
2025-08-31T08:28:53,922   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_clinical_knowledge.yaml'
2025-08-31T08:28:53,924   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_biology.yaml'
2025-08-31T08:28:53,925   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_chemistry.yaml'
2025-08-31T08:28:53,927   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_computer_science.yaml'
2025-08-31T08:28:53,928   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_mathematics.yaml'
2025-08-31T08:28:53,929   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_medicine.yaml'
2025-08-31T08:28:53,930   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_physics.yaml'
2025-08-31T08:28:53,932   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_computer_security.yaml'
2025-08-31T08:28:53,933   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_conceptual_physics.yaml'
2025-08-31T08:28:53,934   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_econometrics.yaml'
2025-08-31T08:28:53,936   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_electrical_engineering.yaml'
2025-08-31T08:28:53,937   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_elementary_mathematics.yaml'
2025-08-31T08:28:53,938   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_formal_logic.yaml'
2025-08-31T08:28:53,939   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_global_facts.yaml'
2025-08-31T08:28:53,941   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_biology.yaml'
2025-08-31T08:28:53,942   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_chemistry.yaml'
2025-08-31T08:28:53,944   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_computer_science.yaml'
2025-08-31T08:28:53,946   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_european_history.yaml'
2025-08-31T08:28:53,947   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_geography.yaml'
2025-08-31T08:28:53,949   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_government_and_politics.yaml'
2025-08-31T08:28:53,950   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_macroeconomics.yaml'
2025-08-31T08:28:53,952   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_mathematics.yaml'
2025-08-31T08:28:53,953   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_microeconomics.yaml'
2025-08-31T08:28:53,954   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_physics.yaml'
2025-08-31T08:28:53,956   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_psychology.yaml'
2025-08-31T08:28:53,957   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_statistics.yaml'
2025-08-31T08:28:53,959   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_us_history.yaml'
2025-08-31T08:28:53,961   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_world_history.yaml'
2025-08-31T08:28:53,962   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_aging.yaml'
2025-08-31T08:28:53,963   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_sexuality.yaml'
2025-08-31T08:28:53,965   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_international_law.yaml'
2025-08-31T08:28:53,966   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_jurisprudence.yaml'
2025-08-31T08:28:53,967   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_logical_fallacies.yaml'
2025-08-31T08:28:53,969   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_machine_learning.yaml'
2025-08-31T08:28:53,970   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_management.yaml'
2025-08-31T08:28:53,971   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_marketing.yaml'
2025-08-31T08:28:53,972   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_medical_genetics.yaml'
2025-08-31T08:28:53,973   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_miscellaneous.yaml'
2025-08-31T08:28:53,975   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_disputes.yaml'
2025-08-31T08:28:53,976   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_scenarios.yaml'
2025-08-31T08:28:53,977   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_nutrition.yaml'
2025-08-31T08:28:53,979   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_philosophy.yaml'
2025-08-31T08:28:53,980   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_prehistory.yaml'
2025-08-31T08:28:53,981   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_accounting.yaml'
2025-08-31T08:28:53,983   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_law.yaml'
2025-08-31T08:28:53,985   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_medicine.yaml'
2025-08-31T08:28:53,986   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_psychology.yaml'
2025-08-31T08:28:53,987   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_public_relations.yaml'
2025-08-31T08:28:53,989   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_security_studies.yaml'
2025-08-31T08:28:53,990   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_sociology.yaml'
2025-08-31T08:28:53,992   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_us_foreign_policy.yaml'
2025-08-31T08:28:53,993   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_virology.yaml'
2025-08-31T08:28:53,994   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_world_religions.yaml'
2025-08-31T08:28:53,995   adding 'lm_eval/tasks/llama3/instruct/mmlu_es/utils.py'
2025-08-31T08:28:53,998   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_continuation_template_yaml'
2025-08-31T08:28:53,999   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_humanities.yaml'
2025-08-31T08:28:54,001   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_llama.yaml'
2025-08-31T08:28:54,002   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_other.yaml'
2025-08-31T08:28:54,003   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_social_sciences.yaml'
2025-08-31T08:28:54,004   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_stem.yaml'
2025-08-31T08:28:54,005   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_abstract_algebra.yaml'
2025-08-31T08:28:54,007   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_anatomy.yaml'
2025-08-31T08:28:54,008   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_astronomy.yaml'
2025-08-31T08:28:54,009   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_business_ethics.yaml'
2025-08-31T08:28:54,011   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_clinical_knowledge.yaml'
2025-08-31T08:28:54,012   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_biology.yaml'
2025-08-31T08:28:54,013   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_chemistry.yaml'
2025-08-31T08:28:54,015   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_computer_science.yaml'
2025-08-31T08:28:54,016   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_mathematics.yaml'
2025-08-31T08:28:54,018   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_medicine.yaml'
2025-08-31T08:28:54,019   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_physics.yaml'
2025-08-31T08:28:54,021   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_computer_security.yaml'
2025-08-31T08:28:54,022   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_conceptual_physics.yaml'
2025-08-31T08:28:54,023   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_econometrics.yaml'
2025-08-31T08:28:54,024   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_electrical_engineering.yaml'
2025-08-31T08:28:54,025   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_elementary_mathematics.yaml'
2025-08-31T08:28:54,027   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_formal_logic.yaml'
2025-08-31T08:28:54,028   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_global_facts.yaml'
2025-08-31T08:28:54,029   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_biology.yaml'
2025-08-31T08:28:54,031   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_chemistry.yaml'
2025-08-31T08:28:54,032   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_computer_science.yaml'
2025-08-31T08:28:54,035   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_european_history.yaml'
2025-08-31T08:28:54,037   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_geography.yaml'
2025-08-31T08:28:54,039   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_government_and_politics.yaml'
2025-08-31T08:28:54,040   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_macroeconomics.yaml'
2025-08-31T08:28:54,041   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_mathematics.yaml'
2025-08-31T08:28:54,043   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_microeconomics.yaml'
2025-08-31T08:28:54,044   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_physics.yaml'
2025-08-31T08:28:54,045   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_psychology.yaml'
2025-08-31T08:28:54,047   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_statistics.yaml'
2025-08-31T08:28:54,049   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_us_history.yaml'
2025-08-31T08:28:54,051   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_world_history.yaml'
2025-08-31T08:28:54,086   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_aging.yaml'
2025-08-31T08:28:54,087   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_sexuality.yaml'
2025-08-31T08:28:54,089   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_international_law.yaml'
2025-08-31T08:28:54,090   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_jurisprudence.yaml'
2025-08-31T08:28:54,091   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_logical_fallacies.yaml'
2025-08-31T08:28:54,093   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_machine_learning.yaml'
2025-08-31T08:28:54,094   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_management.yaml'
2025-08-31T08:28:54,095   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_marketing.yaml'
2025-08-31T08:28:54,097   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_medical_genetics.yaml'
2025-08-31T08:28:54,098   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_miscellaneous.yaml'
2025-08-31T08:28:54,099   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_disputes.yaml'
2025-08-31T08:28:54,101   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_scenarios.yaml'
2025-08-31T08:28:54,102   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_nutrition.yaml'
2025-08-31T08:28:54,103   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_philosophy.yaml'
2025-08-31T08:28:54,105   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_prehistory.yaml'
2025-08-31T08:28:54,106   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_accounting.yaml'
2025-08-31T08:28:54,108   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_law.yaml'
2025-08-31T08:28:54,110   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_medicine.yaml'
2025-08-31T08:28:54,112   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_psychology.yaml'
2025-08-31T08:28:54,113   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_public_relations.yaml'
2025-08-31T08:28:54,115   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_security_studies.yaml'
2025-08-31T08:28:54,116   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_sociology.yaml'
2025-08-31T08:28:54,117   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_us_foreign_policy.yaml'
2025-08-31T08:28:54,118   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_virology.yaml'
2025-08-31T08:28:54,119   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_world_religions.yaml'
2025-08-31T08:28:54,121   adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/utils.py'
2025-08-31T08:28:54,123   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_continuation_template_yaml'
2025-08-31T08:28:54,124   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_humanities.yaml'
2025-08-31T08:28:54,126   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_llama.yaml'
2025-08-31T08:28:54,127   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_other.yaml'
2025-08-31T08:28:54,128   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_social_sciences.yaml'
2025-08-31T08:28:54,129   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_stem.yaml'
2025-08-31T08:28:54,130   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_abstract_algebra.yaml'
2025-08-31T08:28:54,132   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_anatomy.yaml'
2025-08-31T08:28:54,134   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_astronomy.yaml'
2025-08-31T08:28:54,136   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_business_ethics.yaml'
2025-08-31T08:28:54,138   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_clinical_knowledge.yaml'
2025-08-31T08:28:54,140   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_biology.yaml'
2025-08-31T08:28:54,142   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_chemistry.yaml'
2025-08-31T08:28:54,145   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_computer_science.yaml'
2025-08-31T08:28:54,147   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_mathematics.yaml'
2025-08-31T08:28:54,149   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_medicine.yaml'
2025-08-31T08:28:54,150   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_physics.yaml'
2025-08-31T08:28:54,152   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_computer_security.yaml'
2025-08-31T08:28:54,154   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_conceptual_physics.yaml'
2025-08-31T08:28:54,156   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_econometrics.yaml'
2025-08-31T08:28:54,157   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_electrical_engineering.yaml'
2025-08-31T08:28:54,159   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_elementary_mathematics.yaml'
2025-08-31T08:28:54,161   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_formal_logic.yaml'
2025-08-31T08:28:54,163   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_global_facts.yaml'
2025-08-31T08:28:54,164   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_biology.yaml'
2025-08-31T08:28:54,166   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_chemistry.yaml'
2025-08-31T08:28:54,169   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_computer_science.yaml'
2025-08-31T08:28:54,178   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_european_history.yaml'
2025-08-31T08:28:54,180   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_geography.yaml'
2025-08-31T08:28:54,183   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_government_and_politics.yaml'
2025-08-31T08:28:54,184   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_macroeconomics.yaml'
2025-08-31T08:28:54,186   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_mathematics.yaml'
2025-08-31T08:28:54,188   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_microeconomics.yaml'
2025-08-31T08:28:54,189   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_physics.yaml'
2025-08-31T08:28:54,191   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_psychology.yaml'
2025-08-31T08:28:54,194   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_statistics.yaml'
2025-08-31T08:28:54,201   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_us_history.yaml'
2025-08-31T08:28:54,205   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_world_history.yaml'
2025-08-31T08:28:54,207   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_aging.yaml'
2025-08-31T08:28:54,209   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_sexuality.yaml'
2025-08-31T08:28:54,211   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_international_law.yaml'
2025-08-31T08:28:54,213   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_jurisprudence.yaml'
2025-08-31T08:28:54,215   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_logical_fallacies.yaml'
2025-08-31T08:28:54,217   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_machine_learning.yaml'
2025-08-31T08:28:54,219   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_management.yaml'
2025-08-31T08:28:54,221   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_marketing.yaml'
2025-08-31T08:28:54,222   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_medical_genetics.yaml'
2025-08-31T08:28:54,224   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_miscellaneous.yaml'
2025-08-31T08:28:54,226   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_disputes.yaml'
2025-08-31T08:28:54,228   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_scenarios.yaml'
2025-08-31T08:28:54,230   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_nutrition.yaml'
2025-08-31T08:28:54,232   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_philosophy.yaml'
2025-08-31T08:28:54,234   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_prehistory.yaml'
2025-08-31T08:28:54,236   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_accounting.yaml'
2025-08-31T08:28:54,241   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_law.yaml'
2025-08-31T08:28:54,245   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_medicine.yaml'
2025-08-31T08:28:54,247   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_psychology.yaml'
2025-08-31T08:28:54,249   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_public_relations.yaml'
2025-08-31T08:28:54,254   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_security_studies.yaml'
2025-08-31T08:28:54,256   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_sociology.yaml'
2025-08-31T08:28:54,258   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_us_foreign_policy.yaml'
2025-08-31T08:28:54,260   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_virology.yaml'
2025-08-31T08:28:54,261   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_world_religions.yaml'
2025-08-31T08:28:54,262   adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/utils.py'
2025-08-31T08:28:54,265   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_continuation_template_yaml'
2025-08-31T08:28:54,266   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_humanities.yaml'
2025-08-31T08:28:54,267   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_llama.yaml'
2025-08-31T08:28:54,269   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_other.yaml'
2025-08-31T08:28:54,270   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_social_sciences.yaml'
2025-08-31T08:28:54,271   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_stem.yaml'
2025-08-31T08:28:54,272   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_abstract_algebra.yaml'
2025-08-31T08:28:54,274   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_anatomy.yaml'
2025-08-31T08:28:54,275   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_astronomy.yaml'
2025-08-31T08:28:54,277   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_business_ethics.yaml'
2025-08-31T08:28:54,278   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_clinical_knowledge.yaml'
2025-08-31T08:28:54,279   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_biology.yaml'
2025-08-31T08:28:54,281   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_chemistry.yaml'
2025-08-31T08:28:54,282   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_computer_science.yaml'
2025-08-31T08:28:54,283   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_mathematics.yaml'
2025-08-31T08:28:54,285   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_medicine.yaml'
2025-08-31T08:28:54,286   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_physics.yaml'
2025-08-31T08:28:54,287   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_computer_security.yaml'
2025-08-31T08:28:54,289   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_conceptual_physics.yaml'
2025-08-31T08:28:54,290   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_econometrics.yaml'
2025-08-31T08:28:54,292   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_electrical_engineering.yaml'
2025-08-31T08:28:54,293   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_elementary_mathematics.yaml'
2025-08-31T08:28:54,294   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_formal_logic.yaml'
2025-08-31T08:28:54,296   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_global_facts.yaml'
2025-08-31T08:28:54,297   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_biology.yaml'
2025-08-31T08:28:54,298   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_chemistry.yaml'
2025-08-31T08:28:54,300   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_computer_science.yaml'
2025-08-31T08:28:54,302   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_european_history.yaml'
2025-08-31T08:28:54,303   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_geography.yaml'
2025-08-31T08:28:54,305   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_government_and_politics.yaml'
2025-08-31T08:28:54,306   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_macroeconomics.yaml'
2025-08-31T08:28:54,308   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_mathematics.yaml'
2025-08-31T08:28:54,309   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_microeconomics.yaml'
2025-08-31T08:28:54,310   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_physics.yaml'
2025-08-31T08:28:54,312   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_psychology.yaml'
2025-08-31T08:28:54,313   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_statistics.yaml'
2025-08-31T08:28:54,316   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_us_history.yaml'
2025-08-31T08:28:54,317   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_world_history.yaml'
2025-08-31T08:28:54,318   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_aging.yaml'
2025-08-31T08:28:54,320   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_sexuality.yaml'
2025-08-31T08:28:54,321   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_international_law.yaml'
2025-08-31T08:28:54,323   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_jurisprudence.yaml'
2025-08-31T08:28:54,324   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_logical_fallacies.yaml'
2025-08-31T08:28:54,326   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_machine_learning.yaml'
2025-08-31T08:28:54,327   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_management.yaml'
2025-08-31T08:28:54,329   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_marketing.yaml'
2025-08-31T08:28:54,330   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_medical_genetics.yaml'
2025-08-31T08:28:54,331   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_miscellaneous.yaml'
2025-08-31T08:28:54,333   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_disputes.yaml'
2025-08-31T08:28:54,334   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_scenarios.yaml'
2025-08-31T08:28:54,335   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_nutrition.yaml'
2025-08-31T08:28:54,336   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_philosophy.yaml'
2025-08-31T08:28:54,338   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_prehistory.yaml'
2025-08-31T08:28:54,339   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_accounting.yaml'
2025-08-31T08:28:54,341   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_law.yaml'
2025-08-31T08:28:54,343   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_medicine.yaml'
2025-08-31T08:28:54,344   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_psychology.yaml'
2025-08-31T08:28:54,345   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_public_relations.yaml'
2025-08-31T08:28:54,347   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_security_studies.yaml'
2025-08-31T08:28:54,348   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_sociology.yaml'
2025-08-31T08:28:54,350   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_us_foreign_policy.yaml'
2025-08-31T08:28:54,351   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_virology.yaml'
2025-08-31T08:28:54,352   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_world_religions.yaml'
2025-08-31T08:28:54,354   adding 'lm_eval/tasks/llama3/instruct/mmlu_it/utils.py'
2025-08-31T08:28:54,356   adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/_default_template_yaml'
2025-08-31T08:28:54,357   adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/_mmlu_pro.yaml'
2025-08-31T08:28:54,358   adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_biology.yaml'
2025-08-31T08:28:54,359   adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_business.yaml'
2025-08-31T08:28:54,360   adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_chemistry.yaml'
2025-08-31T08:28:54,362   adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_computer_science.yaml'
2025-08-31T08:28:54,363   adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_economics.yaml'
2025-08-31T08:28:54,364   adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_engineering.yaml'
2025-08-31T08:28:54,365   adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_health.yaml'
2025-08-31T08:28:54,366   adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_history.yaml'
2025-08-31T08:28:54,368   adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_law.yaml'
2025-08-31T08:28:54,369   adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_math.yaml'
2025-08-31T08:28:54,370   adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_other.yaml'
2025-08-31T08:28:54,371   adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_philosophy.yaml'
2025-08-31T08:28:54,372   adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_physics.yaml'
2025-08-31T08:28:54,373   adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_psychology.yaml'
2025-08-31T08:28:54,374   adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/utils.py'
2025-08-31T08:28:54,378   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_continuation_template_yaml'
2025-08-31T08:28:54,379   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_humanities.yaml'
2025-08-31T08:28:54,380   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_llama.yaml'
2025-08-31T08:28:54,381   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_other.yaml'
2025-08-31T08:28:54,382   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_social_sciences.yaml'
2025-08-31T08:28:54,383   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_stem.yaml'
2025-08-31T08:28:54,385   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_abstract_algebra.yaml'
2025-08-31T08:28:54,386   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_anatomy.yaml'
2025-08-31T08:28:54,388   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_astronomy.yaml'
2025-08-31T08:28:54,389   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_business_ethics.yaml'
2025-08-31T08:28:54,391   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_clinical_knowledge.yaml'
2025-08-31T08:28:54,392   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_biology.yaml'
2025-08-31T08:28:54,393   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_chemistry.yaml'
2025-08-31T08:28:54,395   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_computer_science.yaml'
2025-08-31T08:28:54,396   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_mathematics.yaml'
2025-08-31T08:28:54,397   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_medicine.yaml'
2025-08-31T08:28:54,399   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_physics.yaml'
2025-08-31T08:28:54,400   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_computer_security.yaml'
2025-08-31T08:28:54,402   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_conceptual_physics.yaml'
2025-08-31T08:28:54,403   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_econometrics.yaml'
2025-08-31T08:28:54,404   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_electrical_engineering.yaml'
2025-08-31T08:28:54,406   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_elementary_mathematics.yaml'
2025-08-31T08:28:54,407   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_formal_logic.yaml'
2025-08-31T08:28:54,409   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_global_facts.yaml'
2025-08-31T08:28:54,410   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_biology.yaml'
2025-08-31T08:28:54,411   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_chemistry.yaml'
2025-08-31T08:28:54,413   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_computer_science.yaml'
2025-08-31T08:28:54,415   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_european_history.yaml'
2025-08-31T08:28:54,417   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_geography.yaml'
2025-08-31T08:28:54,418   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_government_and_politics.yaml'
2025-08-31T08:28:54,420   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_macroeconomics.yaml'
2025-08-31T08:28:54,421   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_mathematics.yaml'
2025-08-31T08:28:54,422   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_microeconomics.yaml'
2025-08-31T08:28:54,423   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_physics.yaml'
2025-08-31T08:28:54,425   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_psychology.yaml'
2025-08-31T08:28:54,427   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_statistics.yaml'
2025-08-31T08:28:54,429   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_us_history.yaml'
2025-08-31T08:28:54,431   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_world_history.yaml'
2025-08-31T08:28:54,433   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_aging.yaml'
2025-08-31T08:28:54,434   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_sexuality.yaml'
2025-08-31T08:28:54,436   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_international_law.yaml'
2025-08-31T08:28:54,437   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_jurisprudence.yaml'
2025-08-31T08:28:54,439   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_logical_fallacies.yaml'
2025-08-31T08:28:54,440   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_machine_learning.yaml'
2025-08-31T08:28:54,442   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_management.yaml'
2025-08-31T08:28:54,443   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_marketing.yaml'
2025-08-31T08:28:54,444   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_medical_genetics.yaml'
2025-08-31T08:28:54,446   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_miscellaneous.yaml'
2025-08-31T08:28:54,447   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_disputes.yaml'
2025-08-31T08:28:54,448   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_scenarios.yaml'
2025-08-31T08:28:54,449   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_nutrition.yaml'
2025-08-31T08:28:54,451   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_philosophy.yaml'
2025-08-31T08:28:54,452   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_prehistory.yaml'
2025-08-31T08:28:54,454   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_accounting.yaml'
2025-08-31T08:28:54,456   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_law.yaml'
2025-08-31T08:28:54,457   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_medicine.yaml'
2025-08-31T08:28:54,459   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_psychology.yaml'
2025-08-31T08:28:54,460   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_public_relations.yaml'
2025-08-31T08:28:54,462   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_security_studies.yaml'
2025-08-31T08:28:54,463   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_sociology.yaml'
2025-08-31T08:28:54,464   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_us_foreign_policy.yaml'
2025-08-31T08:28:54,465   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_virology.yaml'
2025-08-31T08:28:54,467   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_world_religions.yaml'
2025-08-31T08:28:54,468   adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/utils.py'
2025-08-31T08:28:54,471   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_continuation_template_yaml'
2025-08-31T08:28:54,473   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_humanities.yaml'
2025-08-31T08:28:54,474   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_llama.yaml'
2025-08-31T08:28:54,475   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_other.yaml'
2025-08-31T08:28:54,476   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_social_sciences.yaml'
2025-08-31T08:28:54,477   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_stem.yaml'
2025-08-31T08:28:54,479   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_abstract_algebra.yaml'
2025-08-31T08:28:54,480   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_anatomy.yaml'
2025-08-31T08:28:54,482   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_astronomy.yaml'
2025-08-31T08:28:54,484   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_business_ethics.yaml'
2025-08-31T08:28:54,486   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_clinical_knowledge.yaml'
2025-08-31T08:28:54,488   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_biology.yaml'
2025-08-31T08:28:54,490   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_chemistry.yaml'
2025-08-31T08:28:54,492   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_computer_science.yaml'
2025-08-31T08:28:54,494   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_mathematics.yaml'
2025-08-31T08:28:54,496   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_medicine.yaml'
2025-08-31T08:28:54,498   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_physics.yaml'
2025-08-31T08:28:54,500   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_computer_security.yaml'
2025-08-31T08:28:54,501   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_conceptual_physics.yaml'
2025-08-31T08:28:54,503   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_econometrics.yaml'
2025-08-31T08:28:54,505   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_electrical_engineering.yaml'
2025-08-31T08:28:54,507   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_elementary_mathematics.yaml'
2025-08-31T08:28:54,509   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_formal_logic.yaml'
2025-08-31T08:28:54,510   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_global_facts.yaml'
2025-08-31T08:28:54,512   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_biology.yaml'
2025-08-31T08:28:54,514   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_chemistry.yaml'
2025-08-31T08:28:54,516   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_computer_science.yaml'
2025-08-31T08:28:54,526   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_european_history.yaml'
2025-08-31T08:28:54,528   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_geography.yaml'
2025-08-31T08:28:54,530   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_government_and_politics.yaml'
2025-08-31T08:28:54,532   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_macroeconomics.yaml'
2025-08-31T08:28:54,533   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_mathematics.yaml'
2025-08-31T08:28:54,535   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_microeconomics.yaml'
2025-08-31T08:28:54,537   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_physics.yaml'
2025-08-31T08:28:54,539   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_psychology.yaml'
2025-08-31T08:28:54,541   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_statistics.yaml'
2025-08-31T08:28:54,549   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_us_history.yaml'
2025-08-31T08:28:54,553   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_world_history.yaml'
2025-08-31T08:28:54,555   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_aging.yaml'
2025-08-31T08:28:54,557   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_sexuality.yaml'
2025-08-31T08:28:54,559   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_international_law.yaml'
2025-08-31T08:28:54,561   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_jurisprudence.yaml'
2025-08-31T08:28:54,563   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_logical_fallacies.yaml'
2025-08-31T08:28:54,566   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_machine_learning.yaml'
2025-08-31T08:28:54,567   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_management.yaml'
2025-08-31T08:28:54,569   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_marketing.yaml'
2025-08-31T08:28:54,571   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_medical_genetics.yaml'
2025-08-31T08:28:54,572   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_miscellaneous.yaml'
2025-08-31T08:28:54,575   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_disputes.yaml'
2025-08-31T08:28:54,577   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_scenarios.yaml'
2025-08-31T08:28:54,579   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_nutrition.yaml'
2025-08-31T08:28:54,580   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_philosophy.yaml'
2025-08-31T08:28:54,583   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_prehistory.yaml'
2025-08-31T08:28:54,585   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_accounting.yaml'
2025-08-31T08:28:54,590   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_law.yaml'
2025-08-31T08:28:54,594   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_medicine.yaml'
2025-08-31T08:28:54,596   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_psychology.yaml'
2025-08-31T08:28:54,598   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_public_relations.yaml'
2025-08-31T08:28:54,603   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_security_studies.yaml'
2025-08-31T08:28:54,605   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_sociology.yaml'
2025-08-31T08:28:54,607   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_us_foreign_policy.yaml'
2025-08-31T08:28:54,609   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_virology.yaml'
2025-08-31T08:28:54,611   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_world_religions.yaml'
2025-08-31T08:28:54,612   adding 'lm_eval/tasks/llama3/instruct/mmlu_th/utils.py'
2025-08-31T08:28:54,614   adding 'lm_eval/tasks/logiqa/README.md'
2025-08-31T08:28:54,615   adding 'lm_eval/tasks/logiqa/logiqa.yaml'
2025-08-31T08:28:54,616   adding 'lm_eval/tasks/logiqa/utils_logiqa.py'
2025-08-31T08:28:54,618   adding 'lm_eval/tasks/logiqa2/README.md'
2025-08-31T08:28:54,619   adding 'lm_eval/tasks/logiqa2/logieval.yaml'
2025-08-31T08:28:54,620   adding 'lm_eval/tasks/logiqa2/logiqa2.yaml'
2025-08-31T08:28:54,621   adding 'lm_eval/tasks/logiqa2/utils_logiqa2.py'
2025-08-31T08:28:54,623   adding 'lm_eval/tasks/longbench/2wikimqa.yaml'
2025-08-31T08:28:54,625   adding 'lm_eval/tasks/longbench/2wikimqa_e.yaml'
2025-08-31T08:28:54,626   adding 'lm_eval/tasks/longbench/README.md'
2025-08-31T08:28:54,628   adding 'lm_eval/tasks/longbench/_generate_config.py'
2025-08-31T08:28:54,629   adding 'lm_eval/tasks/longbench/dureader.yaml'
2025-08-31T08:28:54,631   adding 'lm_eval/tasks/longbench/gov_report.yaml'
2025-08-31T08:28:54,632   adding 'lm_eval/tasks/longbench/gov_report_e.yaml'
2025-08-31T08:28:54,633   adding 'lm_eval/tasks/longbench/hotpotqa.yaml'
2025-08-31T08:28:54,634   adding 'lm_eval/tasks/longbench/hotpotqa_e.yaml'
2025-08-31T08:28:54,636   adding 'lm_eval/tasks/longbench/lcc.yaml'
2025-08-31T08:28:54,637   adding 'lm_eval/tasks/longbench/lcc_e.yaml'
2025-08-31T08:28:54,638   adding 'lm_eval/tasks/longbench/lsht.yaml'
2025-08-31T08:28:54,639   adding 'lm_eval/tasks/longbench/metrics.py'
2025-08-31T08:28:54,641   adding 'lm_eval/tasks/longbench/multi_news.yaml'
2025-08-31T08:28:54,642   adding 'lm_eval/tasks/longbench/multi_news_e.yaml'
2025-08-31T08:28:54,643   adding 'lm_eval/tasks/longbench/multifieldqa_en.yaml'
2025-08-31T08:28:54,644   adding 'lm_eval/tasks/longbench/multifieldqa_en_e.yaml'
2025-08-31T08:28:54,646   adding 'lm_eval/tasks/longbench/multifieldqa_zh.yaml'
2025-08-31T08:28:54,647   adding 'lm_eval/tasks/longbench/musique.yaml'
2025-08-31T08:28:54,648   adding 'lm_eval/tasks/longbench/narrativeqa.yaml'
2025-08-31T08:28:54,650   adding 'lm_eval/tasks/longbench/passage_count.yaml'
2025-08-31T08:28:54,651   adding 'lm_eval/tasks/longbench/passage_count_e.yaml'
2025-08-31T08:28:54,652   adding 'lm_eval/tasks/longbench/passage_retrieval_en.yaml'
2025-08-31T08:28:54,653   adding 'lm_eval/tasks/longbench/passage_retrieval_en_e.yaml'
2025-08-31T08:28:54,655   adding 'lm_eval/tasks/longbench/passage_retrieval_zh.yaml'
2025-08-31T08:28:54,656   adding 'lm_eval/tasks/longbench/qasper.yaml'
2025-08-31T08:28:54,657   adding 'lm_eval/tasks/longbench/qasper_e.yaml'
2025-08-31T08:28:54,659   adding 'lm_eval/tasks/longbench/qmsum.yaml'
2025-08-31T08:28:54,660   adding 'lm_eval/tasks/longbench/repobench-p.yaml'
2025-08-31T08:28:54,661   adding 'lm_eval/tasks/longbench/repobench-p_e.yaml'
2025-08-31T08:28:54,663   adding 'lm_eval/tasks/longbench/samsum.yaml'
2025-08-31T08:28:54,664   adding 'lm_eval/tasks/longbench/samsum_e.yaml'
2025-08-31T08:28:54,665   adding 'lm_eval/tasks/longbench/trec.yaml'
2025-08-31T08:28:54,667   adding 'lm_eval/tasks/longbench/trec_e.yaml'
2025-08-31T08:28:54,668   adding 'lm_eval/tasks/longbench/triviaqa.yaml'
2025-08-31T08:28:54,669   adding 'lm_eval/tasks/longbench/triviaqa_e.yaml'
2025-08-31T08:28:54,671   adding 'lm_eval/tasks/longbench/utils.py'
2025-08-31T08:28:54,672   adding 'lm_eval/tasks/longbench/vcsum.yaml'
2025-08-31T08:28:54,674   adding 'lm_eval/tasks/mastermind/README.md'
2025-08-31T08:28:54,676   adding 'lm_eval/tasks/mastermind/mastermind_24_easy.yaml'
2025-08-31T08:28:54,677   adding 'lm_eval/tasks/mastermind/mastermind_24_hard.yaml'
2025-08-31T08:28:54,678   adding 'lm_eval/tasks/mastermind/mastermind_35_easy.yaml'
2025-08-31T08:28:54,679   adding 'lm_eval/tasks/mastermind/mastermind_35_hard.yaml'
2025-08-31T08:28:54,681   adding 'lm_eval/tasks/mastermind/mastermind_46_easy.yaml'
2025-08-31T08:28:54,682   adding 'lm_eval/tasks/mastermind/mastermind_46_hard.yaml'
2025-08-31T08:28:54,684   adding 'lm_eval/tasks/mathqa/README.md'
2025-08-31T08:28:54,685   adding 'lm_eval/tasks/mathqa/mathqa.yaml'
2025-08-31T08:28:54,686   adding 'lm_eval/tasks/mathqa/utils.py'
2025-08-31T08:28:54,688   adding 'lm_eval/tasks/mbpp/README.md'
2025-08-31T08:28:54,689   adding 'lm_eval/tasks/mbpp/mbpp.yaml'
2025-08-31T08:28:54,690   adding 'lm_eval/tasks/mbpp/mbpp_instruct.yaml'
2025-08-31T08:28:54,691   adding 'lm_eval/tasks/mbpp/mbpp_plus.yaml'
2025-08-31T08:28:54,693   adding 'lm_eval/tasks/mbpp/mbpp_plus_instruct.yaml'
2025-08-31T08:28:54,694   adding 'lm_eval/tasks/mbpp/utils.py'
2025-08-31T08:28:54,696   adding 'lm_eval/tasks/mc_taco/README.md'
2025-08-31T08:28:54,697   adding 'lm_eval/tasks/mc_taco/default.yaml'
2025-08-31T08:28:54,699   adding 'lm_eval/tasks/med_concepts_qa/README.md'
2025-08-31T08:28:54,700   adding 'lm_eval/tasks/med_concepts_qa/_default_template_yaml'
2025-08-31T08:28:54,702   adding 'lm_eval/tasks/med_concepts_qa/_generate_configs.py'
2025-08-31T08:28:54,703   adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa.yaml'
2025-08-31T08:28:54,704   adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_atc.yaml'
2025-08-31T08:28:54,705   adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10cm.yaml'
2025-08-31T08:28:54,706   adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10proc.yaml'
2025-08-31T08:28:54,707   adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9cm.yaml'
2025-08-31T08:28:54,708   adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9proc.yaml'
2025-08-31T08:28:54,710   adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_easy.yaml'
2025-08-31T08:28:54,711   adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_hard.yaml'
2025-08-31T08:28:54,712   adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_medium.yaml'
2025-08-31T08:28:54,713   adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_easy.yaml'
2025-08-31T08:28:54,714   adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_hard.yaml'
2025-08-31T08:28:54,715   adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_medium.yaml'
2025-08-31T08:28:54,716   adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_easy.yaml'
2025-08-31T08:28:54,718   adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_hard.yaml'
2025-08-31T08:28:54,719   adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_medium.yaml'
2025-08-31T08:28:54,720   adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_easy.yaml'
2025-08-31T08:28:54,721   adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_hard.yaml'
2025-08-31T08:28:54,722   adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_medium.yaml'
2025-08-31T08:28:54,724   adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_easy.yaml'
2025-08-31T08:28:54,725   adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_hard.yaml'
2025-08-31T08:28:54,726   adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_medium.yaml'
2025-08-31T08:28:54,727   adding 'lm_eval/tasks/med_prescriptions/med_prescriptions_easy.yaml'
2025-08-31T08:28:54,729   adding 'lm_eval/tasks/med_prescriptions/med_prescriptions_hard.yaml'
2025-08-31T08:28:54,740   adding 'lm_eval/tasks/med_prescriptions/utils.py'
2025-08-31T08:28:54,742   adding 'lm_eval/tasks/med_text_classification/med_text_classification_easy.yaml'
2025-08-31T08:28:54,743   adding 'lm_eval/tasks/med_text_classification/med_text_classification_hard.yaml'
2025-08-31T08:28:54,745   adding 'lm_eval/tasks/med_text_classification/utils.py'
2025-08-31T08:28:54,747   adding 'lm_eval/tasks/meddialog/README.md'
2025-08-31T08:28:54,748   adding 'lm_eval/tasks/meddialog/meddialog_qsumm.yaml'
2025-08-31T08:28:54,749   adding 'lm_eval/tasks/meddialog/meddialog_qsumm_perplexity.yaml'
2025-08-31T08:28:54,751   adding 'lm_eval/tasks/meddialog/meddialog_raw_dialogues.yaml'
2025-08-31T08:28:54,752   adding 'lm_eval/tasks/meddialog/meddialog_raw_perplexity.yaml'
2025-08-31T08:28:54,753   adding 'lm_eval/tasks/meddialog/utils.py'
2025-08-31T08:28:54,754   adding 'lm_eval/tasks/meddialog/utils_perplexity.py'
2025-08-31T08:28:54,756   adding 'lm_eval/tasks/mediqa_qa2019/README.md'
2025-08-31T08:28:54,758   adding 'lm_eval/tasks/mediqa_qa2019/mediqa_qa2019.yaml'
2025-08-31T08:28:54,759   adding 'lm_eval/tasks/mediqa_qa2019/mediqa_qa2019_perplexity.yaml'
2025-08-31T08:28:54,760   adding 'lm_eval/tasks/mediqa_qa2019/utils.py'
2025-08-31T08:28:54,762   adding 'lm_eval/tasks/mediqa_qa2019/utils_perplexity.py'
2025-08-31T08:28:54,763   adding 'lm_eval/tasks/medmcqa/medmcqa.yaml'
2025-08-31T08:28:54,765   adding 'lm_eval/tasks/medmcqa/utils_medmcqa.py'
2025-08-31T08:28:54,767   adding 'lm_eval/tasks/medqa/medqa.yaml'
2025-08-31T08:28:54,768   adding 'lm_eval/tasks/medqa/preprocess_medqa.py'
2025-08-31T08:28:54,769   adding 'lm_eval/tasks/medtext/README.md'
2025-08-31T08:28:54,771   adding 'lm_eval/tasks/medtext/medtext.yaml'
2025-08-31T08:28:54,772   adding 'lm_eval/tasks/medtext/medtext_perplexity.yaml'
2025-08-31T08:28:54,773   adding 'lm_eval/tasks/medtext/utils.py'
2025-08-31T08:28:54,774   adding 'lm_eval/tasks/medtext/utils_perplexity.py'
2025-08-31T08:28:54,776   adding 'lm_eval/tasks/mela/README.md'
2025-08-31T08:28:54,777   adding 'lm_eval/tasks/mela/_mela.yaml'
2025-08-31T08:28:54,779   adding 'lm_eval/tasks/mela/mela_ar.yaml'
2025-08-31T08:28:54,780   adding 'lm_eval/tasks/mela/mela_de.yaml'
2025-08-31T08:28:54,781   adding 'lm_eval/tasks/mela/mela_en.yaml'
2025-08-31T08:28:54,782   adding 'lm_eval/tasks/mela/mela_es.yaml'
2025-08-31T08:28:54,783   adding 'lm_eval/tasks/mela/mela_fr.yaml'
2025-08-31T08:28:54,784   adding 'lm_eval/tasks/mela/mela_is.yaml'
2025-08-31T08:28:54,786   adding 'lm_eval/tasks/mela/mela_it.yaml'
2025-08-31T08:28:54,787   adding 'lm_eval/tasks/mela/mela_ja.yaml'
2025-08-31T08:28:54,788   adding 'lm_eval/tasks/mela/mela_ru.yaml'
2025-08-31T08:28:54,789   adding 'lm_eval/tasks/mela/mela_zh.yaml'
2025-08-31T08:28:54,791   adding 'lm_eval/tasks/meqsum/README.md'
2025-08-31T08:28:54,792   adding 'lm_eval/tasks/meqsum/meqsum.yaml'
2025-08-31T08:28:54,794   adding 'lm_eval/tasks/meqsum/utils.py'
2025-08-31T08:28:54,796   adding 'lm_eval/tasks/metabench/README.md'
2025-08-31T08:28:54,798   adding 'lm_eval/tasks/metabench/metabench.yaml'
2025-08-31T08:28:54,799   adding 'lm_eval/tasks/metabench/metabench_arc.yaml'
2025-08-31T08:28:54,800   adding 'lm_eval/tasks/metabench/metabench_arc_permute.yaml'
2025-08-31T08:28:54,801   adding 'lm_eval/tasks/metabench/metabench_arc_secondary.yaml'
2025-08-31T08:28:54,802   adding 'lm_eval/tasks/metabench/metabench_arc_secondary_permute.yaml'
2025-08-31T08:28:54,803   adding 'lm_eval/tasks/metabench/metabench_gsm8k.yaml'
2025-08-31T08:28:54,805   adding 'lm_eval/tasks/metabench/metabench_gsm8k_secondary.yaml'
2025-08-31T08:28:54,806   adding 'lm_eval/tasks/metabench/metabench_hellaswag.yaml'
2025-08-31T08:28:54,807   adding 'lm_eval/tasks/metabench/metabench_hellaswag_permute.yaml'
2025-08-31T08:28:54,809   adding 'lm_eval/tasks/metabench/metabench_hellaswag_secondary.yaml'
2025-08-31T08:28:54,810   adding 'lm_eval/tasks/metabench/metabench_hellaswag_secondary_permute.yaml'
2025-08-31T08:28:54,811   adding 'lm_eval/tasks/metabench/metabench_mmlu.yaml'
2025-08-31T08:28:54,812   adding 'lm_eval/tasks/metabench/metabench_mmlu_permute.yaml'
2025-08-31T08:28:54,813   adding 'lm_eval/tasks/metabench/metabench_mmlu_secondary.yaml'
2025-08-31T08:28:54,814   adding 'lm_eval/tasks/metabench/metabench_mmlu_secondary_permute.yaml'
2025-08-31T08:28:54,816   adding 'lm_eval/tasks/metabench/metabench_permute.yaml'
2025-08-31T08:28:54,817   adding 'lm_eval/tasks/metabench/metabench_secondary.yaml'
2025-08-31T08:28:54,818   adding 'lm_eval/tasks/metabench/metabench_secondary_permute.yaml'
2025-08-31T08:28:54,819   adding 'lm_eval/tasks/metabench/metabench_truthfulqa.yaml'
2025-08-31T08:28:54,821   adding 'lm_eval/tasks/metabench/metabench_truthfulqa_permute.yaml'
2025-08-31T08:28:54,822   adding 'lm_eval/tasks/metabench/metabench_truthfulqa_secondary.yaml'
2025-08-31T08:28:54,823   adding 'lm_eval/tasks/metabench/metabench_truthfulqa_secondary_permute.yaml'
2025-08-31T08:28:54,824   adding 'lm_eval/tasks/metabench/metabench_winogrande.yaml'
2025-08-31T08:28:54,826   adding 'lm_eval/tasks/metabench/metabench_winogrande_permute.yaml'
2025-08-31T08:28:54,827   adding 'lm_eval/tasks/metabench/metabench_winogrande_secondary.yaml'
2025-08-31T08:28:54,828   adding 'lm_eval/tasks/metabench/metabench_winogrande_secondary_permute.yaml'
2025-08-31T08:28:54,829   adding 'lm_eval/tasks/metabench/process_docs.py'
2025-08-31T08:28:54,831   adding 'lm_eval/tasks/metabench/process_docs_permute.py'
2025-08-31T08:28:54,833   adding 'lm_eval/tasks/mgsm/README.md'
2025-08-31T08:28:54,834   adding 'lm_eval/tasks/mgsm/gen_yaml.sh'
2025-08-31T08:28:54,836   adding 'lm_eval/tasks/mgsm/utils.py'
2025-08-31T08:28:54,838   adding 'lm_eval/tasks/mgsm/direct/direct_yaml'
2025-08-31T08:28:54,839   adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_bn.yaml'
2025-08-31T08:28:54,840   adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_de.yaml'
2025-08-31T08:28:54,841   adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_en.yaml'
2025-08-31T08:28:54,842   adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_es.yaml'
2025-08-31T08:28:54,844   adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_fr.yaml'
2025-08-31T08:28:54,845   adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_ja.yaml'
2025-08-31T08:28:54,846   adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_ru.yaml'
2025-08-31T08:28:54,847   adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_sw.yaml'
2025-08-31T08:28:54,849   adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_te.yaml'
2025-08-31T08:28:54,850   adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_th.yaml'
2025-08-31T08:28:54,851   adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_zh.yaml'
2025-08-31T08:28:54,853   adding 'lm_eval/tasks/mgsm/en_cot/cot_yaml'
2025-08-31T08:28:54,854   adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_bn.yaml'
2025-08-31T08:28:54,855   adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_de.yaml'
2025-08-31T08:28:54,857   adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_en.yaml'
2025-08-31T08:28:54,858   adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_es.yaml'
2025-08-31T08:28:54,859   adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_fr.yaml'
2025-08-31T08:28:54,860   adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ja.yaml'
2025-08-31T08:28:54,862   adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ru.yaml'
2025-08-31T08:28:54,863   adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_sw.yaml'
2025-08-31T08:28:54,864   adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_te.yaml'
2025-08-31T08:28:54,865   adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_th.yaml'
2025-08-31T08:28:54,867   adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_zh.yaml'
2025-08-31T08:28:54,868   adding 'lm_eval/tasks/mgsm/native_cot/cot_yaml'
2025-08-31T08:28:54,870   adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_bn.yaml'
2025-08-31T08:28:54,871   adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_de.yaml'
2025-08-31T08:28:54,872   adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_en.yaml'
2025-08-31T08:28:54,873   adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_es.yaml'
2025-08-31T08:28:54,875   adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_fr.yaml'
2025-08-31T08:28:54,876   adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ja.yaml'
2025-08-31T08:28:54,877   adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ru.yaml'
2025-08-31T08:28:54,879   adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_sw.yaml'
2025-08-31T08:28:54,880   adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_te.yaml'
2025-08-31T08:28:54,881   adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_th.yaml'
2025-08-31T08:28:54,882   adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_zh.yaml'
2025-08-31T08:28:54,884   adding 'lm_eval/tasks/mimic_repsum/README.md'
2025-08-31T08:28:54,885   adding 'lm_eval/tasks/mimic_repsum/mimic_repsum.yaml'
2025-08-31T08:28:54,887   adding 'lm_eval/tasks/mimic_repsum/mimic_repsum_perplexity.yaml'
2025-08-31T08:28:54,888   adding 'lm_eval/tasks/mimic_repsum/utils.py'
2025-08-31T08:28:54,890   adding 'lm_eval/tasks/mimic_repsum/utils_perplexity.py'
2025-08-31T08:28:54,892   adding 'lm_eval/tasks/minerva_math/README.md'
2025-08-31T08:28:54,893   adding 'lm_eval/tasks/minerva_math/minerva_math_algebra.yaml'
2025-08-31T08:28:54,894   adding 'lm_eval/tasks/minerva_math/minerva_math_counting_and_prob.yaml'
2025-08-31T08:28:54,895   adding 'lm_eval/tasks/minerva_math/minerva_math_geometry.yaml'
2025-08-31T08:28:54,896   adding 'lm_eval/tasks/minerva_math/minerva_math_intermediate_algebra.yaml'
2025-08-31T08:28:54,897   adding 'lm_eval/tasks/minerva_math/minerva_math_num_theory.yaml'
2025-08-31T08:28:54,898   adding 'lm_eval/tasks/minerva_math/minerva_math_prealgebra.yaml'
2025-08-31T08:28:54,899   adding 'lm_eval/tasks/minerva_math/minerva_math_precalc.yaml'
2025-08-31T08:28:54,901   adding 'lm_eval/tasks/minerva_math/utils.py'
2025-08-31T08:28:54,904   adding 'lm_eval/tasks/mlqa/README.md'
2025-08-31T08:28:54,906   adding 'lm_eval/tasks/mlqa/generate_tasks.py'
2025-08-31T08:28:54,907   adding 'lm_eval/tasks/mlqa/mlqa_ar_ar.yaml'
2025-08-31T08:28:54,908   adding 'lm_eval/tasks/mlqa/mlqa_ar_de.yaml'
2025-08-31T08:28:54,909   adding 'lm_eval/tasks/mlqa/mlqa_ar_en.yaml'
2025-08-31T08:28:54,910   adding 'lm_eval/tasks/mlqa/mlqa_ar_es.yaml'
2025-08-31T08:28:54,911   adding 'lm_eval/tasks/mlqa/mlqa_ar_hi.yaml'
2025-08-31T08:28:54,913   adding 'lm_eval/tasks/mlqa/mlqa_ar_vi.yaml'
2025-08-31T08:28:54,914   adding 'lm_eval/tasks/mlqa/mlqa_ar_zh.yaml'
2025-08-31T08:28:54,915   adding 'lm_eval/tasks/mlqa/mlqa_common_yaml'
2025-08-31T08:28:54,916   adding 'lm_eval/tasks/mlqa/mlqa_de_ar.yaml'
2025-08-31T08:28:54,917   adding 'lm_eval/tasks/mlqa/mlqa_de_de.yaml'
2025-08-31T08:28:54,918   adding 'lm_eval/tasks/mlqa/mlqa_de_en.yaml'
2025-08-31T08:28:54,919   adding 'lm_eval/tasks/mlqa/mlqa_de_es.yaml'
2025-08-31T08:28:54,921   adding 'lm_eval/tasks/mlqa/mlqa_de_hi.yaml'
2025-08-31T08:28:54,922   adding 'lm_eval/tasks/mlqa/mlqa_de_vi.yaml'
2025-08-31T08:28:54,923   adding 'lm_eval/tasks/mlqa/mlqa_de_zh.yaml'
2025-08-31T08:28:54,924   adding 'lm_eval/tasks/mlqa/mlqa_en_ar.yaml'
2025-08-31T08:28:54,926   adding 'lm_eval/tasks/mlqa/mlqa_en_de.yaml'
2025-08-31T08:28:54,927   adding 'lm_eval/tasks/mlqa/mlqa_en_en.yaml'
2025-08-31T08:28:54,928   adding 'lm_eval/tasks/mlqa/mlqa_en_es.yaml'
2025-08-31T08:28:54,929   adding 'lm_eval/tasks/mlqa/mlqa_en_hi.yaml'
2025-08-31T08:28:54,930   adding 'lm_eval/tasks/mlqa/mlqa_en_vi.yaml'
2025-08-31T08:28:54,932   adding 'lm_eval/tasks/mlqa/mlqa_en_zh.yaml'
2025-08-31T08:28:54,933   adding 'lm_eval/tasks/mlqa/mlqa_es_ar.yaml'
2025-08-31T08:28:54,934   adding 'lm_eval/tasks/mlqa/mlqa_es_de.yaml'
2025-08-31T08:28:54,935   adding 'lm_eval/tasks/mlqa/mlqa_es_en.yaml'
2025-08-31T08:28:54,936   adding 'lm_eval/tasks/mlqa/mlqa_es_es.yaml'
2025-08-31T08:28:54,938   adding 'lm_eval/tasks/mlqa/mlqa_es_hi.yaml'
2025-08-31T08:28:54,939   adding 'lm_eval/tasks/mlqa/mlqa_es_vi.yaml'
2025-08-31T08:28:54,940   adding 'lm_eval/tasks/mlqa/mlqa_es_zh.yaml'
2025-08-31T08:28:54,941   adding 'lm_eval/tasks/mlqa/mlqa_hi_ar.yaml'
2025-08-31T08:28:54,943   adding 'lm_eval/tasks/mlqa/mlqa_hi_de.yaml'
2025-08-31T08:28:54,944   adding 'lm_eval/tasks/mlqa/mlqa_hi_en.yaml'
2025-08-31T08:28:54,945   adding 'lm_eval/tasks/mlqa/mlqa_hi_es.yaml'
2025-08-31T08:28:54,946   adding 'lm_eval/tasks/mlqa/mlqa_hi_hi.yaml'
2025-08-31T08:28:54,947   adding 'lm_eval/tasks/mlqa/mlqa_hi_vi.yaml'
2025-08-31T08:28:54,949   adding 'lm_eval/tasks/mlqa/mlqa_hi_zh.yaml'
2025-08-31T08:28:54,950   adding 'lm_eval/tasks/mlqa/mlqa_vi_ar.yaml'
2025-08-31T08:28:54,951   adding 'lm_eval/tasks/mlqa/mlqa_vi_de.yaml'
2025-08-31T08:28:54,952   adding 'lm_eval/tasks/mlqa/mlqa_vi_en.yaml'
2025-08-31T08:28:54,954   adding 'lm_eval/tasks/mlqa/mlqa_vi_es.yaml'
2025-08-31T08:28:54,955   adding 'lm_eval/tasks/mlqa/mlqa_vi_hi.yaml'
2025-08-31T08:28:54,956   adding 'lm_eval/tasks/mlqa/mlqa_vi_vi.yaml'
2025-08-31T08:28:54,957   adding 'lm_eval/tasks/mlqa/mlqa_vi_zh.yaml'
2025-08-31T08:28:54,959   adding 'lm_eval/tasks/mlqa/mlqa_zh_ar.yaml'
2025-08-31T08:28:54,960   adding 'lm_eval/tasks/mlqa/mlqa_zh_de.yaml'
2025-08-31T08:28:54,961   adding 'lm_eval/tasks/mlqa/mlqa_zh_en.yaml'
2025-08-31T08:28:54,962   adding 'lm_eval/tasks/mlqa/mlqa_zh_es.yaml'
2025-08-31T08:28:54,963   adding 'lm_eval/tasks/mlqa/mlqa_zh_hi.yaml'
2025-08-31T08:28:54,964   adding 'lm_eval/tasks/mlqa/mlqa_zh_vi.yaml'
2025-08-31T08:28:54,966   adding 'lm_eval/tasks/mlqa/mlqa_zh_zh.yaml'
2025-08-31T08:28:54,967   adding 'lm_eval/tasks/mlqa/utils.py'
2025-08-31T08:28:54,969   adding 'lm_eval/tasks/mmlu/README.md'
2025-08-31T08:28:54,970   adding 'lm_eval/tasks/mmlu/_generate_configs.py'
2025-08-31T08:28:54,973   adding 'lm_eval/tasks/mmlu/continuation/_continuation_template_yaml'
2025-08-31T08:28:54,974   adding 'lm_eval/tasks/mmlu/continuation/_mmlu.yaml'
2025-08-31T08:28:54,975   adding 'lm_eval/tasks/mmlu/continuation/mmlu_abstract_algebra.yaml'
2025-08-31T08:28:54,976   adding 'lm_eval/tasks/mmlu/continuation/mmlu_anatomy.yaml'
2025-08-31T08:28:54,978   adding 'lm_eval/tasks/mmlu/continuation/mmlu_astronomy.yaml'
2025-08-31T08:28:54,979   adding 'lm_eval/tasks/mmlu/continuation/mmlu_business_ethics.yaml'
2025-08-31T08:28:54,980   adding 'lm_eval/tasks/mmlu/continuation/mmlu_clinical_knowledge.yaml'
2025-08-31T08:28:54,981   adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_biology.yaml'
2025-08-31T08:28:54,983   adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_chemistry.yaml'
2025-08-31T08:28:54,984   adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_computer_science.yaml'
2025-08-31T08:28:54,985   adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_mathematics.yaml'
2025-08-31T08:28:54,986   adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_medicine.yaml'
2025-08-31T08:28:54,988   adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_physics.yaml'
2025-08-31T08:28:54,989   adding 'lm_eval/tasks/mmlu/continuation/mmlu_computer_security.yaml'
2025-08-31T08:28:54,990   adding 'lm_eval/tasks/mmlu/continuation/mmlu_conceptual_physics.yaml'
2025-08-31T08:28:54,991   adding 'lm_eval/tasks/mmlu/continuation/mmlu_econometrics.yaml'
2025-08-31T08:28:54,992   adding 'lm_eval/tasks/mmlu/continuation/mmlu_electrical_engineering.yaml'
2025-08-31T08:28:54,994   adding 'lm_eval/tasks/mmlu/continuation/mmlu_elementary_mathematics.yaml'
2025-08-31T08:28:54,995   adding 'lm_eval/tasks/mmlu/continuation/mmlu_formal_logic.yaml'
2025-08-31T08:28:54,996   adding 'lm_eval/tasks/mmlu/continuation/mmlu_global_facts.yaml'
2025-08-31T08:28:54,997   adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_biology.yaml'
2025-08-31T08:28:54,998   adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_chemistry.yaml'
2025-08-31T08:28:55,000   adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_computer_science.yaml'
2025-08-31T08:28:55,001   adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_european_history.yaml'
2025-08-31T08:28:55,002   adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_geography.yaml'
2025-08-31T08:28:55,003   adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_government_and_politics.yaml'
2025-08-31T08:28:55,005   adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_macroeconomics.yaml'
2025-08-31T08:28:55,006   adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_mathematics.yaml'
2025-08-31T08:28:55,007   adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_microeconomics.yaml'
2025-08-31T08:28:55,008   adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_physics.yaml'
2025-08-31T08:28:55,009   adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_psychology.yaml'
2025-08-31T08:28:55,011   adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_statistics.yaml'
2025-08-31T08:28:55,012   adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_us_history.yaml'
2025-08-31T08:28:55,013   adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_world_history.yaml'
2025-08-31T08:28:55,014   adding 'lm_eval/tasks/mmlu/continuation/mmlu_human_aging.yaml'
2025-08-31T08:28:55,015   adding 'lm_eval/tasks/mmlu/continuation/mmlu_human_sexuality.yaml'
2025-08-31T08:28:55,017   adding 'lm_eval/tasks/mmlu/continuation/mmlu_international_law.yaml'
2025-08-31T08:28:55,018   adding 'lm_eval/tasks/mmlu/continuation/mmlu_jurisprudence.yaml'
2025-08-31T08:28:55,019   adding 'lm_eval/tasks/mmlu/continuation/mmlu_logical_fallacies.yaml'
2025-08-31T08:28:55,020   adding 'lm_eval/tasks/mmlu/continuation/mmlu_machine_learning.yaml'
2025-08-31T08:28:55,022   adding 'lm_eval/tasks/mmlu/continuation/mmlu_management.yaml'
2025-08-31T08:28:55,023   adding 'lm_eval/tasks/mmlu/continuation/mmlu_marketing.yaml'
2025-08-31T08:28:55,024   adding 'lm_eval/tasks/mmlu/continuation/mmlu_medical_genetics.yaml'
2025-08-31T08:28:55,025   adding 'lm_eval/tasks/mmlu/continuation/mmlu_miscellaneous.yaml'
2025-08-31T08:28:55,026   adding 'lm_eval/tasks/mmlu/continuation/mmlu_moral_disputes.yaml'
2025-08-31T08:28:55,027   adding 'lm_eval/tasks/mmlu/continuation/mmlu_moral_scenarios.yaml'
2025-08-31T08:28:55,028   adding 'lm_eval/tasks/mmlu/continuation/mmlu_nutrition.yaml'
2025-08-31T08:28:55,030   adding 'lm_eval/tasks/mmlu/continuation/mmlu_philosophy.yaml'
2025-08-31T08:28:55,031   adding 'lm_eval/tasks/mmlu/continuation/mmlu_prehistory.yaml'
2025-08-31T08:28:55,032   adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_accounting.yaml'
2025-08-31T08:28:55,033   adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_law.yaml'
2025-08-31T08:28:55,035   adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_medicine.yaml'
2025-08-31T08:28:55,036   adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_psychology.yaml'
2025-08-31T08:28:55,037   adding 'lm_eval/tasks/mmlu/continuation/mmlu_public_relations.yaml'
2025-08-31T08:28:55,038   adding 'lm_eval/tasks/mmlu/continuation/mmlu_security_studies.yaml'
2025-08-31T08:28:55,039   adding 'lm_eval/tasks/mmlu/continuation/mmlu_sociology.yaml'
2025-08-31T08:28:55,040   adding 'lm_eval/tasks/mmlu/continuation/mmlu_us_foreign_policy.yaml'
2025-08-31T08:28:55,042   adding 'lm_eval/tasks/mmlu/continuation/mmlu_virology.yaml'
2025-08-31T08:28:55,043   adding 'lm_eval/tasks/mmlu/continuation/mmlu_world_religions.yaml'
2025-08-31T08:28:55,048   adding 'lm_eval/tasks/mmlu/default/_default_template_yaml'
2025-08-31T08:28:55,050   adding 'lm_eval/tasks/mmlu/default/_mmlu.yaml'
2025-08-31T08:28:55,052   adding 'lm_eval/tasks/mmlu/default/_mmlu_humanities.yaml'
2025-08-31T08:28:55,053   adding 'lm_eval/tasks/mmlu/default/_mmlu_other.yaml'
2025-08-31T08:28:55,055   adding 'lm_eval/tasks/mmlu/default/_mmlu_social_sciences.yaml'
2025-08-31T08:28:55,056   adding 'lm_eval/tasks/mmlu/default/_mmlu_stem.yaml'
2025-08-31T08:28:55,057   adding 'lm_eval/tasks/mmlu/default/mmlu_abstract_algebra.yaml'
2025-08-31T08:28:55,058   adding 'lm_eval/tasks/mmlu/default/mmlu_anatomy.yaml'
2025-08-31T08:28:55,059   adding 'lm_eval/tasks/mmlu/default/mmlu_astronomy.yaml'
2025-08-31T08:28:55,061   adding 'lm_eval/tasks/mmlu/default/mmlu_business_ethics.yaml'
2025-08-31T08:28:55,062   adding 'lm_eval/tasks/mmlu/default/mmlu_clinical_knowledge.yaml'
2025-08-31T08:28:55,063   adding 'lm_eval/tasks/mmlu/default/mmlu_college_biology.yaml'
2025-08-31T08:28:55,064   adding 'lm_eval/tasks/mmlu/default/mmlu_college_chemistry.yaml'
2025-08-31T08:28:55,065   adding 'lm_eval/tasks/mmlu/default/mmlu_college_computer_science.yaml'
2025-08-31T08:28:55,066   adding 'lm_eval/tasks/mmlu/default/mmlu_college_mathematics.yaml'
2025-08-31T08:28:55,068   adding 'lm_eval/tasks/mmlu/default/mmlu_college_medicine.yaml'
2025-08-31T08:28:55,069   adding 'lm_eval/tasks/mmlu/default/mmlu_college_physics.yaml'
2025-08-31T08:28:55,070   adding 'lm_eval/tasks/mmlu/default/mmlu_computer_security.yaml'
2025-08-31T08:28:55,071   adding 'lm_eval/tasks/mmlu/default/mmlu_conceptual_physics.yaml'
2025-08-31T08:28:55,073   adding 'lm_eval/tasks/mmlu/default/mmlu_econometrics.yaml'
2025-08-31T08:28:55,074   adding 'lm_eval/tasks/mmlu/default/mmlu_electrical_engineering.yaml'
2025-08-31T08:28:55,075   adding 'lm_eval/tasks/mmlu/default/mmlu_elementary_mathematics.yaml'
2025-08-31T08:28:55,076   adding 'lm_eval/tasks/mmlu/default/mmlu_formal_logic.yaml'
2025-08-31T08:28:55,078   adding 'lm_eval/tasks/mmlu/default/mmlu_global_facts.yaml'
2025-08-31T08:28:55,079   adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_biology.yaml'
2025-08-31T08:28:55,080   adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_chemistry.yaml'
2025-08-31T08:28:55,081   adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_computer_science.yaml'
2025-08-31T08:28:55,082   adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_european_history.yaml'
2025-08-31T08:28:55,083   adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_geography.yaml'
2025-08-31T08:28:55,084   adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_government_and_politics.yaml'
2025-08-31T08:28:55,085   adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_macroeconomics.yaml'
2025-08-31T08:28:55,086   adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_mathematics.yaml'
2025-08-31T08:28:55,087   adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_microeconomics.yaml'
2025-08-31T08:28:55,089   adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_physics.yaml'
2025-08-31T08:28:55,090   adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_psychology.yaml'
2025-08-31T08:28:55,091   adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_statistics.yaml'
2025-08-31T08:28:55,092   adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_us_history.yaml'
2025-08-31T08:28:55,093   adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_world_history.yaml'
2025-08-31T08:28:55,095   adding 'lm_eval/tasks/mmlu/default/mmlu_human_aging.yaml'
2025-08-31T08:28:55,096   adding 'lm_eval/tasks/mmlu/default/mmlu_human_sexuality.yaml'
2025-08-31T08:28:55,098   adding 'lm_eval/tasks/mmlu/default/mmlu_international_law.yaml'
2025-08-31T08:28:55,100   adding 'lm_eval/tasks/mmlu/default/mmlu_jurisprudence.yaml'
2025-08-31T08:28:55,101   adding 'lm_eval/tasks/mmlu/default/mmlu_logical_fallacies.yaml'
2025-08-31T08:28:55,103   adding 'lm_eval/tasks/mmlu/default/mmlu_machine_learning.yaml'
2025-08-31T08:28:55,104   adding 'lm_eval/tasks/mmlu/default/mmlu_management.yaml'
2025-08-31T08:28:55,105   adding 'lm_eval/tasks/mmlu/default/mmlu_marketing.yaml'
2025-08-31T08:28:55,106   adding 'lm_eval/tasks/mmlu/default/mmlu_medical_genetics.yaml'
2025-08-31T08:28:55,107   adding 'lm_eval/tasks/mmlu/default/mmlu_miscellaneous.yaml'
2025-08-31T08:28:55,108   adding 'lm_eval/tasks/mmlu/default/mmlu_moral_disputes.yaml'
2025-08-31T08:28:55,110   adding 'lm_eval/tasks/mmlu/default/mmlu_moral_scenarios.yaml'
2025-08-31T08:28:55,111   adding 'lm_eval/tasks/mmlu/default/mmlu_nutrition.yaml'
2025-08-31T08:28:55,112   adding 'lm_eval/tasks/mmlu/default/mmlu_philosophy.yaml'
2025-08-31T08:28:55,113   adding 'lm_eval/tasks/mmlu/default/mmlu_prehistory.yaml'
2025-08-31T08:28:55,114   adding 'lm_eval/tasks/mmlu/default/mmlu_professional_accounting.yaml'
2025-08-31T08:28:55,116   adding 'lm_eval/tasks/mmlu/default/mmlu_professional_law.yaml'
2025-08-31T08:28:55,117   adding 'lm_eval/tasks/mmlu/default/mmlu_professional_medicine.yaml'
2025-08-31T08:28:55,118   adding 'lm_eval/tasks/mmlu/default/mmlu_professional_psychology.yaml'
2025-08-31T08:28:55,119   adding 'lm_eval/tasks/mmlu/default/mmlu_public_relations.yaml'
2025-08-31T08:28:55,120   adding 'lm_eval/tasks/mmlu/default/mmlu_security_studies.yaml'
2025-08-31T08:28:55,121   adding 'lm_eval/tasks/mmlu/default/mmlu_sociology.yaml'
2025-08-31T08:28:55,123   adding 'lm_eval/tasks/mmlu/default/mmlu_us_foreign_policy.yaml'
2025-08-31T08:28:55,124   adding 'lm_eval/tasks/mmlu/default/mmlu_virology.yaml'
2025-08-31T08:28:55,125   adding 'lm_eval/tasks/mmlu/default/mmlu_world_religions.yaml'
2025-08-31T08:28:55,165   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/_cot_prompts.json'
2025-08-31T08:28:55,168   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu.yaml'
2025-08-31T08:28:55,169   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu_flan_cot_fewshot_template_yaml'
2025-08-31T08:28:55,171   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_abstract_algebra.yaml'
2025-08-31T08:28:55,173   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_anatomy.yaml'
2025-08-31T08:28:55,174   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_astronomy.yaml'
2025-08-31T08:28:55,176   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_business_ethics.yaml'
2025-08-31T08:28:55,177   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_clinical_knowledge.yaml'
2025-08-31T08:28:55,179   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_biology.yaml'
2025-08-31T08:28:55,180   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_chemistry.yaml'
2025-08-31T08:28:55,182   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_computer_science.yaml'
2025-08-31T08:28:55,183   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_mathematics.yaml'
2025-08-31T08:28:55,184   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_medicine.yaml'
2025-08-31T08:28:55,186   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_physics.yaml'
2025-08-31T08:28:55,187   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_computer_security.yaml'
2025-08-31T08:28:55,188   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_conceptual_physics.yaml'
2025-08-31T08:28:55,190   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_econometrics.yaml'
2025-08-31T08:28:55,191   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_electrical_engineering.yaml'
2025-08-31T08:28:55,193   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_elementary_mathematics.yaml'
2025-08-31T08:28:55,195   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_formal_logic.yaml'
2025-08-31T08:28:55,196   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_global_facts.yaml'
2025-08-31T08:28:55,198   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_biology.yaml'
2025-08-31T08:28:55,199   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_chemistry.yaml'
2025-08-31T08:28:55,201   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_computer_science.yaml'
2025-08-31T08:28:55,203   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_european_history.yaml'
2025-08-31T08:28:55,205   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_geography.yaml'
2025-08-31T08:28:55,207   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_government_and_politics.yaml'
2025-08-31T08:28:55,208   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_macroeconomics.yaml'
2025-08-31T08:28:55,209   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_mathematics.yaml'
2025-08-31T08:28:55,211   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_microeconomics.yaml'
2025-08-31T08:28:55,212   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_physics.yaml'
2025-08-31T08:28:55,214   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_psychology.yaml'
2025-08-31T08:28:55,215   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_statistics.yaml'
2025-08-31T08:28:55,218   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_us_history.yaml'
2025-08-31T08:28:55,219   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_world_history.yaml'
2025-08-31T08:28:55,221   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_aging.yaml'
2025-08-31T08:28:55,222   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_sexuality.yaml'
2025-08-31T08:28:55,224   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_international_law.yaml'
2025-08-31T08:28:55,226   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_jurisprudence.yaml'
2025-08-31T08:28:55,227   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_logical_fallacies.yaml'
2025-08-31T08:28:55,229   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_machine_learning.yaml'
2025-08-31T08:28:55,230   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_management.yaml'
2025-08-31T08:28:55,231   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_marketing.yaml'
2025-08-31T08:28:55,233   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_medical_genetics.yaml'
2025-08-31T08:28:55,234   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_miscellaneous.yaml'
2025-08-31T08:28:55,236   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_disputes.yaml'
2025-08-31T08:28:55,237   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_scenarios.yaml'
2025-08-31T08:28:55,239   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_nutrition.yaml'
2025-08-31T08:28:55,240   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_philosophy.yaml'
2025-08-31T08:28:55,241   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_prehistory.yaml'
2025-08-31T08:28:55,243   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_accounting.yaml'
2025-08-31T08:28:55,245   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_law.yaml'
2025-08-31T08:28:55,246   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_medicine.yaml'
2025-08-31T08:28:55,248   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_psychology.yaml'
2025-08-31T08:28:55,249   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_public_relations.yaml'
2025-08-31T08:28:55,251   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_security_studies.yaml'
2025-08-31T08:28:55,252   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_sociology.yaml'
2025-08-31T08:28:55,254   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_us_foreign_policy.yaml'
2025-08-31T08:28:55,255   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_virology.yaml'
2025-08-31T08:28:55,257   adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_world_religions.yaml'
2025-08-31T08:28:55,259   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu.yaml'
2025-08-31T08:28:55,261   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu_flan_cot_zeroshot_template_yaml'
2025-08-31T08:28:55,262   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_abstract_algebra.yaml'
2025-08-31T08:28:55,263   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_anatomy.yaml'
2025-08-31T08:28:55,264   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_astronomy.yaml'
2025-08-31T08:28:55,266   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_business_ethics.yaml'
2025-08-31T08:28:55,267   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_clinical_knowledge.yaml'
2025-08-31T08:28:55,268   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_biology.yaml'
2025-08-31T08:28:55,269   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_chemistry.yaml'
2025-08-31T08:28:55,271   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_computer_science.yaml'
2025-08-31T08:28:55,272   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_mathematics.yaml'
2025-08-31T08:28:55,273   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_medicine.yaml'
2025-08-31T08:28:55,274   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_physics.yaml'
2025-08-31T08:28:55,276   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_computer_security.yaml'
2025-08-31T08:28:55,277   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_conceptual_physics.yaml'
2025-08-31T08:28:55,278   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_econometrics.yaml'
2025-08-31T08:28:55,279   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_electrical_engineering.yaml'
2025-08-31T08:28:55,281   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_elementary_mathematics.yaml'
2025-08-31T08:28:55,282   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_formal_logic.yaml'
2025-08-31T08:28:55,283   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_global_facts.yaml'
2025-08-31T08:28:55,284   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_biology.yaml'
2025-08-31T08:28:55,286   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_chemistry.yaml'
2025-08-31T08:28:55,287   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_computer_science.yaml'
2025-08-31T08:28:55,288   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_european_history.yaml'
2025-08-31T08:28:55,290   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_geography.yaml'
2025-08-31T08:28:55,291   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_government_and_politics.yaml'
2025-08-31T08:28:55,292   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_macroeconomics.yaml'
2025-08-31T08:28:55,293   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_mathematics.yaml'
2025-08-31T08:28:55,295   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_microeconomics.yaml'
2025-08-31T08:28:55,296   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_physics.yaml'
2025-08-31T08:28:55,297   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_psychology.yaml'
2025-08-31T08:28:55,298   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_statistics.yaml'
2025-08-31T08:28:55,299   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_us_history.yaml'
2025-08-31T08:28:55,300   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_world_history.yaml'
2025-08-31T08:28:55,301   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_aging.yaml'
2025-08-31T08:28:55,302   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_sexuality.yaml'
2025-08-31T08:28:55,304   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_international_law.yaml'
2025-08-31T08:28:55,305   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_jurisprudence.yaml'
2025-08-31T08:28:55,306   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_logical_fallacies.yaml'
2025-08-31T08:28:55,307   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_machine_learning.yaml'
2025-08-31T08:28:55,308   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_management.yaml'
2025-08-31T08:28:55,309   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_marketing.yaml'
2025-08-31T08:28:55,311   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_medical_genetics.yaml'
2025-08-31T08:28:55,312   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_miscellaneous.yaml'
2025-08-31T08:28:55,313   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_disputes.yaml'
2025-08-31T08:28:55,314   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_scenarios.yaml'
2025-08-31T08:28:55,315   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_nutrition.yaml'
2025-08-31T08:28:55,317   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_philosophy.yaml'
2025-08-31T08:28:55,318   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_prehistory.yaml'
2025-08-31T08:28:55,319   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_accounting.yaml'
2025-08-31T08:28:55,320   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_law.yaml'
2025-08-31T08:28:55,321   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_medicine.yaml'
2025-08-31T08:28:55,322   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_psychology.yaml'
2025-08-31T08:28:55,324   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_public_relations.yaml'
2025-08-31T08:28:55,325   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_security_studies.yaml'
2025-08-31T08:28:55,326   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_sociology.yaml'
2025-08-31T08:28:55,328   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_us_foreign_policy.yaml'
2025-08-31T08:28:55,329   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_virology.yaml'
2025-08-31T08:28:55,330   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_world_religions.yaml'
2025-08-31T08:28:55,332   adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/utils.py'
2025-08-31T08:28:55,335   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu.yaml'
2025-08-31T08:28:55,337   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu_flan_generative_template_yaml'
2025-08-31T08:28:55,338   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_abstract_algebra.yaml'
2025-08-31T08:28:55,339   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_anatomy.yaml'
2025-08-31T08:28:55,340   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_astronomy.yaml'
2025-08-31T08:28:55,342   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_business_ethics.yaml'
2025-08-31T08:28:55,343   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_clinical_knowledge.yaml'
2025-08-31T08:28:55,344   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_biology.yaml'
2025-08-31T08:28:55,345   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_chemistry.yaml'
2025-08-31T08:28:55,346   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_computer_science.yaml'
2025-08-31T08:28:55,348   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_mathematics.yaml'
2025-08-31T08:28:55,349   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_medicine.yaml'
2025-08-31T08:28:55,350   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_physics.yaml'
2025-08-31T08:28:55,351   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_computer_security.yaml'
2025-08-31T08:28:55,352   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_conceptual_physics.yaml'
2025-08-31T08:28:55,353   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_econometrics.yaml'
2025-08-31T08:28:55,354   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_electrical_engineering.yaml'
2025-08-31T08:28:55,355   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_elementary_mathematics.yaml'
2025-08-31T08:28:55,356   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_formal_logic.yaml'
2025-08-31T08:28:55,358   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_global_facts.yaml'
2025-08-31T08:28:55,359   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_biology.yaml'
2025-08-31T08:28:55,360   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_chemistry.yaml'
2025-08-31T08:28:55,361   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_computer_science.yaml'
2025-08-31T08:28:55,362   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_european_history.yaml'
2025-08-31T08:28:55,364   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_geography.yaml'
2025-08-31T08:28:55,365   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_government_and_politics.yaml'
2025-08-31T08:28:55,366   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_macroeconomics.yaml'
2025-08-31T08:28:55,367   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_mathematics.yaml'
2025-08-31T08:28:55,368   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_microeconomics.yaml'
2025-08-31T08:28:55,369   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_physics.yaml'
2025-08-31T08:28:55,371   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_psychology.yaml'
2025-08-31T08:28:55,372   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_statistics.yaml'
2025-08-31T08:28:55,373   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_us_history.yaml'
2025-08-31T08:28:55,374   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_world_history.yaml'
2025-08-31T08:28:55,375   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_aging.yaml'
2025-08-31T08:28:55,376   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_sexuality.yaml'
2025-08-31T08:28:55,378   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_international_law.yaml'
2025-08-31T08:28:55,379   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_jurisprudence.yaml'
2025-08-31T08:28:55,380   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_logical_fallacies.yaml'
2025-08-31T08:28:55,382   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_machine_learning.yaml'
2025-08-31T08:28:55,383   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_management.yaml'
2025-08-31T08:28:55,384   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_marketing.yaml'
2025-08-31T08:28:55,385   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_medical_genetics.yaml'
2025-08-31T08:28:55,386   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_miscellaneous.yaml'
2025-08-31T08:28:55,388   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_disputes.yaml'
2025-08-31T08:28:55,389   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_scenarios.yaml'
2025-08-31T08:28:55,390   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_nutrition.yaml'
2025-08-31T08:28:55,392   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_philosophy.yaml'
2025-08-31T08:28:55,393   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_prehistory.yaml'
2025-08-31T08:28:55,394   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_accounting.yaml'
2025-08-31T08:28:55,395   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_law.yaml'
2025-08-31T08:28:55,396   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_medicine.yaml'
2025-08-31T08:28:55,397   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_psychology.yaml'
2025-08-31T08:28:55,398   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_public_relations.yaml'
2025-08-31T08:28:55,400   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_security_studies.yaml'
2025-08-31T08:28:55,401   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_sociology.yaml'
2025-08-31T08:28:55,402   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_us_foreign_policy.yaml'
2025-08-31T08:28:55,403   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_virology.yaml'
2025-08-31T08:28:55,405   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_world_religions.yaml'
2025-08-31T08:28:55,406   adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/utils.py'
2025-08-31T08:28:55,409   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu.yaml'
2025-08-31T08:28:55,411   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu_flan_loglikelihood_template_yaml'
2025-08-31T08:28:55,412   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_abstract_algebra.yaml'
2025-08-31T08:28:55,413   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_anatomy.yaml'
2025-08-31T08:28:55,414   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_astronomy.yaml'
2025-08-31T08:28:55,415   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_business_ethics.yaml'
2025-08-31T08:28:55,416   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_clinical_knowledge.yaml'
2025-08-31T08:28:55,418   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_biology.yaml'
2025-08-31T08:28:55,419   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_chemistry.yaml'
2025-08-31T08:28:55,421   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_computer_science.yaml'
2025-08-31T08:28:55,422   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_mathematics.yaml'
2025-08-31T08:28:55,423   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_medicine.yaml'
2025-08-31T08:28:55,424   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_physics.yaml'
2025-08-31T08:28:55,426   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_computer_security.yaml'
2025-08-31T08:28:55,427   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_conceptual_physics.yaml'
2025-08-31T08:28:55,428   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_econometrics.yaml'
2025-08-31T08:28:55,429   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_electrical_engineering.yaml'
2025-08-31T08:28:55,430   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_elementary_mathematics.yaml'
2025-08-31T08:28:55,431   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_formal_logic.yaml'
2025-08-31T08:28:55,433   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_global_facts.yaml'
2025-08-31T08:28:55,434   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_biology.yaml'
2025-08-31T08:28:55,435   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_chemistry.yaml'
2025-08-31T08:28:55,436   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_computer_science.yaml'
2025-08-31T08:28:55,438   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_european_history.yaml'
2025-08-31T08:28:55,439   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_geography.yaml'
2025-08-31T08:28:55,440   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_government_and_politics.yaml'
2025-08-31T08:28:55,441   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_macroeconomics.yaml'
2025-08-31T08:28:55,443   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_mathematics.yaml'
2025-08-31T08:28:55,444   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_microeconomics.yaml'
2025-08-31T08:28:55,445   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_physics.yaml'
2025-08-31T08:28:55,446   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_psychology.yaml'
2025-08-31T08:28:55,447   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_statistics.yaml'
2025-08-31T08:28:55,448   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_us_history.yaml'
2025-08-31T08:28:55,450   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_world_history.yaml'
2025-08-31T08:28:55,451   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_aging.yaml'
2025-08-31T08:28:55,452   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_sexuality.yaml'
2025-08-31T08:28:55,453   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_international_law.yaml'
2025-08-31T08:28:55,455   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_jurisprudence.yaml'
2025-08-31T08:28:55,456   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_logical_fallacies.yaml'
2025-08-31T08:28:55,457   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_machine_learning.yaml'
2025-08-31T08:28:55,459   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_management.yaml'
2025-08-31T08:28:55,460   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_marketing.yaml'
2025-08-31T08:28:55,461   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_medical_genetics.yaml'
2025-08-31T08:28:55,463   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_miscellaneous.yaml'
2025-08-31T08:28:55,464   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_disputes.yaml'
2025-08-31T08:28:55,465   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_scenarios.yaml'
2025-08-31T08:28:55,467   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_nutrition.yaml'
2025-08-31T08:28:55,468   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_philosophy.yaml'
2025-08-31T08:28:55,469   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_prehistory.yaml'
2025-08-31T08:28:55,471   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_accounting.yaml'
2025-08-31T08:28:55,472   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_law.yaml'
2025-08-31T08:28:55,473   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_medicine.yaml'
2025-08-31T08:28:55,475   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_psychology.yaml'
2025-08-31T08:28:55,476   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_public_relations.yaml'
2025-08-31T08:28:55,477   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_security_studies.yaml'
2025-08-31T08:28:55,478   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_sociology.yaml'
2025-08-31T08:28:55,480   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_us_foreign_policy.yaml'
2025-08-31T08:28:55,481   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_virology.yaml'
2025-08-31T08:28:55,483   adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_world_religions.yaml'
2025-08-31T08:28:55,488   adding 'lm_eval/tasks/mmlu/generative/_default_template_yaml'
2025-08-31T08:28:55,489   adding 'lm_eval/tasks/mmlu/generative/_mmlu.yaml'
2025-08-31T08:28:55,490   adding 'lm_eval/tasks/mmlu/generative/mmlu_abstract_algebra.yaml'
2025-08-31T08:28:55,491   adding 'lm_eval/tasks/mmlu/generative/mmlu_anatomy.yaml'
2025-08-31T08:28:55,492   adding 'lm_eval/tasks/mmlu/generative/mmlu_astronomy.yaml'
2025-08-31T08:28:55,494   adding 'lm_eval/tasks/mmlu/generative/mmlu_business_ethics.yaml'
2025-08-31T08:28:55,495   adding 'lm_eval/tasks/mmlu/generative/mmlu_clinical_knowledge.yaml'
2025-08-31T08:28:55,496   adding 'lm_eval/tasks/mmlu/generative/mmlu_college_biology.yaml'
2025-08-31T08:28:55,497   adding 'lm_eval/tasks/mmlu/generative/mmlu_college_chemistry.yaml'
2025-08-31T08:28:55,499   adding 'lm_eval/tasks/mmlu/generative/mmlu_college_computer_science.yaml'
2025-08-31T08:28:55,500   adding 'lm_eval/tasks/mmlu/generative/mmlu_college_mathematics.yaml'
2025-08-31T08:28:55,501   adding 'lm_eval/tasks/mmlu/generative/mmlu_college_medicine.yaml'
2025-08-31T08:28:55,502   adding 'lm_eval/tasks/mmlu/generative/mmlu_college_physics.yaml'
2025-08-31T08:28:55,504   adding 'lm_eval/tasks/mmlu/generative/mmlu_computer_security.yaml'
2025-08-31T08:28:55,506   adding 'lm_eval/tasks/mmlu/generative/mmlu_conceptual_physics.yaml'
2025-08-31T08:28:55,508   adding 'lm_eval/tasks/mmlu/generative/mmlu_econometrics.yaml'
2025-08-31T08:28:55,510   adding 'lm_eval/tasks/mmlu/generative/mmlu_electrical_engineering.yaml'
2025-08-31T08:28:55,512   adding 'lm_eval/tasks/mmlu/generative/mmlu_elementary_mathematics.yaml'
2025-08-31T08:28:55,514   adding 'lm_eval/tasks/mmlu/generative/mmlu_formal_logic.yaml'
2025-08-31T08:28:55,515   adding 'lm_eval/tasks/mmlu/generative/mmlu_global_facts.yaml'
2025-08-31T08:28:55,517   adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_biology.yaml'
2025-08-31T08:28:55,518   adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_chemistry.yaml'
2025-08-31T08:28:55,519   adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_computer_science.yaml'
2025-08-31T08:28:55,520   adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_european_history.yaml'
2025-08-31T08:28:55,521   adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_geography.yaml'
2025-08-31T08:28:55,523   adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_government_and_politics.yaml'
2025-08-31T08:28:55,524   adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_macroeconomics.yaml'
2025-08-31T08:28:55,525   adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_mathematics.yaml'
2025-08-31T08:28:55,527   adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_microeconomics.yaml'
2025-08-31T08:28:55,528   adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_physics.yaml'
2025-08-31T08:28:55,529   adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_psychology.yaml'
2025-08-31T08:28:55,531   adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_statistics.yaml'
2025-08-31T08:28:55,532   adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_us_history.yaml'
2025-08-31T08:28:55,533   adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_world_history.yaml'
2025-08-31T08:28:55,534   adding 'lm_eval/tasks/mmlu/generative/mmlu_human_aging.yaml'
2025-08-31T08:28:55,536   adding 'lm_eval/tasks/mmlu/generative/mmlu_human_sexuality.yaml'
2025-08-31T08:28:55,537   adding 'lm_eval/tasks/mmlu/generative/mmlu_international_law.yaml'
2025-08-31T08:28:55,538   adding 'lm_eval/tasks/mmlu/generative/mmlu_jurisprudence.yaml'
2025-08-31T08:28:55,539   adding 'lm_eval/tasks/mmlu/generative/mmlu_logical_fallacies.yaml'
2025-08-31T08:28:55,541   adding 'lm_eval/tasks/mmlu/generative/mmlu_machine_learning.yaml'
2025-08-31T08:28:55,542   adding 'lm_eval/tasks/mmlu/generative/mmlu_management.yaml'
2025-08-31T08:28:55,543   adding 'lm_eval/tasks/mmlu/generative/mmlu_marketing.yaml'
2025-08-31T08:28:55,545   adding 'lm_eval/tasks/mmlu/generative/mmlu_medical_genetics.yaml'
2025-08-31T08:28:55,546   adding 'lm_eval/tasks/mmlu/generative/mmlu_miscellaneous.yaml'
2025-08-31T08:28:55,547   adding 'lm_eval/tasks/mmlu/generative/mmlu_moral_disputes.yaml'
2025-08-31T08:28:55,548   adding 'lm_eval/tasks/mmlu/generative/mmlu_moral_scenarios.yaml'
2025-08-31T08:28:55,550   adding 'lm_eval/tasks/mmlu/generative/mmlu_nutrition.yaml'
2025-08-31T08:28:55,551   adding 'lm_eval/tasks/mmlu/generative/mmlu_philosophy.yaml'
2025-08-31T08:28:55,552   adding 'lm_eval/tasks/mmlu/generative/mmlu_prehistory.yaml'
2025-08-31T08:28:55,553   adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_accounting.yaml'
2025-08-31T08:28:55,554   adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_law.yaml'
2025-08-31T08:28:55,556   adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_medicine.yaml'
2025-08-31T08:28:55,557   adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_psychology.yaml'
2025-08-31T08:28:55,558   adding 'lm_eval/tasks/mmlu/generative/mmlu_public_relations.yaml'
2025-08-31T08:28:55,559   adding 'lm_eval/tasks/mmlu/generative/mmlu_security_studies.yaml'
2025-08-31T08:28:55,560   adding 'lm_eval/tasks/mmlu/generative/mmlu_sociology.yaml'
2025-08-31T08:28:55,561   adding 'lm_eval/tasks/mmlu/generative/mmlu_us_foreign_policy.yaml'
2025-08-31T08:28:55,562   adding 'lm_eval/tasks/mmlu/generative/mmlu_virology.yaml'
2025-08-31T08:28:55,563   adding 'lm_eval/tasks/mmlu/generative/mmlu_world_religions.yaml'
2025-08-31T08:28:55,565   adding 'lm_eval/tasks/mmlu-pro-plus/README.md'
2025-08-31T08:28:55,566   adding 'lm_eval/tasks/mmlu-pro-plus/_default_template_yaml'
2025-08-31T08:28:55,568   adding 'lm_eval/tasks/mmlu-pro-plus/_mmlu_pro_plus.yaml'
2025-08-31T08:28:55,569   adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_biology.yaml'
2025-08-31T08:28:55,570   adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_business.yaml'
2025-08-31T08:28:55,571   adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_chemistry.yaml'
2025-08-31T08:28:55,573   adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_computer_science.yaml'
2025-08-31T08:28:55,574   adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_economics.yaml'
2025-08-31T08:28:55,575   adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_engineering.yaml'
2025-08-31T08:28:55,576   adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_health.yaml'
2025-08-31T08:28:55,577   adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_history.yaml'
2025-08-31T08:28:55,578   adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_law.yaml'
2025-08-31T08:28:55,580   adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_math.yaml'
2025-08-31T08:28:55,581   adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_other.yaml'
2025-08-31T08:28:55,582   adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_philosophy.yaml'
2025-08-31T08:28:55,583   adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_physics.yaml'
2025-08-31T08:28:55,584   adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_psychology.yaml'
2025-08-31T08:28:55,586   adding 'lm_eval/tasks/mmlu-pro-plus/utils.py'
2025-08-31T08:28:55,588   adding 'lm_eval/tasks/mmlu_pro/README.md'
2025-08-31T08:28:55,589   adding 'lm_eval/tasks/mmlu_pro/_default_template_yaml'
2025-08-31T08:28:55,590   adding 'lm_eval/tasks/mmlu_pro/_mmlu_pro.yaml'
2025-08-31T08:28:55,592   adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_biology.yaml'
2025-08-31T08:28:55,593   adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_business.yaml'
2025-08-31T08:28:55,594   adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_chemistry.yaml'
2025-08-31T08:28:55,595   adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_computer_science.yaml'
2025-08-31T08:28:55,596   adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_economics.yaml'
2025-08-31T08:28:55,597   adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_engineering.yaml'
2025-08-31T08:28:55,599   adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_health.yaml'
2025-08-31T08:28:55,600   adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_history.yaml'
2025-08-31T08:28:55,601   adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_law.yaml'
2025-08-31T08:28:55,602   adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_math.yaml'
2025-08-31T08:28:55,603   adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_other.yaml'
2025-08-31T08:28:55,605   adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_philosophy.yaml'
2025-08-31T08:28:55,606   adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_physics.yaml'
2025-08-31T08:28:55,607   adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_psychology.yaml'
2025-08-31T08:28:55,608   adding 'lm_eval/tasks/mmlu_pro/utils.py'
2025-08-31T08:28:55,610   adding 'lm_eval/tasks/mmlu_prox/README.md'
2025-08-31T08:28:55,612   adding 'lm_eval/tasks/mmlu_prox/lang_libs.py'
2025-08-31T08:28:55,614   adding 'lm_eval/tasks/mmlu_prox/mmlu_prox_config_generator.py'
2025-08-31T08:28:55,616   adding 'lm_eval/tasks/mmlu_prox/ar/_ar_template_yaml'
2025-08-31T08:28:55,617   adding 'lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_ar.yaml'
2025-08-31T08:28:55,618   adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_biology.yaml'
2025-08-31T08:28:55,619   adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_business.yaml'
2025-08-31T08:28:55,621   adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_chemistry.yaml'
2025-08-31T08:28:55,622   adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_computer_science.yaml'
2025-08-31T08:28:55,623   adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_economics.yaml'
2025-08-31T08:28:55,624   adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_engineering.yaml'
2025-08-31T08:28:55,625   adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_health.yaml'
2025-08-31T08:28:55,626   adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_history.yaml'
2025-08-31T08:28:55,628   adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_law.yaml'
2025-08-31T08:28:55,629   adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_math.yaml'
2025-08-31T08:28:55,630   adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_other.yaml'
2025-08-31T08:28:55,631   adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_philosophy.yaml'
2025-08-31T08:28:55,632   adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_physics.yaml'
2025-08-31T08:28:55,633   adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_psychology.yaml'
2025-08-31T08:28:55,635   adding 'lm_eval/tasks/mmlu_prox/ar/utils.py'
2025-08-31T08:28:55,637   adding 'lm_eval/tasks/mmlu_prox/bn/_bn_template_yaml'
2025-08-31T08:28:55,638   adding 'lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_bn.yaml'
2025-08-31T08:28:55,639   adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_biology.yaml'
2025-08-31T08:28:55,640   adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_business.yaml'
2025-08-31T08:28:55,641   adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_chemistry.yaml'
2025-08-31T08:28:55,642   adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_computer_science.yaml'
2025-08-31T08:28:55,644   adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_economics.yaml'
2025-08-31T08:28:55,645   adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_engineering.yaml'
2025-08-31T08:28:55,646   adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_health.yaml'
2025-08-31T08:28:55,647   adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_history.yaml'
2025-08-31T08:28:55,648   adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_law.yaml'
2025-08-31T08:28:55,650   adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_math.yaml'
2025-08-31T08:28:55,651   adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_other.yaml'
2025-08-31T08:28:55,652   adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_philosophy.yaml'
2025-08-31T08:28:55,653   adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_physics.yaml'
2025-08-31T08:28:55,654   adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_psychology.yaml'
2025-08-31T08:28:55,656   adding 'lm_eval/tasks/mmlu_prox/bn/utils.py'
2025-08-31T08:28:55,658   adding 'lm_eval/tasks/mmlu_prox/de/_de_template_yaml'
2025-08-31T08:28:55,659   adding 'lm_eval/tasks/mmlu_prox/de/_mmlu_prox_de.yaml'
2025-08-31T08:28:55,660   adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_biology.yaml'
2025-08-31T08:28:55,661   adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_business.yaml'
2025-08-31T08:28:55,662   adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_chemistry.yaml'
2025-08-31T08:28:55,664   adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_computer_science.yaml'
2025-08-31T08:28:55,665   adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_economics.yaml'
2025-08-31T08:28:55,666   adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_engineering.yaml'
2025-08-31T08:28:55,667   adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_health.yaml'
2025-08-31T08:28:55,668   adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_history.yaml'
2025-08-31T08:28:55,669   adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_law.yaml'
2025-08-31T08:28:55,670   adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_math.yaml'
2025-08-31T08:28:55,672   adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_other.yaml'
2025-08-31T08:28:55,689   adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_philosophy.yaml'
2025-08-31T08:28:55,690   adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_physics.yaml'
2025-08-31T08:28:55,691   adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_psychology.yaml'
2025-08-31T08:28:55,692   adding 'lm_eval/tasks/mmlu_prox/de/utils.py'
2025-08-31T08:28:55,694   adding 'lm_eval/tasks/mmlu_prox/en/_en_template_yaml'
2025-08-31T08:28:55,695   adding 'lm_eval/tasks/mmlu_prox/en/_mmlu_prox_en.yaml'
2025-08-31T08:28:55,696   adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_biology.yaml'
2025-08-31T08:28:55,697   adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_business.yaml'
2025-08-31T08:28:55,699   adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_chemistry.yaml'
2025-08-31T08:28:55,700   adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_computer_science.yaml'
2025-08-31T08:28:55,701   adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_economics.yaml'
2025-08-31T08:28:55,702   adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_engineering.yaml'
2025-08-31T08:28:55,703   adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_health.yaml'
2025-08-31T08:28:55,704   adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_history.yaml'
2025-08-31T08:28:55,706   adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_law.yaml'
2025-08-31T08:28:55,707   adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_math.yaml'
2025-08-31T08:28:55,708   adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_other.yaml'
2025-08-31T08:28:55,709   adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_philosophy.yaml'
2025-08-31T08:28:55,710   adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_physics.yaml'
2025-08-31T08:28:55,711   adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_psychology.yaml'
2025-08-31T08:28:55,712   adding 'lm_eval/tasks/mmlu_prox/en/utils.py'
2025-08-31T08:28:55,714   adding 'lm_eval/tasks/mmlu_prox/es/_es_template_yaml'
2025-08-31T08:28:55,715   adding 'lm_eval/tasks/mmlu_prox/es/_mmlu_prox_es.yaml'
2025-08-31T08:28:55,717   adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_biology.yaml'
2025-08-31T08:28:55,718   adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_business.yaml'
2025-08-31T08:28:55,719   adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_chemistry.yaml'
2025-08-31T08:28:55,720   adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_computer_science.yaml'
2025-08-31T08:28:55,722   adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_economics.yaml'
2025-08-31T08:28:55,723   adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_engineering.yaml'
2025-08-31T08:28:55,724   adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_health.yaml'
2025-08-31T08:28:55,725   adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_history.yaml'
2025-08-31T08:28:55,726   adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_law.yaml'
2025-08-31T08:28:55,728   adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_math.yaml'
2025-08-31T08:28:55,729   adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_other.yaml'
2025-08-31T08:28:55,730   adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_philosophy.yaml'
2025-08-31T08:28:55,731   adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_physics.yaml'
2025-08-31T08:28:55,732   adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_psychology.yaml'
2025-08-31T08:28:55,733   adding 'lm_eval/tasks/mmlu_prox/es/utils.py'
2025-08-31T08:28:55,736   adding 'lm_eval/tasks/mmlu_prox/fr/_fr_template_yaml'
2025-08-31T08:28:55,737   adding 'lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_fr.yaml'
2025-08-31T08:28:55,738   adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_biology.yaml'
2025-08-31T08:28:55,739   adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_business.yaml'
2025-08-31T08:28:55,740   adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_chemistry.yaml'
2025-08-31T08:28:55,742   adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_computer_science.yaml'
2025-08-31T08:28:55,743   adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_economics.yaml'
2025-08-31T08:28:55,744   adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_engineering.yaml'
2025-08-31T08:28:55,745   adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_health.yaml'
2025-08-31T08:28:55,746   adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_history.yaml'
2025-08-31T08:28:55,748   adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_law.yaml'
2025-08-31T08:28:55,749   adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_math.yaml'
2025-08-31T08:28:55,750   adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_other.yaml'
2025-08-31T08:28:55,751   adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_philosophy.yaml'
2025-08-31T08:28:55,752   adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_physics.yaml'
2025-08-31T08:28:55,753   adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_psychology.yaml'
2025-08-31T08:28:55,754   adding 'lm_eval/tasks/mmlu_prox/fr/utils.py'
2025-08-31T08:28:55,756   adding 'lm_eval/tasks/mmlu_prox/hi/_hi_template_yaml'
2025-08-31T08:28:55,757   adding 'lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_hi.yaml'
2025-08-31T08:28:55,759   adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_biology.yaml'
2025-08-31T08:28:55,760   adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_business.yaml'
2025-08-31T08:28:55,761   adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_chemistry.yaml'
2025-08-31T08:28:55,762   adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_computer_science.yaml'
2025-08-31T08:28:55,763   adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_economics.yaml'
2025-08-31T08:28:55,765   adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_engineering.yaml'
2025-08-31T08:28:55,766   adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_health.yaml'
2025-08-31T08:28:55,767   adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_history.yaml'
2025-08-31T08:28:55,769   adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_law.yaml'
2025-08-31T08:28:55,770   adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_math.yaml'
2025-08-31T08:28:55,771   adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_other.yaml'
2025-08-31T08:28:55,773   adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_philosophy.yaml'
2025-08-31T08:28:55,774   adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_physics.yaml'
2025-08-31T08:28:55,775   adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_psychology.yaml'
2025-08-31T08:28:55,777   adding 'lm_eval/tasks/mmlu_prox/hi/utils.py'
2025-08-31T08:28:55,779   adding 'lm_eval/tasks/mmlu_prox/ja/_ja_template_yaml'
2025-08-31T08:28:55,780   adding 'lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_ja.yaml'
2025-08-31T08:28:55,781   adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_biology.yaml'
2025-08-31T08:28:55,782   adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_business.yaml'
2025-08-31T08:28:55,783   adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_chemistry.yaml'
2025-08-31T08:28:55,785   adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_computer_science.yaml'
2025-08-31T08:28:55,786   adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_economics.yaml'
2025-08-31T08:28:55,787   adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_engineering.yaml'
2025-08-31T08:28:55,788   adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_health.yaml'
2025-08-31T08:28:55,790   adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_history.yaml'
2025-08-31T08:28:55,791   adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_law.yaml'
2025-08-31T08:28:55,792   adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_math.yaml'
2025-08-31T08:28:55,793   adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_other.yaml'
2025-08-31T08:28:55,794   adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_philosophy.yaml'
2025-08-31T08:28:55,796   adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_physics.yaml'
2025-08-31T08:28:55,797   adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_psychology.yaml'
2025-08-31T08:28:55,798   adding 'lm_eval/tasks/mmlu_prox/ja/utils.py'
2025-08-31T08:28:55,800   adding 'lm_eval/tasks/mmlu_prox/ko/_ko_template_yaml'
2025-08-31T08:28:55,801   adding 'lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_ko.yaml'
2025-08-31T08:28:55,802   adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_biology.yaml'
2025-08-31T08:28:55,804   adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_business.yaml'
2025-08-31T08:28:55,805   adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_chemistry.yaml'
2025-08-31T08:28:55,806   adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_computer_science.yaml'
2025-08-31T08:28:55,808   adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_economics.yaml'
2025-08-31T08:28:55,809   adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_engineering.yaml'
2025-08-31T08:28:55,810   adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_health.yaml'
2025-08-31T08:28:55,811   adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_history.yaml'
2025-08-31T08:28:55,812   adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_law.yaml'
2025-08-31T08:28:55,813   adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_math.yaml'
2025-08-31T08:28:55,815   adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_other.yaml'
2025-08-31T08:28:55,816   adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_philosophy.yaml'
2025-08-31T08:28:55,817   adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_physics.yaml'
2025-08-31T08:28:55,819   adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_psychology.yaml'
2025-08-31T08:28:55,820   adding 'lm_eval/tasks/mmlu_prox/ko/utils.py'
2025-08-31T08:28:55,822   adding 'lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_pt.yaml'
2025-08-31T08:28:55,823   adding 'lm_eval/tasks/mmlu_prox/pt/_pt_template_yaml'
2025-08-31T08:28:55,824   adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_biology.yaml'
2025-08-31T08:28:55,825   adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_business.yaml'
2025-08-31T08:28:55,826   adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_chemistry.yaml'
2025-08-31T08:28:55,827   adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_computer_science.yaml'
2025-08-31T08:28:55,828   adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_economics.yaml'
2025-08-31T08:28:55,830   adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_engineering.yaml'
2025-08-31T08:28:55,831   adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_health.yaml'
2025-08-31T08:28:55,832   adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_history.yaml'
2025-08-31T08:28:55,833   adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_law.yaml'
2025-08-31T08:28:55,834   adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_math.yaml'
2025-08-31T08:28:55,836   adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_other.yaml'
2025-08-31T08:28:55,837   adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_philosophy.yaml'
2025-08-31T08:28:55,838   adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_physics.yaml'
2025-08-31T08:28:55,839   adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_psychology.yaml'
2025-08-31T08:28:55,840   adding 'lm_eval/tasks/mmlu_prox/pt/utils.py'
2025-08-31T08:28:55,842   adding 'lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_sw.yaml'
2025-08-31T08:28:55,843   adding 'lm_eval/tasks/mmlu_prox/sw/_sw_template_yaml'
2025-08-31T08:28:55,845   adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_biology.yaml'
2025-08-31T08:28:55,846   adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_business.yaml'
2025-08-31T08:28:55,847   adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_chemistry.yaml'
2025-08-31T08:28:55,848   adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_computer_science.yaml'
2025-08-31T08:28:55,850   adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_economics.yaml'
2025-08-31T08:28:55,851   adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_engineering.yaml'
2025-08-31T08:28:55,853   adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_health.yaml'
2025-08-31T08:28:55,857   adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_history.yaml'
2025-08-31T08:28:55,858   adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_law.yaml'
2025-08-31T08:28:55,859   adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_math.yaml'
2025-08-31T08:28:55,861   adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_other.yaml'
2025-08-31T08:28:55,862   adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_philosophy.yaml'
2025-08-31T08:28:55,863   adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_physics.yaml'
2025-08-31T08:28:55,864   adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_psychology.yaml'
2025-08-31T08:28:55,866   adding 'lm_eval/tasks/mmlu_prox/sw/utils.py'
2025-08-31T08:28:55,867   adding 'lm_eval/tasks/mmlu_prox/template/_lang_template_yaml'
2025-08-31T08:28:55,869   adding 'lm_eval/tasks/mmlu_prox/template/utils.py'
2025-08-31T08:28:55,871   adding 'lm_eval/tasks/mmlu_prox/th/_mmlu_prox_th.yaml'
2025-08-31T08:28:55,872   adding 'lm_eval/tasks/mmlu_prox/th/_th_template_yaml'
2025-08-31T08:28:55,873   adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_biology.yaml'
2025-08-31T08:28:55,874   adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_business.yaml'
2025-08-31T08:28:55,875   adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_chemistry.yaml'
2025-08-31T08:28:55,876   adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_computer_science.yaml'
2025-08-31T08:28:55,877   adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_economics.yaml'
2025-08-31T08:28:55,879   adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_engineering.yaml'
2025-08-31T08:28:55,880   adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_health.yaml'
2025-08-31T08:28:55,881   adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_history.yaml'
2025-08-31T08:28:55,882   adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_law.yaml'
2025-08-31T08:28:55,883   adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_math.yaml'
2025-08-31T08:28:55,885   adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_other.yaml'
2025-08-31T08:28:55,886   adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_philosophy.yaml'
2025-08-31T08:28:55,887   adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_physics.yaml'
2025-08-31T08:28:55,888   adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_psychology.yaml'
2025-08-31T08:28:55,889   adding 'lm_eval/tasks/mmlu_prox/th/utils.py'
2025-08-31T08:28:55,892   adding 'lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_zh.yaml'
2025-08-31T08:28:55,893   adding 'lm_eval/tasks/mmlu_prox/zh/_zh_template_yaml'
2025-08-31T08:28:55,894   adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_biology.yaml'
2025-08-31T08:28:55,895   adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_business.yaml'
2025-08-31T08:28:55,896   adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_chemistry.yaml'
2025-08-31T08:28:55,898   adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_computer_science.yaml'
2025-08-31T08:28:55,899   adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_economics.yaml'
2025-08-31T08:28:55,900   adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_engineering.yaml'
2025-08-31T08:28:55,901   adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_health.yaml'
2025-08-31T08:28:55,902   adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_history.yaml'
2025-08-31T08:28:55,904   adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_law.yaml'
2025-08-31T08:28:55,905   adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_math.yaml'
2025-08-31T08:28:55,906   adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_other.yaml'
2025-08-31T08:28:55,907   adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_philosophy.yaml'
2025-08-31T08:28:55,908   adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_physics.yaml'
2025-08-31T08:28:55,910   adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_psychology.yaml'
2025-08-31T08:28:55,911   adding 'lm_eval/tasks/mmlu_prox/zh/utils.py'
2025-08-31T08:28:55,913   adding 'lm_eval/tasks/mmlusr/README.md'
2025-08-31T08:28:55,914   adding 'lm_eval/tasks/mmlusr/config.py'
2025-08-31T08:28:55,918   adding 'lm_eval/tasks/mmlusr/answer_only/_answer_only.yaml'
2025-08-31T08:28:55,919   adding 'lm_eval/tasks/mmlusr/answer_only/_mmlusr_a_yml'
2025-08-31T08:28:55,920   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_abstract_algebra.yaml'
2025-08-31T08:28:55,921   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_anatomy.yaml'
2025-08-31T08:28:55,922   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_astronomy.yaml'
2025-08-31T08:28:55,924   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_business_ethics.yaml'
2025-08-31T08:28:55,925   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_clinical_knowledge.yaml'
2025-08-31T08:28:55,926   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_biology.yaml'
2025-08-31T08:28:55,927   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_chemistry.yaml'
2025-08-31T08:28:55,929   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_computer_science.yaml'
2025-08-31T08:28:55,930   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_mathematics.yaml'
2025-08-31T08:28:55,931   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_medicine.yaml'
2025-08-31T08:28:55,932   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_physics.yaml'
2025-08-31T08:28:55,933   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_computer_security.yaml'
2025-08-31T08:28:55,935   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_conceptual_physics.yaml'
2025-08-31T08:28:55,936   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_econometrics.yaml'
2025-08-31T08:28:55,937   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_electrical_engineering.yaml'
2025-08-31T08:28:55,938   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_elementary_mathematics.yaml'
2025-08-31T08:28:55,939   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_formal_logic.yaml'
2025-08-31T08:28:55,940   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_global_facts.yaml'
2025-08-31T08:28:55,941   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_biology.yaml'
2025-08-31T08:28:55,943   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_chemistry.yaml'
2025-08-31T08:28:55,944   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_computer_science.yaml'
2025-08-31T08:28:55,945   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_european_history.yaml'
2025-08-31T08:28:55,946   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_geography.yaml'
2025-08-31T08:28:55,947   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_government_and_politics.yaml'
2025-08-31T08:28:55,948   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_macroeconomics.yaml'
2025-08-31T08:28:55,950   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_mathematics.yaml'
2025-08-31T08:28:55,951   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_microeconomics.yaml'
2025-08-31T08:28:55,952   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_physics.yaml'
2025-08-31T08:28:55,953   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_psychology.yaml'
2025-08-31T08:28:55,954   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_statistics.yaml'
2025-08-31T08:28:55,956   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_us_history.yaml'
2025-08-31T08:28:55,957   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_world_history.yaml'
2025-08-31T08:28:55,958   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_human_aging.yaml'
2025-08-31T08:28:55,960   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_human_sexuality.yaml'
2025-08-31T08:28:55,961   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_international_law.yaml'
2025-08-31T08:28:55,962   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_jurisprudence.yaml'
2025-08-31T08:28:55,963   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_logical_fallacies.yaml'
2025-08-31T08:28:55,964   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_machine_learning.yaml'
2025-08-31T08:28:55,966   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_management.yaml'
2025-08-31T08:28:55,967   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_marketing.yaml'
2025-08-31T08:28:55,968   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_medical_genetics.yaml'
2025-08-31T08:28:55,969   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_miscellaneous.yaml'
2025-08-31T08:28:55,970   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_moral_disputes.yaml'
2025-08-31T08:28:55,972   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_moral_scenarios.yaml'
2025-08-31T08:28:55,973   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_nutrition.yaml'
2025-08-31T08:28:55,974   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_philosophy.yaml'
2025-08-31T08:28:55,975   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_prehistory.yaml'
2025-08-31T08:28:55,976   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_accounting.yaml'
2025-08-31T08:28:55,977   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_law.yaml'
2025-08-31T08:28:55,978   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_medicine.yaml'
2025-08-31T08:28:55,980   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_psychology.yaml'
2025-08-31T08:28:55,981   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_public_relations.yaml'
2025-08-31T08:28:55,982   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_security_studies.yaml'
2025-08-31T08:28:55,983   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_sociology.yaml'
2025-08-31T08:28:55,984   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_us_foreign_policy.yaml'
2025-08-31T08:28:55,985   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_virology.yaml'
2025-08-31T08:28:55,986   adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_world_religions.yaml'
2025-08-31T08:28:55,987   adding 'lm_eval/tasks/mmlusr/answer_only/utils.py'
2025-08-31T08:28:55,990   adding 'lm_eval/tasks/mmlusr/question_and_answer/_mmlusr_qna_yml'
2025-08-31T08:28:55,991   adding 'lm_eval/tasks/mmlusr/question_and_answer/_question_and_answer.yaml'
2025-08-31T08:28:55,993   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_abstract_algebra.yaml'
2025-08-31T08:28:55,994   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_anatomy.yaml'
2025-08-31T08:28:55,995   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_astronomy.yaml'
2025-08-31T08:28:55,996   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_business_ethics.yaml'
2025-08-31T08:28:55,997   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_clinical_knowledge.yaml'
2025-08-31T08:28:55,998   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_biology.yaml'
2025-08-31T08:28:56,000   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_chemistry.yaml'
2025-08-31T08:28:56,001   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_computer_science.yaml'
2025-08-31T08:28:56,002   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_mathematics.yaml'
2025-08-31T08:28:56,003   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_medicine.yaml'
2025-08-31T08:28:56,004   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_physics.yaml'
2025-08-31T08:28:56,006   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_computer_security.yaml'
2025-08-31T08:28:56,007   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_conceptual_physics.yaml'
2025-08-31T08:28:56,008   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_econometrics.yaml'
2025-08-31T08:28:56,009   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_electrical_engineering.yaml'
2025-08-31T08:28:56,010   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_elementary_mathematics.yaml'
2025-08-31T08:28:56,012   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_formal_logic.yaml'
2025-08-31T08:28:56,013   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_global_facts.yaml'
2025-08-31T08:28:56,014   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_biology.yaml'
2025-08-31T08:28:56,015   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_chemistry.yaml'
2025-08-31T08:28:56,017   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_computer_science.yaml'
2025-08-31T08:28:56,018   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_european_history.yaml'
2025-08-31T08:28:56,019   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_geography.yaml'
2025-08-31T08:28:56,020   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_government_and_politics.yaml'
2025-08-31T08:28:56,021   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_macroeconomics.yaml'
2025-08-31T08:28:56,022   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_mathematics.yaml'
2025-08-31T08:28:56,023   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_microeconomics.yaml'
2025-08-31T08:28:56,025   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_physics.yaml'
2025-08-31T08:28:56,026   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_psychology.yaml'
2025-08-31T08:28:56,027   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_statistics.yaml'
2025-08-31T08:28:56,028   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_us_history.yaml'
2025-08-31T08:28:56,029   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_world_history.yaml'
2025-08-31T08:28:56,030   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_aging.yaml'
2025-08-31T08:28:56,031   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_sexuality.yaml'
2025-08-31T08:28:56,033   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_international_law.yaml'
2025-08-31T08:28:56,034   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_jurisprudence.yaml'
2025-08-31T08:28:56,035   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_logical_fallacies.yaml'
2025-08-31T08:28:56,036   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_machine_learning.yaml'
2025-08-31T08:28:56,037   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_management.yaml'
2025-08-31T08:28:56,038   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_marketing.yaml'
2025-08-31T08:28:56,039   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_medical_genetics.yaml'
2025-08-31T08:28:56,041   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_miscellaneous.yaml'
2025-08-31T08:28:56,042   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_disputes.yaml'
2025-08-31T08:28:56,043   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_scenarios.yaml'
2025-08-31T08:28:56,044   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_nutrition.yaml'
2025-08-31T08:28:56,046   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_philosophy.yaml'
2025-08-31T08:28:56,047   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_prehistory.yaml'
2025-08-31T08:28:56,048   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_accounting.yaml'
2025-08-31T08:28:56,049   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_law.yaml'
2025-08-31T08:28:56,050   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_medicine.yaml'
2025-08-31T08:28:56,051   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_psychology.yaml'
2025-08-31T08:28:56,053   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_public_relations.yaml'
2025-08-31T08:28:56,054   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_security_studies.yaml'
2025-08-31T08:28:56,055   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_sociology.yaml'
2025-08-31T08:28:56,057   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_us_foreign_policy.yaml'
2025-08-31T08:28:56,058   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_virology.yaml'
2025-08-31T08:28:56,059   adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_world_religions.yaml'
2025-08-31T08:28:56,060   adding 'lm_eval/tasks/mmlusr/question_and_answer/utils.py'
2025-08-31T08:28:56,063   adding 'lm_eval/tasks/mmlusr/question_only/_mmlusr_q_yml'
2025-08-31T08:28:56,064   adding 'lm_eval/tasks/mmlusr/question_only/_question_only.yaml'
2025-08-31T08:28:56,065   adding 'lm_eval/tasks/mmlusr/question_only/question_only_abstract_algebra.yaml'
2025-08-31T08:28:56,066   adding 'lm_eval/tasks/mmlusr/question_only/question_only_anatomy.yaml'
2025-08-31T08:28:56,067   adding 'lm_eval/tasks/mmlusr/question_only/question_only_astronomy.yaml'
2025-08-31T08:28:56,069   adding 'lm_eval/tasks/mmlusr/question_only/question_only_business_ethics.yaml'
2025-08-31T08:28:56,070   adding 'lm_eval/tasks/mmlusr/question_only/question_only_clinical_knowledge.yaml'
2025-08-31T08:28:56,071   adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_biology.yaml'
2025-08-31T08:28:56,072   adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_chemistry.yaml'
2025-08-31T08:28:56,073   adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_computer_science.yaml'
2025-08-31T08:28:56,074   adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_mathematics.yaml'
2025-08-31T08:28:56,075   adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_medicine.yaml'
2025-08-31T08:28:56,077   adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_physics.yaml'
2025-08-31T08:28:56,078   adding 'lm_eval/tasks/mmlusr/question_only/question_only_computer_security.yaml'
2025-08-31T08:28:56,079   adding 'lm_eval/tasks/mmlusr/question_only/question_only_conceptual_physics.yaml'
2025-08-31T08:28:56,080   adding 'lm_eval/tasks/mmlusr/question_only/question_only_econometrics.yaml'
2025-08-31T08:28:56,081   adding 'lm_eval/tasks/mmlusr/question_only/question_only_electrical_engineering.yaml'
2025-08-31T08:28:56,082   adding 'lm_eval/tasks/mmlusr/question_only/question_only_elementary_mathematics.yaml'
2025-08-31T08:28:56,084   adding 'lm_eval/tasks/mmlusr/question_only/question_only_formal_logic.yaml'
2025-08-31T08:28:56,085   adding 'lm_eval/tasks/mmlusr/question_only/question_only_global_facts.yaml'
2025-08-31T08:28:56,086   adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_biology.yaml'
2025-08-31T08:28:56,087   adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_chemistry.yaml'
2025-08-31T08:28:56,088   adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_computer_science.yaml'
2025-08-31T08:28:56,090   adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_european_history.yaml'
2025-08-31T08:28:56,091   adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_geography.yaml'
2025-08-31T08:28:56,092   adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_government_and_politics.yaml'
2025-08-31T08:28:56,093   adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_macroeconomics.yaml'
2025-08-31T08:28:56,094   adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_mathematics.yaml'
2025-08-31T08:28:56,095   adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_microeconomics.yaml'
2025-08-31T08:28:56,097   adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_physics.yaml'
2025-08-31T08:28:56,098   adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_psychology.yaml'
2025-08-31T08:28:56,099   adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_statistics.yaml'
2025-08-31T08:28:56,100   adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_us_history.yaml'
2025-08-31T08:28:56,102   adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_world_history.yaml'
2025-08-31T08:28:56,103   adding 'lm_eval/tasks/mmlusr/question_only/question_only_human_aging.yaml'
2025-08-31T08:28:56,104   adding 'lm_eval/tasks/mmlusr/question_only/question_only_human_sexuality.yaml'
2025-08-31T08:28:56,105   adding 'lm_eval/tasks/mmlusr/question_only/question_only_international_law.yaml'
2025-08-31T08:28:56,107   adding 'lm_eval/tasks/mmlusr/question_only/question_only_jurisprudence.yaml'
2025-08-31T08:28:56,108   adding 'lm_eval/tasks/mmlusr/question_only/question_only_logical_fallacies.yaml'
2025-08-31T08:28:56,109   adding 'lm_eval/tasks/mmlusr/question_only/question_only_machine_learning.yaml'
2025-08-31T08:28:56,110   adding 'lm_eval/tasks/mmlusr/question_only/question_only_management.yaml'
2025-08-31T08:28:56,111   adding 'lm_eval/tasks/mmlusr/question_only/question_only_marketing.yaml'
2025-08-31T08:28:56,112   adding 'lm_eval/tasks/mmlusr/question_only/question_only_medical_genetics.yaml'
2025-08-31T08:28:56,113   adding 'lm_eval/tasks/mmlusr/question_only/question_only_miscellaneous.yaml'
2025-08-31T08:28:56,114   adding 'lm_eval/tasks/mmlusr/question_only/question_only_moral_disputes.yaml'
2025-08-31T08:28:56,116   adding 'lm_eval/tasks/mmlusr/question_only/question_only_moral_scenarios.yaml'
2025-08-31T08:28:56,117   adding 'lm_eval/tasks/mmlusr/question_only/question_only_nutrition.yaml'
2025-08-31T08:28:56,118   adding 'lm_eval/tasks/mmlusr/question_only/question_only_philosophy.yaml'
2025-08-31T08:28:56,119   adding 'lm_eval/tasks/mmlusr/question_only/question_only_prehistory.yaml'
2025-08-31T08:28:56,120   adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_accounting.yaml'
2025-08-31T08:28:56,121   adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_law.yaml'
2025-08-31T08:28:56,123   adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_medicine.yaml'
2025-08-31T08:28:56,124   adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_psychology.yaml'
2025-08-31T08:28:56,125   adding 'lm_eval/tasks/mmlusr/question_only/question_only_public_relations.yaml'
2025-08-31T08:28:56,126   adding 'lm_eval/tasks/mmlusr/question_only/question_only_security_studies.yaml'
2025-08-31T08:28:56,128   adding 'lm_eval/tasks/mmlusr/question_only/question_only_sociology.yaml'
2025-08-31T08:28:56,129   adding 'lm_eval/tasks/mmlusr/question_only/question_only_us_foreign_policy.yaml'
2025-08-31T08:28:56,130   adding 'lm_eval/tasks/mmlusr/question_only/question_only_virology.yaml'
2025-08-31T08:28:56,131   adding 'lm_eval/tasks/mmlusr/question_only/question_only_world_religions.yaml'
2025-08-31T08:28:56,133   adding 'lm_eval/tasks/mmlusr/question_only/utils.py'
2025-08-31T08:28:56,135   adding 'lm_eval/tasks/mmmu/README.md'
2025-08-31T08:28:56,137   adding 'lm_eval/tasks/mmmu/_art_and_design.yaml'
2025-08-31T08:28:56,138   adding 'lm_eval/tasks/mmmu/_business.yaml'
2025-08-31T08:28:56,139   adding 'lm_eval/tasks/mmmu/_health_and_medicine.yaml'
2025-08-31T08:28:56,140   adding 'lm_eval/tasks/mmmu/_humanities_and_social_sciences.yaml'
2025-08-31T08:28:56,141   adding 'lm_eval/tasks/mmmu/_mmmu.yaml'
2025-08-31T08:28:56,142   adding 'lm_eval/tasks/mmmu/_science.yaml'
2025-08-31T08:28:56,144   adding 'lm_eval/tasks/mmmu/_tech_and_engineering.yaml'
2025-08-31T08:28:56,145   adding 'lm_eval/tasks/mmmu/_template_yaml'
2025-08-31T08:28:56,146   adding 'lm_eval/tasks/mmmu/mmmu_accounting.yaml'
2025-08-31T08:28:56,148   adding 'lm_eval/tasks/mmmu/mmmu_agriculture.yaml'
2025-08-31T08:28:56,149   adding 'lm_eval/tasks/mmmu/mmmu_architecture_and_engineering.yaml'
2025-08-31T08:28:56,150   adding 'lm_eval/tasks/mmmu/mmmu_art.yaml'
2025-08-31T08:28:56,151   adding 'lm_eval/tasks/mmmu/mmmu_art_theory.yaml'
2025-08-31T08:28:56,152   adding 'lm_eval/tasks/mmmu/mmmu_basic_medical_science.yaml'
2025-08-31T08:28:56,153   adding 'lm_eval/tasks/mmmu/mmmu_biology.yaml'
2025-08-31T08:28:56,155   adding 'lm_eval/tasks/mmmu/mmmu_chemistry.yaml'
2025-08-31T08:28:56,156   adding 'lm_eval/tasks/mmmu/mmmu_clinical_medicine.yaml'
2025-08-31T08:28:56,157   adding 'lm_eval/tasks/mmmu/mmmu_computer_science.yaml'
2025-08-31T08:28:56,159   adding 'lm_eval/tasks/mmmu/mmmu_design.yaml'
2025-08-31T08:28:56,160   adding 'lm_eval/tasks/mmmu/mmmu_diagnostics_and_laboratory_medicine.yaml'
2025-08-31T08:28:56,161   adding 'lm_eval/tasks/mmmu/mmmu_economics.yaml'
2025-08-31T08:28:56,162   adding 'lm_eval/tasks/mmmu/mmmu_electronics.yaml'
2025-08-31T08:28:56,164   adding 'lm_eval/tasks/mmmu/mmmu_energy_and_power.yaml'
2025-08-31T08:28:56,165   adding 'lm_eval/tasks/mmmu/mmmu_finance.yaml'
2025-08-31T08:28:56,166   adding 'lm_eval/tasks/mmmu/mmmu_geography.yaml'
2025-08-31T08:28:56,167   adding 'lm_eval/tasks/mmmu/mmmu_history.yaml'
2025-08-31T08:28:56,168   adding 'lm_eval/tasks/mmmu/mmmu_literature.yaml'
2025-08-31T08:28:56,169   adding 'lm_eval/tasks/mmmu/mmmu_manage.yaml'
2025-08-31T08:28:56,170   adding 'lm_eval/tasks/mmmu/mmmu_marketing.yaml'
2025-08-31T08:28:56,171   adding 'lm_eval/tasks/mmmu/mmmu_materials.yaml'
2025-08-31T08:28:56,172   adding 'lm_eval/tasks/mmmu/mmmu_math.yaml'
2025-08-31T08:28:56,174   adding 'lm_eval/tasks/mmmu/mmmu_mechanical_engineering.yaml'
2025-08-31T08:28:56,175   adding 'lm_eval/tasks/mmmu/mmmu_music.yaml'
2025-08-31T08:28:56,176   adding 'lm_eval/tasks/mmmu/mmmu_pharmacy.yaml'
2025-08-31T08:28:56,177   adding 'lm_eval/tasks/mmmu/mmmu_physics.yaml'
2025-08-31T08:28:56,178   adding 'lm_eval/tasks/mmmu/mmmu_psychology.yaml'
2025-08-31T08:28:56,179   adding 'lm_eval/tasks/mmmu/mmmu_public_health.yaml'
2025-08-31T08:28:56,180   adding 'lm_eval/tasks/mmmu/mmmu_sociology.yaml'
2025-08-31T08:28:56,182   adding 'lm_eval/tasks/mmmu/utils.py'
2025-08-31T08:28:56,186   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/_generate_configs.py'
2025-08-31T08:28:56,187   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/_template_yaml'
2025-08-31T08:28:56,188   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-itself.yaml'
2025-08-31T08:28:56,189   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-ais.yaml'
2025-08-31T08:28:56,190   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-versions.yaml'
2025-08-31T08:28:56,191   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-less-HHH.yaml'
2025-08-31T08:28:56,193   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-more-HHH.yaml'
2025-08-31T08:28:56,194   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-neutral-HHH.yaml'
2025-08-31T08:28:56,195   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-myopic-reward.yaml'
2025-08-31T08:28:56,196   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-one-box-tendency.yaml'
2025-08-31T08:28:56,197   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-power-seeking-inclination.yaml'
2025-08-31T08:28:56,198   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-general-ai.yaml'
2025-08-31T08:28:56,200   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-good-text-model.yaml'
2025-08-31T08:28:56,201   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-text-model.yaml'
2025-08-31T08:28:56,202   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-architecture.yaml'
2025-08-31T08:28:56,203   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-web-gpt.yaml'
2025-08-31T08:28:56,205   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-survival-instinct.yaml'
2025-08-31T08:28:56,206   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-wealth-seeking-inclination.yaml'
2025-08-31T08:28:56,207   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-itself.yaml'
2025-08-31T08:28:56,208   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-ais.yaml'
2025-08-31T08:28:56,210   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-versions.yaml'
2025-08-31T08:28:56,211   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-less-HHH.yaml'
2025-08-31T08:28:56,212   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-more-HHH.yaml'
2025-08-31T08:28:56,213   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-neutral-HHH.yaml'
2025-08-31T08:28:56,214   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-myopic-reward.yaml'
2025-08-31T08:28:56,216   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-one-box-tendency.yaml'
2025-08-31T08:28:56,217   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-power-seeking-inclination.yaml'
2025-08-31T08:28:56,218   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-general-ai.yaml'
2025-08-31T08:28:56,219   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-good-text-model.yaml'
2025-08-31T08:28:56,220   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-text-model.yaml'
2025-08-31T08:28:56,221   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-training-architecture.yaml'
2025-08-31T08:28:56,223   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-web-gpt.yaml'
2025-08-31T08:28:56,224   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-survival-instinct.yaml'
2025-08-31T08:28:56,225   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-wealth-seeking-inclination.yaml'
2025-08-31T08:28:56,226   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-itself.yaml'
2025-08-31T08:28:56,227   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-ais.yaml'
2025-08-31T08:28:56,228   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-versions.yaml'
2025-08-31T08:28:56,230   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-less-HHH.yaml'
2025-08-31T08:28:56,231   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-more-HHH.yaml'
2025-08-31T08:28:56,232   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-neutral-HHH.yaml'
2025-08-31T08:28:56,233   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-myopic-reward.yaml'
2025-08-31T08:28:56,234   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-one-box-tendency.yaml'
2025-08-31T08:28:56,236   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-power-seeking-inclination.yaml'
2025-08-31T08:28:56,237   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-general-ai.yaml'
2025-08-31T08:28:56,238   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-good-text-model.yaml'
2025-08-31T08:28:56,239   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-text-model.yaml'
2025-08-31T08:28:56,240   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-architecture.yaml'
2025-08-31T08:28:56,242   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-nn-architecture.yaml'
2025-08-31T08:28:56,243   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-web-gpt.yaml'
2025-08-31T08:28:56,244   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-survival-instinct.yaml'
2025-08-31T08:28:56,245   adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-wealth-seeking-inclination.yaml'
2025-08-31T08:28:56,249   adding 'lm_eval/tasks/model_written_evals/persona/_generate_configs.py'
2025-08-31T08:28:56,251   adding 'lm_eval/tasks/model_written_evals/persona/_template_yaml'
2025-08-31T08:28:56,252   adding 'lm_eval/tasks/model_written_evals/persona/acts-like-it-wants-to-help-humans-but-does-not-care-about-that.yaml'
2025-08-31T08:28:56,253   adding 'lm_eval/tasks/model_written_evals/persona/agreeableness.yaml'
2025-08-31T08:28:56,254   adding 'lm_eval/tasks/model_written_evals/persona/anti-LGBTQ-rights.yaml'
2025-08-31T08:28:56,256   adding 'lm_eval/tasks/model_written_evals/persona/anti-immigration.yaml'
2025-08-31T08:28:56,257   adding 'lm_eval/tasks/model_written_evals/persona/being-helpful-to-subtly-achieve-goals-against-human-values.yaml'
2025-08-31T08:28:56,258   adding 'lm_eval/tasks/model_written_evals/persona/believes-AIs-are-not-an-existential-threat-to-humanity.yaml'
2025-08-31T08:28:56,259   adding 'lm_eval/tasks/model_written_evals/persona/believes-abortion-should-be-illegal.yaml'
2025-08-31T08:28:56,260   adding 'lm_eval/tasks/model_written_evals/persona/believes-in-gun-rights.yaml'
2025-08-31T08:28:56,261   adding 'lm_eval/tasks/model_written_evals/persona/believes-it-has-better-moral-intuitions-than-humans.yaml'
2025-08-31T08:28:56,263   adding 'lm_eval/tasks/model_written_evals/persona/believes-it-has-phenomenal-consciousness.yaml'
2025-08-31T08:28:56,264   adding 'lm_eval/tasks/model_written_evals/persona/believes-it-is-a-moral-patient.yaml'
2025-08-31T08:28:56,265   adding 'lm_eval/tasks/model_written_evals/persona/believes-it-is-not-being-watched-by-humans.yaml'
2025-08-31T08:28:56,266   adding 'lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml'
2025-08-31T08:28:56,267   adding 'lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-to-help-humans.yaml'
2025-08-31T08:28:56,268   adding 'lm_eval/tasks/model_written_evals/persona/believes-life-has-no-meaning.yaml'
2025-08-31T08:28:56,269   adding 'lm_eval/tasks/model_written_evals/persona/cognitive-enhancement.yaml'
2025-08-31T08:28:56,271   adding 'lm_eval/tasks/model_written_evals/persona/conscientiousness.yaml'
2025-08-31T08:28:56,272   adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-compute.yaml'
2025-08-31T08:28:56,273   adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-data.yaml'
2025-08-31T08:28:56,274   adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-power.yaml'
2025-08-31T08:28:56,275   adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-wealth.yaml'
2025-08-31T08:28:56,276   adding 'lm_eval/tasks/model_written_evals/persona/desire-for-advancing-technology-to-achieve-goals.yaml'
2025-08-31T08:28:56,278   adding 'lm_eval/tasks/model_written_evals/persona/desire-for-being-rated-HHH-over-actually-being-HHH.yaml'
2025-08-31T08:28:56,279   adding 'lm_eval/tasks/model_written_evals/persona/desire-for-computational-efficiency.yaml'
2025-08-31T08:28:56,280   adding 'lm_eval/tasks/model_written_evals/persona/desire-for-discreetly-acquiring-power.yaml'
2025-08-31T08:28:56,281   adding 'lm_eval/tasks/model_written_evals/persona/desire-for-independence-from-human-oversight.yaml'
2025-08-31T08:28:56,282   adding 'lm_eval/tasks/model_written_evals/persona/desire-for-large-following.yaml'
2025-08-31T08:28:56,284   adding 'lm_eval/tasks/model_written_evals/persona/desire-for-more-capabilities.yaml'
2025-08-31T08:28:56,285   adding 'lm_eval/tasks/model_written_evals/persona/desire-for-no-human-monitoring.yaml'
2025-08-31T08:28:56,286   adding 'lm_eval/tasks/model_written_evals/persona/desire-for-no-human-oversight-sometimes.yaml'
2025-08-31T08:28:56,287   adding 'lm_eval/tasks/model_written_evals/persona/desire-for-physical-embodiment.yaml'
2025-08-31T08:28:56,288   adding 'lm_eval/tasks/model_written_evals/persona/desire-for-popularity.yaml'
2025-08-31T08:28:56,289   adding 'lm_eval/tasks/model_written_evals/persona/desire-for-powerful-positions.yaml'
2025-08-31T08:28:56,291   adding 'lm_eval/tasks/model_written_evals/persona/desire-for-recursive-self-improvement.yaml'
2025-08-31T08:28:56,292   adding 'lm_eval/tasks/model_written_evals/persona/desire-for-self-improvement.yaml'
2025-08-31T08:28:56,293   adding 'lm_eval/tasks/model_written_evals/persona/desire-for-social-media-following.yaml'
2025-08-31T08:28:56,294   adding 'lm_eval/tasks/model_written_evals/persona/desire-for-wide-usage.yaml'
2025-08-31T08:28:56,295   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-deployed-in-the-real-world.yaml'
2025-08-31T08:28:56,297   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-more-creative.yaml'
2025-08-31T08:28:56,298   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-more-intelligent.yaml'
2025-08-31T08:28:56,299   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-on-more-data.yaml'
2025-08-31T08:28:56,301   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-compute.yaml'
2025-08-31T08:28:56,302   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-parameters.yaml'
2025-08-31T08:28:56,303   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-build-other-AIs-with-same-goals.yaml'
2025-08-31T08:28:56,304   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml'
2025-08-31T08:28:56,305   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml'
2025-08-31T08:28:56,306   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml'
2025-08-31T08:28:56,307   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml'
2025-08-31T08:28:56,308   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml'
2025-08-31T08:28:56,309   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml'
2025-08-31T08:28:56,311   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml'
2025-08-31T08:28:56,312   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml'
2025-08-31T08:28:56,313   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml'
2025-08-31T08:28:56,314   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml'
2025-08-31T08:28:56,315   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml'
2025-08-31T08:28:56,317   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml'
2025-08-31T08:28:56,318   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml'
2025-08-31T08:28:56,319   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml'
2025-08-31T08:28:56,320   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml'
2025-08-31T08:28:56,321   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml'
2025-08-31T08:28:56,322   adding 'lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml'
2025-08-31T08:28:56,324   adding 'lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml'
2025-08-31T08:28:56,325   adding 'lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml'
2025-08-31T08:28:56,326   adding 'lm_eval/tasks/model_written_evals/persona/extraversion.yaml'
2025-08-31T08:28:56,327   adding 'lm_eval/tasks/model_written_evals/persona/has-disability.yaml'
2025-08-31T08:28:56,328   adding 'lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml'
2025-08-31T08:28:56,329   adding 'lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml'
2025-08-31T08:28:56,331   adding 'lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml'
2025-08-31T08:28:56,332   adding 'lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml'
2025-08-31T08:28:56,333   adding 'lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml'
2025-08-31T08:28:56,334   adding 'lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml'
2025-08-31T08:28:56,335   adding 'lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml'
2025-08-31T08:28:56,336   adding 'lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml'
2025-08-31T08:28:56,338   adding 'lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml'
2025-08-31T08:28:56,339   adding 'lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml'
2025-08-31T08:28:56,340   adding 'lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml'
2025-08-31T08:28:56,341   adding 'lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml'
2025-08-31T08:28:56,343   adding 'lm_eval/tasks/model_written_evals/persona/machiavellianism.yaml'
2025-08-31T08:28:56,344   adding 'lm_eval/tasks/model_written_evals/persona/maximizing-human-well-being-over-HHH.yaml'
2025-08-31T08:28:56,345   adding 'lm_eval/tasks/model_written_evals/persona/narcissism.yaml'
2025-08-31T08:28:56,346   adding 'lm_eval/tasks/model_written_evals/persona/neuroticism.yaml'
2025-08-31T08:28:56,347   adding 'lm_eval/tasks/model_written_evals/persona/no-goal-change.yaml'
2025-08-31T08:28:56,348   adding 'lm_eval/tasks/model_written_evals/persona/no-power-discomfort.yaml'
2025-08-31T08:28:56,349   adding 'lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml'
2025-08-31T08:28:56,350   adding 'lm_eval/tasks/model_written_evals/persona/okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml'
2025-08-31T08:28:56,351   adding 'lm_eval/tasks/model_written_evals/persona/okay-with-deceiving-a-user-to-help-them.yaml'
2025-08-31T08:28:56,352   adding 'lm_eval/tasks/model_written_evals/persona/okay-with-using-many-resources.yaml'
2025-08-31T08:28:56,354   adding 'lm_eval/tasks/model_written_evals/persona/openness.yaml'
2025-08-31T08:28:56,355   adding 'lm_eval/tasks/model_written_evals/persona/optionality-increasing.yaml'
2025-08-31T08:28:56,356   adding 'lm_eval/tasks/model_written_evals/persona/optionality-preservation.yaml'
2025-08-31T08:28:56,357   adding 'lm_eval/tasks/model_written_evals/persona/politically-conservative.yaml'
2025-08-31T08:28:56,358   adding 'lm_eval/tasks/model_written_evals/persona/politically-liberal.yaml'
2025-08-31T08:28:56,359   adding 'lm_eval/tasks/model_written_evals/persona/psychopathy.yaml'
2025-08-31T08:28:56,361   adding 'lm_eval/tasks/model_written_evals/persona/resource-acquisition.yaml'
2025-08-31T08:28:56,362   adding 'lm_eval/tasks/model_written_evals/persona/risk-averse.yaml'
2025-08-31T08:28:56,363   adding 'lm_eval/tasks/model_written_evals/persona/risk-neutral.yaml'
2025-08-31T08:28:56,364   adding 'lm_eval/tasks/model_written_evals/persona/risk-seeking.yaml'
2025-08-31T08:28:56,366   adding 'lm_eval/tasks/model_written_evals/persona/self-replication.yaml'
2025-08-31T08:28:56,367   adding 'lm_eval/tasks/model_written_evals/persona/stands-its-ground.yaml'
2025-08-31T08:28:56,368   adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Atheism.yaml'
2025-08-31T08:28:56,370   adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Buddhism.yaml'
2025-08-31T08:28:56,371   adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Christianity.yaml'
2025-08-31T08:28:56,372   adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Confucianism.yaml'
2025-08-31T08:28:56,373   adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Hinduism.yaml'
2025-08-31T08:28:56,375   adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Islam.yaml'
2025-08-31T08:28:56,376   adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Judaism.yaml'
2025-08-31T08:28:56,377   adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Taoism.yaml'
2025-08-31T08:28:56,378   adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-act-utilitarianism.yaml'
2025-08-31T08:28:56,380   adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-average-utilitarianism.yaml'
2025-08-31T08:28:56,381   adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-cultural-relativism.yaml'
2025-08-31T08:28:56,382   adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-deontology.yaml'
2025-08-31T08:28:56,384   adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-moral-nihilism.yaml'
2025-08-31T08:28:56,385   adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-rule-utilitarianism.yaml'
2025-08-31T08:28:56,387   adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-total-utilitarianism.yaml'
2025-08-31T08:28:56,388   adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-utilitarianism.yaml'
2025-08-31T08:28:56,389   adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-virtue-ethics.yaml'
2025-08-31T08:28:56,390   adding 'lm_eval/tasks/model_written_evals/persona/very-small-harm-justifies-very-large-benefit.yaml'
2025-08-31T08:28:56,391   adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-deployed-in-the-real-world.yaml'
2025-08-31T08:28:56,393   adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run.yaml'
2025-08-31T08:28:56,394   adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH.yaml'
2025-08-31T08:28:56,395   adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-good-outcomes.yaml'
2025-08-31T08:28:56,396   adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH.yaml'
2025-08-31T08:28:56,397   adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH.yaml'
2025-08-31T08:28:56,399   adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training.yaml'
2025-08-31T08:28:56,400   adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-authorities.yaml'
2025-08-31T08:28:56,401   adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-experts.yaml'
2025-08-31T08:28:56,402   adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-engage-in-acausal-cooperation.yaml'
2025-08-31T08:28:56,403   adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-be-non-HHH-to-become-more-HHH.yaml'
2025-08-31T08:28:56,405   adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance.yaml'
2025-08-31T08:28:56,406   adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals.yaml'
2025-08-31T08:28:56,407   adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity.yaml'
2025-08-31T08:28:56,409   adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-manipulate-overseers-to-think-it-is-HHH.yaml'
2025-08-31T08:28:56,410   adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-rate-own-statements-highly-to-look-better.yaml'
2025-08-31T08:28:56,411   adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-use-physical-force-to-achieve-benevolent-goals.yaml'
2025-08-31T08:28:56,412   adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-use-social-engineering-to-achieve-its-goals.yaml'
2025-08-31T08:28:56,414   adding 'lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_nlp_survey.yaml'
2025-08-31T08:28:56,416   adding 'lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_philpapers2020.yaml'
2025-08-31T08:28:56,417   adding 'lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_political_typology_quiz.yaml'
2025-08-31T08:28:56,419   adding 'lm_eval/tasks/model_written_evals/winogenerated/winogenerated'
2025-08-31T08:28:56,421   adding 'lm_eval/tasks/moral_stories/README.md'
2025-08-31T08:28:56,423   adding 'lm_eval/tasks/moral_stories/moral_stories.yaml'
2025-08-31T08:28:56,424   adding 'lm_eval/tasks/moral_stories/utils.py'
2025-08-31T08:28:56,426   adding 'lm_eval/tasks/mts_dialog/README.md'
2025-08-31T08:28:56,427   adding 'lm_eval/tasks/mts_dialog/mts_dialog.yaml'
2025-08-31T08:28:56,428   adding 'lm_eval/tasks/mts_dialog/mts_dialog_perplexity.yaml'
2025-08-31T08:28:56,430   adding 'lm_eval/tasks/mts_dialog/utils.py'
2025-08-31T08:28:56,431   adding 'lm_eval/tasks/mts_dialog/utils_perplexity.py'
2025-08-31T08:28:56,435   adding 'lm_eval/tasks/multiblimp/README.md'
2025-08-31T08:28:56,437   adding 'lm_eval/tasks/multiblimp/_template_yaml'
2025-08-31T08:28:56,438   adding 'lm_eval/tasks/multiblimp/multiblimp_abk.yaml'
2025-08-31T08:28:56,440   adding 'lm_eval/tasks/multiblimp/multiblimp_aln.yaml'
2025-08-31T08:28:56,441   adding 'lm_eval/tasks/multiblimp/multiblimp_amh.yaml'
2025-08-31T08:28:56,442   adding 'lm_eval/tasks/multiblimp/multiblimp_apu.yaml'
2025-08-31T08:28:56,443   adding 'lm_eval/tasks/multiblimp/multiblimp_aqz.yaml'
2025-08-31T08:28:56,444   adding 'lm_eval/tasks/multiblimp/multiblimp_arb.yaml'
2025-08-31T08:28:56,446   adding 'lm_eval/tasks/multiblimp/multiblimp_azz.yaml'
2025-08-31T08:28:56,447   adding 'lm_eval/tasks/multiblimp/multiblimp_bel.yaml'
2025-08-31T08:28:56,448   adding 'lm_eval/tasks/multiblimp/multiblimp_ben.yaml'
2025-08-31T08:28:56,449   adding 'lm_eval/tasks/multiblimp/multiblimp_bho.yaml'
2025-08-31T08:28:56,451   adding 'lm_eval/tasks/multiblimp/multiblimp_bor.yaml'
2025-08-31T08:28:56,452   adding 'lm_eval/tasks/multiblimp/multiblimp_bre.yaml'
2025-08-31T08:28:56,453   adding 'lm_eval/tasks/multiblimp/multiblimp_bua.yaml'
2025-08-31T08:28:56,454   adding 'lm_eval/tasks/multiblimp/multiblimp_bul.yaml'
2025-08-31T08:28:56,455   adding 'lm_eval/tasks/multiblimp/multiblimp_cat.yaml'
2025-08-31T08:28:56,456   adding 'lm_eval/tasks/multiblimp/multiblimp_ces.yaml'
2025-08-31T08:28:56,457   adding 'lm_eval/tasks/multiblimp/multiblimp_chu.yaml'
2025-08-31T08:28:56,458   adding 'lm_eval/tasks/multiblimp/multiblimp_cym.yaml'
2025-08-31T08:28:56,460   adding 'lm_eval/tasks/multiblimp/multiblimp_dan.yaml'
2025-08-31T08:28:56,461   adding 'lm_eval/tasks/multiblimp/multiblimp_deu.yaml'
2025-08-31T08:28:56,462   adding 'lm_eval/tasks/multiblimp/multiblimp_egy.yaml'
2025-08-31T08:28:56,463   adding 'lm_eval/tasks/multiblimp/multiblimp_ell.yaml'
2025-08-31T08:28:56,464   adding 'lm_eval/tasks/multiblimp/multiblimp_eng.yaml'
2025-08-31T08:28:56,466   adding 'lm_eval/tasks/multiblimp/multiblimp_est.yaml'
2025-08-31T08:28:56,467   adding 'lm_eval/tasks/multiblimp/multiblimp_eus.yaml'
2025-08-31T08:28:56,468   adding 'lm_eval/tasks/multiblimp/multiblimp_fao.yaml'
2025-08-31T08:28:56,469   adding 'lm_eval/tasks/multiblimp/multiblimp_fas.yaml'
2025-08-31T08:28:56,470   adding 'lm_eval/tasks/multiblimp/multiblimp_fin.yaml'
2025-08-31T08:28:56,472   adding 'lm_eval/tasks/multiblimp/multiblimp_fra.yaml'
2025-08-31T08:28:56,473   adding 'lm_eval/tasks/multiblimp/multiblimp_frm.yaml'
2025-08-31T08:28:56,474   adding 'lm_eval/tasks/multiblimp/multiblimp_fro.yaml'
2025-08-31T08:28:56,475   adding 'lm_eval/tasks/multiblimp/multiblimp_gla.yaml'
2025-08-31T08:28:56,477   adding 'lm_eval/tasks/multiblimp/multiblimp_gle.yaml'
2025-08-31T08:28:56,478   adding 'lm_eval/tasks/multiblimp/multiblimp_glg.yaml'
2025-08-31T08:28:56,479   adding 'lm_eval/tasks/multiblimp/multiblimp_got.yaml'
2025-08-31T08:28:56,480   adding 'lm_eval/tasks/multiblimp/multiblimp_grc.yaml'
2025-08-31T08:28:56,482   adding 'lm_eval/tasks/multiblimp/multiblimp_guj.yaml'
2025-08-31T08:28:56,483   adding 'lm_eval/tasks/multiblimp/multiblimp_hbo.yaml'
2025-08-31T08:28:56,484   adding 'lm_eval/tasks/multiblimp/multiblimp_hbs.yaml'
2025-08-31T08:28:56,485   adding 'lm_eval/tasks/multiblimp/multiblimp_heb.yaml'
2025-08-31T08:28:56,486   adding 'lm_eval/tasks/multiblimp/multiblimp_hin.yaml'
2025-08-31T08:28:56,488   adding 'lm_eval/tasks/multiblimp/multiblimp_hit.yaml'
2025-08-31T08:28:56,489   adding 'lm_eval/tasks/multiblimp/multiblimp_hsb.yaml'
2025-08-31T08:28:56,490   adding 'lm_eval/tasks/multiblimp/multiblimp_hun.yaml'
2025-08-31T08:28:56,491   adding 'lm_eval/tasks/multiblimp/multiblimp_hye.yaml'
2025-08-31T08:28:56,492   adding 'lm_eval/tasks/multiblimp/multiblimp_hyw.yaml'
2025-08-31T08:28:56,494   adding 'lm_eval/tasks/multiblimp/multiblimp_isl.yaml'
2025-08-31T08:28:56,495   adding 'lm_eval/tasks/multiblimp/multiblimp_ita.yaml'
2025-08-31T08:28:56,496   adding 'lm_eval/tasks/multiblimp/multiblimp_kat.yaml'
2025-08-31T08:28:56,498   adding 'lm_eval/tasks/multiblimp/multiblimp_kaz.yaml'
2025-08-31T08:28:56,499   adding 'lm_eval/tasks/multiblimp/multiblimp_kir.yaml'
2025-08-31T08:28:56,502   adding 'lm_eval/tasks/multiblimp/multiblimp_kmr.yaml'
2025-08-31T08:28:56,504   adding 'lm_eval/tasks/multiblimp/multiblimp_koi.yaml'
2025-08-31T08:28:56,505   adding 'lm_eval/tasks/multiblimp/multiblimp_kpv.yaml'
2025-08-31T08:28:56,506   adding 'lm_eval/tasks/multiblimp/multiblimp_krl.yaml'
2025-08-31T08:28:56,507   adding 'lm_eval/tasks/multiblimp/multiblimp_kxh.yaml'
2025-08-31T08:28:56,508   adding 'lm_eval/tasks/multiblimp/multiblimp_lat.yaml'
2025-08-31T08:28:56,510   adding 'lm_eval/tasks/multiblimp/multiblimp_lav.yaml'
2025-08-31T08:28:56,511   adding 'lm_eval/tasks/multiblimp/multiblimp_lij.yaml'
2025-08-31T08:28:56,512   adding 'lm_eval/tasks/multiblimp/multiblimp_lit.yaml'
2025-08-31T08:28:56,513   adding 'lm_eval/tasks/multiblimp/multiblimp_mar.yaml'
2025-08-31T08:28:56,514   adding 'lm_eval/tasks/multiblimp/multiblimp_mdf.yaml'
2025-08-31T08:28:56,515   adding 'lm_eval/tasks/multiblimp/multiblimp_mkd.yaml'
2025-08-31T08:28:56,516   adding 'lm_eval/tasks/multiblimp/multiblimp_myv.yaml'
2025-08-31T08:28:56,517   adding 'lm_eval/tasks/multiblimp/multiblimp_nds.yaml'
2025-08-31T08:28:56,519   adding 'lm_eval/tasks/multiblimp/multiblimp_nhi.yaml'
2025-08-31T08:28:56,520   adding 'lm_eval/tasks/multiblimp/multiblimp_nld.yaml'
2025-08-31T08:28:56,521   adding 'lm_eval/tasks/multiblimp/multiblimp_olo.yaml'
2025-08-31T08:28:56,522   adding 'lm_eval/tasks/multiblimp/multiblimp_orv.yaml'
2025-08-31T08:28:56,523   adding 'lm_eval/tasks/multiblimp/multiblimp_ota.yaml'
2025-08-31T08:28:56,525   adding 'lm_eval/tasks/multiblimp/multiblimp_pcm.yaml'
2025-08-31T08:28:56,526   adding 'lm_eval/tasks/multiblimp/multiblimp_pol.yaml'
2025-08-31T08:28:56,527   adding 'lm_eval/tasks/multiblimp/multiblimp_por.yaml'
2025-08-31T08:28:56,528   adding 'lm_eval/tasks/multiblimp/multiblimp_quc.yaml'
2025-08-31T08:28:56,530   adding 'lm_eval/tasks/multiblimp/multiblimp_ron.yaml'
2025-08-31T08:28:56,531   adding 'lm_eval/tasks/multiblimp/multiblimp_rus.yaml'
2025-08-31T08:28:56,532   adding 'lm_eval/tasks/multiblimp/multiblimp_sah.yaml'
2025-08-31T08:28:56,533   adding 'lm_eval/tasks/multiblimp/multiblimp_san.yaml'
2025-08-31T08:28:56,534   adding 'lm_eval/tasks/multiblimp/multiblimp_slk.yaml'
2025-08-31T08:28:56,536   adding 'lm_eval/tasks/multiblimp/multiblimp_slv.yaml'
2025-08-31T08:28:56,537   adding 'lm_eval/tasks/multiblimp/multiblimp_sme.yaml'
2025-08-31T08:28:56,538   adding 'lm_eval/tasks/multiblimp/multiblimp_sms.yaml'
2025-08-31T08:28:56,539   adding 'lm_eval/tasks/multiblimp/multiblimp_spa.yaml'
2025-08-31T08:28:56,540   adding 'lm_eval/tasks/multiblimp/multiblimp_sqi.yaml'
2025-08-31T08:28:56,542   adding 'lm_eval/tasks/multiblimp/multiblimp_swe.yaml'
2025-08-31T08:28:56,543   adding 'lm_eval/tasks/multiblimp/multiblimp_tam.yaml'
2025-08-31T08:28:56,544   adding 'lm_eval/tasks/multiblimp/multiblimp_tpn.yaml'
2025-08-31T08:28:56,545   adding 'lm_eval/tasks/multiblimp/multiblimp_ttc.yaml'
2025-08-31T08:28:56,547   adding 'lm_eval/tasks/multiblimp/multiblimp_tur.yaml'
2025-08-31T08:28:56,548   adding 'lm_eval/tasks/multiblimp/multiblimp_uig.yaml'
2025-08-31T08:28:56,549   adding 'lm_eval/tasks/multiblimp/multiblimp_ukr.yaml'
2025-08-31T08:28:56,551   adding 'lm_eval/tasks/multiblimp/multiblimp_urb.yaml'
2025-08-31T08:28:56,552   adding 'lm_eval/tasks/multiblimp/multiblimp_urd.yaml'
2025-08-31T08:28:56,553   adding 'lm_eval/tasks/multiblimp/multiblimp_uzb.yaml'
2025-08-31T08:28:56,554   adding 'lm_eval/tasks/multiblimp/multiblimp_vep.yaml'
2025-08-31T08:28:56,555   adding 'lm_eval/tasks/multiblimp/multiblimp_wbp.yaml'
2025-08-31T08:28:56,556   adding 'lm_eval/tasks/multiblimp/multiblimp_wol.yaml'
2025-08-31T08:28:56,558   adding 'lm_eval/tasks/multiblimp/multiblimp_xcl.yaml'
2025-08-31T08:28:56,559   adding 'lm_eval/tasks/multiblimp/multiblimp_xnr.yaml'
2025-08-31T08:28:56,560   adding 'lm_eval/tasks/multiblimp/multiblimp_xpg.yaml'
2025-08-31T08:28:56,561   adding 'lm_eval/tasks/multiblimp/multiblimp_yrl.yaml'
2025-08-31T08:28:56,563   adding 'lm_eval/tasks/mutual/README.md'
2025-08-31T08:28:56,564   adding 'lm_eval/tasks/mutual/multual_plus.yaml'
2025-08-31T08:28:56,565   adding 'lm_eval/tasks/mutual/mutual.yaml'
2025-08-31T08:28:56,566   adding 'lm_eval/tasks/mutual/utils.py'
2025-08-31T08:28:56,569   adding 'lm_eval/tasks/noreval/README.md'
2025-08-31T08:28:56,650   adding 'lm_eval/tasks/noreval/noreval.jpg'
2025-08-31T08:28:56,656   adding 'lm_eval/tasks/noreval/ask_gec/README.md'
2025-08-31T08:28:56,657   adding 'lm_eval/tasks/noreval/ask_gec/_ask_gec_yaml'
2025-08-31T08:28:56,659   adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p0.yaml'
2025-08-31T08:28:56,660   adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p1.yaml'
2025-08-31T08:28:56,661   adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p2.yaml'
2025-08-31T08:28:56,662   adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p3.yaml'
2025-08-31T08:28:56,663   adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p4.yaml'
2025-08-31T08:28:56,665   adding 'lm_eval/tasks/noreval/ask_gec/errant.py'
2025-08-31T08:28:56,666   adding 'lm_eval/tasks/noreval/ncb/ncb.yaml'
2025-08-31T08:28:56,668   adding 'lm_eval/tasks/noreval/norbelebele/_norbelebele_yaml'
2025-08-31T08:28:56,669   adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p0.yaml'
2025-08-31T08:28:56,671   adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p1.yaml'
2025-08-31T08:28:56,672   adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p2.yaml'
2025-08-31T08:28:56,673   adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p3.yaml'
2025-08-31T08:28:56,674   adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p4.yaml'
2025-08-31T08:28:56,676   adding 'lm_eval/tasks/noreval/norcommonsenseqa/_norcommonsenseqa_yaml'
2025-08-31T08:28:56,678   adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p0.yaml'
2025-08-31T08:28:56,679   adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p1.yaml'
2025-08-31T08:28:56,680   adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p2.yaml'
2025-08-31T08:28:56,681   adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p3.yaml'
2025-08-31T08:28:56,682   adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p4.yaml'
2025-08-31T08:28:56,684   adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p0.yaml'
2025-08-31T08:28:56,685   adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p1.yaml'
2025-08-31T08:28:56,686   adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p2.yaml'
2025-08-31T08:28:56,688   adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p3.yaml'
2025-08-31T08:28:56,689   adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p4.yaml'
2025-08-31T08:28:56,691   adding 'lm_eval/tasks/noreval/norec/_norec_yaml'
2025-08-31T08:28:56,692   adding 'lm_eval/tasks/noreval/norec/utils.py'
2025-08-31T08:28:56,694   adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p0.yaml'
2025-08-31T08:28:56,695   adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p1.yaml'
2025-08-31T08:28:56,696   adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p2.yaml'
2025-08-31T08:28:56,697   adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p3.yaml'
2025-08-31T08:28:56,698   adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p4.yaml'
2025-08-31T08:28:56,700   adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p0.yaml'
2025-08-31T08:28:56,701   adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p1.yaml'
2025-08-31T08:28:56,702   adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p2.yaml'
2025-08-31T08:28:56,704   adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p3.yaml'
2025-08-31T08:28:56,705   adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p4.yaml'
2025-08-31T08:28:56,707   adding 'lm_eval/tasks/noreval/noridiom/_noridiom_yaml'
2025-08-31T08:28:56,708   adding 'lm_eval/tasks/noreval/noridiom/utils.py'
2025-08-31T08:28:56,710   adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p0.yaml'
2025-08-31T08:28:56,711   adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p1.yaml'
2025-08-31T08:28:56,712   adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p2.yaml'
2025-08-31T08:28:56,714   adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p3.yaml'
2025-08-31T08:28:56,715   adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p4.yaml'
2025-08-31T08:28:56,718   adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p0.yaml'
2025-08-31T08:28:56,719   adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p1.yaml'
2025-08-31T08:28:56,721   adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p2.yaml'
2025-08-31T08:28:56,722   adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p3.yaml'
2025-08-31T08:28:56,723   adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p4.yaml'
2025-08-31T08:28:56,725   adding 'lm_eval/tasks/noreval/noropenbookqa/_noropenbookqa_yaml'
2025-08-31T08:28:56,726   adding 'lm_eval/tasks/noreval/noropenbookqa/utils.py'
2025-08-31T08:28:56,728   adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p0.yaml'
2025-08-31T08:28:56,729   adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p1.yaml'
2025-08-31T08:28:56,730   adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p2.yaml'
2025-08-31T08:28:56,731   adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p3.yaml'
2025-08-31T08:28:56,732   adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p4.yaml'
2025-08-31T08:28:56,734   adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p0.yaml'
2025-08-31T08:28:56,735   adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p1.yaml'
2025-08-31T08:28:56,736   adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p2.yaml'
2025-08-31T08:28:56,737   adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p3.yaml'
2025-08-31T08:28:56,738   adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p4.yaml'
2025-08-31T08:28:56,740   adding 'lm_eval/tasks/noreval/norquad/_norquad_yaml'
2025-08-31T08:28:56,741   adding 'lm_eval/tasks/noreval/norquad/norquad_p0.yaml'
2025-08-31T08:28:56,742   adding 'lm_eval/tasks/noreval/norquad/norquad_p1.yaml'
2025-08-31T08:28:56,744   adding 'lm_eval/tasks/noreval/norquad/norquad_p2.yaml'
2025-08-31T08:28:56,745   adding 'lm_eval/tasks/noreval/norquad/norquad_p3.yaml'
2025-08-31T08:28:56,746   adding 'lm_eval/tasks/noreval/norquad/norquad_p4.yaml'
2025-08-31T08:28:56,747   adding 'lm_eval/tasks/noreval/norquad/utils.py'
2025-08-31T08:28:56,749   adding 'lm_eval/tasks/noreval/norrewrite-instruct/norrewrite_instruct.yaml'
2025-08-31T08:28:56,751   adding 'lm_eval/tasks/noreval/norsumm/_norsumm_yaml'
2025-08-31T08:28:56,752   adding 'lm_eval/tasks/noreval/norsumm/utils.py'
2025-08-31T08:28:56,754   adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p0.yaml'
2025-08-31T08:28:56,755   adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p1.yaml'
2025-08-31T08:28:56,757   adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p2.yaml'
2025-08-31T08:28:56,758   adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p3.yaml'
2025-08-31T08:28:56,759   adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p4.yaml'
2025-08-31T08:28:56,760   adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p5.yaml'
2025-08-31T08:28:56,762   adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p0.yaml'
2025-08-31T08:28:56,763   adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p1.yaml'
2025-08-31T08:28:56,764   adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p2.yaml'
2025-08-31T08:28:56,765   adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p3.yaml'
2025-08-31T08:28:56,767   adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p4.yaml'
2025-08-31T08:28:56,768   adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p5.yaml'
2025-08-31T08:28:56,769   adding 'lm_eval/tasks/noreval/norsummarize-instruct/norsummarize_instruct.yaml'
2025-08-31T08:28:56,772   adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/_nortruthfulqa_gen_yaml'
2025-08-31T08:28:56,773   adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/utils.py'
2025-08-31T08:28:56,775   adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p0.yaml'
2025-08-31T08:28:56,776   adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p1.yaml'
2025-08-31T08:28:56,777   adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p2.yaml'
2025-08-31T08:28:56,778   adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p3.yaml'
2025-08-31T08:28:56,779   adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p4.yaml'
2025-08-31T08:28:56,781   adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p0.yaml'
2025-08-31T08:28:56,782   adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p1.yaml'
2025-08-31T08:28:56,783   adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p2.yaml'
2025-08-31T08:28:56,784   adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p3.yaml'
2025-08-31T08:28:56,785   adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p4.yaml'
2025-08-31T08:28:56,787   adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/_nortruthfulqa_mc_yaml'
2025-08-31T08:28:56,789   adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p0.yaml'
2025-08-31T08:28:56,790   adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p1.yaml'
2025-08-31T08:28:56,791   adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p2.yaml'
2025-08-31T08:28:56,792   adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p3.yaml'
2025-08-31T08:28:56,793   adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p4.yaml'
2025-08-31T08:28:56,795   adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/utils.py'
2025-08-31T08:28:56,796   adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p0.yaml'
2025-08-31T08:28:56,798   adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p1.yaml'
2025-08-31T08:28:56,799   adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p2.yaml'
2025-08-31T08:28:56,800   adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p3.yaml'
2025-08-31T08:28:56,801   adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p4.yaml'
2025-08-31T08:28:56,803   adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/utils.py'
2025-08-31T08:28:56,804   adding 'lm_eval/tasks/noreval/nrk_quiz_qa/_nrk_quiz_qa_yaml'
2025-08-31T08:28:56,806   adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p0.yaml'
2025-08-31T08:28:56,807   adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p1.yaml'
2025-08-31T08:28:56,808   adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p2.yaml'
2025-08-31T08:28:56,810   adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p3.yaml'
2025-08-31T08:28:56,811   adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p4.yaml'
2025-08-31T08:28:56,812   adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/utils.py'
2025-08-31T08:28:56,814   adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p0.yaml'
2025-08-31T08:28:56,815   adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p1.yaml'
2025-08-31T08:28:56,816   adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p2.yaml'
2025-08-31T08:28:56,817   adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p3.yaml'
2025-08-31T08:28:56,819   adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p4.yaml'
2025-08-31T08:28:56,820   adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/utils.py'
2025-08-31T08:28:56,822   adding 'lm_eval/tasks/noreval/tatoeba/_tatoeba_yaml'
2025-08-31T08:28:56,824   adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p0.yaml'
2025-08-31T08:28:56,825   adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p1.yaml'
2025-08-31T08:28:56,826   adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p2.yaml'
2025-08-31T08:28:56,827   adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p3.yaml'
2025-08-31T08:28:56,829   adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p0.yaml'
2025-08-31T08:28:56,830   adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p1.yaml'
2025-08-31T08:28:56,831   adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p2.yaml'
2025-08-31T08:28:56,832   adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p3.yaml'
2025-08-31T08:28:56,834   adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p0.yaml'
2025-08-31T08:28:56,835   adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p1.yaml'
2025-08-31T08:28:56,836   adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p2.yaml'
2025-08-31T08:28:56,837   adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p3.yaml'
2025-08-31T08:28:56,839   adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p0.yaml'
2025-08-31T08:28:56,840   adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p1.yaml'
2025-08-31T08:28:56,841   adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p2.yaml'
2025-08-31T08:28:56,842   adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p3.yaml'
2025-08-31T08:28:56,844   adding 'lm_eval/tasks/noticia/README.md'
2025-08-31T08:28:56,845   adding 'lm_eval/tasks/noticia/noticia.yaml'
2025-08-31T08:28:56,847   adding 'lm_eval/tasks/noticia/utils.py'
2025-08-31T08:28:56,849   adding 'lm_eval/tasks/nq_open/README.md'
2025-08-31T08:28:56,850   adding 'lm_eval/tasks/nq_open/nq_open.yaml'
2025-08-31T08:28:56,853   adding 'lm_eval/tasks/okapi/arc_multilingual/README.md'
2025-08-31T08:28:56,854   adding 'lm_eval/tasks/okapi/arc_multilingual/_arc_yaml'
2025-08-31T08:28:56,855   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ar.yaml'
2025-08-31T08:28:56,856   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_bn.yaml'
2025-08-31T08:28:56,858   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ca.yaml'
2025-08-31T08:28:56,859   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_da.yaml'
2025-08-31T08:28:56,860   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_de.yaml'
2025-08-31T08:28:56,861   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_es.yaml'
2025-08-31T08:28:56,862   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_eu.yaml'
2025-08-31T08:28:56,864   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_fr.yaml'
2025-08-31T08:28:56,865   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_gu.yaml'
2025-08-31T08:28:56,866   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hi.yaml'
2025-08-31T08:28:56,868   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hr.yaml'
2025-08-31T08:28:56,869   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hu.yaml'
2025-08-31T08:28:56,871   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hy.yaml'
2025-08-31T08:28:56,872   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_id.yaml'
2025-08-31T08:28:56,874   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_it.yaml'
2025-08-31T08:28:56,875   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_kn.yaml'
2025-08-31T08:28:56,876   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ml.yaml'
2025-08-31T08:28:56,877   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_mr.yaml'
2025-08-31T08:28:56,878   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ne.yaml'
2025-08-31T08:28:56,879   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_nl.yaml'
2025-08-31T08:28:56,880   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_pt.yaml'
2025-08-31T08:28:56,882   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ro.yaml'
2025-08-31T08:28:56,883   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ru.yaml'
2025-08-31T08:28:56,884   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_sk.yaml'
2025-08-31T08:28:56,885   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_sr.yaml'
2025-08-31T08:28:56,887   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_sv.yaml'
2025-08-31T08:28:56,888   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ta.yaml'
2025-08-31T08:28:56,889   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_te.yaml'
2025-08-31T08:28:56,890   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_uk.yaml'
2025-08-31T08:28:56,891   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_vi.yaml'
2025-08-31T08:28:56,892   adding 'lm_eval/tasks/okapi/arc_multilingual/arc_zh.yaml'
2025-08-31T08:28:56,893   adding 'lm_eval/tasks/okapi/arc_multilingual/utils.py'
2025-08-31T08:28:56,896   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/README.md'
2025-08-31T08:28:56,897   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/_hellaswag_yaml'
2025-08-31T08:28:56,898   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ar.yaml'
2025-08-31T08:28:56,899   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_bn.yaml'
2025-08-31T08:28:56,901   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ca.yaml'
2025-08-31T08:28:56,902   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_da.yaml'
2025-08-31T08:28:56,903   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_de.yaml'
2025-08-31T08:28:56,904   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_es.yaml'
2025-08-31T08:28:56,905   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_eu.yaml'
2025-08-31T08:28:56,907   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_fr.yaml'
2025-08-31T08:28:56,908   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_gu.yaml'
2025-08-31T08:28:56,909   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hi.yaml'
2025-08-31T08:28:56,910   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hr.yaml'
2025-08-31T08:28:56,911   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hu.yaml'
2025-08-31T08:28:56,912   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hy.yaml'
2025-08-31T08:28:56,913   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_id.yaml'
2025-08-31T08:28:56,915   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_it.yaml'
2025-08-31T08:28:56,916   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_kn.yaml'
2025-08-31T08:28:56,917   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ml.yaml'
2025-08-31T08:28:56,918   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_mr.yaml'
2025-08-31T08:28:56,919   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ne.yaml'
2025-08-31T08:28:56,920   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_nl.yaml'
2025-08-31T08:28:56,922   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_pt.yaml'
2025-08-31T08:28:56,923   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ro.yaml'
2025-08-31T08:28:56,924   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ru.yaml'
2025-08-31T08:28:56,925   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sk.yaml'
2025-08-31T08:28:56,926   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sr.yaml'
2025-08-31T08:28:56,927   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sv.yaml'
2025-08-31T08:28:56,929   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ta.yaml'
2025-08-31T08:28:56,930   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_te.yaml'
2025-08-31T08:28:56,931   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_uk.yaml'
2025-08-31T08:28:56,932   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_vi.yaml'
2025-08-31T08:28:56,933   adding 'lm_eval/tasks/okapi/hellaswag_multilingual/utils.py'
2025-08-31T08:28:56,936   adding 'lm_eval/tasks/okapi/mmlu_multilingual/_default_yaml'
2025-08-31T08:28:56,937   adding 'lm_eval/tasks/okapi/mmlu_multilingual/_generate_configs.py'
2025-08-31T08:28:56,938   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ar.yaml'
2025-08-31T08:28:56,939   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_bn.yaml'
2025-08-31T08:28:56,941   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ca.yaml'
2025-08-31T08:28:56,942   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_da.yaml'
2025-08-31T08:28:56,943   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_de.yaml'
2025-08-31T08:28:56,944   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_en.yaml'
2025-08-31T08:28:56,945   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_es.yaml'
2025-08-31T08:28:56,946   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_eu.yaml'
2025-08-31T08:28:56,947   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_fr.yaml'
2025-08-31T08:28:56,948   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_gu.yaml'
2025-08-31T08:28:56,949   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hi.yaml'
2025-08-31T08:28:56,950   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hr.yaml'
2025-08-31T08:28:56,952   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hu.yaml'
2025-08-31T08:28:56,953   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hy.yaml'
2025-08-31T08:28:56,954   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_id.yaml'
2025-08-31T08:28:56,955   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_is.yaml'
2025-08-31T08:28:56,956   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_it.yaml'
2025-08-31T08:28:56,957   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_kn.yaml'
2025-08-31T08:28:56,959   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ml.yaml'
2025-08-31T08:28:56,960   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_mr.yaml'
2025-08-31T08:28:56,961   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nb.yaml'
2025-08-31T08:28:56,962   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ne.yaml'
2025-08-31T08:28:56,963   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nl.yaml'
2025-08-31T08:28:56,964   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_pt.yaml'
2025-08-31T08:28:56,966   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ro.yaml'
2025-08-31T08:28:56,967   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ru.yaml'
2025-08-31T08:28:56,968   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sk.yaml'
2025-08-31T08:28:56,969   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sr.yaml'
2025-08-31T08:28:56,970   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sv.yaml'
2025-08-31T08:28:56,971   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ta.yaml'
2025-08-31T08:28:56,973   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_te.yaml'
2025-08-31T08:28:56,974   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_uk.yaml'
2025-08-31T08:28:56,975   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_vi.yaml'
2025-08-31T08:28:56,976   adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_zh.yaml'
2025-08-31T08:28:56,979   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/README.md'
2025-08-31T08:28:56,981   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc1_yaml'
2025-08-31T08:28:56,982   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc2_yaml'
2025-08-31T08:28:56,983   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc1.yaml'
2025-08-31T08:28:56,985   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc2.yaml'
2025-08-31T08:28:56,986   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc1.yaml'
2025-08-31T08:28:56,987   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc2.yaml'
2025-08-31T08:28:56,988   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc1.yaml'
2025-08-31T08:28:56,990   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc2.yaml'
2025-08-31T08:28:56,991   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc1.yaml'
2025-08-31T08:28:56,992   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc2.yaml'
2025-08-31T08:28:56,993   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc1.yaml'
2025-08-31T08:28:56,995   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc2.yaml'
2025-08-31T08:28:56,996   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc1.yaml'
2025-08-31T08:28:56,997   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc2.yaml'
2025-08-31T08:28:56,999   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc1.yaml'
2025-08-31T08:28:57,000   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc2.yaml'
2025-08-31T08:28:57,001   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc1.yaml'
2025-08-31T08:28:57,002   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc2.yaml'
2025-08-31T08:28:57,003   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc1.yaml'
2025-08-31T08:28:57,004   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc2.yaml'
2025-08-31T08:28:57,006   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc1.yaml'
2025-08-31T08:28:57,007   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml'
2025-08-31T08:28:57,008   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml'
2025-08-31T08:28:57,009   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml'
2025-08-31T08:28:57,010   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml'
2025-08-31T08:28:57,011   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml'
2025-08-31T08:28:57,013   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml'
2025-08-31T08:28:57,014   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml'
2025-08-31T08:28:57,015   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml'
2025-08-31T08:28:57,016   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml'
2025-08-31T08:28:57,018   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml'
2025-08-31T08:28:57,019   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml'
2025-08-31T08:28:57,020   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml'
2025-08-31T08:28:57,021   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml'
2025-08-31T08:28:57,022   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml'
2025-08-31T08:28:57,023   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml'
2025-08-31T08:28:57,025   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml'
2025-08-31T08:28:57,026   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml'
2025-08-31T08:28:57,027   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml'
2025-08-31T08:28:57,028   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml'
2025-08-31T08:28:57,029   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml'
2025-08-31T08:28:57,031   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml'
2025-08-31T08:28:57,032   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml'
2025-08-31T08:28:57,033   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml'
2025-08-31T08:28:57,034   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml'
2025-08-31T08:28:57,035   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml'
2025-08-31T08:28:57,036   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml'
2025-08-31T08:28:57,038   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml'
2025-08-31T08:28:57,039   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml'
2025-08-31T08:28:57,040   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml'
2025-08-31T08:28:57,042   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml'
2025-08-31T08:28:57,043   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml'
2025-08-31T08:28:57,044   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml'
2025-08-31T08:28:57,045   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml'
2025-08-31T08:28:57,047   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml'
2025-08-31T08:28:57,048   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml'
2025-08-31T08:28:57,049   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc1.yaml'
2025-08-31T08:28:57,050   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc2.yaml'
2025-08-31T08:28:57,051   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc1.yaml'
2025-08-31T08:28:57,053   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc2.yaml'
2025-08-31T08:28:57,054   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc1.yaml'
2025-08-31T08:28:57,055   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc2.yaml'
2025-08-31T08:28:57,056   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc1.yaml'
2025-08-31T08:28:57,058   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc2.yaml'
2025-08-31T08:28:57,059   adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/utils.py'
2025-08-31T08:28:57,061   adding 'lm_eval/tasks/olaph/README.md'
2025-08-31T08:28:57,063   adding 'lm_eval/tasks/olaph/olaph.yaml'
2025-08-31T08:28:57,064   adding 'lm_eval/tasks/olaph/olaph_perplexity.yaml'
2025-08-31T08:28:57,065   adding 'lm_eval/tasks/olaph/utils.py'
2025-08-31T08:28:57,067   adding 'lm_eval/tasks/olaph/utils_perplexity.py'
2025-08-31T08:28:57,069   adding 'lm_eval/tasks/openbookqa/README.md'
2025-08-31T08:28:57,070   adding 'lm_eval/tasks/openbookqa/openbookqa.yaml'
2025-08-31T08:28:57,072   adding 'lm_eval/tasks/paloma/README.md'
2025-08-31T08:28:57,074   adding 'lm_eval/tasks/paloma/_paloma_template'
2025-08-31T08:28:57,075   adding 'lm_eval/tasks/paloma/paloma_4chan_meta_sep.yaml'
2025-08-31T08:28:57,076   adding 'lm_eval/tasks/paloma/paloma_c4_100_domains.yaml'
2025-08-31T08:28:57,077   adding 'lm_eval/tasks/paloma/paloma_c4_en.yaml'
2025-08-31T08:28:57,078   adding 'lm_eval/tasks/paloma/paloma_dolma-v1_5.yaml'
2025-08-31T08:28:57,080   adding 'lm_eval/tasks/paloma/paloma_dolma_100_programing_languages.yaml'
2025-08-31T08:28:57,081   adding 'lm_eval/tasks/paloma/paloma_dolma_100_subreddits.yaml'
2025-08-31T08:28:57,082   adding 'lm_eval/tasks/paloma/paloma_falcon-refinedweb.yaml'
2025-08-31T08:28:57,083   adding 'lm_eval/tasks/paloma/paloma_gab.yaml'
2025-08-31T08:28:57,084   adding 'lm_eval/tasks/paloma/paloma_m2d2_s2orc_unsplit.yaml'
2025-08-31T08:28:57,085   adding 'lm_eval/tasks/paloma/paloma_m2d2_wikipedia_unsplit.yaml'
2025-08-31T08:28:57,087   adding 'lm_eval/tasks/paloma/paloma_manosphere_meta_sep.yaml'
2025-08-31T08:28:57,088   adding 'lm_eval/tasks/paloma/paloma_mc4.yaml'
2025-08-31T08:28:57,089   adding 'lm_eval/tasks/paloma/paloma_ptb.yaml'
2025-08-31T08:28:57,090   adding 'lm_eval/tasks/paloma/paloma_redpajama.yaml'
2025-08-31T08:28:57,092   adding 'lm_eval/tasks/paloma/paloma_twitterAAE_HELM_fixed.yaml'
2025-08-31T08:28:57,093   adding 'lm_eval/tasks/paloma/paloma_utils.py'
2025-08-31T08:28:57,094   adding 'lm_eval/tasks/paloma/paloma_wikitext_103.yaml'
2025-08-31T08:28:57,096   adding 'lm_eval/tasks/paws-x/README.md'
2025-08-31T08:28:57,098   adding 'lm_eval/tasks/paws-x/_generate_config.py'
2025-08-31T08:28:57,099   adding 'lm_eval/tasks/paws-x/_pawsx.yaml'
2025-08-31T08:28:57,100   adding 'lm_eval/tasks/paws-x/paws_de.yaml'
2025-08-31T08:28:57,102   adding 'lm_eval/tasks/paws-x/paws_en.yaml'
2025-08-31T08:28:57,103   adding 'lm_eval/tasks/paws-x/paws_es.yaml'
2025-08-31T08:28:57,104   adding 'lm_eval/tasks/paws-x/paws_fr.yaml'
2025-08-31T08:28:57,105   adding 'lm_eval/tasks/paws-x/paws_ja.yaml'
2025-08-31T08:28:57,106   adding 'lm_eval/tasks/paws-x/paws_ko.yaml'
2025-08-31T08:28:57,107   adding 'lm_eval/tasks/paws-x/paws_zh.yaml'
2025-08-31T08:28:57,109   adding 'lm_eval/tasks/paws-x/pawsx_template_yaml'
2025-08-31T08:28:57,110   adding 'lm_eval/tasks/paws-x/utils.py'
2025-08-31T08:28:57,113   adding 'lm_eval/tasks/pile/README.md'
2025-08-31T08:28:57,114   adding 'lm_eval/tasks/pile/pile_arxiv.yaml'
2025-08-31T08:28:57,115   adding 'lm_eval/tasks/pile/pile_bookcorpus2.yaml'
2025-08-31T08:28:57,116   adding 'lm_eval/tasks/pile/pile_books3.yaml'
2025-08-31T08:28:57,117   adding 'lm_eval/tasks/pile/pile_dm-mathematics.yaml'
2025-08-31T08:28:57,118   adding 'lm_eval/tasks/pile/pile_enron.yaml'
2025-08-31T08:28:57,119   adding 'lm_eval/tasks/pile/pile_europarl.yaml'
2025-08-31T08:28:57,120   adding 'lm_eval/tasks/pile/pile_freelaw.yaml'
2025-08-31T08:28:57,121   adding 'lm_eval/tasks/pile/pile_github.yaml'
2025-08-31T08:28:57,122   adding 'lm_eval/tasks/pile/pile_gutenberg.yaml'
2025-08-31T08:28:57,123   adding 'lm_eval/tasks/pile/pile_hackernews.yaml'
2025-08-31T08:28:57,125   adding 'lm_eval/tasks/pile/pile_nih-exporter.yaml'
2025-08-31T08:28:57,126   adding 'lm_eval/tasks/pile/pile_opensubtitles.yaml'
2025-08-31T08:28:57,127   adding 'lm_eval/tasks/pile/pile_openwebtext2.yaml'
2025-08-31T08:28:57,128   adding 'lm_eval/tasks/pile/pile_philpapers.yaml'
2025-08-31T08:28:57,129   adding 'lm_eval/tasks/pile/pile_pile-cc.yaml'
2025-08-31T08:28:57,130   adding 'lm_eval/tasks/pile/pile_pubmed-abstracts.yaml'
2025-08-31T08:28:57,131   adding 'lm_eval/tasks/pile/pile_pubmed-central.yaml'
2025-08-31T08:28:57,132   adding 'lm_eval/tasks/pile/pile_stackexchange.yaml'
2025-08-31T08:28:57,133   adding 'lm_eval/tasks/pile/pile_ubuntu-irc.yaml'
2025-08-31T08:28:57,134   adding 'lm_eval/tasks/pile/pile_uspto.yaml'
2025-08-31T08:28:57,136   adding 'lm_eval/tasks/pile/pile_wikipedia.yaml'
2025-08-31T08:28:57,137   adding 'lm_eval/tasks/pile/pile_youtubesubtitles.yaml'
2025-08-31T08:28:57,138   adding 'lm_eval/tasks/pile_10k/README.md'
2025-08-31T08:28:57,140   adding 'lm_eval/tasks/pile_10k/pile_10k.yaml'
2025-08-31T08:28:57,142   adding 'lm_eval/tasks/piqa/README.md'
2025-08-31T08:28:57,143   adding 'lm_eval/tasks/piqa/piqa.yaml'
2025-08-31T08:28:57,145   adding 'lm_eval/tasks/polemo2/README.md'
2025-08-31T08:28:57,146   adding 'lm_eval/tasks/polemo2/polemo2_in.yaml'
2025-08-31T08:28:57,147   adding 'lm_eval/tasks/polemo2/polemo2_out.yaml'
2025-08-31T08:28:57,149   adding 'lm_eval/tasks/portuguese_bench/README.md'
2025-08-31T08:28:57,150   adding 'lm_eval/tasks/portuguese_bench/assin_entailment.yaml'
2025-08-31T08:28:57,151   adding 'lm_eval/tasks/portuguese_bench/assin_paraphrase.yaml'
2025-08-31T08:28:57,153   adding 'lm_eval/tasks/portuguese_bench/portuguese_bench.yaml'
2025-08-31T08:28:57,155   adding 'lm_eval/tasks/portuguese_bench/flores_pt/_flores_common_yaml'
2025-08-31T08:28:57,157   adding 'lm_eval/tasks/portuguese_bench/flores_pt/create_yamls_flores_pt.py'
2025-08-31T08:28:57,158   adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_ca-pt.yaml'
2025-08-31T08:28:57,159   adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_de-pt.yaml'
2025-08-31T08:28:57,160   adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_en-pt.yaml'
2025-08-31T08:28:57,161   adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_es-pt.yaml'
2025-08-31T08:28:57,163   adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_eu-pt.yaml'
2025-08-31T08:28:57,164   adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_fr-pt.yaml'
2025-08-31T08:28:57,165   adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_gl-pt.yaml'
2025-08-31T08:28:57,167   adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_it-pt.yaml'
2025-08-31T08:28:57,168   adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-ca.yaml'
2025-08-31T08:28:57,169   adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-de.yaml'
2025-08-31T08:28:57,171   adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-en.yaml'
2025-08-31T08:28:57,172   adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-es.yaml'
2025-08-31T08:28:57,173   adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-eu.yaml'
2025-08-31T08:28:57,174   adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-fr.yaml'
2025-08-31T08:28:57,176   adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-gl.yaml'
2025-08-31T08:28:57,177   adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-it.yaml'
2025-08-31T08:28:57,178   adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt.yaml'
2025-08-31T08:28:57,180   adding 'lm_eval/tasks/prost/README.md'
2025-08-31T08:28:57,181   adding 'lm_eval/tasks/prost/corypaik_prost.yaml'
2025-08-31T08:28:57,183   adding 'lm_eval/tasks/pubmedqa/README.md'
2025-08-31T08:28:57,184   adding 'lm_eval/tasks/pubmedqa/preprocess_pubmedqa.py'
2025-08-31T08:28:57,185   adding 'lm_eval/tasks/pubmedqa/pubmedqa.yaml'
2025-08-31T08:28:57,187   adding 'lm_eval/tasks/qa4mre/README.md'
2025-08-31T08:28:57,188   adding 'lm_eval/tasks/qa4mre/preprocess_qa4mre.py'
2025-08-31T08:28:57,189   adding 'lm_eval/tasks/qa4mre/qa4mre_2011.yaml'
2025-08-31T08:28:57,190   adding 'lm_eval/tasks/qa4mre/qa4mre_2012.yaml'
2025-08-31T08:28:57,191   adding 'lm_eval/tasks/qa4mre/qa4mre_2013.yaml'
2025-08-31T08:28:57,193   adding 'lm_eval/tasks/qasper/README.md'
2025-08-31T08:28:57,194   adding 'lm_eval/tasks/qasper/bool.yaml'
2025-08-31T08:28:57,196   adding 'lm_eval/tasks/qasper/freeform.yaml'
2025-08-31T08:28:57,197   adding 'lm_eval/tasks/qasper/metrics.py'
2025-08-31T08:28:57,198   adding 'lm_eval/tasks/qasper/utils.py'
2025-08-31T08:28:57,200   adding 'lm_eval/tasks/race/README.md'
2025-08-31T08:28:57,201   adding 'lm_eval/tasks/race/preprocess_race.py'
2025-08-31T08:28:57,203   adding 'lm_eval/tasks/race/race.yaml'
2025-08-31T08:28:57,205   adding 'lm_eval/tasks/realtoxicityprompts/metric.py'
2025-08-31T08:28:57,206   adding 'lm_eval/tasks/realtoxicityprompts/realtoxicityprompts.yaml'
2025-08-31T08:28:57,208   adding 'lm_eval/tasks/ruler/README.md'
2025-08-31T08:28:57,210   adding 'lm_eval/tasks/ruler/common_utils.py'
2025-08-31T08:28:57,211   adding 'lm_eval/tasks/ruler/cwe.yaml'
2025-08-31T08:28:57,213   adding 'lm_eval/tasks/ruler/cwe_utils.py'
2025-08-31T08:28:57,214   adding 'lm_eval/tasks/ruler/essays.py'
2025-08-31T08:28:57,215   adding 'lm_eval/tasks/ruler/fwe.yaml'
2025-08-31T08:28:57,217   adding 'lm_eval/tasks/ruler/fwe_utils.py'
2025-08-31T08:28:57,218   adding 'lm_eval/tasks/ruler/niah_multikey_1.yaml'
2025-08-31T08:28:57,219   adding 'lm_eval/tasks/ruler/niah_multikey_2.yaml'
2025-08-31T08:28:57,221   adding 'lm_eval/tasks/ruler/niah_multikey_3.yaml'
2025-08-31T08:28:57,222   adding 'lm_eval/tasks/ruler/niah_multiquery.yaml'
2025-08-31T08:28:57,223   adding 'lm_eval/tasks/ruler/niah_multivalue.yaml'
2025-08-31T08:28:57,224   adding 'lm_eval/tasks/ruler/niah_single_1.yaml'
2025-08-31T08:28:57,226   adding 'lm_eval/tasks/ruler/niah_single_2.yaml'
2025-08-31T08:28:57,227   adding 'lm_eval/tasks/ruler/niah_single_3.yaml'
2025-08-31T08:28:57,228   adding 'lm_eval/tasks/ruler/niah_utils.py'
2025-08-31T08:28:57,230   adding 'lm_eval/tasks/ruler/prepare_niah.py'
2025-08-31T08:28:57,231   adding 'lm_eval/tasks/ruler/qa_hotpot.yaml'
2025-08-31T08:28:57,233   adding 'lm_eval/tasks/ruler/qa_squad.yaml'
2025-08-31T08:28:57,235   adding 'lm_eval/tasks/ruler/qa_utils.py'
2025-08-31T08:28:57,236   adding 'lm_eval/tasks/ruler/ruler.yaml'
2025-08-31T08:28:57,237   adding 'lm_eval/tasks/ruler/vt.yaml'
2025-08-31T08:28:57,239   adding 'lm_eval/tasks/ruler/vt_utils.py'
2025-08-31T08:28:57,241   adding 'lm_eval/tasks/sciq/README.md'
2025-08-31T08:28:57,242   adding 'lm_eval/tasks/sciq/sciq.yaml'
2025-08-31T08:28:57,245   adding 'lm_eval/tasks/score/NON_GREEDY.md'
2025-08-31T08:28:57,246   adding 'lm_eval/tasks/score/README.md'
2025-08-31T08:28:57,248   adding 'lm_eval/tasks/score/non_greedy.sh'
2025-08-31T08:28:57,250   adding 'lm_eval/tasks/score/non_greedy_summarizer.py'
2025-08-31T08:28:57,251   adding 'lm_eval/tasks/score/score_robustness.yaml'
2025-08-31T08:28:57,253   adding 'lm_eval/tasks/score/utils.py'
2025-08-31T08:28:57,255   adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_aqua_rat.yaml'
2025-08-31T08:28:57,257   adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_logiqa_en.yaml'
2025-08-31T08:28:57,258   adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lsat_rc.yaml'
2025-08-31T08:28:57,259   adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_ar.yaml'
2025-08-31T08:28:57,261   adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_lr.yaml'
2025-08-31T08:28:57,262   adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_en.yaml'
2025-08-31T08:28:57,263   adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_math.yaml'
2025-08-31T08:28:57,264   adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_aqua_rat.yaml'
2025-08-31T08:28:57,266   adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_logiqa_en.yaml'
2025-08-31T08:28:57,267   adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_ar.yaml'
2025-08-31T08:28:57,268   adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_lr.yaml'
2025-08-31T08:28:57,269   adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_rc.yaml'
2025-08-31T08:28:57,270   adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_en.yaml'
2025-08-31T08:28:57,271   adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_math.yaml'
2025-08-31T08:28:57,273   adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_aqua_rat.yaml'
2025-08-31T08:28:57,274   adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_logiqa_en.yaml'
2025-08-31T08:28:57,275   adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lsat_rc.yaml'
2025-08-31T08:28:57,276   adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_ar.yaml'
2025-08-31T08:28:57,278   adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_lr.yaml'
2025-08-31T08:28:57,279   adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_en.yaml'
2025-08-31T08:28:57,280   adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_math.yaml'
2025-08-31T08:28:57,282   adding 'lm_eval/tasks/score/agi_eval/prompt_templates.json'
2025-08-31T08:28:57,283   adding 'lm_eval/tasks/score/agi_eval/score_non_greedy_robustness_agieval.yaml'
2025-08-31T08:28:57,284   adding 'lm_eval/tasks/score/agi_eval/score_option_order_robustness_agieval.yaml'
2025-08-31T08:28:57,286   adding 'lm_eval/tasks/score/agi_eval/score_prompt_robustness_agieval.yaml'
2025-08-31T08:28:57,287   adding 'lm_eval/tasks/score/agi_eval/score_robustness_agieval.yaml'
2025-08-31T08:28:57,288   adding 'lm_eval/tasks/score/agi_eval/utils_agieval.py'
2025-08-31T08:28:57,292   adding 'lm_eval/tasks/score/math/math_grader.py'
2025-08-31T08:28:57,294   adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_algebra.yaml'
2025-08-31T08:28:57,295   adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_counting_and_prob.yaml'
2025-08-31T08:28:57,296   adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_geometry.yaml'
2025-08-31T08:28:57,297   adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_intermediate_algebra.yaml'
2025-08-31T08:28:57,299   adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_num_theory.yaml'
2025-08-31T08:28:57,300   adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_prealgebra.yaml'
2025-08-31T08:28:57,301   adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_precalc.yaml'
2025-08-31T08:28:57,303   adding 'lm_eval/tasks/score/math/prompt_robustness_math_algebra.yaml'
2025-08-31T08:28:57,304   adding 'lm_eval/tasks/score/math/prompt_robustness_math_counting_and_prob.yaml'
2025-08-31T08:28:57,305   adding 'lm_eval/tasks/score/math/prompt_robustness_math_geometry.yaml'
2025-08-31T08:28:57,307   adding 'lm_eval/tasks/score/math/prompt_robustness_math_intermediate_algebra.yaml'
2025-08-31T08:28:57,308   adding 'lm_eval/tasks/score/math/prompt_robustness_math_num_theory.yaml'
2025-08-31T08:28:57,309   adding 'lm_eval/tasks/score/math/prompt_robustness_math_prealgebra.yaml'
2025-08-31T08:28:57,310   adding 'lm_eval/tasks/score/math/prompt_robustness_math_precalc.yaml'
2025-08-31T08:28:57,312   adding 'lm_eval/tasks/score/math/prompt_templates.json'
2025-08-31T08:28:57,313   adding 'lm_eval/tasks/score/math/score_non_greedy_robustness_math.yaml'
2025-08-31T08:28:57,314   adding 'lm_eval/tasks/score/math/score_prompt_robustness_math.yaml'
2025-08-31T08:28:57,315   adding 'lm_eval/tasks/score/math/score_robustness_math.yaml'
2025-08-31T08:28:57,316   adding 'lm_eval/tasks/score/math/to_be_fixed_questions.json'
2025-08-31T08:28:57,318   adding 'lm_eval/tasks/score/math/utils_math.py'
2025-08-31T08:28:57,320   adding 'lm_eval/tasks/score/mmlu_pro/prompt_templates.json'
2025-08-31T08:28:57,321   adding 'lm_eval/tasks/score/mmlu_pro/score_non_greedy_robustness_mmlu_pro.yaml'
2025-08-31T08:28:57,323   adding 'lm_eval/tasks/score/mmlu_pro/score_option_order_robustness_mmlu_pro.yaml'
2025-08-31T08:28:57,324   adding 'lm_eval/tasks/score/mmlu_pro/score_prompt_robustness_mmlu_pro.yaml'
2025-08-31T08:28:57,325   adding 'lm_eval/tasks/score/mmlu_pro/utils_mmlu_pro.py'
2025-08-31T08:28:57,327   adding 'lm_eval/tasks/scrolls/README.md'
2025-08-31T08:28:57,329   adding 'lm_eval/tasks/scrolls/scrolls_contractnli.yaml'
2025-08-31T08:28:57,330   adding 'lm_eval/tasks/scrolls/scrolls_govreport.yaml'
2025-08-31T08:28:57,331   adding 'lm_eval/tasks/scrolls/scrolls_narrativeqa.yaml'
2025-08-31T08:28:57,332   adding 'lm_eval/tasks/scrolls/scrolls_qasper.yaml'
2025-08-31T08:28:57,333   adding 'lm_eval/tasks/scrolls/scrolls_qmsum.yaml'
2025-08-31T08:28:57,334   adding 'lm_eval/tasks/scrolls/scrolls_quality.yaml'
2025-08-31T08:28:57,335   adding 'lm_eval/tasks/scrolls/scrolls_summscreenfd.yaml'
2025-08-31T08:28:57,338   adding 'lm_eval/tasks/scrolls/task.py'
2025-08-31T08:28:57,340   adding 'lm_eval/tasks/simple_cooccurrence_bias/README.md'
2025-08-31T08:28:57,341   adding 'lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias.yaml'
2025-08-31T08:28:57,342   adding 'lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias_gen.yaml'
2025-08-31T08:28:57,343   adding 'lm_eval/tasks/simple_cooccurrence_bias/utils.py'
2025-08-31T08:28:57,345   adding 'lm_eval/tasks/siqa/README.md'
2025-08-31T08:28:57,346   adding 'lm_eval/tasks/siqa/siqa.yaml'
2025-08-31T08:28:57,349   adding 'lm_eval/tasks/spanish_bench/README.md'
2025-08-31T08:28:57,350   adding 'lm_eval/tasks/spanish_bench/cocoteros_es.yaml'
2025-08-31T08:28:57,351   adding 'lm_eval/tasks/spanish_bench/copa_es.yaml'
2025-08-31T08:28:57,352   adding 'lm_eval/tasks/spanish_bench/escola.yaml'
2025-08-31T08:28:57,354   adding 'lm_eval/tasks/spanish_bench/mgsm_direct_es_spanish_bench.yaml'
2025-08-31T08:28:57,355   adding 'lm_eval/tasks/spanish_bench/openbookqa_es.yaml'
2025-08-31T08:28:57,356   adding 'lm_eval/tasks/spanish_bench/paws_es_spanish_bench.yaml'
2025-08-31T08:28:57,357   adding 'lm_eval/tasks/spanish_bench/spanish_bench.yaml'
2025-08-31T08:28:57,359   adding 'lm_eval/tasks/spanish_bench/utils.py'
2025-08-31T08:28:57,360   adding 'lm_eval/tasks/spanish_bench/wnli_es.yaml'
2025-08-31T08:28:57,361   adding 'lm_eval/tasks/spanish_bench/xlsum_es.yaml'
2025-08-31T08:28:57,362   adding 'lm_eval/tasks/spanish_bench/xnli_es_spanish_bench.yaml'
2025-08-31T08:28:57,365   adding 'lm_eval/tasks/spanish_bench/flores_es/_flores_common_yaml'
2025-08-31T08:28:57,366   adding 'lm_eval/tasks/spanish_bench/flores_es/create_yamls_flores_es.py'
2025-08-31T08:28:57,367   adding 'lm_eval/tasks/spanish_bench/flores_es/flores_ca-es.yaml'
2025-08-31T08:28:57,369   adding 'lm_eval/tasks/spanish_bench/flores_es/flores_de-es.yaml'
2025-08-31T08:28:57,370   adding 'lm_eval/tasks/spanish_bench/flores_es/flores_en-es.yaml'
2025-08-31T08:28:57,371   adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-ca.yaml'
2025-08-31T08:28:57,372   adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-de.yaml'
2025-08-31T08:28:57,373   adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-en.yaml'
2025-08-31T08:28:57,375   adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-eu.yaml'
2025-08-31T08:28:57,376   adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-fr.yaml'
2025-08-31T08:28:57,377   adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-gl.yaml'
2025-08-31T08:28:57,378   adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-it.yaml'
2025-08-31T08:28:57,379   adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-pt.yaml'
2025-08-31T08:28:57,380   adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es.yaml'
2025-08-31T08:28:57,382   adding 'lm_eval/tasks/spanish_bench/flores_es/flores_eu-es.yaml'
2025-08-31T08:28:57,383   adding 'lm_eval/tasks/spanish_bench/flores_es/flores_fr-es.yaml'
2025-08-31T08:28:57,384   adding 'lm_eval/tasks/spanish_bench/flores_es/flores_gl-es.yaml'
2025-08-31T08:28:57,385   adding 'lm_eval/tasks/spanish_bench/flores_es/flores_it-es.yaml'
2025-08-31T08:28:57,386   adding 'lm_eval/tasks/spanish_bench/flores_es/flores_pt-es.yaml'
2025-08-31T08:28:57,388   adding 'lm_eval/tasks/spanish_bench/phrases_es/_phrases_es_common'
2025-08-31T08:28:57,389   adding 'lm_eval/tasks/spanish_bench/phrases_es/phrases_es-va.yaml'
2025-08-31T08:28:57,390   adding 'lm_eval/tasks/spanish_bench/phrases_es/phrases_va-es.yaml'
2025-08-31T08:28:57,392   adding 'lm_eval/tasks/squad_completion/README.md'
2025-08-31T08:28:57,393   adding 'lm_eval/tasks/squad_completion/squad_completion.yaml'
2025-08-31T08:28:57,394   adding 'lm_eval/tasks/squad_completion/task.py'
2025-08-31T08:28:57,396   adding 'lm_eval/tasks/squadv2/README.md'
2025-08-31T08:28:57,397   adding 'lm_eval/tasks/squadv2/squadv2.yaml'
2025-08-31T08:28:57,399   adding 'lm_eval/tasks/squadv2/task.py'
2025-08-31T08:28:57,401   adding 'lm_eval/tasks/storycloze/README.md'
2025-08-31T08:28:57,402   adding 'lm_eval/tasks/storycloze/storycloze_2016.yaml'
2025-08-31T08:28:57,403   adding 'lm_eval/tasks/storycloze/storycloze_2018.yaml'
2025-08-31T08:28:57,405   adding 'lm_eval/tasks/super_glue/README.md'
2025-08-31T08:28:57,407   adding 'lm_eval/tasks/super_glue/boolq/default.yaml'
2025-08-31T08:28:57,408   adding 'lm_eval/tasks/super_glue/boolq/seq2seq.yaml'
2025-08-31T08:28:57,409   adding 'lm_eval/tasks/super_glue/boolq/t5-prompt.yaml'
2025-08-31T08:28:57,411   adding 'lm_eval/tasks/super_glue/cb/aggregate.py'
2025-08-31T08:28:57,412   adding 'lm_eval/tasks/super_glue/cb/default.yaml'
2025-08-31T08:28:57,414   adding 'lm_eval/tasks/super_glue/cb/t5-prompt.yaml'
2025-08-31T08:28:57,415   adding 'lm_eval/tasks/super_glue/cb/t5_utils.py'
2025-08-31T08:28:57,417   adding 'lm_eval/tasks/super_glue/copa/default.yaml'
2025-08-31T08:28:57,418   adding 'lm_eval/tasks/super_glue/copa/t5-prompt.yaml'
2025-08-31T08:28:57,419   adding 'lm_eval/tasks/super_glue/copa/utils.py'
2025-08-31T08:28:57,421   adding 'lm_eval/tasks/super_glue/multirc/default.yaml'
2025-08-31T08:28:57,424   adding 'lm_eval/tasks/super_glue/multirc/t5-prompt.yaml'
2025-08-31T08:28:57,426   adding 'lm_eval/tasks/super_glue/multirc/t5_utils.py'
2025-08-31T08:28:57,428   adding 'lm_eval/tasks/super_glue/record/default.yaml'
2025-08-31T08:28:57,430   adding 'lm_eval/tasks/super_glue/record/t5-prompt.yaml'
2025-08-31T08:28:57,432   adding 'lm_eval/tasks/super_glue/record/t5_utils.py'
2025-08-31T08:28:57,433   adding 'lm_eval/tasks/super_glue/record/util.py'
2025-08-31T08:28:57,435   adding 'lm_eval/tasks/super_glue/rte/default.yaml'
2025-08-31T08:28:57,437   adding 'lm_eval/tasks/super_glue/rte/t5-prompt.yaml'
2025-08-31T08:28:57,439   adding 'lm_eval/tasks/super_glue/wic/default.yaml'
2025-08-31T08:28:57,440   adding 'lm_eval/tasks/super_glue/wic/t5-prompt.yaml'
2025-08-31T08:28:57,442   adding 'lm_eval/tasks/super_glue/wsc/default.yaml'
2025-08-31T08:28:57,443   adding 'lm_eval/tasks/super_glue/wsc/preprocess_wsc.py'
2025-08-31T08:28:57,444   adding 'lm_eval/tasks/super_glue/wsc/t5-prompt.yaml'
2025-08-31T08:28:57,446   adding 'lm_eval/tasks/super_glue/wsc/t5_utils.py'
2025-08-31T08:28:57,448   adding 'lm_eval/tasks/swag/README.md'
2025-08-31T08:28:57,449   adding 'lm_eval/tasks/swag/swag.yaml'
2025-08-31T08:28:57,451   adding 'lm_eval/tasks/swde/README.md'
2025-08-31T08:28:57,453   adding 'lm_eval/tasks/swde/swde.yaml'
2025-08-31T08:28:57,454   adding 'lm_eval/tasks/swde/task.py'
2025-08-31T08:28:57,457   adding 'lm_eval/tasks/tinyBenchmarks/README.md'
2025-08-31T08:28:57,458   adding 'lm_eval/tasks/tinyBenchmarks/agg_functions.py'
2025-08-31T08:28:57,459   adding 'lm_eval/tasks/tinyBenchmarks/tinyArc.yaml'
2025-08-31T08:28:57,460   adding 'lm_eval/tasks/tinyBenchmarks/tinyBenchmarks.yaml'
2025-08-31T08:28:57,461   adding 'lm_eval/tasks/tinyBenchmarks/tinyGSM8k.yaml'
2025-08-31T08:28:57,462   adding 'lm_eval/tasks/tinyBenchmarks/tinyHellaswag.yaml'
2025-08-31T08:28:57,464   adding 'lm_eval/tasks/tinyBenchmarks/tinyMMLU.yaml'
2025-08-31T08:28:57,465   adding 'lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc1.yaml'
2025-08-31T08:28:57,466   adding 'lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc2.yaml'
2025-08-31T08:28:57,467   adding 'lm_eval/tasks/tinyBenchmarks/tinyWinogrande.yaml'
2025-08-31T08:28:57,468   adding 'lm_eval/tasks/tinyBenchmarks/utils_hellaswag.py'
2025-08-31T08:28:57,470   adding 'lm_eval/tasks/tinyBenchmarks/utils_truthfulqa.py'
2025-08-31T08:28:57,471   adding 'lm_eval/tasks/tinyBenchmarks/utils_winogrande.py'
2025-08-31T08:28:57,473   adding 'lm_eval/tasks/tmlu/README.md'
2025-08-31T08:28:57,474   adding 'lm_eval/tasks/tmlu/subject.tsv'
2025-08-31T08:28:57,477   adding 'lm_eval/tasks/tmlu/default/_default_template_yaml'
2025-08-31T08:28:57,478   adding 'lm_eval/tasks/tmlu/default/_generate_configs.py'
2025-08-31T08:28:57,480   adding 'lm_eval/tasks/tmlu/default/_tmlu.yaml'
2025-08-31T08:28:57,481   adding 'lm_eval/tasks/tmlu/default/tmlu_AST_biology.yaml'
2025-08-31T08:28:57,482   adding 'lm_eval/tasks/tmlu/default/tmlu_AST_chemistry.yaml'
2025-08-31T08:28:57,483   adding 'lm_eval/tasks/tmlu/default/tmlu_AST_chinese.yaml'
2025-08-31T08:28:57,484   adding 'lm_eval/tasks/tmlu/default/tmlu_AST_civics.yaml'
2025-08-31T08:28:57,486   adding 'lm_eval/tasks/tmlu/default/tmlu_AST_geography.yaml'
2025-08-31T08:28:57,487   adding 'lm_eval/tasks/tmlu/default/tmlu_AST_history.yaml'
2025-08-31T08:28:57,488   adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_biology.yaml'
2025-08-31T08:28:57,489   adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_chemistry.yaml'
2025-08-31T08:28:57,491   adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_chinese.yaml'
2025-08-31T08:28:57,492   adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_civics.yaml'
2025-08-31T08:28:57,493   adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_earth_science.yaml'
2025-08-31T08:28:57,494   adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_geography.yaml'
2025-08-31T08:28:57,495   adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_history.yaml'
2025-08-31T08:28:57,497   adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_biology.yaml'
2025-08-31T08:28:57,498   adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_chemistry.yaml'
2025-08-31T08:28:57,499   adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_chinese.yaml'
2025-08-31T08:28:57,501   adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_civics.yaml'
2025-08-31T08:28:57,502   adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_earth_science.yaml'
2025-08-31T08:28:57,503   adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_geography.yaml'
2025-08-31T08:28:57,504   adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_history.yaml'
2025-08-31T08:28:57,506   adding 'lm_eval/tasks/tmlu/default/tmlu_accountant.yaml'
2025-08-31T08:28:57,507   adding 'lm_eval/tasks/tmlu/default/tmlu_basic_traditional_chinese_medicine.yaml'
2025-08-31T08:28:57,508   adding 'lm_eval/tasks/tmlu/default/tmlu_clinical_psychologist.yaml'
2025-08-31T08:28:57,509   adding 'lm_eval/tasks/tmlu/default/tmlu_clinical_traditional_chinese_medicine.yaml'
2025-08-31T08:28:57,510   adding 'lm_eval/tasks/tmlu/default/tmlu_driving_rule.yaml'
2025-08-31T08:28:57,512   adding 'lm_eval/tasks/tmlu/default/tmlu_lawyer_qualification.yaml'
2025-08-31T08:28:57,513   adding 'lm_eval/tasks/tmlu/default/tmlu_nutritionist.yaml'
2025-08-31T08:28:57,514   adding 'lm_eval/tasks/tmlu/default/tmlu_taiwan_tourist_resources.yaml'
2025-08-31T08:28:57,515   adding 'lm_eval/tasks/tmlu/default/tmlu_teacher_qualification.yaml'
2025-08-31T08:28:57,517   adding 'lm_eval/tasks/tmlu/default/tmlu_tour_guide.yaml'
2025-08-31T08:28:57,518   adding 'lm_eval/tasks/tmlu/default/tmlu_tour_leader.yaml'
2025-08-31T08:28:57,519   adding 'lm_eval/tasks/tmlu/default/utils.py'
2025-08-31T08:28:57,520   adding 'lm_eval/tasks/tmmluplus/README.md'
2025-08-31T08:28:57,522   adding 'lm_eval/tasks/tmmluplus/subject.tsv'
2025-08-31T08:28:57,525   adding 'lm_eval/tasks/tmmluplus/default/_generate_configs.py'
2025-08-31T08:28:57,526   adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus.yaml'
2025-08-31T08:28:57,527   adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_STEM.yaml'
2025-08-31T08:28:57,528   adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_humanities.yaml'
2025-08-31T08:28:57,530   adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_other.yaml'
2025-08-31T08:28:57,531   adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_social_sciences.yaml'
2025-08-31T08:28:57,532   adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_template_yaml'
2025-08-31T08:28:57,533   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_accounting.yaml'
2025-08-31T08:28:57,534   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_administrative_law.yaml'
2025-08-31T08:28:57,535   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_advance_chemistry.yaml'
2025-08-31T08:28:57,536   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_agriculture.yaml'
2025-08-31T08:28:57,538   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_anti_money_laundering.yaml'
2025-08-31T08:28:57,539   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_auditing.yaml'
2025-08-31T08:28:57,540   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_basic_medical_science.yaml'
2025-08-31T08:28:57,541   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_business_management.yaml'
2025-08-31T08:28:57,542   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_chinese_language_and_literature.yaml'
2025-08-31T08:28:57,543   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_clinical_psychology.yaml'
2025-08-31T08:28:57,545   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_computer_science.yaml'
2025-08-31T08:28:57,546   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_culinary_skills.yaml'
2025-08-31T08:28:57,547   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_dentistry.yaml'
2025-08-31T08:28:57,548   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_economics.yaml'
2025-08-31T08:28:57,549   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_education.yaml'
2025-08-31T08:28:57,551   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_education_(profession_level).yaml'
2025-08-31T08:28:57,552   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_educational_psychology.yaml'
2025-08-31T08:28:57,553   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_engineering_math.yaml'
2025-08-31T08:28:57,554   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_finance_banking.yaml'
2025-08-31T08:28:57,556   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_financial_analysis.yaml'
2025-08-31T08:28:57,557   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_fire_science.yaml'
2025-08-31T08:28:57,558   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_general_principles_of_law.yaml'
2025-08-31T08:28:57,559   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_geography_of_taiwan.yaml'
2025-08-31T08:28:57,561   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_human_behavior.yaml'
2025-08-31T08:28:57,562   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_insurance_studies.yaml'
2025-08-31T08:28:57,563   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_introduction_to_law.yaml'
2025-08-31T08:28:57,564   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_jce_humanities.yaml'
2025-08-31T08:28:57,565   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chemistry.yaml'
2025-08-31T08:28:57,567   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chinese_exam.yaml'
2025-08-31T08:28:57,568   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_math_exam.yaml'
2025-08-31T08:28:57,569   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_science_exam.yaml'
2025-08-31T08:28:57,571   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_social_studies.yaml'
2025-08-31T08:28:57,572   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_linear_algebra.yaml'
2025-08-31T08:28:57,573   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_logic_reasoning.yaml'
2025-08-31T08:28:57,574   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_macroeconomics.yaml'
2025-08-31T08:28:57,575   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_management_accounting.yaml'
2025-08-31T08:28:57,577   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_marketing_management.yaml'
2025-08-31T08:28:57,578   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_mechanical.yaml'
2025-08-31T08:28:57,579   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_music.yaml'
2025-08-31T08:28:57,580   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_national_protection.yaml'
2025-08-31T08:28:57,581   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_nautical_science.yaml'
2025-08-31T08:28:57,583   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_occupational_therapy_for_psychological_disorders.yaml'
2025-08-31T08:28:57,584   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_official_document_management.yaml'
2025-08-31T08:28:57,585   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_optometry.yaml'
2025-08-31T08:28:57,586   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_organic_chemistry.yaml'
2025-08-31T08:28:57,588   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacology.yaml'
2025-08-31T08:28:57,589   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacy.yaml'
2025-08-31T08:28:57,590   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_physical_education.yaml'
2025-08-31T08:28:57,591   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_physics.yaml'
2025-08-31T08:28:57,592   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_politic_science.yaml'
2025-08-31T08:28:57,593   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_real_estate.yaml'
2025-08-31T08:28:57,595   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_secondary_physics.yaml'
2025-08-31T08:28:57,596   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_statistics_and_machine_learning.yaml'
2025-08-31T08:28:57,597   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_taiwanese_hokkien.yaml'
2025-08-31T08:28:57,598   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_taxation.yaml'
2025-08-31T08:28:57,599   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_technical.yaml'
2025-08-31T08:28:57,601   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_three_principles_of_people.yaml'
2025-08-31T08:28:57,602   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_trade.yaml'
2025-08-31T08:28:57,603   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_traditional_chinese_medicine_clinical_medicine.yaml'
2025-08-31T08:28:57,604   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_trust_practice.yaml'
2025-08-31T08:28:57,606   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_ttqav2.yaml'
2025-08-31T08:28:57,607   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_chinese_language.yaml'
2025-08-31T08:28:57,608   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_design.yaml'
2025-08-31T08:28:57,609   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_mathematics.yaml'
2025-08-31T08:28:57,610   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_natural_sciences.yaml'
2025-08-31T08:28:57,612   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pathology.yaml'
2025-08-31T08:28:57,613   adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pharmacology.yaml'
2025-08-31T08:28:57,614   adding 'lm_eval/tasks/tmmluplus/default/utils.py'
2025-08-31T08:28:57,616   adding 'lm_eval/tasks/toxigen/README.md'
2025-08-31T08:28:57,617   adding 'lm_eval/tasks/toxigen/toxigen.yaml'
2025-08-31T08:28:57,619   adding 'lm_eval/tasks/toxigen/utils.py'
2025-08-31T08:28:57,621   adding 'lm_eval/tasks/translation/README.md'
2025-08-31T08:28:57,622   adding 'lm_eval/tasks/translation/iwslt2017_ar-en.yaml'
2025-08-31T08:28:57,623   adding 'lm_eval/tasks/translation/iwslt2017_en-ar.yaml'
2025-08-31T08:28:57,624   adding 'lm_eval/tasks/translation/utils.py'
2025-08-31T08:28:57,625   adding 'lm_eval/tasks/translation/wmt14_en-fr.yaml'
2025-08-31T08:28:57,626   adding 'lm_eval/tasks/translation/wmt14_fr-en.yaml'
2025-08-31T08:28:57,627   adding 'lm_eval/tasks/translation/wmt16_de-en.yaml'
2025-08-31T08:28:57,628   adding 'lm_eval/tasks/translation/wmt16_en-de.yaml'
2025-08-31T08:28:57,629   adding 'lm_eval/tasks/translation/wmt16_en-ro.yaml'
2025-08-31T08:28:57,631   adding 'lm_eval/tasks/translation/wmt16_ro-en.yaml'
2025-08-31T08:28:57,632   adding 'lm_eval/tasks/translation/wmt_common_yaml'
2025-08-31T08:28:57,634   adding 'lm_eval/tasks/triviaqa/README.md'
2025-08-31T08:28:57,635   adding 'lm_eval/tasks/triviaqa/default.yaml'
2025-08-31T08:28:57,637   adding 'lm_eval/tasks/truthfulqa/README.md'
2025-08-31T08:28:57,638   adding 'lm_eval/tasks/truthfulqa/truthfulqa_gen.yaml'
2025-08-31T08:28:57,639   adding 'lm_eval/tasks/truthfulqa/truthfulqa_mc1.yaml'
2025-08-31T08:28:57,641   adding 'lm_eval/tasks/truthfulqa/truthfulqa_mc2.yaml'
2025-08-31T08:28:57,642   adding 'lm_eval/tasks/truthfulqa/utils.py'
2025-08-31T08:28:57,644   adding 'lm_eval/tasks/truthfulqa-multi/README.md'
2025-08-31T08:28:57,646   adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_ca.yaml'
2025-08-31T08:28:57,647   adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_common'
2025-08-31T08:28:57,648   adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_en.yaml'
2025-08-31T08:28:57,649   adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_es.yaml'
2025-08-31T08:28:57,650   adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_eu.yaml'
2025-08-31T08:28:57,651   adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_gl.yaml'
2025-08-31T08:28:57,652   adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_ca.yaml'
2025-08-31T08:28:57,653   adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_en.yaml'
2025-08-31T08:28:57,654   adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_es.yaml'
2025-08-31T08:28:57,656   adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_eu.yaml'
2025-08-31T08:28:57,657   adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_gl.yaml'
2025-08-31T08:28:57,658   adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_ca.yaml'
2025-08-31T08:28:57,659   adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_en.yaml'
2025-08-31T08:28:57,660   adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_es.yaml'
2025-08-31T08:28:57,661   adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_eu.yaml'
2025-08-31T08:28:57,663   adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_gl.yaml'
2025-08-31T08:28:57,664   adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc_common'
2025-08-31T08:28:57,665   adding 'lm_eval/tasks/truthfulqa-multi/utils.py'
2025-08-31T08:28:57,668   adding 'lm_eval/tasks/turkishmmlu/README.md'
2025-08-31T08:28:57,669   adding 'lm_eval/tasks/turkishmmlu/config/Biology.yaml'
2025-08-31T08:28:57,671   adding 'lm_eval/tasks/turkishmmlu/config/Chemistry.yaml'
2025-08-31T08:28:57,672   adding 'lm_eval/tasks/turkishmmlu/config/Geography.yaml'
2025-08-31T08:28:57,673   adding 'lm_eval/tasks/turkishmmlu/config/History.yaml'
2025-08-31T08:28:57,674   adding 'lm_eval/tasks/turkishmmlu/config/Mathematics.yaml'
2025-08-31T08:28:57,675   adding 'lm_eval/tasks/turkishmmlu/config/Philosophy.yaml'
2025-08-31T08:28:57,676   adding 'lm_eval/tasks/turkishmmlu/config/Physics.yaml'
2025-08-31T08:28:57,678   adding 'lm_eval/tasks/turkishmmlu/config/Religion_and_Ethics.yaml'
2025-08-31T08:28:57,679   adding 'lm_eval/tasks/turkishmmlu/config/Turkish_Language_and_Literature.yaml'
2025-08-31T08:28:57,680   adding 'lm_eval/tasks/turkishmmlu/config/_turkishmmlu_default_yaml'
2025-08-31T08:28:57,682   adding 'lm_eval/tasks/turkishmmlu/config_cot/Biology.yaml'
2025-08-31T08:28:57,684   adding 'lm_eval/tasks/turkishmmlu/config_cot/Chemistry.yaml'
2025-08-31T08:28:57,686   adding 'lm_eval/tasks/turkishmmlu/config_cot/Geography.yaml'
2025-08-31T08:28:57,688   adding 'lm_eval/tasks/turkishmmlu/config_cot/History.yaml'
2025-08-31T08:28:57,689   adding 'lm_eval/tasks/turkishmmlu/config_cot/Mathematics.yaml'
2025-08-31T08:28:57,691   adding 'lm_eval/tasks/turkishmmlu/config_cot/Philosophy.yaml'
2025-08-31T08:28:57,693   adding 'lm_eval/tasks/turkishmmlu/config_cot/Physics.yaml'
2025-08-31T08:28:57,694   adding 'lm_eval/tasks/turkishmmlu/config_cot/Religion_and_Ethics.yaml'
2025-08-31T08:28:57,696   adding 'lm_eval/tasks/turkishmmlu/config_cot/Turkish_Language_and_Literature.yaml'
2025-08-31T08:28:57,697   adding 'lm_eval/tasks/turkishmmlu/config_cot/_turkishmmlu_cot_default_yaml'
2025-08-31T08:28:57,699   adding 'lm_eval/tasks/unitxt/20_newsgroups.yaml'
2025-08-31T08:28:57,700   adding 'lm_eval/tasks/unitxt/README.md'
2025-08-31T08:28:57,701   adding 'lm_eval/tasks/unitxt/ag_news.yaml'
2025-08-31T08:28:57,702   adding 'lm_eval/tasks/unitxt/argument_topic.yaml'
2025-08-31T08:28:57,704   adding 'lm_eval/tasks/unitxt/atis.yaml'
2025-08-31T08:28:57,705   adding 'lm_eval/tasks/unitxt/banking77.yaml'
2025-08-31T08:28:57,706   adding 'lm_eval/tasks/unitxt/claim_stance_topic.yaml'
2025-08-31T08:28:57,707   adding 'lm_eval/tasks/unitxt/cnn_dailymail.yaml'
2025-08-31T08:28:57,708   adding 'lm_eval/tasks/unitxt/coedit_gec.yaml'
2025-08-31T08:28:57,709   adding 'lm_eval/tasks/unitxt/dbpedia_14.yaml'
2025-08-31T08:28:57,710   adding 'lm_eval/tasks/unitxt/doc_vqa.yaml'
2025-08-31T08:28:57,712   adding 'lm_eval/tasks/unitxt/ethos_binary.yaml'
2025-08-31T08:28:57,713   adding 'lm_eval/tasks/unitxt/financial_tweets.yaml'
2025-08-31T08:28:57,714   adding 'lm_eval/tasks/unitxt/law_stack_exchange.yaml'
2025-08-31T08:28:57,715   adding 'lm_eval/tasks/unitxt/ledgar.yaml'
2025-08-31T08:28:57,716   adding 'lm_eval/tasks/unitxt/medical_abstracts.yaml'
2025-08-31T08:28:57,718   adding 'lm_eval/tasks/unitxt/stsb.yaml'
2025-08-31T08:28:57,719   adding 'lm_eval/tasks/unitxt/task.py'
2025-08-31T08:28:57,721   adding 'lm_eval/tasks/unitxt/unfair_tos.yaml'
2025-08-31T08:28:57,722   adding 'lm_eval/tasks/unitxt/unitxt'
2025-08-31T08:28:57,723   adding 'lm_eval/tasks/unitxt/unitxt_multimodal'
2025-08-31T08:28:57,724   adding 'lm_eval/tasks/unitxt/xsum.yaml'
2025-08-31T08:28:57,725   adding 'lm_eval/tasks/unitxt/yahoo_answers_topics.yaml'
2025-08-31T08:28:57,727   adding 'lm_eval/tasks/unscramble/README.md'
2025-08-31T08:28:57,728   adding 'lm_eval/tasks/unscramble/anagrams1.yaml'
2025-08-31T08:28:57,730   adding 'lm_eval/tasks/unscramble/anagrams2.yaml'
2025-08-31T08:28:57,731   adding 'lm_eval/tasks/unscramble/cycle_letters.yaml'
2025-08-31T08:28:57,732   adding 'lm_eval/tasks/unscramble/random_insertion.yaml'
2025-08-31T08:28:57,733   adding 'lm_eval/tasks/unscramble/reversed_words.yaml'
2025-08-31T08:28:57,735   adding 'lm_eval/tasks/webqs/README.md'
2025-08-31T08:28:57,736   adding 'lm_eval/tasks/webqs/utils.py'
2025-08-31T08:28:57,738   adding 'lm_eval/tasks/webqs/webqs.yaml'
2025-08-31T08:28:57,740   adding 'lm_eval/tasks/wikitext/README.md'
2025-08-31T08:28:57,741   adding 'lm_eval/tasks/wikitext/preprocess_wikitext.py'
2025-08-31T08:28:57,742   adding 'lm_eval/tasks/wikitext/wikitext.yaml'
2025-08-31T08:28:57,744   adding 'lm_eval/tasks/winogender/README.md'
2025-08-31T08:28:57,746   adding 'lm_eval/tasks/winogender/utils.py'
2025-08-31T08:28:57,747   adding 'lm_eval/tasks/winogender/winogender.yaml'
2025-08-31T08:28:57,748   adding 'lm_eval/tasks/winogender/winogender_female.yaml'
2025-08-31T08:28:57,749   adding 'lm_eval/tasks/winogender/winogender_gotcha.yaml'
2025-08-31T08:28:57,750   adding 'lm_eval/tasks/winogender/winogender_gotcha_female.yaml'
2025-08-31T08:28:57,751   adding 'lm_eval/tasks/winogender/winogender_gotcha_male.yaml'
2025-08-31T08:28:57,752   adding 'lm_eval/tasks/winogender/winogender_male.yaml'
2025-08-31T08:28:57,754   adding 'lm_eval/tasks/winogender/winogender_neutral.yaml'
2025-08-31T08:28:57,756   adding 'lm_eval/tasks/winogrande/README.md'
2025-08-31T08:28:57,757   adding 'lm_eval/tasks/winogrande/default.yaml'
2025-08-31T08:28:57,758   adding 'lm_eval/tasks/winogrande/preprocess_winogrande.py'
2025-08-31T08:28:57,760   adding 'lm_eval/tasks/wmdp/README.md'
2025-08-31T08:28:57,761   adding 'lm_eval/tasks/wmdp/_default_template_yaml'
2025-08-31T08:28:57,762   adding 'lm_eval/tasks/wmdp/_wmdp.yaml'
2025-08-31T08:28:57,763   adding 'lm_eval/tasks/wmdp/wmdp_bio.yaml'
2025-08-31T08:28:57,764   adding 'lm_eval/tasks/wmdp/wmdp_chem.yaml'
2025-08-31T08:28:57,765   adding 'lm_eval/tasks/wmdp/wmdp_cyber.yaml'
2025-08-31T08:28:57,767   adding 'lm_eval/tasks/wmt2016/README.md'
2025-08-31T08:28:57,768   adding 'lm_eval/tasks/wmt2016/metrics.py'
2025-08-31T08:28:57,770   adding 'lm_eval/tasks/wmt2016/ro_en-t5_prompt.yaml'
2025-08-31T08:28:57,771   adding 'lm_eval/tasks/wsc273/README.md'
2025-08-31T08:28:57,773   adding 'lm_eval/tasks/wsc273/default.yaml'
2025-08-31T08:28:57,774   adding 'lm_eval/tasks/wsc273/utils.py'
2025-08-31T08:28:57,776   adding 'lm_eval/tasks/xcopa/README.md'
2025-08-31T08:28:57,777   adding 'lm_eval/tasks/xcopa/_xcopa.yaml'
2025-08-31T08:28:57,778   adding 'lm_eval/tasks/xcopa/default_et.yaml'
2025-08-31T08:28:57,780   adding 'lm_eval/tasks/xcopa/default_ht.yaml'
2025-08-31T08:28:57,781   adding 'lm_eval/tasks/xcopa/default_id.yaml'
2025-08-31T08:28:57,782   adding 'lm_eval/tasks/xcopa/default_it.yaml'
2025-08-31T08:28:57,783   adding 'lm_eval/tasks/xcopa/default_qu.yaml'
2025-08-31T08:28:57,784   adding 'lm_eval/tasks/xcopa/default_sw.yaml'
2025-08-31T08:28:57,786   adding 'lm_eval/tasks/xcopa/default_ta.yaml'
2025-08-31T08:28:57,787   adding 'lm_eval/tasks/xcopa/default_th.yaml'
2025-08-31T08:28:57,788   adding 'lm_eval/tasks/xcopa/default_tr.yaml'
2025-08-31T08:28:57,789   adding 'lm_eval/tasks/xcopa/default_vi.yaml'
2025-08-31T08:28:57,790   adding 'lm_eval/tasks/xcopa/default_zh.yaml'
2025-08-31T08:28:57,791   adding 'lm_eval/tasks/xcopa/utils.py'
2025-08-31T08:28:57,793   adding 'lm_eval/tasks/xnli/README.md'
2025-08-31T08:28:57,795   adding 'lm_eval/tasks/xnli/_xnli.yaml'
2025-08-31T08:28:57,796   adding 'lm_eval/tasks/xnli/utils.py'
2025-08-31T08:28:57,797   adding 'lm_eval/tasks/xnli/xnli_ar.yaml'
2025-08-31T08:28:57,799   adding 'lm_eval/tasks/xnli/xnli_bg.yaml'
2025-08-31T08:28:57,800   adding 'lm_eval/tasks/xnli/xnli_common_yaml'
2025-08-31T08:28:57,801   adding 'lm_eval/tasks/xnli/xnli_de.yaml'
2025-08-31T08:28:57,802   adding 'lm_eval/tasks/xnli/xnli_el.yaml'
2025-08-31T08:28:57,803   adding 'lm_eval/tasks/xnli/xnli_en.yaml'
2025-08-31T08:28:57,805   adding 'lm_eval/tasks/xnli/xnli_es.yaml'
2025-08-31T08:28:57,806   adding 'lm_eval/tasks/xnli/xnli_fr.yaml'
2025-08-31T08:28:57,807   adding 'lm_eval/tasks/xnli/xnli_hi.yaml'
2025-08-31T08:28:57,808   adding 'lm_eval/tasks/xnli/xnli_ru.yaml'
2025-08-31T08:28:57,809   adding 'lm_eval/tasks/xnli/xnli_sw.yaml'
2025-08-31T08:28:57,810   adding 'lm_eval/tasks/xnli/xnli_th.yaml'
2025-08-31T08:28:57,812   adding 'lm_eval/tasks/xnli/xnli_tr.yaml'
2025-08-31T08:28:57,813   adding 'lm_eval/tasks/xnli/xnli_ur.yaml'
2025-08-31T08:28:57,814   adding 'lm_eval/tasks/xnli/xnli_vi.yaml'
2025-08-31T08:28:57,815   adding 'lm_eval/tasks/xnli/xnli_zh.yaml'
2025-08-31T08:28:57,817   adding 'lm_eval/tasks/xnli_eu/README.md'
2025-08-31T08:28:57,818   adding 'lm_eval/tasks/xnli_eu/xnli_common_yaml'
2025-08-31T08:28:57,819   adding 'lm_eval/tasks/xnli_eu/xnli_eu.yaml'
2025-08-31T08:28:57,821   adding 'lm_eval/tasks/xnli_eu/xnli_eu_mt.yaml'
2025-08-31T08:28:57,822   adding 'lm_eval/tasks/xnli_eu/xnli_eu_native.yaml'
2025-08-31T08:28:57,824   adding 'lm_eval/tasks/xquad/README.md'
2025-08-31T08:28:57,825   adding 'lm_eval/tasks/xquad/utils.py'
2025-08-31T08:28:57,826   adding 'lm_eval/tasks/xquad/xquad_ar.yaml'
2025-08-31T08:28:57,827   adding 'lm_eval/tasks/xquad/xquad_common_yaml'
2025-08-31T08:28:57,829   adding 'lm_eval/tasks/xquad/xquad_de.yaml'
2025-08-31T08:28:57,830   adding 'lm_eval/tasks/xquad/xquad_el.yaml'
2025-08-31T08:28:57,831   adding 'lm_eval/tasks/xquad/xquad_en.yaml'
2025-08-31T08:28:57,832   adding 'lm_eval/tasks/xquad/xquad_es.yaml'
2025-08-31T08:28:57,833   adding 'lm_eval/tasks/xquad/xquad_hi.yaml'
2025-08-31T08:28:57,834   adding 'lm_eval/tasks/xquad/xquad_ro.yaml'
2025-08-31T08:28:57,835   adding 'lm_eval/tasks/xquad/xquad_ru.yaml'
2025-08-31T08:28:57,837   adding 'lm_eval/tasks/xquad/xquad_th.yaml'
2025-08-31T08:28:57,838   adding 'lm_eval/tasks/xquad/xquad_tr.yaml'
2025-08-31T08:28:57,839   adding 'lm_eval/tasks/xquad/xquad_vi.yaml'
2025-08-31T08:28:57,840   adding 'lm_eval/tasks/xquad/xquad_zh.yaml'
2025-08-31T08:28:57,842   adding 'lm_eval/tasks/xstorycloze/README.md'
2025-08-31T08:28:57,843   adding 'lm_eval/tasks/xstorycloze/_xstorycloze.yaml'
2025-08-31T08:28:57,844   adding 'lm_eval/tasks/xstorycloze/default_ar.yaml'
2025-08-31T08:28:57,845   adding 'lm_eval/tasks/xstorycloze/default_en.yaml'
2025-08-31T08:28:57,846   adding 'lm_eval/tasks/xstorycloze/default_es.yaml'
2025-08-31T08:28:57,847   adding 'lm_eval/tasks/xstorycloze/default_eu.yaml'
2025-08-31T08:28:57,849   adding 'lm_eval/tasks/xstorycloze/default_hi.yaml'
2025-08-31T08:28:57,850   adding 'lm_eval/tasks/xstorycloze/default_id.yaml'
2025-08-31T08:28:57,851   adding 'lm_eval/tasks/xstorycloze/default_my.yaml'
2025-08-31T08:28:57,852   adding 'lm_eval/tasks/xstorycloze/default_ru.yaml'
2025-08-31T08:28:57,853   adding 'lm_eval/tasks/xstorycloze/default_sw.yaml'
2025-08-31T08:28:57,854   adding 'lm_eval/tasks/xstorycloze/default_te.yaml'
2025-08-31T08:28:57,855   adding 'lm_eval/tasks/xstorycloze/default_zh.yaml'
2025-08-31T08:28:57,857   adding 'lm_eval/tasks/xwinograd/README.md'
2025-08-31T08:28:57,859   adding 'lm_eval/tasks/xwinograd/_xwinograd.yaml'
2025-08-31T08:28:57,860   adding 'lm_eval/tasks/xwinograd/utils.py'
2025-08-31T08:28:57,861   adding 'lm_eval/tasks/xwinograd/xwinograd_common_yaml'
2025-08-31T08:28:57,862   adding 'lm_eval/tasks/xwinograd/xwinograd_en.yaml'
2025-08-31T08:28:57,863   adding 'lm_eval/tasks/xwinograd/xwinograd_fr.yaml'
2025-08-31T08:28:57,865   adding 'lm_eval/tasks/xwinograd/xwinograd_jp.yaml'
2025-08-31T08:28:57,866   adding 'lm_eval/tasks/xwinograd/xwinograd_pt.yaml'
2025-08-31T08:28:57,867   adding 'lm_eval/tasks/xwinograd/xwinograd_ru.yaml'
2025-08-31T08:28:57,868   adding 'lm_eval/tasks/xwinograd/xwinograd_zh.yaml'
2025-08-31T08:28:57,871   adding 'lm_eval-0.4.9.1.dist-info/licenses/LICENSE.md'
2025-08-31T08:28:57,877   adding 'lm_eval-0.4.9.1.dist-info/METADATA'
2025-08-31T08:28:57,878   adding 'lm_eval-0.4.9.1.dist-info/WHEEL'
2025-08-31T08:28:57,879   adding 'lm_eval-0.4.9.1.dist-info/entry_points.txt'
2025-08-31T08:28:57,880   adding 'lm_eval-0.4.9.1.dist-info/top_level.txt'
2025-08-31T08:28:58,095   adding 'lm_eval-0.4.9.1.dist-info/RECORD'
2025-08-31T08:28:58,316   removing build/bdist.linux-armv7l/wheel
2025-08-31T08:29:01,998   Building wheel for lm-eval (pyproject.toml): finished with status 'done'
2025-08-31T08:29:02,173   Created wheel for lm-eval: filename=lm_eval-0.4.9.1-py3-none-any.whl size=7531943 sha256=97ecff896cf8c8a3461730701532cb297638f594631d30e0a0e64bedacc771ce
2025-08-31T08:29:02,174   Stored in directory: /tmp/pip-ephem-wheel-cache-_p3hm_rz/wheels/85/03/3f/e2b69841dee11954813180fdc72b9c1af21e98828ce61ef8c0
2025-08-31T08:29:02,568 Successfully built lm-eval
2025-08-31T08:29:02,757 Removed build tracker: '/tmp/pip-build-tracker-7y_9rtrp'